an API receives sensor data. Data is written to a queue before being processed to produce trend analysis. Need to ensure data is received and process only once. Solution to modify architecture and avoid duplicates?

Question

I took a practice test and this question got me. The possible answers were:

o SNS

o SQS FIFO

o Kinesis Data Streams

o Kinesis Firehose

I assume since it is sensor data one of Kinesis answers is correct. However I could not find online which one processes data only once? Or may be FIFO is a valid option.

Please help

Marc Stpierre Answered 4 weeks ago · Answer 1 · 2022-01-03 05:41:17

Marc Stpierre

Answered 4 weeks ago

I feel the most correct answer is SQS FIFO. Some of the key points of the question (Queue, No-Duplicates, Process Only Once) match up really well with the description of SQS FIFO https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/FIFO-queues.html

an API receives sensor data. Data is written to a queue before being processed to produce trend analysis. Need to ensure data is received and process only once. Solution to modify architecture and avoid duplicates?

1 Answers

Newsletter