S3 Quiz
An application allows a manufacturing site to upload files. Each uploaded 3 GB file is processed to extract metadata, and this process takes a few seconds per file. The frequency at which the uploads happen is unpredictable. For instance, there may be no updates for hours, followed by several files being uploaded concurrently.
What architecture addresses this workload in the most cost efficient manner?
A.
Use a Kinesis Data Delivery Stream to store the file. Use Lambda for processing.
B.
Use an SQS queue to store the file, to be accessed by a fleet of EC2Instances.
C.
Store the file in an EBS volume, which can then be accessed by another EC2 Instancefor processing.
D.
Store the file in an S3 bucket. Use Amazon S3 event notification to invoke aLambda function for file processing.
D. Store the file in an S3 bucket. Use Amazon S3 event notification to invoke aLambda function for file processing.
You can first create a Lambda function with the code to process the file.
You can then use an Event Notification from the S3 bucket to invoke the Lambda function whenever a file is uploaded.
For more information on Amazon S3 event notification, please visit the following URL:
https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html
Option A is incorrect. Kinesis is used to collect, process and analyze real time data.
The frequency of updates are quite unpredictable. By default SQS uses short polling. In this case, it will lead to the cost factor going up since we are getting messages in an unpredictable manner and many a times it will be returning empty responses. Hence option B is not a solution.
