AWS Certified Data Engineer – Associate (DEA-C01) — Question 87

A company has a business intelligence platform on AWS. The company uses an AWS Storage Gateway Amazon S3 File Gateway to transfer files from the company's on-premises environment to an Amazon S3 bucket.

A data engineer needs to setup a process that will automatically launch an AWS Glue workflow to run a series of AWS Glue jobs when each file transfer finishes successfully.

Which solution will meet these requirements with the LEAST operational overhead?

Answer options

• A. Determine when the file transfers usually finish based on previous successful file transfers. Set up an Amazon EventBridge scheduled event to initiate the AWS Glue jobs at that time of day.
• B. Set up an Amazon EventBridge event that initiates the AWS Glue workflow after every successful S3 File Gateway file transfer event.
• C. Set up an on-demand AWS Glue workflow so that the data engineer can start the AWS Glue workflow when each file transfer is complete.
• D. Set up an AWS Lambda function that will invoke the AWS Glue Workflow. Set up an event for the creation of an S3 object as a trigger for the Lambda function.

Correct answer: B

Explanation

Option B is correct because it directly sets up an Amazon EventBridge event that responds to each successful file transfer, ensuring the AWS Glue workflow is initiated automatically with minimal manual intervention. Option A relies on scheduled events, which may not align perfectly with transfer completion times, leading to inefficiencies. Option C requires manual initiation by the data engineer, increasing operational overhead. Option D adds complexity by introducing a Lambda function, which is unnecessary when EventBridge can handle the triggering directly.