AWS Certified Data Engineer – Associate (DEA-C01) — Question 20
A company maintains multiple extract, transform, and load (ETL) workflows that ingest data from the company's operational databases into an Amazon S3 based data lake. The ETL workflows use AWS Glue and Amazon EMR to process data.
The company wants to improve the existing architecture to provide automated orchestration and to require minimal manual effort.
Which solution will meet these requirements with the LEAST operational overhead?
Answer options
- A. AWS Glue workflows
- B. AWS Step Functions tasks
- C. AWS Lambda functions
- D. Amazon Managed Workflows for Apache Airflow (Amazon MWAA) workflows
Correct answer: B
Explanation
AWS Step Functions tasks allow for the automation and orchestration of workflows with minimal operational overhead, making them ideal for this scenario. In contrast, AWS Glue workflows, AWS Lambda functions, and Amazon MWAA workflows may require more manual intervention or management, leading to higher operational complexity.