AWS Certified Data Engineer – Associate (DEA-C01) — Question 232
A company needs to use Amazon Athena to analyze data that is in an Amazon S3 bucket. A data engineer needs to configure AWS Glue table partitions for year, month, and day. The data engineer needs to create the partitions every day to adjust to schema changes in the data.
Which solution will meet these requirements?
Answer options
- A. Use AWS Glue DataBrew to create the partitions for the AWS Glue table.
- B. Use an AWS Lambda function to create the partitions for the AWS Glue table.
- C. Set partition projection properties for the AWS Glue table.
- D. Configure an AWS Glue crawler to run on a set schedule.
Correct answer: C
Explanation
The correct answer is C because setting partition projection properties allows AWS Glue to automatically manage partitions based on specified keys, which is ideal for regularly changing data. Option A is incorrect as AWS Glue DataBrew is primarily for data preparation, not for creating partitions. Option B is not the best solution since a Lambda function would require additional management and may not efficiently handle daily changes. Option D, while useful for discovering new partitions, does not specifically address the need to adjust for schema changes daily.