AWS Certified Data Engineer – Associate (DEA-C01) — Question 170

A data engineer needs to build an enterprise data catalog based on the company's Amazon S3 buckets and Amazon RDS databases. The data catalog must include storage format metadata for the data in the catalog.

Which solution will meet these requirements with the LEAST effort?

Answer options

• A. Use an AWS Glue crawler to scan the S3 buckets and RDS databases and build a data catalog. Use data stewards to inspect the data and update the data catalog with the data format.
• B. Use an AWS Glue crawler to build a data catalog. Use AWS Glue crawler classifiers to recognize the format of data and store the format in the catalog.
• C. Use Amazon Macie to build a data catalog and to identify sensitive data elements. Collect the data format information from Macie.
• D. Use scripts to scan data elements and to assign data classifications based on the format of the data.

Correct answer: B

Explanation

Option B is correct because using an AWS Glue crawler along with classifiers is the most efficient way to automatically gather and store storage format metadata with minimal manual intervention. Option A requires additional effort from data stewards to inspect and update the catalog, while options C and D do not directly address the requirement for automatic cataloging of storage formats.