Google Cloud Professional Data Engineer — Question 161
You are architecting a data transformation solution for BigQuery. Your developers are proficient with SQL and want to use the ELT development technique. In addition, your developers need an intuitive coding environment and the ability to manage SQL as code. You need to identify a solution for your developers to build these pipelines. What should you do?
Answer options
- A. Use Dataform to build, manage, and schedule SQL pipelines.
- B. Use Dataflow jobs to read data from Pub/Sub, transform the data, and load the data to BigQuery.
- C. Use Data Fusion to build and execute ETL pipelines.
- D. Use Cloud Composer to load data and run SQL pipelines by using the BigQuery job operators.
Correct answer: A
Explanation
The correct answer is A because Dataform is specifically designed for building and managing SQL pipelines, aligning perfectly with the developers' requirements for SQL proficiency and an intuitive coding environment. Options B and C involve ETL processes that are less suitable for the specified ELT approach, while D, although useful for scheduling jobs, does not provide the same level of SQL management as Dataform.