Google Cloud Professional Data Engineer — Question 294
You used Dataprep to create a recipe on a sample of data in a BigQuery table. You want to reuse this recipe on a daily upload of data with the same schema, after the load job with variable execution time completes. What should you do?
Answer options
- A. Create a cron schedule in Dataprep.
- B. Create an App Engine cron job to schedule the execution of the Dataprep job.
- C. Export the recipe as a Dataprep template, and create a job in Cloud Scheduler.
- D. Export the Dataprep job as a Dataflow template, and incorporate it into a Composer job.
Correct answer: D
Explanation
The correct answer is D because exporting the Dataprep job as a Dataflow template allows for integration into a Composer job, enabling automation after the variable-length load job. Options A and B do not provide a means to link the Dataprep job's execution directly to the completion of the load job, while option C does not leverage Composer's orchestration capabilities for dynamic scheduling.