Google Cloud Professional Data Engineer — Question 78

You work for a manufacturing plant that batches application log files together into a single log file once a day at 2:00 AM. You have written a Google Cloud
Dataflow job to process that log file. You need to make sure the log file in processed once per day as inexpensively as possible. What should you do?

Answer options

• A. Change the processing job to use Google Cloud Dataproc instead.
• B. Manually start the Cloud Dataflow job each morning when you get into the office.
• C. Create a cron job with Google App Engine Cron Service to run the Cloud Dataflow job.
• D. Configure the Cloud Dataflow job as a streaming job so that it processes the log data immediately.

Correct answer: C

Explanation

The correct answer is C because using Google App Engine Cron Service allows you to automate the execution of the Cloud Dataflow job at 2:00 AM daily, ensuring efficiency and cost-effectiveness. Option A is incorrect as Dataproc may not be more cost-effective for this specific use case. Option B relies on manual intervention, which is not optimal for automation. Option D would not be suitable since the logs are batched and processed daily, not in real-time.