Google Cloud Professional Data Engineer — Question 283

You have uploaded 5 years of log data to Cloud Storage. A user reported that some data points in the log data are outside of their expected ranges, which indicates errors. You need to address this issue and be able to run the process again in the future while keeping the original data for compliance reasons. What should you do?

Answer options

• A. Import the data from Cloud Storage into BigQuery. Create a new BigQuery table, and skip the rows with errors.
• B. Create a Compute Engine instance and create a new copy of the data in Cloud Storage. Skip the rows with errors.
• C. Create a Dataflow workflow that reads the data from Cloud Storage, checks for values outside the expected range, sets the value to an appropriate default, and writes the updated records to a new dataset in Cloud Storage.
• D. Create a Dataflow workflow that reads the data from Cloud Storage, checks for values outside the expected range, sets the value to an appropriate default, and writes the updated records to the same dataset in Cloud Storage.

Correct answer: C

Explanation

The correct answer is C because it allows for the log data to be processed and corrected without altering the original dataset, thus maintaining compliance. Options A and B do not address the need for compliance with original data retention, and option D would overwrite the original dataset, which is not acceptable for compliance purposes.