Google Cloud Professional Data Engineer — Question 33
The marketing team at your organization provides regular updates of a segment of your customer dataset. The marketing team has given you a CSV with 1 million records that must be updated in BigQuery. When you use the UPDATE statement in BigQuery, you receive a quotaExceeded error. What should you do?
Answer options
- A. Reduce the number of records updated each day to stay within the BigQuery UPDATE DML statement limit.
- B. Increase the BigQuery UPDATE DML statement limit in the Quota management section of the Google Cloud Platform Console.
- C. Split the source CSV file into smaller CSV files in Cloud Storage to reduce the number of BigQuery UPDATE DML statements per BigQuery job.
- D. Import the new records from the CSV file into a new BigQuery table. Create a BigQuery job that merges the new records with the existing records and writes the results to a new BigQuery table.
Correct answer: D
Explanation
The correct answer is D because importing new records into a new table and merging them allows you to bypass the limitations of the UPDATE statement. Options A, B, and C do not address the quotaExceeded error effectively, as they either reduce updates or attempt to modify quota limits rather than utilizing a different strategy to manage the data update.