Google Cloud Professional Data Engineer — Question 322
You are building a new data pipeline to share data between two different types of applications: jobs generators and job runners. Your solution must scale to accommodate increases in usage and must accommodate the addition of new applications without negatively affecting the performance of existing ones. What should you do?
Answer options
- A. Create an API using App Engine to receive and send messages to the applications
- B. Use a Cloud Pub/Sub topic to publish jobs, and use subscriptions to execute them
- C. Create a table on Cloud SQL, and insert and delete rows with the job information
- D. Create a table on Cloud Spanner, and insert and delete rows with the job information
Correct answer: B
Explanation
The correct answer is B because Cloud Pub/Sub is designed for high-throughput, asynchronous messaging, allowing jobs to be published and processed independently, which supports scalability and performance. Options A, C, and D do not provide the same level of scalability and could lead to performance issues as the number of applications increases.