Google Cloud Professional Machine Learning Engineer — Question 183
You have created a Vertex AI pipeline that includes two steps. The first step preprocesses 10 TB data completes in about 1 hour, and saves the result in a Cloud Storage bucket. The second step uses the processed data to train a model. You need to update the model’s code to allow you to test different algorithms. You want to reduce pipeline execution time and cost while also minimizing pipeline changes. What should you do?
Answer options
- A. Add a pipeline parameter and an additional pipeline step. Depending on the parameter value, the pipeline step conducts or skips data preprocessing, and starts model training.
- B. Create another pipeline without the preprocessing step, and hardcode the preprocessed Cloud Storage file location for model training.
- C. Configure a machine with more CPU and RAM from the compute-optimized machine family for the data preprocessing step.
- D. Enable caching for the pipeline job, and disable caching for the model training step.
Correct answer: D
Explanation
Enabling caching for the pipeline job allows previously computed results to be reused, significantly reducing execution time and cost for repeated runs, especially in the data preprocessing step. The other options either introduce unnecessary complexity, do not leverage efficient resource utilization, or do not align with the goal of minimizing changes to the pipeline.