Databricks Certified Machine Learning Professional — Question 38

A machine learning engineer is in the process of implementing a concept drift monitoring solution. They are planning to use the following steps:
1. Deploy a model to production and compute predicted values
2. Obtain the observed (actual) label values
3. _____
4. Run a statistical test to determine if there are changes over time
Which of the following should be completed as Step #3?

Answer options

• A. Obtain the observed values (actual) feature values
• B. Measure the latency of the prediction time
• C. Retrain the model
• D. None of these should be completed as Step #3
• E. Compute the evaluation metric using the observed and predicted values

Correct answer: E

Explanation

The correct answer is E because calculating the evaluation metric is essential to assess the model's performance based on the predicted and actual values before analyzing for concept drift. Options A and B do not contribute to the monitoring of concept drift directly, while C, although important, is not a direct step in this specific monitoring process at this stage.