AWS Certified Machine Learning Engineer – Associate (MLA-C01) — Question 154

A company is training a new ML model to replace a model that is deployed on an Amazon SageMaker AI real-time endpoint. An ML engineer needs to determine the latency and the accuracy of the new model. The ML engineer must evaluate the new model in a production scenario without affecting the users of the existing model.

Which solution will meet these requirements?

Answer options

• A. Perform a blue/green deployment with linear traffic shifting.
• B. Perform a blue/green deployment with canary traffic shifting.
• C. Perform a rolling deployment with a rolling batch size of 50% of the current fleet.
• D. Perform shadow testing with a traffic sampling percentage of 100%.

Correct answer: D

Explanation

The correct answer is D because shadow testing allows the new model to process live traffic without impacting the user experience of the existing model, enabling accurate latency and accuracy evaluation. Options A and B involve traffic shifting that could affect users, while option C does not provide a way to evaluate the new model without affecting production traffic.