AWS Certified Machine Learning Engineer – Associate (MLA-C01) — Question 45

A credit card company has a fraud detection model in production on an Amazon SageMaker endpoint. The company develops a new version of the model. The company needs to assess the new model's performance by using live data and without affecting production end users.
Which solution will meet these requirements?

Answer options

• A. Set up SageMaker Debugger and create a custom rule.
• B. Set up blue/green deployments with all-at-once traffic shifting.
• C. Set up blue/green deployments with canary traffic shifting.
• D. Set up shadow testing with a shadow variant of the new model.

Correct answer: D

Explanation

The correct answer is D because shadow testing allows the new model to run alongside the existing one, processing live data without affecting production users. Options A, B, and C do not adequately isolate the new model's performance from user traffic, which is crucial for accurate assessment.