AWS Certified Machine Learning – Specialty — Question 368

A data scientist is building a new model for an ecommerce company. The model will predict how many minutes it will take to deliver a package.

During model training, the data scientist needs to evaluate model performance.

Which metrics should the data scientist use to meet this requirement? (Choose two.)

Answer options

• A. InferenceLatency
• B. Mean squared error (MSE)
• C. Root mean squared error (RMSE)
• D. Precision
• E. Accuracy

Correct answer: B, C

Explanation

Predicting package delivery time in minutes is a regression problem because the target variable is continuous. Mean squared error (MSE) and Root mean squared error (RMSE) are standard evaluation metrics used to measure the error of regression models. In contrast, Precision and Accuracy are designed for classification tasks, and InferenceLatency is an operational performance metric rather than a model quality metric.