AWS Certified Machine Learning – Specialty — Question 19

Which of the following metrics should a Machine Learning Specialist generally use to compare/evaluate machine learning classification models against each other?

Answer options

• A. Recall
• B. Misclassification rate
• C. Mean absolute percentage error (MAPE)
• D. Area Under the ROC Curve (AUC)

Correct answer: D

Explanation

The Area Under the ROC Curve (AUC) is a widely accepted metric for evaluating the performance of classification models, as it summarizes the trade-off between true positive rate and false positive rate across different thresholds. While Recall and Misclassification rate are useful, they do not provide a comprehensive view of model performance across various classification thresholds. Mean absolute percentage error (MAPE) is primarily used for regression tasks, making it inappropriate for comparing classification models.