AWS Certified AI Practitioner (AIF-C01) — Question 223

A financial company has deployed an ML model to predict customer churn. The model has been running in production for 1 week. The company wants to evaluate how accurately the model predicts churn compared to actual customer behavior.

Which metric meets these requirements?

Answer options

• A. Root mean squared error (RMSE)
• B. Return on investment (ROI)
• C. F1 score
• D. Bilingual Evaluation Understudy (BLEU) score

Correct answer: C

Explanation

The F1 score is appropriate for evaluating the accuracy of predictions in classification tasks, such as customer churn, as it considers both precision and recall. RMSE is used for regression tasks, while ROI measures financial return and BLEU score is used for evaluating machine translation quality, making them unsuitable for this scenario.