ISACA Certified Artificial Intelligence Auditor (CAIA) — Question 19

A logistics company uses an AI model to optimize delivery routes. Which of the following methods would BEST verify the model’s accuracy?

Answer options

• A. Using advanced outlier detection techniques to identify anomalies in route length
• B. Running bias tests to confirm that the model does not favor certain delivery areas
• C. Comparing the AI-generated routes with routes generated using traditional methods
• D. Testing the model on the most recent data for the latest conditions

Correct answer: C

Explanation

The correct answer is C because comparing AI-generated routes with those from traditional methods provides a direct assessment of the AI model's effectiveness. While outlier detection (A), bias tests (B), and testing on recent data (D) are valuable, they do not directly measure the model's performance against established benchmarks like traditional routing methods do.