ISACA Certified Artificial Intelligence Auditor (CAIA) — Question 40

An IS auditor is reviewing change documentation of an AI model. Which of the following would pose the GREATEST risk?

Answer options

• A. Management has not tested the model.
• B. Test results are not in a standardized format.
• C. There is a low number of test scenarios.
• D. The seed used for testing is not documented.

Correct answer: C

Explanation

The correct answer, C, highlights that a low number of test scenarios may not adequately assess the model's performance across various conditions, leading to undetected issues. While A, B, and D are significant concerns, they do not present as immediate a risk to the model's reliability and robustness as the lack of comprehensive testing scenarios does.