ISACA Certified Artificial Intelligence Auditor (CAIA) — Question 38

An IS auditor is assessing an AI-powered chatbot that produces inaccurate or fabricated information for customer queries. Which of the following is the BEST recommendation when the model’s configuration emphasizes creativity over accuracy?

Answer options

• A. Add more randomness through external prompts.
• B. Allow the AI model to self-correct its hallucinated outputs.
• C. Implement stricter prompt templates to constrain the model's outputs.
• D. Adjust the model’s temperature parameter to lower randomness.

Correct answer: D

Explanation

The correct answer is D because lowering the temperature parameter decreases randomness, leading to more accurate and reliable outputs. Option A increases randomness, which would likely exacerbate the issue. Option B is ineffective since allowing self-correction may not resolve the inaccuracies. Option C could help but may not directly address the underlying issue of randomness in the model's outputs.