ISACA Certified AI Security Manager — Question 26

An organization plans to apply an AI system to its business, but developers find it difficult to predict system results due to lack of visibility to the inner workings of the AI model. Which of the following is the GREATEST challenge associated with this situation?

Answer options

• A. Assigning a risk owner who is responsible for system uptime and performance
• B. Continuing operations to meet expected AI security requirements
• C. Determining average turnaround time for AI transaction completion
• D. Gaining the trust of end users through explainability and transparency

Correct answer: D

Explanation

The correct answer is D because gaining user trust hinges on the ability to explain how AI decisions are made. Without this transparency, stakeholders may be hesitant to adopt the system. The other options, while important, do not directly address the core issue of trust and understanding surrounding AI model outputs.