AAIA Practice Test

Review 556 AAIA practice questions with answer explanations and community insights.

Question 1

Which of the following key performance indicators (KPIs) are MOST important when evaluating whether an AI model meets business objectives?

  1. Cost of resources required for AI model training
  2. AI model accuracy in predicting actual outcomes
  3. Frequency of AI model retraining
  4. Number of users interacting with the AI model

Question 2

The BEST way to prevent sensitive information disclosure by large language model (LLM) chatbots is through:

  1. manual monitoring.
  2. data sanitization.
  3. data masking.
  4. access controls.

Question 3

An organization is using information gathered from customer accounts to train its AI chatbot. Which of the following is the GREATEST risk associated with this practice?

  1. Transparency
  2. AI model hallucinations
  3. AI bias
  4. Disclosure of personal information

Question 4

An IS auditor is evaluating an organization’s incident management program to ensure it is sufficiently prepared to manage AI-related incidents. Which of the following is MOST important for the auditor to validate?

  1. The program includes processes to respond to AI model drift and data integrity attacks.
  2. The program prioritizes incidents based on alignment with industry leading practices.
  3. The program uses past AI-related incidents and resolutions to categorize current incidents.
  4. The program mandates retraining AI systems after incidents are investigated.

Question 5

Which of the following is MOST important for an IS auditor to consider when identifying AI risk in a know your customer (KYC) application within a banking organization?

  1. Business disruption and financial impact
  2. Intellectual property leakage and invalidation
  3. Benchmarking against peer organizations
  4. Incident response plan