AAIA Exam Dumps - Isaca Advanced in AI Audit Questions and Answers

Linear regression is a " transparent " or " white-box " model. Its primary benefit in an audit context is its interpretability; each coefficient directly indicates the influence of an input variable on the output. This allows auditors to easily verify the logic and ensure that no inappropriate or discriminatory variables are driving the results. While linear models are less prone to complex overfitting than deep learning, they are not immune to it. Their simplicity often results in lower predictive accuracy for complex data, but for auditability and compliance, the ability to explain the " why " behind a prediction is paramount.

False positives in fraud detection AI systems often stem from poorly optimized hyperparameters. Hyperparameters control aspects of the model’s learning process such as the learning rate, decision thresholds, and complexity penalties. When these parameters are not tuned correctly, the model can become overly sensitive and flag normal behavior as suspicious, leading to customer complaints.

“Hyperparameter tuning is essential to balance sensitivity and specificity in AI models. Improper tuning can result in a high rate of false positives or negatives, particularly in systems like fraud detection that require nuanced pattern recognition.”

Options A and B relate to data governance but do not directly cause false positives in predictions. Option C (compute scale training) may affect model efficiency, not accuracy. Thus, D is the most appropriate answer.

Cross-validation testing is a statistical method used to assess how well a model generalizes to an independent data set. The AAIA™ Study Guide recommends this method as a best practice to fine-tune model accuracy and reduce both false positives and false negatives. It involves splitting the dataset into training and testing subsets multiple times to ensure model robustness.

“Cross-validation allows auditors and developers to identify overfitting and adjust model parameters to achieve better generalization and predictive accuracy, especially in fraud detection contexts.”

Regression testing (A) focuses on changes over time; substantive testing (C) is audit-specific but not model-focused. Benford’s Law (D) applies to numerical distributions but is not designed for optimizing ML models. Hence, B is the best approach.

The most direct and effective control for preventing prompt-based manipulation is to enforce a structured input/output template (option A). AAIA highlights prompt management as a key emerging control area because unstructured prompts can lead to:

Prompt injection

Model manipulation

Circumvention of rules

Unauthorized access to sensitive outputs

Safety violations

Templates constrain user input to predefined formats, reducing opportunities to embed hidden instructions or modify model behavior.

Adversarial training (B) strengthens robustness but does not prevent users from inserting manipulative prompts.

Encryption (C) protects data, not prompt integrity.

Immediate retraining (D) addresses performance, not misuse.

Templates ensure consistent, secure, and auditable prompt structure.

Transparency in AI, especially in regulated sectors like finance, is best achieved by using explainability tools that interpret the internal workings and outputs of complex ML models. The AAIA™ Study Guide highlights model explainability as essential for both auditors and regulators to understand why certain decisions are made.

“Explainability tools allow auditors to trace predictions back to input features, helping verify fairness, logic, and compliance. These tools support transparency and trustworthiness in black-box models.”

While documentation (A) and reporting (C) are part of governance, D directly supports decision-level clarity. Dashboards (B) show results, not rationale.

The AAIA™ Study Guide stresses that inputting confidential or proprietary data into third-party generative AI tools may result in unauthorized data disclosure. These tools may store, process, or retrain on the input data, leading to privacy and intellectual property risks.

“When employees input sensitive data into external AI tools, organizations risk losing control over that information. This may result in regulatory non-compliance, legal exposure, and irreversible data leakage.”

While business disruption (C) and reliance (D) are notable, the most severe and immediate risk is B—unauthorized disclosure. Data contamination (A) impacts model reliability, not data security.

Exploratory Data Analysis (EDA) is critical during the initial stages of AI model development. According to the AAIA™ Study Guide, performing EDA—including identifying null values, incorrect data types, or duplicates—ensures that the data fed into the model is clean and reliable.

“Initial data frames should be subject to thorough EDA to uncover data quality issues. These issues, if not addressed early, can severely affect model training and predictive accuracy.”

While separating data sets (B) and visualizations (A) are important steps in later phases, C is foundational to ensure readiness for model training. Risk assessments (D) are necessary but not the first operational step.

Ordinal encoding assigns numeric values in an order (e.g., Poodle = 1, Labrador = 2, Husky = 3). This falsely implies hierarchy or ranking among breeds, introducing bias into the model.

AAIA emphasizes that incorrect encoding of categorical variables can cause:

Artificially weighted importance

Misleading correlations

Incorrect predictions based on false order For non-ordered categories, one-hot encoding (D) is the correct, low-risk approach. Lack of scaling (A) is not directly relevant for categorical fields. Clustering (B) is unrelated. Thus, ordinal encoding introduces the highest risk.

If AI-generated audit reports contain false conclusions , the integrity of audit evidence and overall assurance is compromised. According to AAIA, when AI systems compromise accuracy of audit outputs , the immediate step should be to suspend use (B) to prevent further incorrect or misleading reporting.

This allows auditors to:

Investigate the root cause of incorrect conclusions

Validate the model’s training data, rules, and prompt structures

Reassess controls, safeguards, and human review processes

Prevent reliance on unreliable AI-generated audit material

Increasing context (A) or reducing creativity (C) may help generative models but do not guarantee correction of fundamental errors. Updating SLAs (D) is administrative and does not solve the immediate integrity issue.

When generative AI produces generic or " vague " summaries, it is often because it lacks the specific context of the meeting. " Prompt engineering and contextual anchoring " involve providing the AI with clear instructions (e.g., " focus on control exceptions " ) and anchoring the request in specific data (e.g., " refer only to the attached meeting transcript " ). According to ISACA, this technique directs the model ' s attention and reduces the likelihood of hallucinations or omissions. Increasing " temperature " (Option A) would actually make the model more random and less reliable. Anchoring ensures the AI stays grounded in the actual facts of the audit walkthrough.