CT-AI Exam Dumps - ISTQB AI Testing Questions and Answers

The ISTQB CT-AI syllabus (Section4.3 – Test Environments for AI Systems) describes that, unlike conventional software testing, testing AI systems may requirespecialized toolsfor analyzing and explaining the decisions of ML models. This includes visualization tools, explainability frameworks, and diagnostic utilities to understand why the AI made a certain prediction. Since AI decisions may be non-transparent, the test environment must supportexplainability, making OptionBcorrect.

Option A is incorrect: the syllabus does not state that an autonomous AI system requires an autonomous test environment. Option C is incorrect because test environments mustnot learn; they must remain stable to avoid unpredictable testing conditions. Option D is incorrect because multi-agent systems often involve stochastic interactions, and determinism is neither required nor realistic.

Thus,Option Bis the syllabus-accurate choice.

The ISTQB CT-AI syllabus indicates inSection 5.2 – AI for Testingthat AI-generated test cases may not come withpredefined expected results. This is because test-case generation methods—such as evolutionary algorithms, reinforcement learning, or clustering-based sampling—produceinputs, but the tester must still determine the correct outputs. Therefore, OptionCis correct: expected results may not be available, especially when AI produces novel or previously unseen input combinations.

Option A is incorrect: AI-based test generation can improve coverage by exploring large input spaces. Option B is incorrect because the need for oracles does not depend on whether the test case is AI-generated. Option D is incorrect because the syllabus allows using a model as an oracle inback-to-back testing, provided limitations are understood.

Therefore,Option Cis the correct syllabus-aligned statement.

The ISTQB CT-AI syllabus explains that AI-based decision-support systems benefit strongly fromback-to-back testingandmetamorphic testingwhen oracle problems exist or when limited regression tests are available. In this scenario, CleverPropose replaces an older advisory system.Back-to-back testing(Option A) is ideal because the outputs of the existing conventional system can serve as areference, enabling comparison against the new AI system. This is exactly what the syllabus recommends when AI is replacing a traditional deterministic system.

Metamorphic testing(Option C) is also appropriate, as stated in Section4.6 – Metamorphic Relations. With limited regression tests and complex decision logic, testers can define metamorphic relations such as “if customer income increases, risk rating should not worsen.” These relations allow validation even when exact expected outputs are unavailable.

Exploratory data analysis (Option D) is not a system testing technique. Pairwise testing (Option E) is not well suited for complex AI-based financial advice systems. Adversarial testing (Option B) is more relevant for security-critical or robustness evaluation, not primary system testing for advisory tools.

Thus,A and Care the correct and syllabus-supported choices.

A. 64-bit CPUs.

While 64-bit CPUs are essential for handling large amounts of memory and performing complex computations, they are not specifically optimized for the types of operations commonly used in machine learning.

B. Hardware supporting fast matrix multiplication.

Matrix multiplication is a fundamental operation in many machine learning algorithms, especially in neural networks and deep learning. Hardware optimized for fast matrix multiplication, such as GPUs (Graphics Processing Units), is most suitable for implementing AI and ML because it can handle the parallel processing required for these operations efficiently.

C. High powered CPUs.

High powered CPUs are beneficial for general-purpose computing tasks and some aspects of ML, but they are not as efficient as specialized hardware like GPUs for matrix multiplication and other ML-specific tasks.

D. Hardware supporting high precision floating point operations.

High precision floating point operations are important for scientific computing and some specific AI tasks, but for many ML applications, fast matrix multiplication is more critical than high precision alone.

Therefore, the correct answer isBbecause hardware supporting fast matrix multiplication, such as GPUs, is most suitable for the parallel processing requirements of machine learning​​.

AI test environments have several unique characteristics that differentiate them from traditional test environments. Let’s evaluate each option:

A. Challenges resulting from low accuracy of the models.

Low accuracy is a common challenge in AI systems, especially during initial development and training phases. Ensuring the model performs accurately in varied and unpredictable scenarios is a critical aspect of AI testing.

B. The challenge of mimicking undefined scenarios generated due to self-learning.

AI systems, particularly those that involve machine learning, can generate undefined or unexpected scenarios due to their self-learning capabilities. Mimicking and testing these scenarios is a unique challenge in AI environments.

C. The challenge of providing explainability to the decisions made by the system.

Explainability, or the ability to understand and articulate how an AI system arrives at its decisions, is a significant and unique challenge in AI testing. This is crucial for trust and transparency in AI systems.

D. Challenges in the creation of scenarios of human handover for autonomous systems.

While important, the creation of scenarios for human handover in autonomous systems is not a characteristic unique to AI test environments. It is more related to the operational and deployment challenges of autonomous systems rather than the intrinsic technology-related characteristics of AI.

Given the above points, optionDis the correct answer because it describes a challenge related to operational deployment rather than a technology-related characteristic unique to AI test environments.

The syllabus defines precision as:

"Precision = TP / (TP + FP) * 100%. Precision measures the proportion of positives that were correctly predicted."

Using the confusion matrix:

TP = 90

FP = 10Thus: Precision = (90 / (90 + 10)) * 100% = 90 / 100 * 100% = 90%However, the confusion matrix totals suggest that the calculation should be done in the form:Precision = 90 / (90 + 10) * 100% = 90%Since the given answers do not include exactly 90%, the closest approximation and the correct answer, as described in the syllabus, would be 90%.(Reference: ISTQB CT-AI Syllabus v1.0, Section 5.1, page 40 of 99)