CT-UT Exam Dumps - ISTQB Usability Testing Questions and Answers

Usability test reports are more effective when they are balanced and include not only problems but also what worked well. Including positive findings increases credibility, encourages the development team, and helps them understand what should remain unchanged. Option B violates privacy and ethical standards. Option C may dilute focus, and D could worsen the problem by making the report less accessible. Thus, the best practice supported by usability.gov and Nielsen Norman Group is to include both positive and negative findings.

A usability test session is a controlled period during which a test participant performs tasks using the system under test while being observed by a moderator and sometimes additional stakeholders or observers. The goal is to understand how users interact with the interface and identify usability problems. Option A describes an individual task, not the whole session. Option C refers to a test plan or test script, and Option D describes a test technique rather than a usability session. Thus, option B provides the most accurate and comprehensive definition.

Moderating the usability test is a core activity during the actual usability test session. The moderator guides participants through tasks, ensures the session stays on track, and avoids introducing bias. Option A (testing the setup) happens before the session, during preparation. Option C (extracting findings) occurs during analysis, after the test. Option D (talking during task execution) should be minimized unless necessary, to avoid influencing user behavior. Therefore, option B is the only correct answer aligned with best practices in usability testing.

The Equality Act 2010 (UK) is legislation designed to protect individuals from discrimination in various areas, including employment and access to goods and services—this includes digital products like websites. While it does not directly mandate WCAG compliance levels (A or AA), it implies that digital services must be accessible to users with disabilities. Organizations are required to make "reasonable adjustments" to avoid discrimination. Therefore, the most accurate and comprehensive answer is B.

Usability labs provide a controlled environment that offers several advantages for observing and recording usability test sessions. Specifically, they allow for easy observation of participants (ii), standardized conditions for each session (iv), and facilitate audio and video recording for detailed analysis (v). However, the context is not natural (i), because the lab is an artificial setting rather than the user’s actual environment. Also, setting up a professional usability lab is not inexpensive (iii); it typically involves significant costs for equipment, space, and staffing. Therefore, options ii, iv, and v are true, while i and iii are false.

The primary goal of usability testing is to observe and record user behavior while interacting with the system. A location where user actions cannot be seen or recorded (option A) completely undermines the test's purpose and is therefore not suitable.

While options B, C, and D are not ideal in all cases, they can still be valid settings depending on the context. Testing in a user’s natural environment (B) increases ecological validity. Remote testing via video link (C) is widely accepted. Testing in a public setting (D) can be useful for mobile apps or services intended for real-world use.

A usability test script is a structured document used by the moderator to ensure consistency across test sessions. It typically includes pre-session briefing text, pre- and post-session interview questions, and the specific usability tasks to be performed. However, it does not include answers to the test questions, as usability tests focus on observing user behavior and performance—not testing users’ knowledge. Providing answers would bias results and invalidate findings. Thus, option D is incorrect and the best choice.

A pilot usability test session is a critical step prior to conducting the actual usability test. Its purpose is to ensure that the test setup, task design, and moderator instructions are clear and function as expected. According to ISO 9241-210 and the Nielsen Norman Group's best practices, pilot testing helps detect unforeseen issues and fine-tune the process. Options A and B are incorrect because testing conditions must reflect realistic scenarios, and thorough preparation is essential to gather meaningful usability data. Option D is also incorrect; a usability test typically consists of multiple sessions with different users to gather sufficient data for analysis. The pilot session ensures everything works smoothly before involving real participants.

The described issue violates the usability heuristic “User control and freedom,” as defined by Jakob Nielsen. This principle emphasizes that users should have the ability to undo and redo actions and navigate freely without being trapped in irreversible sequences. In the scenario, users are forced into the checkout process without a clear way to return or correct mistakes, except through the unreliable and disruptive back button. This design flaw undermines user autonomy and can result in lost progress or frustration.

Common mistakes in usability testing include:

Ignoring critical results (ii): A significant issue if findings are not acted upon.

Scheduling the test too late (iv): This can lead to usability problems being discovered too late to be addressed effectively.

Having the wrong focus (v): For instance, focusing on aesthetics instead of usability goals.

Option i ("user is too active") is not a problem—active participation is necessary. Option iii ("no observers involved") is not a typical mistake, since tests can still be valid even with recorded sessions and later review. Hence, the correct answer is A: ii, iv & v are true.