Pass the ISTQB Usability Testing CT-UT Questions and answers with ValidTests

In usability evaluations, a distinction is made between actual usability problems (where a user struggles to complete a task or is confused by the interface) and suggestions or ideas that users provide based on their preferences or perceived improvements. When a participant offers a new feature idea (such as a quick search box), this is classified as a “good idea” or “feature suggestion,” not necessarily a usability problem. It may inform future design enhancements but does not indicate a failure in usability for existing functionality.

A usability evaluation is specifically designed to assess how real users interact with a software product. It focuses on effectiveness, efficiency, and user satisfaction in completing tasks. This may involve usability testing, expert reviews, or heuristic evaluations. The goal is to identify any usability problems and understand user behavior during real use.

Option A (Accessibility evaluation) targets inclusivity for users with disabilities, not general user interaction. Option B (Usability maturity assessment) evaluates the organization’s usability practices, and Option C (Risk assessment) evaluates potential project or system risks. Only option D directly involves observing and measuring user interaction.

Accessibility refers to designing products so that people with disabilities or limitations (permanent or temporary) can use them effectively. According to the Web Content Accessibility Guidelines (WCAG) and ISO standards, accessibility focuses on ensuring that users with vision, hearing, cognitive, or mobility impairments can access digital interfaces. Option D captures this intent accurately. The other options relate to general usability or responsiveness (e.g., device adaptability or user experience in noisy environments) but do not address the inclusive nature of accessibility as defined by official guidelines.

The Web Content Accessibility Guidelines (WCAG) provide standards to ensure websites are accessible to people with disabilities. They specifically address:

i. Text resizability (SC 1.4.4),

iii. Text alternatives for non-text content (SC 1.1.1),

iv. Keyboard accessibility (SC 2.1.1),

v. Device independence, which includes not relying solely on mouse input.

Visually appealing design (ii) is not an accessibility requirement and is thus not a WCAG focus. The correct answer is D: i, iii, iv & v are true; ii is false.

The use of HTML tables for layout instead of proper semantic HTML and responsive design violates accessibility guidelines, particularly those defined in the Web Content Accessibility Guidelines (WCAG). Such a design makes it difficult or impossible for users relying on screen readers, keyboard navigation, or other assistive technologies to interact effectively with the site. Therefore, this creates a significant accessibility risk, which is distinct from general usability or user experience risks. Accessibility ensures inclusion of users with physical or cognitive impairments, making option B the correct choice.

Usability is defined in ISO 9241-11 as the extent to which a system can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use. Without knowing the context—such as product complexity, user familiarity, device type, or purchasing habits—it is impossible to judge whether five minutes is good or bad. For complex items, five minutes may be reasonable, while for one-click purchases, it may be excessive. Thus, usability cannot be assessed solely based on one metric like time—it must be evaluated within its full usage context.

The Equality Act 2010 (UK) is legislation designed to protect individuals from discrimination in various areas, including employment and access to goods and services—this includes digital products like websites. While it does not directly mandate WCAG compliance levels (A or AA), it implies that digital services must be accessible to users with disabilities. Organizations are required to make "reasonable adjustments" to avoid discrimination. Therefore, the most accurate and comprehensive answer is B.

Conducting user surveys involves a structured approach that ensures data collection is effective, reliable, and meaningful. The process typically starts with writing a survey plan, which defines the objectives, scope, target population, and methodology. Next, interviewing users and stakeholders is important to gather qualitative insights, refine survey questions, and align the survey with business goals and user needs.

Selecting or designing the questionnaire follows, which includes crafting clear, unbiased questions to capture the desired data. After that, deploying the questionnaire to the recruited participants is essential; this can be done via email, online tools, or in-person, depending on the context. Once the data is collected, it must be analyzed to extract meaningful patterns, trends, and insights. Finally, communicating the findings to stakeholders completes the process by informing decision-making.

Other options miss critical steps such as deploying the questionnaire (Option C), or combine steps incorrectly (Options A and D). Importantly, the step of interviewing users and stakeholders prior to deployment ensures the survey is well-informed and targeted, enhancing the quality and relevance of data collected.

The described issue violates the usability heuristic “User control and freedom,” as defined by Jakob Nielsen. This principle emphasizes that users should have the ability to undo and redo actions and navigate freely without being trapped in irreversible sequences. In the scenario, users are forced into the checkout process without a clear way to return or correct mistakes, except through the unreliable and disruptive back button. This design flaw undermines user autonomy and can result in lost progress or frustration.

SUS (System Usability Scale), SUMI (Software Usability Measurement Inventory), and WAMMI (Website Analysis and Measurement Inventory) are all validated, standardized usability questionnaires that support benchmarking. They allow comparison against known usability scores from a wide variety of systems. These instruments provide numeric scores that can be interpreted using benchmark datasets or industry standards. Therefore, all three—i, ii, and iii—are true, making D the correct answer.