Abstract

CAZANAS, Alex; DE SAN MIGUEL, Andre  and  PARRA, Esther. Estimating Sample Size for Usability Testing. Enfoque UTE [online]. 2017, vol.8, suppl.1, pp.172-185. ISSN 1390-6542.  https://doi.org/10.29019/enfoqueute.v8n1.126.

One strategy used to assure that an interface meets user requirements is to conduct usability testing. When conducting such testing one of the unknowns is sample size. Since extensive testing is costly, minimizing the number of participants can contribute greatly to successful resource management of a project. Even though a significant number of models have been proposed to estimate sample size in usability testing, there is still not consensus on the optimal size. Several studies claim that 3 to 5 users suffice to uncover 80% of problems in a software interface. However, many other studies challenge this assertion. This study analyzed data collected from the user testing of a web application to verify the rule of thumb, commonly known as the “magic number 5”. The outcomes of the analysis showed that the 5-user rule significantly underestimates the required sample size to achieve reasonable levels of problem detection.

Keywords : usability testing; problem discovery; sample size..

        · abstract in Spanish     · text in English     · English ( pdf )