Articles Questions

Updated September 29, 2022

What's the Minimum Number of Users for a Usability Test?

Dr. Oliver Eidel

Question

We’re planning our usability testing, i.e. our IEC 62366 - compliant Summative Usability Evaluation. Is there any sort of minimum number of users we need to include?

Short Answer

Five.

Long Answer

If you’ve read some standards by now, you can safely assume that they would never state something like this explicitly. There’s a somewhat unwritten rule that the minimum count of users for a usability test is five, based on research by Jakob Nielsen at Sun Microsystems. So that should be your starting point.

But don’t take this too literally and just include five users. If you have the opportunity to acquire more, say 10 or 15, that’s great!

Of course, this heavily depends on how easy you can acquire test users. If your software is geared towards radiologists, it may be difficult and expensive to find any who are available. If it’s however a consumer-facing app, it becomes easy. You could literally ask a bunch of friends.

By the way, Nielsen intention wasn’t to stop usability tests after including five users. Instead, he suggests doing multiple tests (see wikipedia, quote below). The question is whether you have (time) resources to conduct multiple usability test prior to your first certification. Maybe consider doing more after your initial product is certified and you have more money.

It is worth noting that Nielsen does not advocate stopping after a single test with five users; his point is that testing with five users, fixing the problems they uncover, and then testing the revised site with five different users is a better use of limited resources than running a single usability test with 10 users. In practice, the tests are run once or twice per week during the entire development cycle, using three to five test subjects per round, and with the results delivered within 24 hours to the designers. The number of users actually tested over the course of the project can thus easily reach 50 to 100 people. Research shows that user testing conducted by organisations most commonly involves the recruitment of 5-10 participants

On a slighty different note: You want to get your medical software certified under MDR but don't know where to start? No worries! That's why we built the Wizard. It's a self-guided software which helps you create your documentation yourself, for only 149€ / month. No prior knowledge required. You should check it out.

Or, if you're looking for some human help, did you know that we also provide consulting, often guiding startups from start to finish in their medical device compliance?

And there's so much more: If you're looking for the best QMS software ever, look no further. We've built Formwork, and it's free!

Congratulations! You read this far.

Get notified when we post something new.

Sign up for our free newsletter.

Dr. Oliver Eidel

I'm a medical doctor, software engineer and regulatory dude. I've helped 50+ companies with their medical device compliance. I mainly work as a regulatory consultant, but my goal is to make consulting unnecessary by publishing all of our articles and templates for free :)

If you're still lost and have further questions, just send me an email. Read more about me here.

Digital Health Jobs No Cookie For You Privacy Policy Imprint
No QMS on this planet will save you from creating crappy software.