
{"id":5207,"date":"2020-03-27T09:00:00","date_gmt":"2020-03-27T08:00:00","guid":{"rendered":"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/uncategorized\/usability-testing-guide\/"},"modified":"2021-09-06T17:41:26","modified_gmt":"2021-09-06T15:41:26","slug":"usability-testing-guide","status":"publish","type":"post","link":"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/usability-testing-guide\/","title":{"rendered":"Usability Testing: Everything You Need to Know (Methods, Tools, and Examples)"},"content":{"rendered":"<p>As you crack into the world of UX design, there\u2019s one thing you absolutely must understand and learn to practice like a pro: usability testing.<\/p>\n<p>Precisely because it\u2019s such a critical skill to master, it can be a lot to wrap your head around. What is it exactly, and how do you do it? How is it different from user testing? What are some actual methods that you can employ?<\/p>\n<p>In this guide, we\u2019ll give you everything you need to know about usability testing\u2014the what, the why, and the how.<\/p>\n<p>Here\u2019s what we\u2019ll cover:<\/p>\n<ol>\n<li><a href=\"#what-is-usability-testing-and-why-does-it-matter\">What is usability testing and why does it matter?<\/a><\/li>\n<li><a href=\"#usability-testing-vs-user-testing\">Usability testing vs. user testing<\/a><\/li>\n<li><a href=\"#formative-vs-summative-usability-testing\">Formative vs. summative usability testing<\/a><\/li>\n<li><a href=\"#attitudinal-vs-behavioral-research\">Attitudinal vs. behavioral research<\/a><\/li>\n<li><a href=\"#five-essential-usability-testing-methods\">Five essential usability testing methods<\/a>\n<ul>\n<li><a href=\"#performance-testing\">Performance testing<\/a><\/li>\n<li><a href=\"#card-sorting\">Card sorting<\/a><\/li>\n<li><a href=\"#tree-testing\">Tree testing<\/a><\/li>\n<li><a href=\"#5-second-test\">5-second test<\/a><\/li>\n<li><a href=\"#eye-tracking\">Eye tracking<\/a><\/li>\n<\/ul>\n<\/li>\n<li><a href=\"#how-to-learn-more-about-usability-testing\">How to learn more about usability testing<\/a><\/li>\n<\/ol>\n<p>Ready? Let\u2019s dive in.<\/p>\n<h2 id=\"what-is-usability-testing-and-why-does-it-matter\">1. What is usability testing and why does it matter?<\/h2>\n<p>Simply put, <a href=\"https:\/\/www.nngroup.com\/articles\/usability-testing-101\/\" target=\"_blank\" rel=\"noopener\">usability testing<\/a> is the process of discovering ways to improve your product by observing users as they engage with the product itself (or a prototype of the product). It\u2019s a UX research method specifically trained on\u2014you guessed it\u2014the usability of your products. And <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/what-is-usability\/\" target=\"_blank\" rel=\"noopener\">what is usability<\/a>? Usability is a measure of how easily users can accomplish a given task with your product.<\/p>\n<p>Usability testing, when executed well, uncovers pain points in the user journey and highlights barriers to good usability. It will also help you learn about your users\u2019 behaviors and preferences as these relate to your product, and to discover opportunities to design for needs that you may have overlooked.<\/p>\n<p>You can conduct usability testing at any point in the design process when you\u2019ve turned initial ideas into design solutions, but the earlier the better. Test early and test often! You can conduct some kind of usability testing with <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/difference-between-wireframes-prototypes-mockups\/\" target=\"_blank\" rel=\"noopener\">low- and high- fidelity prototypes<\/a> alike\u2014and testing should continue after you\u2019ve got a live, out-in-the-world product.<\/p>\n<h2 id=\"usability-testing-vs-user-testing\">2. Usability testing vs. user testing<\/h2>\n<p>Though they sound similar and share a somewhat similar end goal, usability testing and user testing are two different things. We\u2019ll look at the differences in a moment, but first, here\u2019s what they have in common:<\/p>\n<ul>\n<li>Both share the end goal of creating a design solution to meet real user needs<\/li>\n<li>Both take the time to observe and listen to the user to hear from them what needs\/pain points they experience<\/li>\n<li>Both look for feasible ways of meeting those needs or addressing those pain points<\/li>\n<\/ul>\n<p>User testing essentially asks if this particular kind of user would want this particular kind of product\u2014or what kind of product would benefit them in the first place. It is entirely user-focused.<\/p>\n<p>Usability testing, on the other hand, is more product-focused and looks at users\u2019 needs in the context of an existing product (even if that product is still in prototype stages of development). Usability testing takes your existing product and places it in the hands of your users (or potential users) to see how the product actually works for them\u2014how they\u2019re able to accomplish what they need to do with the product.<\/p>\n<p><img decoding=\"async\" title=\"Usability testing: paper prototype\" src=\"\/en\/wp-content\/uploads\/old-blog-uploads\/paperprototype.jpg\" alt=\"Designer working with a paper prototype, considering options for usability.\" \/><\/p>\n<h2 id=\"formative-vs-summative-usability-testing\">3. Formative vs. summative usability testing<\/h2>\n<p>Alright! Now that you understand what usability testing is, and what it isn\u2019t, let\u2019s get into the various types of usability testing out there.<\/p>\n<p>There are two broad categories of usability testing that are important to understand\u2014<a href=\"https:\/\/www.userzoom.com\/usability-testing\/whats-the-difference-between-formative-and-summative\/\" target=\"_blank\" rel=\"noopener\">formative and summative<\/a>. These have to do with when you conduct the testing and what your broad objectives are\u2014what the overarching impact the testing should have on your product.<\/p>\n<p><strong>Formative usability testing:\u00a0<\/strong><\/p>\n<ul>\n<li>Is a <a href=\"https:\/\/imotions.com\/blog\/qualitative-vs-quantitative-research\/\" target=\"_blank\" rel=\"noopener\">qualitative research process\u00a0<\/a><\/li>\n<li>Happens earlier in the design, development, or iteration process<\/li>\n<li>Seeks to understand what about the product needs to be improved<\/li>\n<li>Results in qualitative findings and ideation that you can incorporate into prototypes and wireframes<\/li>\n<\/ul>\n<p><strong>Summative usability testing:<\/strong><\/p>\n<ul>\n<li>Is a research process that\u2019s more <a href=\"https:\/\/imotions.com\/blog\/qualitative-vs-quantitative-research\/\" target=\"_blank\" rel=\"noopener\">quantitative<\/a> in nature<\/li>\n<li>Happens later in the design, development, or iteration process<\/li>\n<li>Seeks to understand whether the solutions you are implementing (or have implemented) are effective<\/li>\n<li>Results in quantitative findings that can help determine broad areas for improvement or specific areas to fine-tune (this can go hand in hand with <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/competitive-analysis-ux\/\" target=\"_blank\" rel=\"noopener\">competitive analysis<\/a>)<\/li>\n<\/ul>\n<h2 id=\"attitudinal-vs-behavioral-research\">4. Attitudinal vs. behavioral research<\/h2>\n<p>Alongside the timing and purpose of the testing (formative vs. summative), it\u2019s important to understand two broad categories that your research (both your objectives and your findings) will fall into: behavioral and attitudinal.<\/p>\n<p><strong>Attitudinal research<\/strong> is all about what people say\u2014what they think\u00a0 and communicate about your product and how it works. <strong>Behavioral research<\/strong> focuses on what people do\u2014how they actually do interact with your product and the feelings that surface as a result.<\/p>\n<p>What people say and what people do are often two very different things. These two categories help define those differences, choose our testing methods more intentionally, and categorize our findings more effectively.<\/p>\n<h2 id=\"five-essential-usability-testing-methods\">5. Five essential usability testing methods<\/h2>\n<p>Some usability testing methods are geared more towards uncovering either behavioral or attitudinal findings; but many have the potential to result in both.<\/p>\n<p>Of the methods you\u2019ll learn about in this section, performance testing has the greatest potential for targeting both\u2014and will perhaps require the greatest amount of thoughtfulness regarding how you approach it.<\/p>\n<p>Naturally, then, we\u2019ll spend a little more time on that method than the other four, though that in no way diminishes their usefulness! Here are the methods we\u2019ll cover:<\/p>\n<ul>\n<li><a href=\"#performance-testing\">Performance testing<\/a><\/li>\n<li><a href=\"#card-sorting\">Card sorting<\/a><\/li>\n<li><a href=\"#tree-testing\">Tree testing<\/a><\/li>\n<li><a href=\"#5-second-test\">5-second test<\/a><\/li>\n<li><a href=\"#eye-tracking\">Eye tracking<\/a><\/li>\n<\/ul>\n<p>These are merely five common and\/or interesting methods\u2014it is not a comprehensive list of every method you can use to get inside the hearts and minds of your users. But it\u2019s a place to start. So here we go!<\/p>\n<h3 id=\"performance-testinghttpswwwnngroupcomarticlesusability-testing-101-targetblank\"><a href=\"https:\/\/www.nngroup.com\/articles\/usability-testing-101\/\" target=\"_blank\" rel=\"noopener\">Performance testing<\/a><\/h3>\n<p>In performance testing, you sit down with a user and give them a task (or set of tasks) to complete with the product.<\/p>\n<p>This is often a combination of methods and approaches that will allow you to interview users, see how they use your product, and find out how they feel about the experience afterward. Depending on your approach, you\u2019ll observe them, take notes, and\/or ask <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/how-to-write-usability-testing-questions\/\">usability testing questions<\/a> before, after, or along the way.<\/p>\n<p>Performance testing is by far the most talked-about form of usability testing\u2014especially as it\u2019s often combined with other methods. Performance testing is what most commonly comes to mind in discussions of usability testing as a whole, and it\u2019s what many <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/best-ux-design-certification-programs\/\" target=\"_blank\" rel=\"noopener\">UX design certification programs<\/a> focus on\u2014because it\u2019s so broadly useful and adaptive.<\/p>\n<p>While there\u2019s no one right way to conduct performance testing, there are a number of approaches and combinations of methods you can use, and you\u2019ll want to be intentional about it.<\/p>\n<p>It\u2019s a method that you can adapt to your objectives\u2014so make sure you do! Ask yourself what kind of attitudinal or behavioral findings you\u2019re really looking for, how much time you\u2019ll have for each testing session, and what methods or approaches will help you reach your objectives most efficiently.<\/p>\n<p>Performance testing is often combined with<a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/what-are-user-interviews\/\" target=\"_blank\" rel=\"noopener\"> user interviews<\/a>. For a quick guide on how to ask great questions during this part of a testing session, watch this video:<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/5tVbFfGDQCk\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>Even if you choose not to combine performance testing with user interviews, good performance testing will still involve some degree of questioning and moderating.<\/p>\n<p>Performance testing typically results in a pretty massive chunk of qualitative insights, so you\u2019ll need to devote a fair amount of intention and planning before you jump in.<\/p>\n<p>Maximize the usefulness of your research by being thoughtful about the task(s) you assign and what approach you take to moderating the sessions. As your test participants go about the task(s) you assign, you\u2019ll watch, take notes, and ask questions either during or after the test\u2014depending on your approach.<\/p>\n<h4 id=\"four-approaches-to-performance-testing\">Four approaches to performance testing<\/h4>\n<p>There are <a href=\"https:\/\/www.usability.gov\/get-involved\/blog\/2013\/04\/moderating-usability-tests.html\" target=\"_blank\" rel=\"noopener\">four ways you can go about moderating a performance test<\/a>, and it\u2019s worth understanding and choosing your approach (or combination of approaches) carefully and intentionally. As you choose, take time to consider:<\/p>\n<ul>\n<li>How much guidance the participant will actually need<\/li>\n<li>How intently participants will need to focus<\/li>\n<li>How guidance or prompting from you might affect results or observations<\/li>\n<\/ul>\n<p>With these things in mind, let\u2019s look at the four approaches.<\/p>\n<p><strong>Concurrent Think Aloud (CTA)<\/strong><\/p>\n<p>With this approach, you\u2019ll encourage participants to externalize their thought process\u2014to think out loud. Your job during the session will be to keep them talking through what they\u2019re looking for, what they\u2019re doing and why, and what they think about the results of their actions.<\/p>\n<p>A CTA approach often uncovers a lot of nuanced details in the user journey, but if your objectives include anything related to the accuracy or time for task completion, you might be better off with a Retrospective Think Aloud.<\/p>\n<p><strong>Retrospective Think Aloud (RTA)<\/strong><\/p>\n<p>Here, you\u2019ll allow participants to complete their tasks and recount the journey <strong>afterward<\/strong>. They can complete tasks in a more realistic time frame\u00a0 and degree of accuracy, though there will certainly be nuanced details of participants\u2019 thoughts and feelings you\u2019ll miss out on.<\/p>\n<p><strong>Concurrent Probing (CP)<\/strong><\/p>\n<p>With Concurrent Probing, you ask participants about their experience as they\u2019re having it. You prompt them for details on their expectations, reasons for particular actions, and feeling about results.<\/p>\n<p>This approach can be distracting, but used in combination with CTA, you can allow participants to complete the tasks and prompt only when you see a particularly interesting aspect of their experience, and you\u2019d like to know more. Again, if accuracy and timing are critical objectives, you might be better off with Retrospective Probing.<\/p>\n<p><strong>Retrospective Probing (RP)<\/strong><\/p>\n<p>If you note that a participant says or does something interesting as they complete their task(s), you can note it and ask them about it later\u2014this is Retrospective Probing. This is an approach very often combined with CTA or RTA to ensure that you\u2019re not missing out on those nuanced details of their experience without distracting them from actually completing the task.<\/p>\n<p>Whew! There\u2019s your quick overview of performance testing. To learn more about it, read to the final section of this article: How to learn more about usability testing.<\/p>\n<p>With this under our belts, let\u2019s move on to our other four essential usability testing methods.<\/p>\n<h3 id=\"card-sortinghttpswwwnngroupcomvideosopen-vs-closed-card-sorting-targetblank\"><a href=\"https:\/\/www.nngroup.com\/videos\/open-vs-closed-card-sorting\/\" target=\"_blank\" rel=\"noopener\">Card sorting<\/a><\/h3>\n<p>Card sorting is a way of testing the usability of your information architecture. You give users blank cards (open card sorting) or cards labeled with the names and short descriptions of the main items\/sections of the product (closed card sorting), then ask them to sort the cards into piles according to which items seem to go best together. You can go even further by asking them to sort the cards into larger groups and to name the groups or piles.<\/p>\n<p>Rather than structuring your site or app according to your understanding of the product, card sorting allows the information architecture to mirror the way your users are thinking.<\/p>\n<p>This is a great technique to employ very early in the design process as it is inexpensive and will save the time and expense of making structural adjustments later in the process. And there\u2019s no technology required! If you want to conduct it remotely, though, there are tools like <a href=\"https:\/\/www.optimalworkshop.com\/optimalsort\/\" rel=\"noopener\">OptimalSort<\/a> that do this effectively.<\/p>\n<p>For more on how to conduct card sorting, watch this video:<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/AxgMIEVcIMY\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<h3 id=\"tree-testinghttpswwwnngroupcomarticlestree-testing-targetblank\"><a href=\"https:\/\/www.nngroup.com\/articles\/tree-testing\/\" target=\"_blank\" rel=\"noopener\">Tree testing<\/a><\/h3>\n<p>Tree testing is a great follow up to card sorting, but it can be conducted on its own as well. In tree testing, you create a visual information hierarchy (or \u201ctree) and ask users to complete a task using the tree. For example, you might ask users, \u201cYou want to accomplish X with this product. Where do you go to do that?\u201d Then you observe how easily users are able to find what they\u2019re looking for.<\/p>\n<p>This is another great technique to employ early in the design process. It can be conducted with paper prototypes or spreadsheets, but you can also use tools such as <a href=\"https:\/\/www.optimalworkshop.com\/treejack\/\" target=\"_blank\" rel=\"noopener\">TreeJack<\/a> to accomplish this digitally and remotely.<\/p>\n<h3 id=\"second-testhttpsfivesecondtestcom-targetblank\"><a href=\"https:\/\/fivesecondtest.com\/\" target=\"_blank\" rel=\"noopener\">5-second test<\/a><\/h3>\n<p>In the 5-second test, you expose your users to one portion of your product (one screen, probably the top half of it) for five seconds and then interview them to see what they took away regarding:<\/p>\n<ul>\n<li>The product\/page\u2019s purpose and main features or elements<\/li>\n<li>The intended audience and trustworthiness of the brand<\/li>\n<li>Their impression of the usability and design of the product<\/li>\n<\/ul>\n<p>You can conduct this kind of testing in person rather simply, or remotely with tools like <a href=\"https:\/\/usabilityhub.com\/\" target=\"_blank\" rel=\"noopener\">UsabilityHub<\/a>.<\/p>\n<h3 id=\"eye-trackinghttpsuxplanetorguxers-quick-guide-to-eye-tracking-edf70bffd03d-targetblank\"><a href=\"https:\/\/uxplanet.org\/uxers-quick-guide-to-eye-tracking-edf70bffd03d\" target=\"_blank\" rel=\"noopener\">Eye tracking<\/a><\/h3>\n<p>This one may seem somewhat new, but it\u2019s been around for a while\u2013though the tools and technology around it have evolved. Eye tracking on its own isn\u2019t enough to determine usability, but it\u2019s a great compliment to your other usability testing measures.<\/p>\n<p>In eye tracking you literally track where most users\u2019 eyes land on the screen you\u2019re designing. The reason this is important is that you want to make sure that the elements users\u2019 eyes are drawn to are the ones that communicate the most important information. This is a difficult one to conduct in any kind of analog fashion, but there are a lot of tools out there that make it simple\u2014<a href=\"https:\/\/www.crazyegg.com\/\" rel=\"noopener\">CrazyEgg<\/a> and <a href=\"https:\/\/www.hotjar.com\/\" rel=\"noopener\">HotJar<\/a> are both great places to start.<\/p>\n<p><img decoding=\"async\" title=\"Usability testing: eyetracking\" src=\"\/en\/wp-content\/uploads\/old-blog-uploads\/eyetracking.jpg\" alt=\"Usability test participant looking at a computer screen\" \/><\/p>\n<h2 id=\"how-to-learn-more-about-usability-testing\">6. How to learn more about usability testing<\/h2>\n<p>There you have it: your 15-minute overview of the what, why, and how of usability testing. But don\u2019t stop here! Usability testing and UX research as a whole have a deeply humanizing impact on the design process. It\u2019s a fascinating field to discover and the result of this kind of work has the power of keeping companies, design teams, and even the lone designer accountable to what matters most: the needs of the end user.<\/p>\n<p>If you\u2019d like to learn more about usability testing and UX research, take the <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/tutorials\/ux-research-for-beginners\/\" target=\"_blank\" rel=\"noopener\">free UX Research for Beginners Course<\/a> with CareerFoundry. This tutorial is jam-packed with information that will give you a deeper understanding of the value of this kind of testing as well as a number of other UX research methods.<\/p>\n<p>You can also enroll in a UX design course or bootcamp to get a comprehensive understanding of the entire UX design process (to which usability testing and UX research are an integral part). For guidance on the best programs, check out our list of the <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/best-ux-design-certification-programs\/\" target=\"_blank\" rel=\"noopener\">10 best UX design certification programs<\/a>. And if you&#8217;ve already started your learning process, and you&#8217;re thinking about the job hunt, here are the <a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/ux-researcher-interview-questions-toolkit\/\">top 5 UX research interview questions<\/a> to be ready for.<\/p>\n<p>For further reading about usability testing and UX research, check out these other articles:<\/p>\n<ul>\n<li><a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/how-to-conduct-usability-testing-a-step-by-step-guide\/\" target=\"_blank\" rel=\"noopener\">How to conduct usability testing: a step-by-step guide<\/a><\/li>\n<li><a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/ux-researcher-career-guide\/\" target=\"_blank\" rel=\"noopener\">What does a UX researcher actually do? The ultimate career guide<\/a><\/li>\n<li><a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/usability-heuristics\/\">11 usability heuristics every designer should know<\/a><\/li>\n<li><a href=\"https:\/\/careerfoundry.inbearbeitung.de\/en\/blog\/ux-design\/how-to-conduct-a-ux-audit\/\">How to conduct a UX audit<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>If you&#8217;re new to UX, diving into usability testing can be a daunting task. But as a UX designer, usability testing is a critical skill to have under your belt. This guide will give you the what, why, and how of usability testing.<\/p>\n","protected":false},"author":7,"featured_media":650,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_lmt_disableupdate":"yes","_lmt_disable":"","footnotes":""},"categories":[2],"tags":[],"class_list":["post-5207","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ux-design"],"acf":{"homepage_category_featured":false},"modified_by":"Rash SEO","_links":{"self":[{"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/posts\/5207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/comments?post=5207"}],"version-history":[{"count":1,"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/posts\/5207\/revisions"}],"predecessor-version":[{"id":25608,"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/posts\/5207\/revisions\/25608"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/media\/650"}],"wp:attachment":[{"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/media?parent=5207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/categories?post=5207"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/careerfoundry.inbearbeitung.de\/en\/wp-json\/wp\/v2\/tags?post=5207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}