Warning! You won't be able to use the quotation basket until you enable cookies in your Web browser.
Warning! Your Web browser is no longer supported. Please upgrade to a modern browser.

AN INNOVATIVE METHODOLOGY TO MEASURE PRODUCT USABILITY Histotechnicians are at the Center of our Focus

Email Subscription

Be the first to know about upcoming webinars and join the hundreds that enhance their knowledge with our new videos, articles, and other industry leading content.

Subscribe

Introduction

Whether it’s a new imaging device or a software product, at Leica Biosystems we want to make our products so simple to use that they naturally fit into the Histotechnician’s daily life in a Pathology lab. To do this, we follow a testing process to measure product usability during product development and design of a new product. We refer to this testing methodology as User Experience (UE). Although we study multiple users, including Pathologists, IT professionals and Lab Directors, in this article we will discuss how we measure usability specifically with Histotechnicians using, among other techniques, an innovative approach called the System Usability Scale (SUS).1

1. Brooke, J. (1986). "SUS: a "quick and dirty" usability scale". In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (eds.). Usability Evaluation in Industry. London: Taylor and Francis.

What Usability Metrics do we Measure?

When measuring the User Experience of a product during the design phase, we visit Pathology labs around the world and test prototypes with many Histotechnicians. We prepare testing scenarios that the Histotechnician will experience in their day-to-day work life.

During learning cycles we test, measure and record the following:

  1. System Usability Scale (SUS) for each Histotechnician after each testing session.
  2. Task completion rate and time to complete typical tasks for which the product will be used
  3. Ease of use score per the Histotechnician feedback after performing each task
  4. Direct verbal feedback from Histotechnicians after testing the product

What is the System Usability Scale (SUS)? SUS is a ten-item likert scale that is designed to assess overall opinions of a product (or technology) in development by answering 10 survey questions regarding a product tester’s opinion of product usability, complexity, support needed, integration ability, and confidence using the product.

SUS results are expressed as percentages with low scores being in the 55-69, average scores being 70-85, an above average scores being 85-100.

Design, Test with User, Iterate Repeat Process

Once we have measured the usability during a learning session in a Pathology lab, we take those scores and all the rich learnings back to our Pathology Imaging headquarters and study the results in an Obeya Room (Obeya means “large room” or “war room”). In this room, we carefully study the rich user data as a team, including engineers, software developers, marketers, and product managers. We then identify which changes are needed to the product before going out for the next learning and testing session with the Histotechnician. The changes to the product are made and then we repeat the testing and measuring process. See below for some UX DNA data for which we collected during a recent product development program.

Figure 1 (above): As part of UX DNA testing during product development, we measure the time it takes Histotechnicians to complete common tasks for which the product in development is intended to be used. Blue, red and green bars show task time for different iterations over time. Purple bar shows the goal (or reference point). As shown above, task times generally improve dramatically after each iteration as learnings are applied from each previous session to the next design iteration.
  System Usability Score (%)
Design Iteration Actual Goal
Iteration #1 73% 85%
Iteration #2 73% 85%
Iteration #3 91% 85%
Iteration #4 89% 85%
Iteration #5 94% 85%

 

Table 1 (above): System Usability Scales (SUS) measurements after product testing sessions over several iterations. SUS are designed to assess overall opinions of a product (or technology) in development by answering 10 survey questions regarding a product tester’s opinion of product usability, complexity, support needed, integration ability, and confidence using the product. Results are expressed as a percent; with 40% being a poor grade and >85% being an excellent grade (as the table indicates, SUS increased from 73% to 94% over 5 product design iterations indicating excellent scores by iteration #5.) SUS results are expressed as percentages with low scores being in the 55-69, average scores being 70-85, an above average scores being 85-100.

A High Quality Product Experience for Our Customers

In order to release a product to our valued customers, Leica Biosystems is committed to achieving high scores in User Experience testing before the product’s design is completed. Often times, this may require many rounds of user testing and associated design changes before a product is ready to launch. This rigorous process is very important for our customers as it helps ensure that when a new product is introduced into the Pathology Lab it will be easy to operate and provide high value to the customer.

For more short innovation articles like this, please go to LeicaBiosystems.com/PathologyLeaders.

Coming Soon! Look for our next article on Leica Biosystems innovations!

Did you like the post? Subscribe for the latest updates!

Be the first to know about upcoming webinars and join the hundreds that enhance their knowledge with our new videos, articles, and other industry leading content.