AN INNOVATIVE METHODOLOGY TO MEASURE PRODUCT USABILITY Histotechnicians are at the Center of our Focus
Whether it’s a new imaging device or a software product, at Leica Biosystems we want to make our products so simple to use that they naturally fit into the Histotechnician’s daily life in a Pathology lab. To do this, we follow a testing process to measure product usability during product development and design of a new product. We refer to this testing methodology as User Experience (UE). Although we study multiple users, including Pathologists, IT professionals and Lab Directors, in this article we will discuss how we measure usability specifically with Histotechnicians using, among other techniques, an innovative approach called the System Usability Scale (SUS).1
1. Brooke, J. (1986). "SUS: a "quick and dirty" usability scale". In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (eds.). Usability Evaluation in Industry. London: Taylor and Francis.
What Usability Metrics do we Measure?
When measuring the User Experience of a product during the design phase, we visit Pathology labs around the world and test prototypes with many Histotechnicians. We prepare testing scenarios that the Histotechnician will experience in their day-to-day work life.
During learning cycles we test, measure and record the following:
- System Usability Scale (SUS) for each Histotechnician after each testing session.
- Task completion rate and time to complete typical tasks for which the product will be used
- Ease of use score per the Histotechnician feedback after performing each task
- Direct verbal feedback from Histotechnicians after testing the product
What is the System Usability Scale (SUS)? SUS is a ten-item likert scale that is designed to assess overall opinions of a product (or technology) in development by answering 10 survey questions regarding a product tester’s opinion of product usability, complexity, support needed, integration ability, and confidence using the product.
SUS results are expressed as percentages with low scores being in the 55-69, average scores being 70-85, an above average scores being 85-100.
Design, Test with User, Iterate, Repeat Process
Once we have measured the usability during a learning session in a Pathology lab, we take those scores and all the rich learnings back to our Pathology Imaging headquarters and study the results in an Obeya Room (Obeya means “large room” or “war room”). In this room, we carefully study the rich user data as a team, including engineers, software developers, marketers, and product managers. We then identify which changes are needed to the product before going out for the next learning and testing session with the Histotechnician. The changes to the product are made and then we repeat the testing and measuring process. See below for some UX DNA data for which we collected during a recent product development program.
|System Usability Score (%)|
Table 1 (above): System Usability Scales (SUS) measurements after product testing sessions over several iterations. SUS are designed to assess overall opinions of a product (or technology) in development by answering 10 survey questions regarding a product tester’s opinion of product usability, complexity, support needed, integration ability, and confidence using the product. Results are expressed as a percent; with 40% being a poor grade and >85% being an excellent grade (as the table indicates, SUS increased from 73% to 94% over 5 product design iterations indicating excellent scores by iteration #5.) SUS results are expressed as percentages with low scores being in the 55-69, average scores being 70-85, an above average scores being 85-100.
A High Quality Product Experience for Our Customers
In order to release a product to our valued customers, Leica Biosystems is committed to achieving high scores in User Experience testing before the product’s design is completed. Often times, this may require many rounds of user testing and associated design changes before a product is ready to launch. This rigorous process is very important for our customers as it helps ensure that when a new product is introduced into the Pathology Lab it will be easy to operate and provide high value to the customer.
For more short innovation articles like this, please go to LeicaBiosystems.com/Knowledge Pathway.