Menu

AN INNOVATIVE METHODOLOGY TO MEASURE PRODUCT USABILITY Histotechnicians are at the Center of our Focus

Introduction

Whether it’s a new imaging device or a software product, at Leica Biosystems we want to make our products so simple to use that they naturally fit into the Histotechnician’s daily life in a Pathology lab. To do this, we follow a testing process to measure product usability during product development and design of a new product. We refer to this testing methodology as User Experience (UE). Although we study multiple users, including Pathologists, IT professionals and Lab Directors, in this article we will discuss how we measure usability specifically with Histotechnicians using, among other techniques, an innovative approach called the System Usability Scale (SUS).1

Erhalten Sie neueste Informationen aus dem Knowledge Pathway direkt in Ihr Postfach.

Wenn Sie sich dieses Schulungswebinar aus unserer monatlichen Reihe angesehen haben und dessen Anerkennung als Weiterbildung seitens der Sie zertifizierenden Organisation beantragen möchten, füllen Sie bitte das Formular aus, um Ihrem Protokoll die entsprechenden Weiterbildungspunkte gemäß Ihren eigenen Angaben hinzuzufügen.

ANMELDUNG FÜR WEITERBILDUNGSPUNKTE NACH EIGENANGABEN

What Usability Metrics do we Measure?

When measuring the User Experience of a product during the design phase, we visit Pathology labs around the world and test prototypes with many Histotechnicians. We prepare testing scenarios that the Histotechnician will experience in their day-to-day work life.

During learning cycles we test, measure and record the following:

  1. System Usability Scale (SUS) for each Histotechnician after each testing session.
  2. Task completion rate and time to complete typical tasks for which the product will be used
  3. Ease of use score per the Histotechnician feedback after performing each task
  4. Direct verbal feedback from Histotechnicians after testing the product

What is the System Usability Scale (SUS)? SUS is a ten-item likert scale that is designed to assess overall opinions of a product (or technology) in development by answering 10 survey questions regarding a product tester’s opinion of product usability, complexity, support needed, integration ability, and confidence using the product.

SUS results are expressed as percentages with low scores being in the 55-69, average scores being 70-85, an above average scores being 85-100.

Design, Test with User, Iterate, Repeat Process

Once we have measured the usability during a learning session in a Pathology lab, we take those scores and all the rich learnings back to our Pathology Imaging headquarters and study the results in an Obeya Room (Obeya means “large room” or “war room”). In this room, we carefully study the rich user data as a team, including engineers, software developers, marketers, and product managers. We then identify which changes are needed to the product before going out for the next learning and testing session with the Histotechnician. The changes to the product are made and then we repeat the testing and measuring process. See below for some UX DNA data for which we collected during a recent product development program.

Figure 1 (above): As part of UX DNA testing during product development, we measure the time it takes Histotechnicians to complete common tasks for which the product in development is intended to be used. Blue, red and green bars show task time for different iterations over time. Purple bar shows the goal (or reference point). As shown above, task times generally improve dramatically after each iteration as learnings are applied from each previous session to the next design iteration.
  System Usability Score (%)
Design Iteration Actual Goal
Iteration #1 73% 85%
Iteration #2 73% 85%
Iteration #3 91% 85%
Iteration #4 89% 85%
Iteration #5 94% 85%

 

Table 1 (above): System Usability Scales (SUS) measurements after product testing sessions over several iterations. SUS are designed to assess overall opinions of a product (or technology) in development by answering 10 survey questions regarding a product tester’s opinion of product usability, complexity, support needed, integration ability, and confidence using the product. Results are expressed as a percent; with 40% being a poor grade and >85% being an excellent grade (as the table indicates, SUS increased from 73% to 94% over 5 product design iterations indicating excellent scores by iteration #5.) SUS results are expressed as percentages with low scores being in the 55-69, average scores being 70-85, an above average scores being 85-100.

A High Quality Product Experience for Our Customers

In order to release a product to our valued customers, Leica Biosystems is committed to achieving high scores in User Experience testing before the product’s design is completed. Often times, this may require many rounds of user testing and associated design changes before a product is ready to launch. This rigorous process is very important for our customers as it helps ensure that when a new product is introduced into the Pathology Lab it will be easy to operate and provide high value to the customer.

For more short innovation articles like this, please go to LeicaBiosystems.com/Knowledge Pathway.

Coming Soon! Look for our next article on Leica Biosystems innovations!

References

1. Brooke, J. (1986). "SUS: a "quick and dirty" usability scale". In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (eds.). Usability Evaluation in Industry. London: Taylor and Francis.

Die Inhalte des Knowledge Pathway von Leica Biosystems unterliegen den Nutzungsbedingungen der Website von Leica Biosystems, die hier eingesehen werden können: Impressum. Der Inhalt, einschließlich der Webinare, Schulungspräsentationen und ähnlicher Materialien, soll allgemeine Informationen zu bestimmten Themen liefern, die für medizinische Fachkräfte von Interesse sind. Er soll explizit nicht der medizinischen, behördlichen oder rechtlichen Beratung dienen und kann diese auch nicht ersetzen. Die Ansichten und Meinungen, die in Inhalten Dritter zum Ausdruck gebracht werden, spiegeln die persönlichen Auffassungen der Sprecher/Autoren wider und decken sich nicht notwendigerweise mit denen von Leica Biosystems, seinen Mitarbeitern oder Vertretern. Jegliche in den Inhalten enthaltene Links, die auf Quellen oder Inhalte Dritter verweisen, werden lediglich aus Gründen Ihrer Annehmlichkeit zur Verfügung gestellt.

Vor dem Gebrauch sollten die Produktinformationen, Beilagen und Bedienungsanleitungen der jeweiligen Medikamente und Geräte konsultiert werden. Leica Biosystems und die Herausgeber schließen hiermit jegliche Haftung für Verluste oder Schäden aus, die sich direkt oder indirekt aus der Anwendung des Inhalts ergeben könnten, einschließlich der Anwendung von Medikamenten, Geräten, Techniken oder Verfahren, die im Inhalt beschrieben sind.

Copyright © 2021 Leica Biosystems als Teil der Leica Microsystems, Inc. und Partnerunternehmen von Leica Biosystems. Alle Rechte vorbehalten. LEICA und das Leica Logo sind eingetragene Warenzeichen der Leica Microsystems IR GmbH.

Möchten Sie, dass wir von Ihnen verfasste Texte veröffentlichen?

Wir sind stets auf der Suche nach weiteren interessanten Autoren, die wir hier vorstellen möchten. Reichen Sie Ihren Beitrag ein und wir melden uns bei Ihnen!

Reichen sie ihr Manuskript ein.

Mögen Sie, was Sie sehen?

Erhalten Sie mehr Inhalte aus dem Knowledge Pathway direkt in Ihr Postfach. Sie können sich jederzeit wieder abmelden.