Background: With the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, developers oftentimes rely on methods such as questionnaires as opposed to other, more time-intensive strategies that incorporate direct observation.
Objectives: Prior to release of the potentially inappropriate medication (PIM) clinical dashboard, designed to facilitate completion of a quality improvement project by clinician scholars enrolled in the Veterans Affairs (VA) workforce development Geriatric Scholars Program (GSP), we evaluated the usability of the system. This article describes the process of usability testing a dashboard reporting system with clinicians using direct observation and think-aloud moderating techniques.
Methods: We developed a structured interview protocol that combines virtual observation, think-aloud moderating techniques, and retrospective questioning of the overall user experience, including use of the System Usability Scale (SUS). Thematic analysis was used to analyze field notes from the interviews of three GSP alumni.
Results: Our structured approach to usability testing identified specific functional problems with the dashboard reporting system that were missed by results from the SUS. Usability testing lead to overall improvements in the intuitive use of the system, increased data transparency, and clarification of the dashboard's purpose.
Conclusion: Reliance solely on questionnaires and surveys at the end stages of dashboard development can mask potential functional problems that will impede proper usage and lead to misinterpretation of results. A structured approach to usability testing in the developmental phase is an important tool for developers of clinician friendly systems for displaying easily digested information and tracking outcomes for the purpose of quality improvement.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7425799 | PMC |
| http://dx.doi.org/10.1055/s-0040-1714693 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
From ideation to real context of use of a digital solution to promote physical and cognitive training for older adults.
Sci Rep
January 2025
Center for Health Technology and Services Research (CINTESIS@RISE), School of Health Sciences, University of Aveiro, Aveiro, Portugal.
This study describes the process of designing and developing the user interface of a digital solution aiming to promote physical and cognitive training (DanceMove) and testing for its usability by community-dwelling older adults. This study is subdivided into four phases: (i) concept and ideation, (ii) design and development of the prototype, (iii) testing of the functional mock-ups, and (iv) testing of the prototype in the laboratory and in the real context of use. Through the different phases of the study technological and healthcare professionals and users were involved.
View Article and Find Full Text PDFHealthy Kai (Food) Checker Web-Based Tool to Support Healthy Food Policy Implementation: Development and Usability Study.
JMIR Form Res
January 2025
Department of Epidemiology and Biostatistics, School of Population Health, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand.
Background: Public health programs and policies can positively influence food environments. In 2016, a voluntary National Healthy Food and Drink Policy was released in New Zealand to improve the healthiness of food and drinks for hospital staff and visitors. However, no resources were developed to support policy implementation.
View Article and Find Full Text PDFPatients' Experienced Usability and Satisfaction With Digital Health Solutions in a Home Setting: Instrument Validation Study.
JMIR Med Inform
January 2025
Department of Medical Informatics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, the Netherlands.
Background: The field of digital health solutions (DHS) has grown tremendously over the past years. DHS include tools for self-management, which support individuals to take charge of their own health. The usability of DHS, as experienced by patients, is pivotal to adoption.
View Article and Find Full Text PDFHuman-centered design of a health recommender system for orthopaedic shoulder treatment.
BMC Med Inform Decis Mak
January 2025
Department of Public Health Sciences, Clemson University, Clemson, SC, USA.
Background: Rich data on diverse patients and their treatments and outcomes within Electronic Health Record (EHR) systems can be used to generate real world evidence. A health recommender system (HRS) framework can be applied to a decision support system application to generate data summaries for similar patients during the clinical encounter to assist physicians and patients in making evidence-based shared treatment decisions.
Objective: A human-centered design (HCD) process was used to develop a HRS for treatment decision support in orthopaedic medicine, the Informatics Consult for Individualized Treatment (I-C-IT).
A prospective multi-site study to evaluate the performance and usability of an oral fluid-based HIV self-test in Canada.
BMC Public Health
January 2025
MAP Centre for Urban Health Solutions, Unity Health Toronto, Toronto, ON, Canada.
Background: Blood and oral fluid-based HIV self-tests are important for reaching the undiagnosed living with HIV. The study objectives were to evaluate the oral fluid-based OraQuick® HIV Self-Test (HIV-ST) performance in comparison to laboratory reference testing; determine if laypersons can correctly perform the HIV-ST; document if intended users can successfully interpret pre-made contrived positive, negative, and invalid results; and document if intended users can understand the key messages in the product labeling.
Methods: This prospective study enrolled consenting adult intended users of HIV self-testing from six community health centres in four Canadian provinces between June 2022 and January 2024.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!