The regulations on summative usability evaluations of medical devices (MDs) emphasize that the test environment must have sufficient ecological validity for generalization to real-life use. Here, we examined the influence of environmental fidelity (a component of ecological validity) on the detectability of MD use errors. A total of 140 participants participated in a summative usability evaluation of an anaphylactic shock auto-injector device under either a high-fidelity condition or a condition acceptable from the manufacturer's perspective, lower-fidelity condition. The numbers of errors detected in each condition were compared by applying descriptive statistics and logistic and Poisson multivariate regressions. We found that the level of fidelity did not influence the overall number of use errors detected but did influence the detection of certain use errors. To optimize the test environment and increase the detection of use errors, each environmental feature's role in the test task should first be examined.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.apergo.2024.104266 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Evaluating the Safety and Usability of an Over-the-Counter Medical Device for Adults With Mild to Moderate Hearing Loss: Formative and Summative Usability Testing.
JMIR Hum Factors
January 2025
Center for Research and Innovation in Systems Safety, Department of Anesthesiology, Vanderbilt University Medical Center, 2525 West End Avenue, Suite 800, Nashville, TN, 37203, United States, 16153431528.
Background: Only 15% of the nearly 30 million Americans with hearing loss use hearing aids, partly due to high cost, stigma, and limited access to professional hearing care. Hearing impairment in adults can lead to social isolation and depression and is associated with an increased risk of falls. Given the persistent barriers to hearing aid use, the Food and Drug Administration issued a final rule to allow over-the-counter hearing aids to be sold directly to adult consumers with perceived mild to moderate hearing loss at pharmacies, stores, and online retailers without seeing a physician or licensed hearing health care professional.
View Article and Find Full Text PDFMitochondrial Fitness Science Communication for Aging Adults: Prospective Formative Pilot Study.
JMIR Form Res
December 2024
School of Nursing, Vanderbilt University, Nashville, TN, United States.
Background: A key driver that leads to age-associated decline and chronic disease is mitochondrial dysfunction. Our previous work revealed strong community interest in the concept of mitochondrial fitness, which led to the development of a video-based science communication intervention to prompt behavior change in adults aged 50 years and older.
Objective: This study aimed to conduct formative and summative evaluations of MitoFit, an instructional, biologically based communication intervention aimed at improving physical activity in older adults aged 50 years and older.
Usability Testing of a Digitized Interventional Prehabilitation Tool for Health Care Professionals and Patients Before Major Surgeries: Formative and Summative Evaluation.
JMIR Form Res
December 2024
Institute of Sports Medicine, Goethe University Frankfurt/Main, Frankfurt, Germany.
Background: The development of a medical device requires strict adherence to regulatory processes. Prehabilitation in this context is a new area in surgery that trains, coaches, and advises patients in mental well-being, nutrition, and physical activity. As staff is permanently drained from clinical care, remote and digital solutions with real-time assessments of data, including patient-related outcome reporting, may simplify preparation before major surgeries.
View Article and Find Full Text PDFHuman Factors, Human-Centered Design, and Usability of Sensor-Based Digital Health Technologies: Scoping Review.
J Med Internet Res
November 2024
See Acknowledgements, .
Article Synopsis
- The increasing use of sensor-based digital health technologies (sDHTs) has revealed challenges in applying these tools effectively in clinical trials and patient care for diverse populations.
- This review seeks to analyze current research findings related to the usability and human-centered design of sDHTs to inform a new evaluation framework.
- A scoping review of studies from 2013 to 2023 identified 442 papers, with 83 suitable for data extraction, highlighting that most evaluations focus on user satisfaction and ease of use, but less attention is paid to other usability aspects like learnability and efficiency.
A Handheld Tool for the Rapid Morphological Identification of Mosquito Species (VectorCam) for Community-Based Malaria Vector Surveillance: Summative Usability Study.
JMIR Hum Factors
August 2024
Johns Hopkins University Center for Bioengineering Innovation and Design, Baltimore, MD, United States.
Background: Malaria impacts nearly 250 million individuals annually. Specifically, Uganda has one of the highest burdens, with 13 million cases and nearly 20,000 deaths. Controlling the spread of malaria relies on vector surveillance, a system where collected mosquitos are analyzed for vector species' density in rural areas to plan interventions accordingly.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!