Usability Evaluation Ecological Validity: Is More Always Better?

Healthcare (Basel)

School of Health Information Science, University of Victoria, Victoria, BC V8P 5C2, Canada.

Published: July 2024

Background: The ecological validity associated with usability testing of health information technologies (HITs) can affect test results and the predictability of real-world performance. It is, therefore, necessary to identify conditions with the greatest effect on validity.

Method: We conducted a comparative analysis of two usability testing conditions. We tested a HIT designed for anesthesiologists to detect pain signals and compared two fidelity levels of ecological validity. We measured the difference in the number and type of use errors identified between high and low-fidelity experimental conditions.

Results: We identified the same error types in both test conditions, although the number of errors varied as a function of the condition. The difference in total error counts was relatively modest and not consistent across levels of severity.

Conclusions: Increasing ecological validity does not invariably increase the ability to detect use errors. Our findings suggest that low-fidelity tests are an efficient way to identify and mitigate usability issues affecting ease of use, effectiveness, and safety. We believe early low-fidelity testing is an efficient but underused way to maximize the value of usability testing.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11276482PMC
http://dx.doi.org/10.3390/healthcare12141417DOI Listing

Publication Analysis

Top Keywords

ecological validity
16
usability testing
12
usability
5
usability evaluation
4
ecological
4
evaluation ecological
4
validity
4
validity better?
4
better? background
4
background ecological
4

Similar Publications

Study of the SPL gene family and miR156-SPL module in Populus tomentosa: Potential roles in juvenile-to-adult phase transition and reproductive phase.

Int J Biol Macromol

January 2025

State Key Laboratory of Tree Genetics and Breeding, Beijing Forestry University, Beijing 100083, China; National Engineering Research Center of Tree Breeding and Ecological Restoration, Beijing Forestry University, Beijing 100083, China; Beijing Advanced Innovation Center for Tree Breeding by Molecular Design, College of Biological Sciences and Technology, Beijing Forestry University, Beijing 100083, China. Electronic address:

Populus tomentosa, a deciduous tree species distinguished by its significant economic and ecological value, enjoys a wide-ranging natural distribution. However, its long juvenile period severely restricts the advancement of breeding work. The SPL gene family, a distinctive class of transcription factors exclusive to the plant kingdom, is critical in various processes of plant growth and development.

View Article and Find Full Text PDF

Unlabelled: This review investigated the psychometric properties of the most commonly used short-, long-, complex- and patient-reported walking outcome measures in multiple sclerosis(MS): the timed-25-foot walk test (T25FW), the six-minute walk test (6MWT), the six-spot step-test (SSST), and the 12-item MS walking scale (MSWS-12), along with reported reference data of these tests.

Methods: Based on PubMed and Embase searches, psychometric as well as descriptive data of T25FW, 6MWT, SSST, and MSWS-12 were extracted from studies evaluating persons with MS (pwMS). Descriptive data was also extracted from healthy controls (HC), if reported.

View Article and Find Full Text PDF

Metagenomic exploration and computational prediction of novel enzymes for polyethylene terephthalate degradation.

Ecotoxicol Environ Saf

January 2025

Laboratory of Complex Biological Systems and Bioinformatics (CBB), Department of Bioinformatics, Institute of Biochemistry and Biophysics (IBB), University of Tehran, Tehran, Iran. Electronic address:

As a global environmental challenge, plastic pollution raises serious ecological and health concerns owing to the excessive accumulation of plastic waste, which disrupts ecosystems, harms wildlife, and threatens human health. Polyethylene terephthalate (PET), one of the most commonly used plastics, has contributed significantly to this growing crisis. This study offers a solution for plastic pollution by identifying novel PET-degrading enzymes.

View Article and Find Full Text PDF

Assessment of vegetation restoration potential in central Asia.

J Environ Manage

January 2025

State Key Laboratory of Desert and Oasis Ecology, Xinjiang Institute of Ecology and Geography, Chinese Academy of Sciences, Urumqi, 830011, Xinjiang, China; University of Chinese Academy of Sciences, Beijing, 100049, China.

Vegetation restoration potential (VRP) assessment is an important aspect and foundation of ecological restoration projects. Neglecting the carrying capacity of the natural environment in the formulation and implementation of ecological restoration projects often leads to diminished effectiveness or even environmental damage. Existing models for VRP either overly rely on empirical knowledge, resulting in low efficiency and reproducibility, or fail to consider the nonlinear relationship between the natural environment and vegetation cover, leading to low accuracy in assessment results.

View Article and Find Full Text PDF

Segmentation by recreation experiences of demand in coastal and marine destinations: A study in Galapagos, Ecuador.

PLoS One

January 2025

Facultad de Ciencias Sociales y Humanísticas, Escuela Superior Politécnica del Litoral, ESPOL, Guayaquil, Ecuador.

Tourism in coastal and marine areas offers a wide variety of recreational activities. The present study had the following objectives: (i), identify the dimensions of recreational experiences in coastal and marine destinations focused on island marine protected areas (ii) determine the demand segments for recreational experiences, and (iii) establish the relationship between the demand segments for recreational experiences and the satisfaction and loyalty. The study was conducted in the Galápagos Islands of Ecuador, and 407 valid questionnaires were collected on-site.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!