Usability Evaluation Ecological Validity: Is More Always Better?

Background: The ecological validity associated with usability testing of health information technologies (HITs) can affect test results and the predictability of real-world performance. It is, therefore, necessary to identify conditions with the greatest effect on validity.

Method: We conducted a comparative analysis of two usability testing conditions.

Tabular, Annotated, Visual, or Trends + Contextual Information? Preferences for Online Laboratory Results Displays.

People are increasingly offered access to their personal health information (e.g., laboratory results, clinical notes, diagnostic imaging results).

Hidden in Plain Sight: Overlooked Results and Other Errors in Evaluating Online Laboratory Results.

People are increasingly accessing their own laboratory (lab) results online. However, Canadians may be expected to use different systems to access their results, depending upon where they are tested (e.g.

Overcoming Challenges to Inclusive User-based Testing of Health Information Technology with Vulnerable Older Adults: Recommendations from a Human Factors Engineering Expert Inquiry.

Objectives: Involving representative users in usability testing of health information technology (HIT) is central to user-centered design. However, (vulnerable) older adults as representative users have unique requirements. Aging processes may affect physical capabilities and cognitive skills, which can hamper testing with this demographic and may require special attention and revised protocols.

Using Simulations to Train Medical Students for Unanticipated Technology Failures in Telemedicine.

Simulations offer a safe environment for health professional training and the opportunity to predictably and consistently introduce events or variables that may be rare or dangerous in a live setting. Exposing trainees to unanticipated events during simulations can improve their ability to adapt and improvise. The COVID-19 pandemic accelerated the adoption of telehealth worldwide and highlighted the need for better training in health professional schools.

Information Chaos: An Adapted Framework Describing Citizens' Experiences with Information During COVID-19.

With the onset of the coronavirus pandemic, clinicians, public officials, and citizens alike struggled to stay abreast of the constant and evolving stream of information about the clinical manifestations of illness, epidemiology of the disease, and the public health response. In this paper, we adapted (i.e.

Opportunities to Improve COVID-19 Dashboard Designs for the Public.

Many organizations created COVID-19 dashboards to communicate epidemiologic statistics or community health capabilities with the public. In this paper we used dashboard heuristics to identify common violations observed in COVID-19 dashboards targeted to citizens. Many of the faults we identified likely stem from failing to include users in the design of these dashboards.

Implementation of a Medication Reconciliation Assistive Technology: A Qualitative Analysis.

: To aid the implementation of a medication reconciliation process within a hybrid primary-specialty care setting by using qualitative techniques to describe the climate of implementation and provide guidance for future projects. : Guided by McMullen et al's Rapid Assessment Process, we performed semi-structured interviews prior to and iteratively throughout the implementation. Interviews were coded and analyzed using grounded theory and cross-examined for validity.

Evaluation of Multimedia Medication Reconciliation Software: A Randomized Controlled, Single-Blind Trial to Measure Diagnostic Accuracy for Discrepancy Detection.

Background: The Veterans Affairs Portland Healthcare System developed a medication history collection software that displays prescription names and medication images.

Objective: This article measures the frequency of medication discrepancy reporting using the medication history collection software and compares with the frequency of reporting using a paper-based process. This article also determines the accuracy of each method by comparing both strategies to a best possible medication history.

Beyond technology acceptance to effective technology use: a parsimonious and actionable model.

Objective: To develop and test a parsimonious and actionable model of effective technology use (ETU).

Design: Cross-sectional survey of primary care providers (n = 53) in a large integrated health care organization that recently implemented new medication reconciliation technology.

Methods: Surveys assessed 5 technology-related perceptions (compatibility with work values, implementation climate, compatibility with work processes, perceived usefulness, and ease of use) and 1 outcome variable, ETU.

Design of admission medication reconciliation technology: a human factors approach to requirements and prototyping.

Objective: Our objectives were to (1) develop an in-depth understanding of the workflow and information flow in medication reconciliation, and (2) design medication reconciliation support technology using a combination of rapid-cycle prototyping and human-centered design.

Background: Although medication reconciliation is a national patient safety goal, limitations both of physical environment and in workflow can make it challenging to implement durable systems. We used several human factors techniques to gather requirements and develop a new process to collect a medication history at hospital admission.

Addressing the sociotechnical drivers of quality improvement: a case study of post-operative DVT prophylaxis computerised decision support.

Background: Quality improvement (QI) initiatives characterised by iterative cycles of quantitative data analysis do not readily explain the organisational determinants of change. However, the integration of sociotechnical theory can inform more effective strategies. Our specific aims were to (1) describe a computerised decision support intervention intended to improve adherence with deep venous thrombosis (DVT) prophylaxis recommendations; and (2) show how sociotechnical theory expressed in 'Fit between Individuals, Task and Technology' framework (FITT) can identify and clarify the facilitators and barriers to QI work.

Primary care provider perceptions and use of a novel medication reconciliation technology.

Background: Although medication reconciliation (MR) can reduce medication discrepancies, it is challenging to operationalise. Consequently, we developed a health information technology (HIT) to collect a patient medication history and make it available to the primary care (PC) provider. We deployed a self-service kiosk in a PC clinic that permits patients to indicate a medication adherence history.

Design and implementation of a medication reconciliation kiosk: the Automated Patient History Intake Device (APHID).

Errors associated with medication documentation account for a substantial fraction of preventable medical errors. Hence, the Joint Commission has called for the adoption of reconciliation strategies at all United States healthcare institutions. Although studies suggest that reconciliation tools can reduce errors, it remains unclear how best to implement systems and processes that are reliable and sensitive to clinical workflow.