Extracting Evidence from Health IT Studies to Populate Logic Models.

Background: Logic models graphically present the socio-technical components of a variety of 'programs' such as educational programs. They show the underlying logic and assumptions of how a program is supposed to work. We suggest that they can be used to describe the mechanisms of complex socio-technical health IT interventions.

Evaluating Artificial Intelligence in Clinical Settings-Let Us Not Reinvent the Wheel.

Given the requirement to minimize the risks and maximize the benefits of technology applications in health care provision, there is an urgent need to incorporate theory-informed health IT (HIT) evaluation frameworks into existing and emerging guidelines for the evaluation of artificial intelligence (AI). Such frameworks can help developers, implementers, and strategic decision makers to build on experience and the existing empirical evidence base. We provide a pragmatic conceptual overview of selected concrete examples of how existing theory-informed HIT evaluation frameworks may be used to inform the safe development and implementation of AI in health care settings.

Automatic Classification of Online Discussions and Other Learning Traces to Detect Cognitive Presence.

Cognitive presence is a core construct of the Community of Inquiry (CoI) framework. It is considered crucial for deep and meaningful online-based learning. CoI-based real-time dashboards visualizing students' cognitive presence may help instructors to monitor and support students' learning progress.

Clinical Utility and Usability of the Digital Box and Block Test: Mixed Methods Study.

Background: The Box and Block Test (BBT) is a clinical tool used to measure hand dexterity, which is often used for tracking disease progression or the effectiveness of therapy, particularly benefiting older adults and those with neurological conditions. Digitizing the measurement of hand function may enhance the quality of data collection. We have developed and validated a prototype that digitizes this test, known as the digital BBT (dBBT), which automatically measures time and determines and displays the test result.

Agile eHealth Usability Evaluation: A Triangulative Approach to Promoting the Usability of eHealth Systems.

Background: Usability evaluation is difficult to reconcile with agile software development for eHealth systems, because traditional usability evaluation is often complex and cumbersome to implement. However, obtaining prospective users' feedback during agile software development is crucial for improving the usability of eHealth systems, which is why there is an increasing need for agile eHealth usability evaluation.

Objective: This study investigates whether agile usability evaluations are suitable to evaluate patient-centered eHealth systems being agile developed in health care and are applicable for prospective users, such as older persons suffering from age-related declines.

Visualizing Study Profiles Using the GMDS Competency Catalog for Medical Informatics Programs.

Background: Medical informatics programs cover a variety of topics.

Objectives: To test the utility of the GMDS medical informatics competency catalog in comparing programs by developing study profiles.

Methods: Coverage of 234 competencies is recorded and visualized in a spider diagram.

One Health: Insights from Organizational & Social, Technology Assessment and Human Factors Perspectives.

Objectives: To offer diverse but complementary perspectives on how biomedical and health informatics can be informed by and help to achieve the vision of One Health.

Methods: Overview of key considerations and critical discussion of common themes, barriers and opportunities, based on collaborative review by International Medical Informatics Association (IMIA) working group members active in related fields.

Results: Health and care systems are complex sociotechnical systems that need explicit design and implementation strategies to align with the goals of One Health.

A Digital Box and Block Test for Hand Dexterity Measurement: Instrument Validation Study.

Background: The Box and Block Test (BBT) measures unilateral gross manual dexterity and is widely used in clinical settings with a wide range of populations, including older people and clients with neurological disorders.

Objective: In this study, we present a newly developed digitized version of the BBT, called the digital BBT (dBBT). The physical design is similar to the original BBT, but the dBBT contains digital electronics that automate the test procedure, timing, and score measurement.

The need to strengthen the evaluation of the impact of Artificial Intelligence-based decision support systems on healthcare provision.

Despite the renewed interest in Artificial Intelligence-based clinical decision support systems (AI-CDS), there is still a lack of empirical evidence supporting their effectiveness. This underscores the need for rigorous and continuous evaluation and monitoring of processes and outcomes associated with the introduction of health information technology. We illustrate how the emergence of AI-CDS has helped to bring to the fore the critical importance of evaluation principles and action regarding all health information technology applications, as these hitherto have received limited attention.

Logic Models for Evaluation of Complex Health Information Systems.

Background: Complex health IT needs to be planned and evaluated.

Objectives: To propose logic models for the evaluation of complex health IT.

Methods: Logic models describe input, activities, output, outcome, and impact.

Predicting mHealth Acceptance Using the UTAUT2 Technology Acceptance Model: A Mixed-Methods Approach.

Background: Mobile health (mHealth) apps are increasingly used in healthcare to support people with chronic diseases such as diabetes. mHealth acceptance is crucial for using them. Due to acceptance problems, however, mHealth apps are not used by all chronic disease patients.

IT risk management for medical devices in hospital IT networks: a catalogue of measures and indicators.

Objectives: Connecting medical devices to hospital IT networks can create threats that must be covered by IT risk management. In practice, implementing such risk management is not trivial because the IEC 80001-1, as the existing state-of-the-art, do not describe sufficiently concrete implementation measures or evaluation indicators. The aim of the present work was to develop and evaluate a catalogue of measures and indicators to help hospitals implement and evaluate risk management in accordance with IEC 80001-1.

A Linked Open Data-Based Terminology to Describe Libre/Free and Open-source Software: Incremental Development Study.

Background: There is a variety of libre/free and open-source software (LIFOSS) products for medicine and health care. To support health care and IT professionals select an appropriate software product for given tasks, several comparison studies and web platforms, such as Medfloss.org, are available.

Recommendations of the International Medical Informatics Association (IMIA) on Education in Biomedical and Health Informatics: Second Revision.

Background: The purpose of educational recommendations is to assist in establishing courses and programs in a discipline, to further develop existing educational activities in the various nations, and to support international initiatives for collaboration and sharing of courseware. The International Medical Informatics Association (IMIA) has published two versions of its international recommendations in biomedical and health informatics (BMHI) education, initially in 2000 and revised in 2010. Given the recent changes to the science, technology, the needs of the healthcare systems, and the workforce of BMHI, a revision of the recommendations is necessary.

Extension of the Unified Theory of Acceptance and Use of Technology 2 model for predicting mHealth acceptance using diabetes as an example: a cross-sectional validation study.

Objectives: Mobile health applications are instrumental in the self-management of chronic diseases like diabetes. Technology acceptance models such as Unified Theory of Acceptance and Use of Technology 2 (UTAUT2) have proven essential for predicting the acceptance of information technology. However, earlier research has found that the constructs "perceived disease threat" and "trust" should be added to UTAUT2 in the mHealth acceptance context.

Desiderata for a New Generation of EHRs for Inclusive Healthcare.

Objectives: This research addresses several factors relevant to inequity in healthcare that may be susceptible to being addressed in a new generation of electronic health records (EHRs).

Methods: Through a scoping review of the literature, inequities related to ethnicity, gender, and socioeconomic aspects in healthcare in general and, more specifically in EHRs, have been considered. Papers have been identified between 2011 and 2022 in three categories: EHR, gender inequalities, and ethnicity inequalities.

The Role of Formative Evaluation in Promoting Digitally-based Health Equity and Reducing Bias for Resilient Health Systems: The Case of Patient Portals.

Objectives: Patient portals are increasingly implemented to improve patient involvement and engagement. We here seek to provide an overview of ways to mitigate existing concerns that these technologies increase inequity and bias and do not reach those who could benefit most from them.

Methods: Based on the current literature, we review the limitations of existing evaluations of patient portals in relation to addressing health equity, literacy and bias; outline challenges evaluators face when conducting such evaluations; and suggest methodological approaches that may address existing shortcomings.

Process Mining of Nursing Routine Data: Cool, but also Useful?

Background: Process mining is a promising field of data analytics that is yet to be applied broadly in healthcare. It can streamline the care process, leading to a higher quality of care, increased patient safety and lower costs.

Objectives: To get deeper insights into the emergence and detectability of delirium in a gerontopsychiatric setting.

Using the Taxonomy of Patient Portals to Classify the ELGA Patient Portal.

Background: Patient portals may support patient engagement, yet they may differ largely in their characteristics.

Objectives: To compare the Austrian patient portal with 10 portals from six other countries using the TOPCOP Taxonomy.

Methods: We described the portals using openly available information.

Classification of Patient Portals Described in Evaluation Studies Using the TOPCOP Taxonomy.

Many patient portals have been introduced and evaluated in recent years. The results of evaluation studies are difficult to compare, however, as the evaluated patient portal is often not clearly or only incompletely described in the publication. This problem is common to evaluations in health informatics.

Agile, Easily Applicable, and Useful eHealth Usability Evaluations: Systematic Review and Expert-Validation.

Background: Electronic health (eHealth) usability evaluations of rapidly developed eHealth systems are difficult to accomplish because traditional usability evaluation methods require substantial time in preparation and implementation. This illustrates the growing need for fast, flexible, and cost-effective methods to evaluate the usability of eHealth systems. To address this demand, the present study systematically identified and expert-validated rapidly deployable eHealth usability evaluation methods.