There is growing interest in the use of systems-based risk assessment methods in Human Factors and Ergonomics (HFE). The purpose of this study was to test the intra-rater reliability and criterion-referenced concurrent validity of three systems-based risk assessment approaches: (i) the Systems-Theoretic Process Analysis (STPA) method; (ii) the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method; and, (iii) the Network Hazard Analysis and Risk Management System (Net-HARMS) method. Reliability and validity measures were obtained using the Signal Detection Theory (SDT) paradigm. Whilst STPA identified the highest number of risks, the findings indicate a weak to moderate level of reliability and validity for STPA, EAST-BL and Net-HARMS. There were no statistically significant differences between the methods across analyses. The results suggest that there is merit to the continued use of systems-based risk assessment methods following a series of methodological extensions that aim to enhance the reliability and validity of future applications. The three risk assessment methods produced weak to moderate levels of stability and accuracy regarding their capability to predict risks. There is a pressing need to further test the reliability and validity of safety methods in Human Factors and Ergonomics.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1080/00140139.2021.1962969 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Objective study validity diagnostics: a framework requiring pre-specified, empirical verification to increase trust in the reliability of real-world evidence.
J Am Med Inform Assoc
January 2025
Coordinating Center, Observational Health Data Science and Informatics, New York City, NY 10032, United States.
Objective: Propose a framework to empirically evaluate and report validity of findings from observational studies using pre-specified objective diagnostics, increasing trust in real-world evidence (RWE).
Materials And Methods: The framework employs objective diagnostic measures to assess the appropriateness of study designs, analytic assumptions, and threats to validity in generating reliable evidence addressing causal questions. Diagnostic evaluations should be interpreted before the unblinding of study results or, alternatively, only unblind results from analyses that pass pre-specified thresholds.
Knowledge, attitude and practices associated with COVID-19 among undergraduate students from Malaysian public universities during the endemic phase: a cross-sectional study.
BMC Public Health
January 2025
Biomedical Science Programme, Faculty of Health Sciences, Universiti Kebangsaan Malaysia, Jalan Raja Muda Abdul Aziz, Kuala Lumpur, Malaysia.
Background: After two years of the COVID-19 pandemic, Malaysia began the transition to the endemic phase. students at higher education institutes are among those who were affected by the COVID-19 outbreak and deserve further attention. Hence, this study aimed to assess the knowledge, attitude, and practice (KAP) associated with COVID-19 among public university undergraduate students in Malaysia during the endemic phase.
View Article and Find Full Text PDFEvaluation of external and radiological landmark methods for optimizing ultrasound-guided right internal jugular venous catheterization depth in cardiac surgery.
Sci Rep
January 2025
Department of Radiology, Faculty of Medicine, Chiang Mai University, Chiang Mai, 50200, Thailand.
The formula-based estimation of the right internal jugular venous (IJV) catheterization depth can be inaccurate when using ultrasound guidance. External landmark-based and radiological landmark-based methods have been proposed as alternatives to estimate the insertion depth. This study aimed to evaluate these methods using transesophageal echocardiography (TEE)-guided insertion depth as the reference.
View Article and Find Full Text PDFComparing multi-texture fibrosis analysis versus binary opacity-based abnormality detection for quantitative assessment of idiopathic pulmonary fibrosis.
Sci Rep
January 2025
Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany.
Automated tools for quantification of idiopathic pulmonary fibrosis (IPF) can aid in ensuring reproducibility, however their complexity and costs can differ substantially. In this retrospective study, two automated tools were compared in 45 patients with biopsy proven (12/45) and imaging-based (33/45) IPF diagnosis (mean age 74 ± 9 years, 37 male) for quantification of pulmonary fibrosis in CT. First, a tool that identifies multiple characteristic lung texture features was applied to measure multi-texture fibrotic lung (MTFL) by combining the amount of ground glass, reticulation, and honeycombing.
View Article and Find Full Text PDFReliability of sitting posture between physical therapist video-based evaluation and SMART IMU system using rapid upper limb assessment (RULA).
Sci Rep
January 2025
Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Phuttamonthon, Nakhon Pathom, 73170, Thailand.
This study investigates the ergonomic assessment of sitting postures and the potential for work-related musculoskeletal disorders (WMSDs) in office environments by comparing traditional physical therapist evaluations with Inertial Measurement Unit (IMU) technology by determining the reliability and accuracy of sitting posture assessment using the rapid upper limb assessment (RULA) method. In this experiment, neck and body angle data is collected from twenty participants while sitting and working. The study aims to capture and compare the neck and trunk posture score based RULA protocol system to evaluate ergonomic risks.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!