AI Article Synopsis

  • Non-technical skills (NTS) assessment tools are important for evaluating healthcare professionals, and this study focuses on comparing three specific tools used in the UK during simulated cardiac arrest scenarios.
  • Researchers evaluated the internal consistency and interrater reliability of ANTS, Oxford NOTECHS, and OSCAR, finding significant variations in their performance and usability.
  • The study highlights the need for standardized NTS tools and proper training for educators, advocating for multiple assessors during high-stakes evaluations to ensure reliable scoring.

Article Abstract

Background: Non-technical skills (NTS) assessment tools are widely used to provide formative and summative assessment for healthcare professionals and there are now many of them. This study has examined three different tools designed for similar settings and gathered evidence to test their validity and usability.

Methods: Three NTS assessment tools designed for use in the UK were used by three experienced faculty to review standardized videos of simulated cardiac arrest scenarios: ANTS (Anesthetists' Non-Technical Skills), Oxford NOTECHS (Oxford NOn-TECHnical Skills) and OSCAR (Observational Skill based Clinical Assessment tool for Resuscitation). Internal consistency, interrater reliability and quantitative and qualitative analysis of usability were analyzed for each tool.

Results: Internal consistency and interrater reliability (IRR) varied considerably for the three tools across NTS categories and elements. Intraclass correlation scores of three expert raters ranged from poor (task management in ANTS [0.26] and situation awareness (SA) in Oxford NOTECHS [0.34]) to very good (problem solving in Oxford NOTECHS [0.81] and cooperation [0.84] and SA [0.87] in OSCAR). Furthermore, different statistical tests of IRR produced different results for each tool. Quantitative and qualitative examination of usability also revealed challenges in using each tool.

Conclusions: The lack of standardization of NTS assessment tools and training in their use is unhelpful for healthcare educators and students. Educators require ongoing support in the use of NTS assessment tools for the evaluation of individual healthcare professionals or healthcare teams. Summative or high-stakes examinations using NTS assessment tools should be undertaken with at least two assessors to provide consensus scoring. In light of the renewed focus on simulation as an educational tool to support and enhance training recovery in the aftermath of COVID-19, it is even more important that assessment of these vital skills is standardized, simplified and supported with adequate training.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10007667PMC
http://dx.doi.org/10.1186/s12909-023-04108-4DOI Listing

Publication Analysis

Top Keywords

assessment tools
24
nts assessment
20
non-technical skills
16
oxford notechs
12
assessment
9
tools
8
healthcare professionals
8
three tools
8
tools designed
8
internal consistency
8

Similar Publications

Effectiveness of psychological interventions in reducing post-traumatic stress among post-myocardial infarction patients: a systematic review and meta-analysis.

Eur J Cardiovasc Nurs

January 2025

Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Level 5, Centre for Translational Medicine, Block MD 6, 14 Medical Drive, Singapore 117599, Singapore.

Aims: Myocardial infarction (MI) can lead to post-traumatic stress disorder (PTSD) which frequently occurs with anxiety and depression, impairing daily functioning and increasing the risk of recurrent cardiovascular events. While psychological interventions have shown promise in reducing anxiety and depression, their effectiveness for PTSD in post-MI patients remains unexplored. This systematic review and meta-analysis aim to evaluate the effectiveness of psychological interventions on PTSD, anxiety, and depression in post-MI patients.

View Article and Find Full Text PDF

Behavioural and psychological symptoms of people with dementia in acute hospital settings: a systematic review and meta-analysis.

Age Ageing

January 2025

Centre for Psychiatry and Mental Health, Wolfson Institute of Population Health, Queen Mary University of London, London, E13 8SP, United Kingdom of Great Britain and Northern Ireland.

Background: Behavioural and psychological symptoms of dementia (BPSD) can complicate acute hospital care, but evidence on BPSD in this setting is heterogeneous.

Objective: To determine the prevalence of BPSD in acute hospitals and explore related risk factors, treatments, and outcomes (PROSPERO: CRD42023406294).

Methods: We conducted a systematic review and meta-analysis by searching Cochrane Library, MEDLINE, and PsycINFO for studies on BPSD prevalence among older people with dementia during their acute hospital admissions (up to 5 March 2024).

View Article and Find Full Text PDF

Background: Transgender men often experience body image dissatisfaction due to incongruence between their gender identity and physical appearance. Masculinizing mammoplasty (MM) aligns physical appearance with gender identity; however, its impact on body image satisfaction in Brazil has not been comprehensively assessed using validated tools.

Objectives: To evaluate satisfaction with chest appearance, nipple aesthetics, and body investment among transgender men in Brazil, comparing those who have undergone MM with those who have not, using validated tools, such as the BODY-Q Chest, BODY-Q Nipple, and Body Investment Scale.

View Article and Find Full Text PDF

Background: Dementia is one of the most pressing health concerns among the ageing population, imposing significant health, financial and caregiving burdens on people with dementia (PWD), their families and caregivers. Building the capacity of nursing students is essential for effectively improving quality of life for affected people. This study aimed to assess nursing students' knowledge and attitudes toward dementia and its associated factors.

View Article and Find Full Text PDF

Background And Aims: Substance use (SU) is prevalent among individuals in the criminal justice system (CJS). However, there is often poor access to treatment. We aimed to assess the effectiveness of two medications, extended-release naltrexone (XR-NTX) and extended-release buprenorphine (XR-BUP) for the prison population.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!