Objective: To assess the reliability of measurement of assessments of nontechnical skills in medical teams.
Background: There are several scales for assessing nontechnical skills in medical teams. In this critique, we describe the reliability of such assessments and discuss factors that may influence the obtained estimate of reliability for such scales.
Method: A review of the literature yielded 28 reliability estimates, mostly intraclass correlations. We analyzed the methods of scale development and reliability estimation for factors that are likely to influence the resulting estimate, including aspects of the judges, the targets, what is observed, and the kind of reliability coefficient.
Results: Typical reliability was approximately 0.7, but estimates were quite varied in magnitude, from quite low (0.3) to quite high (0.9). Thus, highly reliable assessment is possible, but rarely achieved. Factors that are likely to influence the magnitude of reliability include the number of assessors, the participants' range in skill level, and the observational process. Most studies do not present enough information to make the estimates comparable from one study to the next.
Conclusions: Although nontechnical skills can be measured reliably under some circumstances, it is not clear from the existing literature that one scale provides more reliable data than another. We recommend several practices that would help readers to make informed decisions about which scales are most useful for their purposes.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.jsurg.2016.12.011 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Surgical performance anxiety among UK oral and maxillofacial surgeons.
Br J Oral Maxillofac Surg
December 2024
Oral and Maxillofacial Surgery Department, King's College Hospital NHS Trust, London SE5 9RS, United Kingdom.
This study of clinicians working in oral and maxillofacial surgery (OMFS) in the United Kingdom (UK) investigates the prevalence and character of surgical performance anxiety (SPA), a state of anxiety in response to negative evaluation by others concerning the performance of a surgical task. There is growing awareness of the impact of non-technical skills on patient outcomes with some research into SPA, but this is not OMFS-specific, and the understanding of performance anxiety in surgery falls behind comparable performance-driven professions. A prospective mixed-methods study was therefore conducted among UK OMFS clinicians using an electronic survey.
View Article and Find Full Text PDFNeoScore: a new tool to assess technical and non-technical skills during neonatal resuscitation.
J Perinatol
January 2025
Department of Women's and Children's Health, Maternal-Fetal Medicine Unit, University of Padua School of Medicine, Padua, Italy.
Background: Training with high-technology manikins improves cardio-pulmonary resuscitation (CPR) skill retention, but a checklist to assess both technical and non-technical skills is lacking. This study aimed to develop a standardized checklist to evaluate healthcare's performance during simulated Neonatal Resuscitation Program (NRP) scenarios.
Materials And Methods: Twenty-two international neonatal resuscitation experts participated in a two-step modified Delphi process, rating each checklist item on a scale of 1-5 and providing feedback.
Utilizing the DiSC Assessment in Surgical Residency Leadership Training to Address Communication Skill Acquisition: A Kern Six-step Approach to Curriculum Development.
J Surg Educ
January 2025
Department of Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, New Jersey. Electronic address:
Objective: Effective communication is essential in delivering high-quality patient care, and in recent years, resident education has expanded to focus on nontechnical skills and communication training. The "Everything DiSC" model is a communication inventory tool used to help employers and employees gain insight into how an individual may communicate within a team and how others may perceive similarities and differences in communication styles, comprising of Dominance (D), Influence (i), Steadiness (S), and Conscientiousness (C). In this report, we describe our experience mapping the DiSC model to the Kern 6-step framework for curriculum development and summarize residents' feedback several years following its implementation.
View Article and Find Full Text PDFAssociation Between Surgeon Stress and Major Surgical Complications.
JAMA Surg
January 2025
Center for Surgery and Public Health, Department of Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
Importance: Surgeon stress can influence technical and nontechnical skills, but the consequences for patient outcomes remain unknown.
Objective: To investigate whether surgeon physiological stress, as assessed by sympathovagal balance, is associated with postoperative complications.
Design, Setting, And Participants: This multicenter prospective cohort study included 14 surgical departments involving 7 specialties within 4 university hospitals in Lyon, France.
Extended reality in anesthesia: a narrative review.
Korean J Anesthesiol
January 2025
Department of Anesthesia and Perioperative Care, University of California, San Francisco, California, USA.
The application of extended reality (XR) technology is rapidly expanding in the medical field, including anesthesia. This review aims to introduce the current literature on XR utilization to help anesthesiologists adopt this technology in education and clinical practice. XR is useful for both knowledge acquisition and skill training in a wide range of settings, from students to medical professionals.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!