Reducing trainee mistakes. Better performance with changing to a high-fidelity simulation system?

Background: Postpartum hemorrhage is a significant cause of both maternal morbidity and mortality worldwide and is increasing in incidence. This study aimed to assess improvement and identify shortcomings in trainee performance in different simulation systems in the management of postpartum hemorrhage.

Objective: To perform a pilot study evaluating and comparing high- and low-fidelity simulation models, assessing improvement in repeated performance with high-fidelity mode and identifying mistakes made assessed using Objective Structured Assessment of Technical Skills and thereby exploring what aspects of emergency management of postpartum hemorrhage should be prioritized in teaching settings and assessing what simulation setup is most effective in achieving competence.

Study Design: This was a prospective randomized, single-blinded, single-institution trial in a population of 17 junior obstetrical trainees at the Charité University Hospital Obstetric Simulation Center in Berlin. Trainees were randomized into 2 groups, with either initial low-fidelity simulation or high-fidelity simulation, followed by repeated assessment of performance, using the high-fidelity model simulation system. Individual simulation sessions were video-recorded and transcribed, and the timing of interventions was documented. Strandardized Objective Structured Assessment of Technical Skills forms were used as a checklist for performance.

Results: There was a statistically significant general improvement in performance (=.02; 24.7-27.2 of 31.0 points; average of 8.7%) in the second cycle of simulation assessment and a statistically significant training effect (=.043; 24.4-28.4 of 31.0 points; average of 12.9%) in the group that underwent repeat simulation assessment from the initial low-fidelity system to the high-fidelity system compared with the group using the same high-fidelity setup (=.276; 25.0-25.8 of 31.0; average of 2.4%).

Conclusion: There was an improvement in the performance when trainees underwent a repeated cycle of simulation assessment changing from a low-fidelity system to a high-fidelity system. Simulation assessment can identify mistakes and learning gaps that are important for obstetrical trainees. This study found that trainees make the same mistakes, regardless of which simulation model was initially used.