Focused Critical Care Echocardiography: Development and Evaluation of an Image Acquisition Assessment Tool.

Objectives: Little attention has been placed on assessment tools to evaluate image acquisition quality for focused critical care echocardiography. We designed a novel assessment tool to objectively evaluate the image acquisition skills of critical care trainees learning focused critical care echocardiography and examined the tool for evidence of validity.

Design: Prospective observational study.

Setting: Medical-surgical ICUs at a tertiary care teaching hospital.

Subjects: Trainees in our critical care medicine fellowship program.

Interventions: Six trainees completed a focused critical care echocardiography training curriculum followed by performing 20 transthoracic echocardiograms on patients receiving invasive mechanical ventilation. At three assessment intervals (the 1st and 2nd examinations, 10th and 11th examinations, and 19th and 20th examinations), echocardiograms performed by trainees were compared with those of critical care physicians certified in echocardiography and scored according to the focused critical care echocardiography assessment tool. The primary outcome was an efficiency score (overall assessment tool score divided by examination time). Differences in mean efficiency scores between echocardiographers of differing skill levels and changes in trainees' mean efficiency scores with increasing focused critical care echocardiography experience were compared by using t tests.

Measurements And Main Results: On the initial assessment, mean efficiency scores (SD) for trainees and experienced physicians were 1.55 (0.95) versus 2.78 (1.38), respectively (p = 0.02), and for the second and third assessments, the corresponding efficiency ratings for trainees and experienced physicians were 2.48 (0.97) versus 4.55 (1.32) (p < 0.01) and 2.61 (1.37) versus 4.17 (2.12) (p = 0.04), respectively.

Conclusions: Trainees' efficiency in focused critical care echocardiography image acquisition improved quickly in the first 10 studies, yet, it could not match with the performance of experienced physicians after 20 focused critical care echocardiography studies. The focused critical care echocardiography assessment tool demonstrated evidence of validity and could discern changes in trainees' image acquisition performance with increasing experience.