Multireader sample size program for diagnostic studies: demonstration and methodology.

The software "Multireader sample size program for diagnostic studies," written by Kevin Schartz and Stephen Hillis, performs sample size computations for diagnostic reader-performance studies. The program computes the sample size needed to detect a specified difference in a reader-performance measure between two imaging modalities when using the analysis methods initially proposed by Dorfman, Berbaum, and Metz, and Obuchowski and Rockette, and later unified and improved by Hillis and colleagues. A commonly used reader-performance measure is the area under the receiver-operating-characteristic curve.

Effect of fatigue on reading computed tomography examination of the multiply injured patient.

Our goal was to ascertain how fatigue affects performance in reading computed tomography (CT) examinations of patients with multiple injuries. CT images with multiple fractures from a previous study of satisfaction of search (SOS) were read by radiologists after a day of clinical work. Performance in this study with fatigued readers was compared to a previous study in which readers were not fatigued.

The Impact of Fatigue on Satisfaction of Search in Chest Radiography.

Rationale And Objectives: To assess the nature of the satisfaction of search (SOS) effect in chest radiography when observers are fatigued; determine if we could replicate recent findings that have documented the nature of the SOS effect to be due to a threshold shift rather than a change in diagnostic accuracy as in earlier film-based studies.

Materials And Methods: Nearing or at the end of a clinical workday, 20 radiologists read 64 chest images twice, once with and once without the addition of a simulated pulmonary nodule. Half of the images had different types of "test" abnormalities.

Trauma in CT: The Role of Severe Injury on Satisfaction of Search Revised.

Purpose: The satisfaction-of-search (SOS) effect occurs when an abnormality on an image is missed because another is found. The aim of this experiment was to test whether severe distracting fractures control the magnitude of SOS on other fractures when both appear in a single CT image.

Methods: The institutional review board approved this study.

The Influence of a Vocalized Checklist on Detection of Multiple Abnormalities in Chest Radiography.

Rationale And Objectives: Although a checklist has been recommended for preventing satisfaction of search (SOS) errors, a previous research study did not demonstrate that benefit. However, observers in that study had to turn away from the image display to use the checklist. The current study tested a vocalized checklist to avoid this constraint.

Satisfaction of Search in Chest Radiography 2015.

Rationale And Objectives: Two decades have passed since the publication of laboratory studies of satisfaction of search (SOS) in chest radiography. Those studies were performed using film. The current investigation tests for SOS effects in computed radiography of the chest.

Demonstration of Multi- and Single-Reader Sample Size Program for Diagnostic Studies software.

The recently released software , written by Kevin Schartz and Stephen Hillis, performs sample size computations for diagnostic reader-performance studies. The program computes the sample size needed to detect a specified difference in a reader performance measure between two modalities, when using the analysis methods initially proposed by Dorfman, Berbaum, and Metz (DBM) and Obuchowski and Rockette (OR), and later unified and improved by Hillis and colleagues. A commonly used reader performance measure is the area under the receiver-operating-characteristic curve.

Satisfaction of search from detection of pulmonary nodules in computed tomography of the chest.

Rationale And Objectives: We tested whether satisfaction of search (SOS) effects that occur in computed tomography (CT) examination of the chest on detection of native abnormalities are produced by the addition of simulated pulmonary nodules.

Materials And Methods: Two experiments were conducted. In the first experiment, 70 CT examinations, half that demonstrated diverse, subtle abnormalities and half that demonstrated no native lesions, were read by 18 radiology residents and fellows under two experimental conditions: presented with and without pulmonary nodules.

Satisfaction of search for subtle skeletal fractures may not be induced by more serious skeletal injury.

Purpose: The aim of this experiment was to test whether radiographs of major injuries, those having serious consequences for life and limb, produce a satisfaction-of-search (SOS) effect on the detection of subtle, nondisplaced test fractures.

Methods: Institutional review board approval and informed consent from 24 participants were obtained. Seventy simulated patients with multiple trauma injuries were constructed from radiographs of 3 different anatomic areas demonstrated only skeletal injuries.

Do long radiology workdays affect nodule detection in dynamic CT interpretation?

Purpose: A previous study demonstrated decreased diagnostic accuracy for finding fractures and decreased ability to focus on skeletal radiographs after a long working day. Skeletal radiographic examinations commonly have images that are displayed statically. The aim of this study was to investigate whether diagnostic accuracy for detecting pulmonary nodules on CT of the chest displayed dynamically would be similarly affected by fatigue.

Long radiology workdays reduce detection and accommodation accuracy.

Purpose: The aim of this study was to measure the diagnostic accuracy of fracture detection, visual accommodation, reading time, and subjective ratings of fatigue and visual strain before and after a day of clinical reading.

Methods: Forty attending radiologists and radiology residents viewed 60 deidentified, HIPAA-compliant bone examinations, half with fractures, once before any clinical reading (early) and once after a day of clinical reading (late). Reading time was recorded.

Does computer-aided diagnosis for lung tumors change satisfaction of search in chest radiography?

Rationale And Objectives: Computer-aided diagnosis (CAD) has been developed to ensure that the radiologist considers suspect focal opacities that may represent cancer in chest radiography. Although CAD was not developed to counteract the satisfaction of search (SOS) effect, it may be an effective intervention to do so. The objective of this study is to determine whether an idealized CAD can reduce SOS effects in chest radiography.

Satisfaction of search in multitrauma patients: severity of detected fractures.

Rationale And Objectives: Satisfaction of search (SOS) occurs when an abnormality is missed because another abnormality has been detected. This research studied whether the severity of a detected fracture determines whether subsequent fractures are overlooked.

Materials And Methods: Each of 70 simulated multitrauma patients presented examinations of three anatomic areas.

Can a checklist reduce SOS errors in chest radiography?

Rationale And Objectives: A previous study demonstrated unexpected protection from satisfaction of search (SOS) effects when observers verbalized the focus of their attention during visual search and interpretation of chest radiographs. We suggested that protection from SOS might have occurred if each observer developed an informal checklist to help generate the verbal descriptions. The objective of this study is to determine whether a formal checklist reduces SOS effects in chest radiology.

A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data.

There are several different statistical methods for analysing multireader ROC studies, with the Dorfman-Berbaum-Metz (DBM) method being the most frequently used. Another method is the corrected F method proposed by Obuchowski and Rockette (OR). The DBM and OR procedures at first appear quite different: DBM is a three-way ANOVA analysis of pseudovalues while OR is a two-way ANOVA analysis of accuracy estimates with correlated errors.