Inter-Rater Agreement Estimates for Data With High Prevalence of a Single Response.

Background And Purpose: Efforts to establish support for the reliability of quality indicator data are ongoing. Most patients typically receive recommended care, therefore, the high-prevalence of event rates make statistical analysis challenging. This article presents a novel statistical approach recently used to estimate inter-rater agreement for the National Database for Nursing Quality Indicator pressure injury risk and prevention data.

Methods and Processes Used to Collect Pressure Injury Risk and Prevention Measures in the National Database of Nursing Quality Indicators® (NDNQI®).

Background: Previous research found that reliability estimates for chart-extracted quality of care data vary.

Purpose: The purpose was to examine methods and processes used to gather data on the National Database of Nursing Quality Indicators (NDNQI) pressure injury (PI) risk and prevention measures to identify factors that may influence their reliability.

Methods: Study participants (N = 120) from 36 hospitals completed a 35-item online survey.

Inter-Rater Agreement of Pressure Ulcer Risk and Prevention Measures in the National Database of Nursing Quality Indicators(®) (NDNQI).

In this descriptive multi-site study, we examined inter-rater agreement on 11 National Database of Nursing Quality Indicators(®) (NDNQI(®) ) pressure ulcer (PrU) risk and prevention measures. One hundred twenty raters at 36 hospitals captured data from 1,637 patient records. At each hospital, agreement between the most experienced rater and each other team rater was calculated for each measure.