Construction and pilot test of a set of indicators to assess the implementation and effectiveness of the who safe childbirth checklist.

Background: The World Health Organization (WHO) launched the "Safe Childbirth Checklist (SCC) Collaboration" in 2012. The SCC is designed to contribute to quality care by providing reminders of evidence-based practices for the prevention and management of the leading causes of maternal and neonatal morbidity and mortality. However, indicators to monitor the implementation and effectiveness of the SCC have not been defined. This study aimed to produce and pilot test a set of valid, reliable and feasible indicators to assess the implementation and effectiveness of the SCC, with an emphasis on best practices.

Methods: As part of the WHO Collaboration, the SCC was adapted to the Mexican context, and a set of indicators was developed to assess the SCC use and adherence to SCC-related best practices. The indicators were pilot tested in three hospitals for feasibility and reliability using the prevalence- and bias-adjusted kappa index (PABAK) for multiple independent evaluators (initial sample, n = 47; second sample, n = 30 to re-test reliability). The data sources were clinical records and cognitive tests drawn from questionnaires to mothers and health professionals.

Results: We generated 53 indicators, and 38 of the indicators (those related to best practices and outcomes) were pilot tested. Of these, 26 relate to care for the mother (20 were measured based on clinical records and 6 via questionnaire), and 12 relate to newborn care (9 were medical record-based and 3 were from questionnaires). Feasible indicators were generally also reliable (PABAK≥0.6). Routine feasibility is affected by the frequency of assessed events.

Conclusions: The generated indicators allow an assessment of the implementation and effectiveness of the SCC and the monitoring of quality of care during childbirth and the immediate postpartum period.