Quality indicators to measure the effect of opioid stewardship interventions in hospital and emergency department settings.

Purpose: The purpose of this project was to develop a set of valid and feasible quality indicators used to track opioid stewardship efforts in hospital and emergency department settings.

Methods: Candidate quality indicators were extracted from published literature. Feasibility screening excluded quality indicators that cannot be reliably extracted from the electronic health record or that are irrelevant to pain management in the hospital and emergency department settings. Validity screening used an electronic survey of key stakeholders including pharmacists, nurses, physicians, administrators, and researchers. Stakeholders used a 9-point Likert scale to rate the validity of each quality indicator based on predefined criteria. During expert panel discussions, stakeholders revised quality indicator wording, added new quality indicators, and voted to include or exclude each quality indicator. Priority ranking used a second electronic survey and a 9-point Likert scale to prioritize the included quality indicators.

Results: Literature search yielded 76 unique quality indicators. Feasibility screening excluded 9 quality indicators. The validity survey was completed by 46 (20%) of 228 stakeholders. Expert panel discussions yielded 19 valid and feasible quality indicators. The top 5 quality indicators by priority were: the proportion of patients with (1) naloxone administrations, (2) as needed opioids with duplicate indications, and (3) long acting or extended release opioids if opioid-naïve, (4) the average dose of morphine milligram equivalents administered per day, and (5) the proportion of opioid discharge prescriptions exceeding 7 days.

Conclusion: Multi-professional stakeholders across a health system participated in this consensus process and developed a set of 19 valid and feasible quality indicators for opioid stewardship interventions in the hospital and emergency department settings.