Background: Public policy has tremendous impacts on population health. While policy development has been extensively studied, policy implementation research is newer and relies largely on qualitative methods. Quantitative measures are needed to disentangle differential impacts of policy implementation determinants (i.e., barriers and facilitators) and outcomes to ensure intended benefits are realized. Implementation outcomes include acceptability, adoption, appropriateness, compliance/fidelity, feasibility, penetration, sustainability, and costs. This systematic review identified quantitative measures that are used to assess health policy implementation determinants and outcomes and evaluated the quality of these measures.

Methods: Three frameworks guided the review: Implementation Outcomes Framework (Proctor et al.), Consolidated Framework for Implementation Research (Damschroder et al.), and Policy Implementation Determinants Framework (Bullock et al.). Six databases were searched: Medline, CINAHL Plus, PsycInfo, PAIS, ERIC, and Worldwide Political. Searches were limited to English language, peer-reviewed journal articles published January 1995 to April 2019. Search terms addressed four levels: health, public policy, implementation, and measurement. Empirical studies of public policies addressing physical or behavioral health with quantitative self-report or archival measures of policy implementation with at least two items assessing implementation outcomes or determinants were included. Consensus scoring of the Psychometric and Pragmatic Evidence Rating Scale assessed the quality of measures.

Results: Database searches yielded 8417 non-duplicate studies, with 870 (10.3%) undergoing full-text screening, yielding 66 studies. From the included studies, 70 unique measures were identified to quantitatively assess implementation outcomes and/or determinants. Acceptability, feasibility, appropriateness, and compliance were the most commonly measured implementation outcomes. Common determinants in the identified measures were organizational culture, implementation climate, and readiness for implementation, each aspects of the internal setting. Pragmatic quality ranged from adequate to good, with most measures freely available, brief, and at high school reading level. Few psychometric properties were reported.

Conclusions: Well-tested quantitative measures of implementation internal settings were under-utilized in policy studies. Further development and testing of external context measures are warranted. This review is intended to stimulate measure development and high-quality assessment of health policy implementation outcomes and determinants to help practitioners and researchers spread evidence-informed policies to improve population health.

Registration: Not registered.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7304175PMC
http://dx.doi.org/10.1186/s13012-020-01007-wDOI Listing

Publication Analysis

Top Keywords

policy implementation
32
implementation outcomes
24
implementation
17
quantitative measures
16
health policy
16
implementation determinants
16
policy
11
outcomes
9
determinants
8
determinants outcomes
8

Similar Publications

Politicians often claim to be "following science" but their claims are, reasonably, disputed. To claim to be following the science can mean that scientific evidence affects or legitimates decisions. The evidence that politicians are following science often comes from formal systems of advice that translate science into advice.

View Article and Find Full Text PDF

Rural Revitalization (RR) is a key national strategy in China aimed at sustainable rural development and has gained significant attention. Given the unique characteristics of different villages, understanding differentiated paths to achieve RR is essential. This study introduces a new "5I Framework" (INDUS-INHAB-INDOC-INFRA-INCOM) to assess RR's overall development status (ODS) and differentiated paths.

View Article and Find Full Text PDF

Bias in machine learning applications to address non-communicable diseases at a population-level: a scoping review.

BMC Public Health

December 2024

Upstream Lab, MAP Centre for Urban Health Solutions, Li Ka Shing Knowledge Institute, Unity Health Toronto, 30 Bond Street, Toronto, ON, M5B 1W8, Canada.

Background: Machine learning (ML) is increasingly used in population and public health to support epidemiological studies, surveillance, and evaluation. Our objective was to conduct a scoping review to identify studies that use ML in population health, with a focus on its use in non-communicable diseases (NCDs). We also examine potential algorithmic biases in model design, training, and implementation, as well as efforts to mitigate these biases.

View Article and Find Full Text PDF

Background: There has been a growing interest in granting prescribing rights to pharmacists as a strategy to improve healthcare access. Researchers continue to explore the impact and implementation of pharmacist prescribing. Given the recent international changes in this field, an overview of current territories allowing pharmacist independent prescribing would provide a comprehensive understanding for researchers and policymakers.

View Article and Find Full Text PDF

Background: In May 2020, Oakland became the most populous city in California to implement a minimum floor price law (MFPL), requiring tobacco retailers to sell cigarettes and cigars at $8 or more per pack/package. Policy enforcement began in August 2020.

Methods: We estimated changes in cigarette and cigar prices and unit sales for Oakland versus a matched comparator during the first 20 months following MFPL implementation using a synthetic difference-in-differences approach.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!