Objective: The clinical decisions and actions of evidence-based practice in psychology (EBPP) are largely underspecified and poorly understood, in part due to the lack of measurement methods. We tested the reliability of a behavioral coding system that characterizes a flow of interrelated activities that includes problem detection and prioritization, intervention selection and implementation, and review of intervention integrity and impact.

Method: The context included two publicly funded youth mental health service organizations located in geographically distinct and underresourced communities in the U.S. where service inequities are common. We sampled 84 digitally recorded and transcribed supervision events that included a sample of professionals who were mostly women (93.02%) and BIPOC (86.04%) whose self-reported race/ethnicity matched the youth populations they served. We coded these events for activities (e.g., considering) and their predicate content (i.e., problems or practices) and examined reliability of these codes applied to excerpts (i.e., small contiguous units of dialogue) as well as to complete events.

Results: Interrater reliability estimates showed that, overall, coders reliably rated the occurrence and extensiveness of activities and content. Excerpt coding was generally more reliable than event coding. However, mathematical aggregation of excerpt coding offered a superior method for estimating event codes reliably, reducing individual subjectivity while providing event level synthesis of activities that are grounded in excerpt level details.

Conclusions: The assessment of clinical decisions and actions has the potential to unpack the black box of EBPP, with different methods best suited to different research questions and resource considerations.

Download full-text PDF

Source
http://dx.doi.org/10.1080/15374416.2024.2384027DOI Listing

Publication Analysis

Top Keywords

decisions actions
12
interrater reliability
8
coding system
8
mental health
8
clinical decisions
8
excerpt coding
8
coding
5
reliability coding
4
system measuring
4
measuring mental
4

Similar Publications

Mandatory surveillance of bacteremia conducted by automated monitoring.

Front Public Health

December 2024

Department of Data Integration and Analysis, Statens Serum Institut, Copenhagen, Denmark.

Except for a few countries, comprehensive all-cause surveillance for bacteremia is not part of mandatory routine public health surveillance. We argue that time has come to include automated surveillance for bacteremia in the national surveillance systems, and explore diverse approaches and challenges in establishing bacteremia monitoring. Assessed against proposed criteria, surveillance for bacteremia should be given high priority.

View Article and Find Full Text PDF

In the last decade, there has been a push for greater evidence-based practice within the humanitarian sector, alongside an increasing turn towards localising humanitarian assistance. Humanitarian actors and organisations have been increasing their production and use of evidence, while also being encouraged to reflect more critically on power hierarchies and decolonise humanitarian aid. This paper explores the intersection of these two narratives, examining how the use of evidence in humanitarian decision-making fits within a localisation agenda.

View Article and Find Full Text PDF

US regulatory compliance for medical combination products: an overview.

Front Med Technol

December 2024

Advance Academic Programs, Krieger School of Arts and Sciences, Johns Hopkins University, Washington, DC, United States.

This article provides a high-level overview of US regulatory review and approval processes for the growing field of medical combination products (CPs; those merging drugs with devices and/or biological products). US law defines drugs, medical devices, and CPs in specific ways, and the components of a CP are still subject to their respective regulations while combined. The Food and Drug Administration's Office of Combination Products (OCP) oversees the review and classification of CPs, which is based on their primary mode of action.

View Article and Find Full Text PDF

Single chain fragment variable, a new theranostic approach for cardiovascular diseases.

Front Immunol

December 2024

Anhui Provincial Key Laboratory for Conservation and Exploitation of Biological Resources, College of Life Science, Anhui Normal University, Wuhu, Anhui, China.

Cardiovascular diseases (CVDs) remain a significant global health challenge, leading to substantial morbidity and mortality. Despite recent advancements in CVD management, pharmaceutical treatments often suffer from poor pharmacokinetics and high toxicity. With the rapid progress of modern molecular biology and immunology, however, single-chain fragment variable (scFv) molecule engineering has emerged as a promising theranostic tool to offer specificity and versatility in targeting CVD-related antigens.

View Article and Find Full Text PDF

Background: Numerous challenges exist in effectively bridging theory and practice in the teaching and assessment of clinical reasoning, despite an abundance of theoretical models. This study compares clinical reasoning practices and decisions between medical students and expert clinicians using a problem-solving framework from the learning sciences, which identifies clinical reasoning as distinct, observable actions in clinical case solving. We examined students at various training stages against expert clinicians to address the research question: How do expert clinicians and medical students differ in their practices and decisions during the diagnostic process?.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!