Do clinicians understand the size of treatment effects? A randomized survey across 8 countries.

CMAJ

Department of Anesthesia and Pain Medicine (Johnston, Crawford), The Hospital for Sick Children, University of Toronto, Toronto, Ont.; Institute of Health Policy, Management and Evaluation (Johnston), Dalla Lana School of Public Health, University of Toronto, Toronto, Ont.; Child Health Evaluative Sciences (Johnston), The Hospital for Sick Children Research Institute, Toronto, Ont.; Iberoamerican Cochrane Center (Alonso-Coello, Dalmau), Biomedical Research Institute Sant Pau, CIBER Epidemiologiay Salud Publica, Barcelona, Spain; Departments of Critical Care and Medicine (Friedrich), St. Michael's Hospital, Toronto, Ont.; Department of Medicine and Interdepartmental Division of Critical Care (Friedrich), University of Toronto, Toronto, Ont.; Departments of Medicine and Biomedical and Health Informatics (Mustafa), University of Missouri-Kansas City, Kansas City, Mo.; Department of Clinical Epidemiology and Biostatistics (Mustafa, Tikkinen, Neumann, Akl, Thabane, Guyatt), McMaster University, Hamilton, Ont.; Departments of Urology and Public Health (Tikkinen), Helsinki University Central Hospital and University of Helsinki, Helsinki, Finland; Department of Internal Medicine (Neumann), Pontificia Universidad Catolica de Chile, Santiago, Chile; Institute of Health and Society (Vandvik), Faculty of Medicine, University of Oslo, Oslo, Norway; Department of Medicine (Vandvik), Innlandet Hospital Trust, Division Gjövik, Norway; Clinical Epidemiology Unit (Akl), American University of Beirut, Beirut, Lebanon; Institute of Primary Health Care (da Costa), University of Bern, Bern, Switzerland; Department of Critical Care Medicine and Sunnybrook Research Institute (Adhikari), Sunnybrook Health Sciences Centre, Toronto, Ont.; Interdepartmental Division of Critical Care (Adhikari), University of Toronto, Toronto, Ont.; School of Medicine and Centre for General Practice (Kosunen), University of Tampere and Pirkanmaa Hospital District, Tampere, Finland; School of Medicine and Department of Internal Medicine (Mustonen), University of Tampere and Tampere University Hospital, Tampere, Finland; Physiology and Experimental Medicine (Crawford), The Hospital for Sick Children Research Institute, Toronto, Ont.; Biostatistics Unit of the Centre for Evaluation of Medicines (Thabane), McMaster University, Hamilton, Ont.; Population Health Research Unit, Hamilton Health Sciences (Thabane), McMaster University, Hamilton, Ont.; Department of Medicine (Guyatt), McMaster University, Hamilton, Ont.

Published: January 2016

Background: Meta-analyses of continuous outcomes typically provide enough information for decision-makers to evaluate the extent to which chance can explain apparent differences between interventions. The interpretation of the magnitude of these differences - from trivial to large - can, however, be challenging. We investigated clinicians' understanding and perceptions of usefulness of 6 statistical formats for presenting continuous outcomes from meta-analyses (standardized mean difference, minimal important difference units, mean difference in natural units, ratio of means, relative risk and risk difference).

Methods: We invited 610 staff and trainees in internal medicine and family medicine programs in 8 countries to participate. Paper-based, self-administered questionnaires presented summary estimates of hypothetical interventions versus placebo for chronic pain. The estimates showed either a small or a large effect for each of the 6 statistical formats for presenting continuous outcomes. Questions addressed participants' understanding of the magnitude of treatment effects and their perception of the usefulness of the presentation format. We randomly assigned participants 1 of 4 versions of the questionnaire, each with a different effect size (large or small) and presentation order for the 6 formats (1 to 6, or 6 to 1).

Results: Overall, 531 (87.0%) of the clinicians responded. Respondents best understood risk difference, followed by relative risk and ratio of means. Similarly, they perceived the dichotomous presentation of continuous outcomes (relative risk and risk difference) to be most useful. Presenting results as a standardized mean difference, the longest standing and most widely used approach, was poorly understood and perceived as least useful.

Interpretation: None of the presentation formats were well understood or perceived as extremely useful. Clinicians best understood the dichotomous presentations of continuous outcomes and perceived them to be the most useful. Further initiatives to help clinicians better grasp the magnitude of the treatment effect are needed.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4695351PMC
http://dx.doi.org/10.1503/cmaj.150430DOI Listing

Publication Analysis

Top Keywords

continuous outcomes
20
relative risk
12
statistical formats
8
formats presenting
8
presenting continuous
8
standardized difference
8
risk risk
8
magnitude treatment
8
best understood
8
risk difference
8

Similar Publications

Echocardiography interpretation training and internal medicine milestones: A pilot study.

J Formos Med Assoc

January 2025

Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan; Telehealth Center, National Taiwan University Hospital, Taipei, Taiwan. Electronic address:

Background/purpose: The competency-based Internal Medicine Milestones (IMM) assesses physician training outcomes through six key competencies. This pilot study introduced IMM concepts through an echocardiography report interpretation course for postgraduate students (PGYs) and residents (Rs). We aimed to help young physicians understand and track competency development as they receive cardiovascular training, with a view to expanding IMM usage for all junior physicians.

View Article and Find Full Text PDF

Plasma brain-related biomarkers and potential therapeutic targets in pediatric ECMO.

Neurotherapeutics

January 2025

Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA. Electronic address:

Extracorporeal membrane oxygenation (ECMO) is a technique used to support severe cardiopulmonary failure. Its potential life-saving benefits are tempered by the significant risk for acute brain injury (ABI), from both primary pathophysiologic factors and ECMO-related complications through central nervous system cellular injury, blood-brain barrier dysfunction (BBB), systemic inflammation and neuroinflammation, and coagulopathy. Plasma biomarkers are an emerging tool used to stratify risk for and diagnose ABI, and prognosticate neurofunctional outcomes.

View Article and Find Full Text PDF

Introduction: Current trends of delaying childbearing and the increasing incidence of endometrial cancer in nulliparous woman necessitate research and development of fertility sparing treatments. Hormonal therapy with progestins offers an alternative to surgical treatment for a select group of patients of reproductive-age, who wish to preserve their reproductive potential.

Materials And Methods: The study evaluates the effectiveness of medroxyprogesterone acetate therapy in patients with early-stage endometrial cancer, atypical endometrial hyperplasia or atypical polypoid adenomyoma, seeking to preserve fertility.

View Article and Find Full Text PDF

Purpose: The aim of the study was to compare the results of radiofrequency (RF) thermotherapy and transurethral resection of the prostate (TURP) in patients who required benign prostatic obstruction (BPO) surgery and had storage symptoms.

Methods: The results of patients who had undergone TURP and RF thermotherapy procedures between December 2019 and 2022 were compared before and after the procedure. Patients' International Prostate Symptom Scores, maximum flow rate (Qmax), postvoiding residues, and overactive bladder validated 8 scores (OAB-V8) at 3 and 6 months were analyzed.

View Article and Find Full Text PDF

Odontogenic exosomes simulating the developmental microenvironment promote complete regeneration of pulp-dentin complex in vivo.

J Adv Res

January 2025

Center of Stomatology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030 People's Republic of China; School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030 People's Republic of China; Hubei Province Key Laboratory of Oral and Maxillofacial Development and Regeneration, Wuhan 430022 People's Republic of China. Electronic address:

Introduction: Establishing an optimized regenerative microenvironment for pulp-dentin complex engineering has become increasingly critical. Recently, exosomes have emerged as favorable biomimetic nanotherapeutic tools to simulate the developmental microenvironment and facilitate tissue regeneration.

Objectives: This study aimed to elucidate the multifaceted roles of exosomes from human dental pulp stem cells (DPSCs) that initiated odontogenic differentiation while sustaining mesenchymal stem cell (MSC) characteristics in odontogenesis, angiogenesis, and neurogenesis during pulp-dentin complex regeneration.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!