Background: This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability.
Methods: This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument's intrinsic and interrater reliability, content and criterion validity, and usability.
Results: STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach's α coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen's kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson's r correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min.
Conclusion: The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10278700 | PMC |
| http://dx.doi.org/10.1097/CM9.0000000000002713 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Promoting Health Equity, Diversity, and Inclusion in Medical and Scientific Writing and Publishing of Research: A Statement from the Inaugural Diversity, Equity, and Inclusion (DEI) Advocacy Team of the Journal of General Internal Medicine.
J Gen Intern Med
January 2025
Department of Medicine and Population Health, Institute for Excellence in Health Equity, New York University Grossman School of Medicine, New York, NY, USA.
The Journal of General Internal Medicine (JGIM) has a long-standing history of publishing manuscripts focused on health equity and is committed to diversity, equity, and inclusion (DEI) in scientific writing and publishing. This is extremely important in the current climate where false narratives and attacks on DEI and health equity are rampant. To demonstrate their commitment to DEI and health equity, the JGIM Editors-in-Chief created an inaugural DEI Advocacy Team.
View Article and Find Full Text PDFPETRICCS Guideline Protocol: A Call to Improve Reporting Standards in Cell Culture Research.
J Oral Pathol Med
January 2025
Laboratory of Oral Histopathology, Health Sciences Faculty, University of Brasília, Brasília, Brazil.
Background: Cell culture studies play an important role in addressing fundamental scientific questions. However, inadequate reporting of these studies results in a lack of transparency and reproducibility. Recognizing the need for improvement, several ongoing efforts, such as CRIS guidelines and the ICLAC checklist, are focused on enhancing best practices for in vitro studies.
View Article and Find Full Text PDFThe impact of face masks on metacognition in sign language is mediated by proficiency.
Cogn Process
January 2025
Institute of Cognitive Sciences and Technologies (ISTC-CNR), Via Nomentana 56, 00161, Rome, Italy.
Face masks can impact processing a narrative in sign language, affecting several metacognitive dimensions of understanding (i.e., perceived effort, confidence and feeling of understanding).
View Article and Find Full Text PDFTunable optical nonreciprocity in double-cavity optomechanical system with nonreciprocal coupling.
Sci Rep
January 2025
College of Physics and Electronic Science, Hubei Normal University, Huangshi, 435002, P. R. China.
We propose a double-cavity optomechanical system with nonreciprocal coupling to realize tunable optical nonreciprocity that has the prospect of making an optical device for the manipulation of information processing and communication. Here we investigate the steady-state dynamic processes of the double-cavity system and the transmission of optical waves from opposite cavity directions. The transmission spectrum of the probe field is presented in detail and the physical mechanism of the induced transparency window is analyzed.
View Article and Find Full Text PDFGuidelines International Network: Principles for Use of Artificial Intelligence in the Health Guideline Enterprise.
Ann Intern Med
January 2025
Clinical Epidemiology and Research Center (CERC), Department of Biomedical Sciences, Humanitas University, and IRCCS Humanitas Research Hospital, Milan, Italy, and Fraunhofer Institute for Translational Medicine and Pharmacology ITMP, Allergology and Immunology, Berlin, Germany (H.J.S.).
Description: Artificial intelligence (AI) has been defined by the High-Level Expert Group on AI of the European Commission as "systems that display intelligent behaviour by analysing their environment and taking actions-with some degree of autonomy-to achieve specific goals." Artificial intelligence has the potential to support guideline planning, development and adaptation, reporting, implementation, impact evaluation, certification, and appraisal of recommendations, which we will refer to as "guideline enterprise." Considering this potential, as well as the lack of guidance for the use of AI in guidelines, the Guidelines International Network (GIN) proposes a set of principles for the development and use of AI tools or processes to support the health guideline enterprise.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!