Objective: To validate and test a simple instrument for assessing the quality of a review.
Methods: In this prospective observational study, the quality of 247 reviews of 119 original articles submitted to the Dutch Journal of Medicine was assessed using a 5-point scale that has been used for years by Obstetrics & Gynecology. Each review was assessed by three editors of the journal. Intraobserver variability, calculated as an intraclass correlation coefficient, was assessed by having the same editors rate 76 reviews for a second time. Validation of the scale was done in two ways. First, editors of three other medical journals were asked to rate the 247 reviews using the same 5-point scale. Second, all reviews were sent to the authors of the article with a questionnaire consisting of 12 yes-or-no questions and one question asking for an overall score for the review.
Results: The interobserver intraclass correlation coefficient for the three editors was 0.62 (95% confidence interval 0.50-0.71) for the first assessment of 247 reviews. For the second assessment of 76 reviews, the interobserver intraclass correlation coefficient was 0.62 (0.45-0.74). The intraobserver intraclass correlation coefficient for each of the internal editors ranged from 0.66 to 0.88. The interobserver intraclass correlation coefficient for the external editors was 0.60 (0.51-0.68). The interobserver intraclass correlation coefficient for all six editors was 0.62 (0.55-0.68). The authors' response rate to the questionnaires was 83%. A significant correlation was found between the mean total editorial quality assessment and the overall score of the authors (intraclass correlation coefficient 0.28, 0.14-0.41).
Conclusion: This 5-point scale proved to be a simple, reliable, and valid instrument enabling editors to assess the quality of reviews. A significant correlation was found between mean editorial quality assessment and the quality as determined by authors.
Level Of Evidence: III.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1097/01.AOG.0000231675.74957.48 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Measuring the role of fathers on breastfeeding success: Psychometric properties of Ethiopia's Afaan Oromo version of the partner breastfeeding influence scale.
J Pediatr Nurs
January 2025
School of Nursing, The Hong Kong Polytechnic University, Hong Kong, China. Electronic address:
Aim: This study aimed to translate the partner breastfeeding influence scale (PBIS) to the Afaan Oromo language and determine its psychometric properties.
Methods: A cross-sectional study involving 320 fathers of infants under six months old was conducted with a 4-week retest. The scale underwent translation and back-translation before its psychometric evaluation.
Intrarater and interrater reliability of the Clinical Frailty Scale-Es and FRAIL-Es in critically ill patients.
Med Intensiva (Engl Ed)
January 2025
Unidad de Cuidados Intensivos, Hospital Universitario de Getafe, Getafe, Madrid, Spain.
Objective: To evaluate the intrarater and interrater reliability of the Clinical Frailty Scale-Spain (CFS-España) and FRAIL-España and the internal consistency of the FRAIL-España when implemented in critically ill patients by intensive care nurses and physicians.
Design: Descriptive, observational and metric study.
Setting: intensive care unit (ICU) of Spain.
Reliability of running gait variability measures calculated from inertial measurement units.
J Biomech
January 2025
Sport and Physical Activity Research Centre, Sheffield Hallam University, Olympic Legacy Park, 2 Old Hall Rd, Sheffield S9 3TY, United Kingdom. Electronic address:
Changes to the variability within biomechanical signals may reflect a change in the health of the human system. However, for running gait variability measures calculated from wearable device data, it is unknown whether a between-day difference reflects a shift in system dynamics reflective of a change in human health or is a result of poor between-day reliability of the measurement device or the biomechanical signal. This study investigated the reliability of stride time and sacral acceleration variability measures calculated from inertial measurement units (IMUs).
View Article and Find Full Text PDFDevelopment of a model for measuring sagittal plane parameters in 10-18-year old adolescents with idiopathic scoliosis based on RTMpose deep learning technology.
J Orthop Surg Res
January 2025
Department of Human Anatomy, Graduate School, Inner Mongolia Medical University, Hohhot, 010010, Inner Mongolia, China.
Purpose: The study aimed to develop a deep learning model for rapid, automated measurement of full-spine X-rays in adolescents with Adolescent Idiopathic Scoliosis (AIS). A significant challenge in this field is the time-consuming nature of manual measurements and the inter-individual variability in these measurements. To address these challenges, we utilized RTMpose deep learning technology to automate the process.
View Article and Find Full Text PDFTranslation and validation of the 8-item contact lens dry eye questionnaire (CLDEQ-8) among Chinese soft contact lens wearers.
Cont Lens Anterior Eye
January 2025
State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangzhou, China. Electronic address:
Purpose: To develop a Chinese version of the 8-item Contact Lens Dry Eye Questionnaire (CLDEQ-8) with cross-cultural adaption and clinical validation among soft contact lens wearers (SCL) in China.
Methods: The translation and adaptation of the Chinese CLDEQ-8 (C-CLDEQ-8) followed a rigorous methodological process based on cross-cultural research guidelines consisting of three main phases: 1) forward and backward translation of original CLDEQ-8 into Chinese, 2) cross-cultural adaptation performed by medical advising committee, and 3) clinical validation and repeatability test of the translated questionnaire on Chinese SCL wearers. Rasch analysis was also performed to investigate the psychometric properties of C-CLDEQ-8.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!