Objective: To evaluate the inter-rater agreement of the record review process of the Dutch Adverse Event study, which we aimed to improve by the involvement of two independent physician reviewers per record instead of one including a consensus procedure in case of disagreement.
Methods: The inter-rater agreement within pairs of physicians (independent review between physician A+B) and between pairs of physicians (independent review between physician A+B and C+D) was measured to evaluate the record review process with two physicians including a consensus procedure, with 4,272 and 119 records, respectively.
Results: The inter-rater agreement within pairs of physicians was substantial for the determination of adverse events (AEs) with a kappa of 0.64 (95% confidence interval [CI]: 0.61, 0.68). The inter-rater agreement between pairs of physicians was fair for the determination of AEs with a kappa of 0.25 (95% CI: 0.05, 0.45).
Conclusion: A record review process with two physicians per record including a consensus procedure to assess AEs is not more reliable than a record review process with one physician. Retrospective estimates of incidence of AEs from record review studies should be interpreted with caution. Improvement of the method is necessary for monitoring incidence of AEs over time at a national level.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.jclinepi.2009.03.004 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Validity and Reliability of the Videoconference-Based Berg Balance Scale in Stroke Survivors: The Tele-Berg Balance Scale.
J Neurol Phys Ther
December 2024
Department of Physical Therapy, Motor Control Laboratory (LADECOM), Centre of Healthy and Sport Sciences, University of Santa Catarina State, Florianópolis, Santa Catarina, Brazil.
Background And Purpose: Telerehabilitation represents an alternative for individuals who have difficulty accessing services to receive care. Therefore, telerehabilitation measures must be studied for their reliability and validity. This study evaluated the validity and reliability of the videoconference-based Berg Balance Scale assessment in stroke survivors.
View Article and Find Full Text PDFThe Impact of Focused Hip Ultrasound Training on Imaging Quality in Infants With Hip Dysplasia.
Cureus
November 2024
Department of Pediatric Orthopedics and Trauma, Al Jalila Children's Specialty Hospital, Dubai, ARE.
Background: The orthopedic department at Al Jalila Children's Specialty Hospital (AJCH) was opened in April 2018. A focused hip ultrasound training course was conducted in April 2019 to improve hip ultrasound imaging quality.
Objectives: This study aims to evaluate the impact of focused training courses on predefined image quality criteria of infant hip ultrasound in the context of developmental hip dysplasia.
Reliability agreement in foul and penalty judgements between officials in the Swedish hockey league.
Front Sports Act Living
December 2024
Department of Health Sciences, Swedish Winter Sports Research Centre, Mid Sweden University, Östersund, Sweden.
Introduction: Officials are essential in terms of player safety and injury prevention, especially in contact team sports such as ice hockey, where numerous fast pace and high force contacts occur. If against the rules, these collisions can result in penalties. However, there is limited literature on the inter-rater reliability of the officials' decisions.
View Article and Find Full Text PDFBeyond reliability: assessing rater competence when using a behavioural marker system.
Adv Simul (Lond)
December 2024
Medical Education Directorate, NHS Lothian, Edinburgh, UK.
Background: Behavioural marker systems are used across several healthcare disciplines to assess behavioural (non-technical) skills, but rater training is variable, and inter-rater reliability is generally poor. Inter-rater reliability provides data about the tool, but not the competence of individual raters. This study aimed to test the inter-rater reliability of a new behavioural marker system (PhaBS - pharmacists' behavioural skills) with clinically experienced faculty raters and near-peer raters.
View Article and Find Full Text PDFProfiling Communication Ability in Dementia: Validation of a new cognitive-communication assessment tool.
Int J Lang Commun Disord
December 2024
Department of Clinical Speech and Language Studies, Trinity College Dublin, Dublin, Ireland.
Background: Individuals with dementia have communication limitations resulting from cognitive impairments that define the syndrome. Whereas there are numerous cognitive assessments for individuals with dementia, there are far fewer communication assessments. The Profiling Communication Ability in Dementia (P-CAD) was developed to address this gap.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!