Background: A Urological Pathology External Quality Assurance (EQA) Scheme in the UK has reported observer variation in the diagnosis and grading of adenocarcinoma in prostatic biopsies using basic κ statistics, which rate all disagreements equally.
Aim: The aim of this study is to use customised weighting schemes to report κ statistics that reflect the closeness of interobserver agreement in the prostate EQA scheme.
Methods: A total of 83, 114 and 116 pathologists took part, respectively, in three web-based circulations and were classified as either expert or other readers. For analyses of diagnosis, there were 10, 8 and 8 cases in the three circulations, respectively. For analyses of Gleason Sum Score, only invasive cases were included, leaving 5, 5 and 6 cases, respectively. Analyses were conducted using customised weighting schemes with 'pairwise-weighted' κ for multiple readers.
Results: Analysis of diagnosis for all circulations and all readers gave a composite κ value of 0.86 and pairwise-weighted κ (κ(p-w)) value of 0.91, both regarded as 'almost perfect' agreement. This was due to the high proportion of responses that showed partial agreement. Analysis of Gleason Sum Score gave κ=0.38 and κ(p-w)=0.58 over all circulations and all readers, indicating that discrepancies occur at the boundary between adjacent grades and may not be as clinically significant as suggested by composite κ.
Conclusion: Weighted κ show higher levels of agreement than previously reported as they have the advantage of applying weighting, which reflects the relative importance of different types of discordance in diagnosis or grading. Agreement on grading remained low.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1136/jclinpath-2011-200229 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Comparative analysis of allowable total error specifications for coagulation factor assays utilizing China National External quality assessment scheme data and biological variation data.
Clin Chim Acta
January 2025
National Center for Clinical Laboratories, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing Hospital/ National Center of Gerontology, PR China. Electronic address:
Background: It is necessary and challenging to establish reasonable and feasible total error specifications for coagulation factor assays for quality control and assessment. The aim of this study is to establish new total error specifications for coagulation factor assays by combining External Quality Assessment data with reliable biological variation data.
Methods: Data from China National External Quality Assessment Scheme (28,408 results from 1,381 laboratories) were analyzed, stratifying External Quality Assessment data by reference intervals to establish concentration-dependent total error specifications.
Behind the scenes of EQA-characteristics, capabilities, benefits and assets of external quality assessment (EQA).
Clin Chem Lab Med
January 2025
Canadian Microbiology Proficiency Testing Program (CMPT), Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
The main stakeholders in external quality assessment (EQA) programs are the participants, in whose interests these challenges are ultimately organised. EQA schemes in the medical field contribute to improving the quality of patient care by evaluating the analytical and diagnostic quality of laboratory and point-of-care tests (POCT) by independent third parties and, if necessary, pointing out erroneous measurement results and analytical or diagnostic improvement potential. Other benefits include the option of using EQA samples for other important laboratory procedures, such as the verification or validation of diagnostic medical devices (IVD-MDs), a contribution to the estimation of measurement uncertainty, a means of training and educating laboratory staff through educational EQA programmes or samples, or even for independent and documented monitoring of staff competence, such as on samples with unusual or even exceptional characteristics.
View Article and Find Full Text PDFBehind the scenes of EQA - characteristics, capabilities, benefits and assets of external quality assessment (EQA).
Clin Chem Lab Med
January 2025
Department of Pathology and Laboratory Medicine, Canadian Microbiology Proficiency Testing Program (CMPT), University of British Columbia, Vancouver, Canada.
This is the first in a series of five papers that detail the role and substantial impact that external quality assessment (EQA) and their providers' services play in ensuring diagnostic (IVD) performance quality. The aim is to give readers and users of EQA services an insight into the processes in EQA, explain to them what happens before EQA samples are delivered and after examination results are submitted to the provider, how they are assessed, what benefits participants can expect, but also who are stakeholders other than participants and what significance do EQA data and assessment results have for them. This first paper presents the history of EQA, insights into legal, financing and ethical matters, information technology used in EQA, structure and lifecycle of EQA programs, frequency and intensity of challenges, and unique requirements of extra-examination and educational EQA programs.
View Article and Find Full Text PDFBehind the scenes of EQA - characteristics, capabilities, benefits and assets of external quality assessment (EQA).
Clin Chem Lab Med
January 2025
Department of Pathology and Laboratory Medicine, Canadian Microbiology Proficiency Testing Program (CMPT), University of British Columbia, Vancouver, Canada.
External quality assessment (EQA) cycles are the smallest complete units within EQA programs that laboratories can use to obtain external assessments of their performance. In each cycle, several samples are distributed to the laboratories registered for participation, and ideally, EQA programs not only cover the examination procedures but also the pre- and post-examination procedures. The properties and concentration range of measurands in individual samples are selected with regard to the intended challenge for the participants so that each sample fulfils its purpose.
View Article and Find Full Text PDFBehind the scenes of EQA - characteristics, capabilities, benefits and assets of external quality assessment (EQA).
Clin Chem Lab Med
January 2025
Canadian Microbiology Proficiency Testing Program (CMPT), Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, Canada.
External quality assessment (EQA) enhances patient safety through the evaluation of the quality of laboratory-based and point of care testing. Regulatory agencies and accreditation organizations utilize the results and the laboratory's response to them as part of assessing the laboratory's fitness to practice. In addition, where EQA samples are commutable and the assigned value has been determined using reference measurement procedures (RMPs), EQA data contributes to the verification of metrological traceability of assays as part of the post-market surveillance of diagnostic (IVD) medical devices (IVD-MDs).
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!