Background: The UK Department of Health is considering a single, generic multi-source feedback (MSF) questionnaire to inform revalidation.

Method: Evaluation of an implementation pilot, reporting: response rates, assessor mix, question redundancy and participants' perceptions. Reliability was estimated using Generalisability theory.

Results: A total of 12,540 responses were received on 977 doctors. The mean time taken to complete an MSF exercise was 68.2 days. The mean number of responses received per doctor was 12.0 (range 1-17) with no significant difference between specialties. Individual question response rates and participants' comments about questions indicate that some questions are less appropriate for some specialities. There was a significant difference in the mean score between specialities. Despite guidance, there were significant differences in the mix of assessors across specialties. More favourable scores were given by progressively more junior doctors. Nurses gave the most reliable scores.

Conclusions: It is feasible to electronically administer a generic questionnaire to a large population of doctors. Generic content is appropriate for most but not all specialties. The differences in mean scores and the reliability of the MSF between specialties may be in part due to the specialty differences in assessor mix. Therefore the number and assessor mix should be standardised at specialty level and scores should not be compared across specialties.

Download full-text PDF

Source
http://dx.doi.org/10.3109/0142159X.2010.535870DOI Listing

Publication Analysis

Top Keywords

assessor mix
12
single generic
8
generic multi-source
8
multi-source feedback
8
response rates
8
responses received
8
specialties
5
feedback tool
4
tool revalidation
4
revalidation career-grade
4

Similar Publications

Background: This study quantifies the number of observations required to reliably assess the operative competence of Core Surgical Trainees (CSTs) in Ireland, using the Supervised Structured Assessment of Operative Performance (SSAOP) tool.

Methods: SSAOPs (April 2016-February 2021) were analysed across a mix of undifferentiated procedures, as well as for three commonly performed general surgery procedures in CST: appendicectomy, abdominal wall hernia repair, and skin/subcutaneous lesion excision. Generalizability and Decision studies determined the number of observations required to achieve dependability indices ≥0.

View Article and Find Full Text PDF

Daily life with severe mental health (SMI) and cancer comorbidity entails multiple challenges. The study aims to explore everyday life experiences among individuals with SMI and cancer comorbidity from the perspectives of patients, significant others, and involved healthcare professionals. The study is registered in PROSPERO (CRD42021259604).

View Article and Find Full Text PDF

Various biological, social, psychological, and environmental factors impact children and youth living with mental health problems across their lifespan. To meet the wide-ranging challenges of mental illness, service system integration is needed to improve efficiencies and reduce fragmentation. Unfortunately, the mental health system has been plagued by the lack of coordination across services.

View Article and Find Full Text PDF

Background: The assessment of cognitive function in post-acute care (PAC) settings is important for understanding an individual's condition and care needs, developing better person-directed care plans, predicting resource needs and understanding case mix. Therefore, we tested the feasibility and reliability of cognitive function assessments, including the Brief Interview for Mental Status (BIMS), Confusion Assessment Method (CAM©), Expression and Understanding, and Behavioral Signs and Symptoms for patients in PAC under the intent of the IMPACT Act of 2014.

Methods: We conducted a national test of assessments of four standardized cognitive function data elements among patients in PAC.

View Article and Find Full Text PDF

A new cream formulation containing hyaluronic acid 5%, complexed with a mix of a bacterial-wall-derived glycoprotein and peptide glycan complex (EDS), has been recently developed. We evaluated in a prospective, assessor-blinded, 6-week study the efficacy and tolerability of EDS in the treatment of facial seborrheic dermatitis (SD) and the effects on skin microbiota. Seventy-five subjects (mean age 46; 60 men) with moderate-severe SD of the face were enrolled.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!