Objective: The fitness to practise of international medical graduates (IMGs) is usually evaluated with standardised assessment tests. Practising doctors should, however, be assessed on their performance rather than their competency, for which reason workplace-based assessment (WBA) has gained increasing attention. Our aim was to assess the composite reliability of WBA instruments for assessing the performance of IMGs.

Design And Setting: Between June 2010 and April 2015, 142 IMGs were assessed by 99 calibrated assessors; each cohort was assessed at their workplace over 6 months. The IMGs completed 970 case-based discussions (CBDs), 1741 Mini-Clinical Examination Exercises (mini-CEX) and 1020 multisource feedback (MSF) sessions.

Participants: 103 male and 39 female candidates based in urban and rural hospitals of the Hunter New England Health region, from 28 countries (Africa, Asia, Europe, South America, South Pacific).

Main Outcome Measures: The reliability of the three WBA tools; the composite reliability of the tools as a group.

Results: The composite reliability of our WBA toolbox program was good: the composite reliability coefficient for five CBDs and 12 mini-CEX was 0.895 (standard error of measurement, 0.138). When the six MSF results were included, the composite reliability coefficient was 0.899 (standard error of measurement, 0.125).

Conclusions: WBA is a reliable method for assessing IMGs when multiple tools and assessors are used over a period of time. This form of assessment meets the criteria for "good assessment" (reliability ≥ 0.8) and can be applied in other settings.

Download full-text PDF

Source
http://dx.doi.org/10.5694/mja16.00069DOI Listing

Publication Analysis

Top Keywords

composite reliability
24
workplace-based assessment
8
international medical
8
medical graduates
8
reliability wba
8
reliability coefficient
8
standard error
8
error measurement
8
reliability
7
composite
6

Similar Publications

This study investigates the geochemical characteristics of rare earth elements (REEs) in highland karstic bauxite deposits located in the Sierra de Bahoruco, Pedernales Province, Dominican Republic. These deposits, formed through intense weathering of volcanic material, represent a potentially valuable REE resource for the nation. Surface and subsurface soil samples were analyzed using portable X-ray fluorescence (pXRF) and a NixPro 2 color sensor validated with inductively coupled plasma optical emission spectrometry (ICP-OES).

View Article and Find Full Text PDF

Response of Differently Structured Dental Polymer-Based Composites to Increasingly Aggressive Aging Conditions.

Nanomaterials (Basel)

January 2025

Department of Conservative Dentistry, University Hospital, Ludwig-Maximilians-University, Goethestr. 70, D-80336 Munich, Germany.

Objective: It is hypothesized that the way nano- and micro-hybrid polymer-based composites are structured and cured impacts the way they respond to aging.

Material And Methods: A polymer-ceramic interpenetrating network composite (Vita Enamic/VE), an industrially polymerized (Brillinat CriosST/BC), and an in situ light-cured composite with discrete inorganic fillers (Admira Fusion5/AF5) were selected. Specimens (308) were either cut from CAD/CAM blocks (VE/BC) or condensed and cured in white polyoxymethylene molds (AF5) and subjected to four different aging conditions ( = 22): (a) 24 h storage in distilled water at 37 °C; (b) 24 h storage in distilled water at 37 °C followed by thermal cycling for 10,000 cycles 5/55 °C (TC); (c) TC followed by storage in a 75% ethanol-water solution; and (d) TC followed by a 3-week demineralization/remineralization cycling.

View Article and Find Full Text PDF

Background: Increasing evidence suggests that a diet rich in antioxidants may prevent erectile dysfunction (ED), but the impact of comprehensive dietary antioxidants on ED has been little studied.

Aim: To investigate the association between the composite dietary antioxidant index (CDAI) and ED risk in adult men.

Methods: The study performed a cross-sectional analysis using data from the 2001-2004 National Health and Nutrition Examination Survey to investigate the association between the composite dietary antioxidant index (CDAI) and ED.

View Article and Find Full Text PDF

The current investigation explores tri-hybrid mediated blood flow through a ciliary annular model, designed to emulate an endoscopic environment. The human circulatory system, driven by the metachronal ciliary waves, is examined in this study to understand how ternary nanoparticles influence wave-like flow dynamics in the presence of interfacial nanolayers. We also analyze the effect of an induced magnetic field on Ag-Cu-/blood flow within the annulus, focusing on thermal radiation, heat sources, buoyancy forces and ciliary motion.

View Article and Find Full Text PDF

Introduction: The venous outflow profile (VOP) is a crucial yet often overlooked aspect affecting stroke outcomes. It plays a major role in the physiopathology of acute cerebral ischemia, as it accounts for both the upstream arterial collaterals and cerebral microperfusion. This enables it to circumvent the limitations of various arterial collateral evaluation systems, which often fail to consider impaired autoregulation and its impact on cerebral blood flow at the microcirculatory levels.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!