Background: Competency-based assessment innovations are being implemented to address concerns about the effectiveness of traditional approaches to medical training and the assessment of competence.

Aim: Integrating intended users' perspectives during the piloting and refinement process of an innovation is necessary to ensure the innovation meets users' needs. Failure to do so results in no opportunity for users to influence the innovation, nor for developers to assess why an innovation works or does not work in different contexts.

Methods: A qualitative participatory action research approach was used. Sixteen first-year residents participated in three focus groups and two interviews during piloting. Verbatim transcripts were analyzed individually and then across all transcripts using a constant comparison approach.

Results: The analysis revealed three key characteristics related to the impact on the residents' acceptance of the innovation as being a worthwhile investment of time and effort: access to frequent, timely, and specific feedback from preceptors. Findings were used to refine the innovation further.

Conclusion: This study highlights the necessary conditions for assessing the success of implementation of educational innovations. Reciprocal communication between users and developers is vital. This reflects the approaches recommended in the Ottawa Consensus Statement on research in assessment published in Medical Teacher in March 2011.

Download full-text PDF

Source
http://dx.doi.org/10.3109/0142159X.2012.644828DOI Listing

Publication Analysis

Top Keywords

competency-based assessment
8
innovation
6
involving users
4
users refinement
4
refinement competency-based
4
competency-based achievement
4
achievement system
4
system innovative
4
innovative approach
4
approach competency-based
4

Similar Publications

Background: Health care systems and the nursing profession worldwide are being transformed by technology and digitalization. Nurses acquire digital competence through their own experience in daily practice, but also from education and training; nursing education providers thus play an important role. While nursing education providers have some level of digital competence, there is a need for ongoing training and support for them to develop more advanced skills and effectively integrate technology into their teaching.

View Article and Find Full Text PDF

Background: The purpose of this study was to investigate the effect of word choice on the quality of narrative feedback in ophthalmology resident trainee assessments following the introduction of competency-based medical education at Queen's University.

Methods: Assessment data from July 2017-December 2020 were retrieved from Elentra (Integrated Teaching and Learning Platform) and anonymized. Written feedback was assigned a Quality of Assessment for Learning (QuAL) score out of five based on this previously validated rubric.

View Article and Find Full Text PDF

Transapical beating heart septal myectomy learning curve and training of future surgeons: an observational study.

Int J Surg

December 2024

Division of Cardiovascular Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, People's Republic of China.

Background: Description of the learning curve for transapical beating heart septal myectomy (TA-BSM) helps to understand the potential for wider adaptability. The authors elaborate and examine a competency-based training assessment for TA-BSM that could serve to disseminate septal myectomy expertise.

Materials And Methods: Data on 177 consecutive patients who underwent the TA-BSM for hypertrophic obstructive cardiomyopathy (HOCM) between April 2022 and June 2023 was collected prospectively, which was registered on ClinicalTrials.

View Article and Find Full Text PDF

Background: The COVID-19 pandemic has led to the popularization of information and communication technology in medical education. This study aimed to compare the objective structured clinical examination (OSCE) and the virtual objective structured clinical examination (vOSCE), based on expert opinion, as tools for assessing the competencies needed under medical curriculum guidelines in Brazil.

Methods: In this multicenter study, the suitability levels of the OSCE and vOSCE for assessing the competencies needed under the Brazilian National Curriculum Guidelines (DCNs) were compared.

View Article and Find Full Text PDF

In this introduction, the guest editors of the "Next Era in Assessment" special collection frame the invited papers by envisioning a next era in assessment of medical education, based on ideas developed during a summit that convened professional and educational leaders and scholars. The authors posit that the next era of assessment will focus unambiguously on serving patients and the health of society, reflect its sociocultural context, and support learners' longitudinal growth and development. As such, assessment will be characterized as transformational, development-oriented and socially accountable.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!