Publications by authors named "Beth-Ann Cummings"

Performance on medical licensing examinations has been previously shown to be predictive of performance in practice. However, licensing examinations are closed-book and real-world medical practice increasingly requires doctors and patients to consult resources to make evidence-informed decisions. To best assess the ability of physicians and physicians-in-practice to avail themselves of point-of-care clinical resources and tools, open-book components may have an emerging role in high-stakes examinations.

View Article and Find Full Text PDF

Introduction: Current medical education models increasingly rely on longitudinal assessments to document learner progress over time. This longitudinal focus has re-kindled discussion regarding learner handover-where assessments are shared across supervisors, rotations, and educational phases, to support learner growth and ease transitions. The authors explored the opinions of, experiences with, and recommendations for successful implementation of learner handover among clinical supervisors.

View Article and Find Full Text PDF

Purpose: Written examinations such as multiple-choice question (MCQ) exams are a key assessment strategy in health professions education (HPE), frequently used to provide feedback, to determine competency, or for licensure decisions. However, traditional psychometric approaches for monitoring the quality of written exams, defined as items that are discriminant and contribute to increase the overall reliability and validity of the exam scores, usually warrant larger samples than are typically available in HPE contexts. The authors conducted a descriptive exploratory study to document how undergraduate medical education (UME) programs ensure the quality of their written exams, particularly MCQs.

View Article and Find Full Text PDF

Purpose: Educational handover (i.e., providing information about learners' past performance) is controversial.

View Article and Find Full Text PDF

Introduction: In-training assessment reports (ITARs) summarize assessment during a clinical placement to inform decision-making and provide formal feedback to learners. Faculty development is an effective but resource-intensive means of improving the quality of completed ITARs. We examined whether the quality of completed ITARs could be improved by 'nudges' from the format of ITAR forms.

View Article and Find Full Text PDF

Historically, students have been "consumers" of undergraduate medical education (UME) rather than stakeholders in its design and implementation. Student input has been retrospective, and although UME leaders have been open to feedback, matters most important to students have often been overlooked, leaving students feeling largely unheard. Student representation has also lacked structure and unity of feedback.

View Article and Find Full Text PDF

Context: Competency-based medical education has spurred the implementation of longitudinal workplace-based assessment (WBA) programmes to track learners' development of competencies. These hinge on the appropriate use of assessment instruments by assessors. This study aimed to validate our assessment programme and specifically to explore whether assessors' beliefs and behaviours rendered the detection of progress possible.

View Article and Find Full Text PDF

Simulation allows for learner-centered health professions training by providing a safe environment to practice and make mistakes without jeopardizing patient care. It was with this goal in mind that the McGill Medical Simulation Center was officially opened on September 14, 2006, as a partnership between McGill University, the Faculty of Medicine and its affiliated hospitals. Its mandate is to provide state-of-the-art facilities to support simulation-based medical and allied health education initiatives.

View Article and Find Full Text PDF

Introduction: Multiple-choice questions (MCQs) are a cornerstone of assessment in medical education. Monitoring item properties (difficulty and discrimination) are important means of investigating examination quality. However, most item property guidelines were developed for use on large cohorts of examinees; little empirical work has investigated the suitability of applying guidelines to item difficulty and discrimination coefficients estimated for small cohorts, such as those in medical education.

View Article and Find Full Text PDF

Context: Longitudinal integrated clerkships (LICs) represent a model of the structural redesign of clinical education that is growing in the USA, Canada, Australia and South Africa. By contrast with time-limited traditional block rotations, medical students in LICs provide comprehensive care of patients and populations in continuing learning relationships over time and across disciplines and venues. The evidence base for LICs reveals transformational professional and workforce outcomes derived from a number of small institution-specific studies.

View Article and Find Full Text PDF

Context: Over the past few decades, longitudinal integrated clerkships (LICs) have been proposed to address many perceived short-coming of traditional block clerkships. This growing interest in LICs has raised broader questions regarding the role of integration, continuity and longitudinality in medical education. A study with complementary theoretical and empirical dimensions was conducted to derive a more precise way of defining these three underlying concepts within the design of medical education curricula.

View Article and Find Full Text PDF

Background: Many countries have reduced resident duty hours in an effort to promote patient safety and enhance resident quality of life. There are concerns that reducing duty hours may impact residents' learning opportunities.

Objectives: We (1) evaluated residents' perceptions of their current learning opportunities in a context of reduced duty hours, and (2) explored the perceived change in resident learning opportunities after call length was reduced from 24 continuous hours to 16 hours.

View Article and Find Full Text PDF

Longitudinal integrated clerkships (LICs) involve learners spending an extended time in a clinical setting (or a variety of interlinked clinical settings) where their clinical learning opportunities are interwoven through continuities of patient contact and care, continuities of assessment and supervision, and continuities of clinical and cultural learning. Our twelve tips are grounded in the lived experiences of designing, implementing, maintaining, and evaluating LICs, and in the extant literature on LICs. We consider: general issues (anticipated benefits and challenges associated with starting and running an LIC); logistical issues (how long each longitudinal experience should last, where it will take place, the number of learners who can be accommodated); and integration issues (how the LIC interfaces with the rest of the program, and the need for evaluation that aligns with the dynamics of the LIC model).

View Article and Find Full Text PDF