Evaluating a National Biomedical Training Program Using QuantCrit: Revealing Disparities in Research Self-efficacy for Women of Color Undergraduates.

Program evaluation for interventions aimed at enhancing diversity can fall short when the evaluation unintentionally reifies the exclusion of multiple marginalized student experiences. The present study presents a Quantitative Critical Race Theory (QuantCrit) approach to program evaluation to understand outcomes for Women of Color undergraduates involved in a national biomedical training program called the Building Infrastructure Leading to Diversity (BUILD) initiative. Using longitudinal data, we examined the impact of participation in the BUILD Scholars programs and BUILD-developed novel biomedical curriculum on undergraduate's research self-efficacy.

Measuring Faculty Mentoring Competency: Establishing the Validity of a Short Form.

This paper describes the procedures for evaluating the psychometric properties of the 26-item Mentoring Competency Assessment (MCA) scale and developing short-forms to measure faculty mentoring outcomes for the NIH-funded Building Infrastructure Leading to Diversity (BUILD) Initiative and National Research Mentoring Network (NRMN). Analyses were conducted using responses to the MCA scale from NRMN mentors and faculty across 11 BUILD institutions in the 2017-18 academic year. After performing extensive item factor analyses and taking the MCA sub-constructs into analytical consideration, we created an 8-item short form and a 14-item short form.

BUILDing Engaged Mentors: Examining the Efficacy of BUILD-led Mentor Training.

The practice of mentorship is a critical focus in science, technology, engineering, mathematics, and medicine (STEMM) disciplines. This quasi-experimental study investigated the efficacy of undergraduate mentor training in biomedical sciences programs in the NIH-funded Building Infrastructure Leading to Diversity (BUILD) initiative comprised of research-rising institutions. We used data from the Higher Education Research Institute's Faculty Survey (2016-17 and 2019-20).

Gauging treatment impact: The development of exposure variables in a large-scale evaluation study.

While guidance on how to design rigorous evaluation studies abounds, prescriptive guidance on how to include critical process and context measures through the construction of exposure variables is lacking. Capturing nuanced intervention dosage information within a large-scale evaluation is particularly complex. The Building Infrastructure Leading to Diversity (BUILD) initiative is part of the Diversity Program Consortium, which is funded by the National Institutes of Health.

Understanding the context and appreciating the complexity of evaluating the Diversity Program Consortium.

The National Institutes of Health (NIH) made a sizeable investment in developing a scientific approach to understanding how to best increase diversity in the NIH-funded workforce by fostering inclusive excellence at a national scale through the Diversity Program Consortium (DPC). This chapter provides an overview of the context in which the consortium-wide evaluation study has taken place to provide readers with an understanding of its level of complexity. This evaluation effort is the first large-scale, national, systemic, longitudinal evaluation of harmonized interventions focused on undergraduate biomedical research training programs in the history of the NIH and the National Institute of General Medical Sciences.

Development of the Self-Efficacy as Faculty Change Agent for Diversity (SE-FCA-D) Scale.

Thispublicationprovides an overview of the development of the Self-Efficacy as Faculty Change Agent/or Diversity (SE-FCA-D) scale. The 5-item scale recently appeared as an additional module on the Higher Education and Research Institute (HERi) Faculty Survey 2019-2020 for the JO BUILD programs within the Diversity Program Consortium that areparticipating in the Enhance Diversity Study, supported by the National Institutes of Health (NIH U54GMI 19024). Thepiloted scale is meant to measure DPC Hallmark of Success FAC-16: "Strong self-efficacy to act as a change agent to enhance diversity in biomedical research and research training environments" (DPC, 2019).

Baseline Characteristics of the 2015-2019 First Year Student Cohorts of the NIH Building Infrastructure Leading to Diversity (BUILD) Program.

Objective: The biomedical/behavioral sciences lag in the recruitment and advancement of students from historically underrepresented backgrounds. In 2014 the NIH created the Diversity Program Consortium (DPC), a prospective, multi-site study comprising 10 Building Infrastructure Leading to Diversity (BUILD) institutional grantees, the National Research Mentoring Network (NRMN) and a Coordination and Evaluation Center (CEC). This article describes baseline characteristics of four incoming, first-year student cohorts at the primary BUILD institutions who completed the Higher Education Research Institute, The Freshmen Survey between 2015-2019.

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

Background: The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites.

A participatory approach to evaluating a national training and institutional change initiative: the BUILD longitudinal evaluation.

Background And Purpose: The National Institutes of Health (NIH) funds training programs to increase the numbers and skills of scientists who obtain NIH research grants, but few programs have been rigorously evaluated. The sizeable recent NIH investment in developing programs to increase the diversity of the NIH-funded workforce, implemented through the Diversity Program Consortium (DPC), is unusual in that it also funds a Consortium-wide evaluation plan, which spans the activities of the 10 BUilding Infrastructure Leading to Diversity (BUILD) awardees and the National Research Mentoring Network (NRMN). The purpose of this article is to describe the evaluation design and innovations of the BUILD Program on students, faculty, and institutions of the 10 primarily undergraduate BUILD sites.

BUILDing BLaST: promoting rural students' biomedical research careers using a culturally responsive, one health approach.

Background And Purpose: Most postsecondary institutions in the state of Alaska (USA) have a broad mission to serve diverse students, many of whom come from schools in rural villages that are accessible only by plane, boat, or snowmobile. The major research university, the University of Alaska in Fairbanks (UAF), serves a population whereby 40% are from groups recognized as underrepresented in the biomedical workforce. The purpose of this article is to describe the Building Infrastructure Leading to Diversity (BUILD)-supported program in the state of Alaska that seeks to engage students from rural areas with a culturally relevant approach that is centered on the One Health paradigm, integrating human, animal, and environmental health.