Identifying factors associated with instructor implementation of three-dimensional assessment in undergraduate biology courses.

Recent national calls to transform undergraduate science education have centered on engaging students in scientific practices as a means to help them develop deeper insights into science. The three-dimensional framework for science education encapsulates the goals of these national calls by recommending that instructors integrate scientific practices, crosscutting concepts, and disciplinary core ideas throughout their courses. Prior research has found that introductory undergraduate biology exams contain few three-dimensional items suggesting that instructors likely face barriers in meeting the goals of national calls.

Open Resources for Biology Education (ORBE): a resource collection.

In undergraduate life sciences education, open educational resources (OERs) increase accessibility and retention for students, reduce costs, and save instructors time and effort. Despite increasing awareness and utilization of these resources, OERs are not centrally located, and many undergraduate instructors describe challenges in locating relevant materials for use in their classes. To address this challenge, we have designed a resource collection (referred to as Open Resources for Biology Education, ORBE) with 89 unique resources that are primarily relevant to undergraduate life sciences education.

Undergraduate Biology Lecture Courses Predominantly Test Facts about Science Rather than Scientific Practices.

Scientific practices are the skills used to develop scientific knowledge and are essential for careers in science. Despite calls from education and government agencies to cultivate scientific practices, there remains little evidence of how often students are asked to apply them in undergraduate courses. We analyzed exams from biology courses at 100 institutions across the United States and found that only 7% of exam questions addressed a scientific practice and that 32% of biology exams did not test any scientific practices.

How Administration Stakes and Settings Affect Student Behavior and Performance on a Biology Concept Assessment.

Biology instructors use concept assessments in their courses to gauge student understanding of important disciplinary ideas. Instructors can choose to administer concept assessments based on participation (i.e.

Access to Online Formative Assessments in Lower-Division Undergraduate Biology Courses: Investigating Barriers to Student Engagement.

Instructors use a variety of online formative assessment (FA) activities to support learning outside class. Previous studies have revealed barriers for students in online courses, but little is known about the barriers students experience when completing online FA assignments. Understanding these barriers to access is critical to fostering more inclusive learning for all students.

Revisiting Clickers: In-Class Questions Followed by At-Home Reflections Are Associated with Higher Student Performance on Related Exam Questions.

Clicker questions are a commonly used active learning technique that stimulates student interactions to help advance understanding of key concepts. Clicker questions are often administered with an initial vote, peer discussion, and a second vote, followed by broader classroom explanation. While clickers can promote learning, some studies have questioned whether students maintain this performance on later exams, highlighting the need to further understand how student answer patterns relate to their understanding of the material and to identify ways for clickers to benefit a broader range of students.

Am I getting through? Surveying students on what messages they recall from the first day of STEM classes.

Background: The first day of class helps students learn about what to expect from their instructors and courses. Messaging used by instructors, which varies in content and approach on the first day, shapes classroom social dynamics and can affect subsequent learning in a course. Prior work established the non-content Instructor Talk Framework to describe the language that instructors use to create learning environments, but little is known about the extent to which students detect those messages.

GenBio-MAPS as a Case Study to Understand and Address the Effects of Test-Taking Motivation in Low-Stakes Program Assessments.

The General Biology-Measuring Achievement and Progression in Science (GenBio-MAPS) assessment measures student understanding of the core concepts at the beginning, middle, and end of undergraduate biology degree programs. Assessment coordinators typically administer this instrument as a low-stakes assignment for which students receive participation credit. While these conditions can elicit high participation rates, it remains unclear how to best measure and account for potential variation in the amount of effort students give to the assessment.

Teaching Metabolism in Upper-Division Undergraduate Biochemistry Courses using Online Computational Systems and Dynamical Models Improves Student Performance.

Understanding metabolic function requires knowledge of the dynamics, interdependence, and regulation of metabolic networks. However, multiple professional societies have recognized that most undergraduate biochemistry students acquire only a surface-level understanding of metabolism. We hypothesized that guiding students through interactive computer simulations of metabolic systems would increase their ability to recognize how individual interactions between components affect the behavior of a system under different conditions.

Making a First Impression: Exploring What Instructors Do and Say on the First Day of Introductory STEM Courses.

Student impressions formed during the first day of class can impact course satisfaction and performance. Despite its potential importance, little is known about how instructors format the first day of class. Here, we report on observations of the first day of class in 23 introductory science, technology, engineering, and math (STEM) courses.

Innovative teaching knowledge stays with users.

Programs seeking to transform undergraduate science, technology, engineering, and mathematics courses often strive for participating faculty to share their knowledge of innovative teaching practices with other faculty in their home departments. Here, we provide interview, survey, and social network analyses revealing that faculty who use innovative teaching practices preferentially talk to each other, suggesting that greater steps are needed for information about innovative practices to reach faculty more broadly.

Benefits of a College STEM Faculty Development Initiative: Instructors Report Increased and Sustained Implementation of Research-Based Instructional Strategies.

The Summer Institutes on Scientific Teaching (SI) is a faculty development workshop in which science, technology, engineering, and mathematics (STEM) instructors, particularly from biology, are trained in the Scientific Teaching (ST) pedagogy. While participants have generally reported positive experiences, we aimed to assess how the SI affected participants' teaching practices. Building on a previously developed taxonomy of ST practices, we surveyed SI participants from the 2004-2014 SI classes regarding specific ST practices.

Interactive learning modules with 3D printed models improve student understanding of protein structure-function relationships.

Ensuring undergraduate students become proficient in relating protein structure to biological function has important implications. With current two-dimensional (2D) methods of teaching, students frequently develop misconceptions, including that proteins contain a lot of empty space, that bond angles for different amino acids can rotate equally, and that product inhibition is equivalent to allostery. To help students translate 2D images to 3D molecules and assign biochemical meaning to physical structures, we designed three 3D learning modules consisting of interactive activities with 3D printed models for amino acids, proteins, and allosteric regulation with coordinating pre- and post-assessments.

Resources for Teaching and Assessing the Biology Core Concepts.

The report called for the biology community to mobilize around teaching the core concepts of biology. This essay describes a collection of resources developed by several different groups that can be used to respond to the report's call to transform undergraduate education at both the individual course and departmental levels. First, we present two frameworks that help articulate the core concepts, the and the Conceptual Elements (CE) Framework, which can be used in mapping the core concepts onto existing curricula and designing new curricula that teach the biology core concepts.

"What Will I Experience in My College STEM Courses?" An Investigation of Student Predictions about Instructional Practices in Introductory Courses.

The instructional practices used in introductory college courses often differ dramatically from those used in high school courses, and dissatisfaction with these practices is cited by students as a prominent reason for leaving science, technology, engineering, and mathematics (STEM) majors. To better characterize the transition to college course work, we investigated the extent to which incoming expectations of course activities differ based on student demographic characteristics, as well as how these expectations align with what students will experience. We surveyed more than 1500 undergraduate students in large introductory STEM courses at three research-intensive institutions during the first week of classes about their expectations regarding how class time would be spent in their courses.

Tools for Change: Measuring Student Conceptual Understanding Across Undergraduate Biology Programs Using Bio-MAPS Assessments.

Assessing learning across a biology major can help departments monitor achievement of broader program-level goals and identify opportunities for curricular improvement. However, biology departments have lacked suitable tools to measure learning at the program scale. To address this need, we developed four freely available assessments-called Biology-Measuring Achievement and Progression in Science or Bio-MAPS-for general biology, molecular biology, ecology/evolution, and physiology programs.

Student Understanding of DNA Structure-Function Relationships Improves from Using 3D Learning Modules with Dynamic 3D Printed Models.

Understanding the relationship between molecular structure and function represents an important goal of undergraduate life sciences. Although evidence suggests that handling physical models supports gains in student understanding of structure-function relationships, such models have not been widely implemented in biochemistry classrooms. Three-dimensional (3D) printing represents an emerging cost-effective means of producing molecular models to help students investigate structure-function concepts.

GenBio-MAPS: A Programmatic Assessment to Measure Student Understanding of Vision and Change Core Concepts across General Biology Programs.

The Vision and Change report provides a nationally agreed upon framework of core concepts that undergraduate biology students should master by graduation. While identifying these concepts was an important first step, departments also need ways to measure the extent to which students understand these concepts. Here, we present the General Biology-Measuring Achievement and Progression in Science (GenBio-MAPS) assessment as a tool to measure student understanding of the core concepts at key time points in a biology degree program.

Student, instructor, and observer agreement regarding frequencies of scientific teaching practices using the Measurement Instrument for Scientific Teaching-Observable (MISTO).

Background: The Scientific Teaching (ST) pedagogical framework encompasses many of the best practices recommended in the literature and highlighted in national reports. Understanding the growth and impact of ST requires instruments to accurately measure the extent to which practitioners implement ST in their courses. Researchers have typically relied on students, instructors, or observers to document course teaching practices, but it remains unclear whether and how these perspectives differ from each other.

Phys-MAPS: a programmatic physiology assessment for introductory and advanced undergraduates.

We describe the development of a new, freely available, online, programmatic-level assessment tool, Measuring Achievement and Progress in Science in Physiology, or Phys-MAPS ( http://cperl.lassp.cornell.

EcoEvo-MAPS: An Ecology and Evolution Assessment for Introductory through Advanced Undergraduates.

A new assessment tool, Ecology and Evolution-Measuring Achievement and Progression in Science or EcoEvo-MAPS, measures student thinking in ecology and evolution during an undergraduate course of study. EcoEvo-MAPS targets foundational concepts in ecology and evolution and uses a novel approach that asks students to evaluate a series of predictions, conclusions, or interpretations as likely or unlikely to be true given a specific scenario. We collected evidence of validity and reliability for EcoEvo-MAPS through an iterative process of faculty review, student interviews, and analyses of assessment data from more than 3000 students at 34 associate's-, bachelor's-, master's-, and doctoral-granting institutions.

Measurement Instrument for Scientific Teaching (MIST): A Tool to Measure the Frequencies of Research-Based Teaching Practices in Undergraduate Science Courses.

The Scientific Teaching (ST) pedagogical framework provides various approaches for science instructors to teach in a way that more closely emulates how science is practiced by actively and inclusively engaging students in their own learning and by making instructional decisions based on student performance data. Fully understanding the impact of ST requires having mechanisms to quantify its implementation. While many useful instruments exist to document teaching practices, these instruments only partially align with the range of practices specified by ST, as described in a recently published taxonomy.

Student Buy-In Toward Formative Assessments: The Influence of Student Factors and Importance for Course Success.

Formative assessment (FA) techniques, such as pre-class assignments, in-class activities, and post-class homework, have been shown to improve student learning. While many students find these techniques beneficial, some students may not understand how they support learning or may resist their implementation. Improving our understanding of FA buy-in has important implications, since buy-in can potentially affect whether students fully engage with and learn from FAs.

First-Year and Non-First-Year Student Expectations Regarding In-Class and Out-of-Class Learning Activities in Introductory Biology.

National calls for teaching transformation build on a constructivist learning theory and propose that students learn by actively engaging in course activities and interacting with other students. While interactive pedagogies can improve learning, they also have the potential to challenge traditional norms regarding class participation and learning strategies. To better understand the potential openness of students to interactive teaching practices, we administered a survey during the first week of two sections of an introductory biology course to characterize how students envisioned spending time during class as well as what activities they expected to complete outside of class during non-exam weeks and in preparation for exams.