A protocol for analyzing repeated measures of online group behavior.

In this article, we feature a novel protocol that enables the analysis of repeated measures of online group behavior. The protocol accounts for (1) the nested hierarchy of the data with weeks nested in persons, and persons nested in weeks, and (2) the temporal nature of the behavior at the early, mid, and late periods of each week. To manage and analyze such data in a general way, we first give an illustration of the data structure.

autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.

In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performance. The app extends current open-source software by providing (1) extensive embedded result narration and summaries for written reports, (2) improved handling of partial credit data via customizable item-person Wright maps, (3) customizable item- and person-flagging systems, (4) item-response theory model constraints and controls, (5) many-facets Rasch analysis to examine item bias, (6) Rasch fixed item equating for mapping student ability across test forms, (7) tabbed spreadsheet outputs and immediate options for secondary data analysis, (8) customizable graphical color schemes, (9) extended ANOVA analysis for examining group differences, and (10) inter-rater reliability analyses for the verifying the consistency of rater scoring systems. We present the app's architecture and functionalities and test its performance with simulated and real-world small-, medium-, and large-scale assessment data.

Engagement and Mentor Support as Drivers of Social Development in the Project K Youth Development Program.

Youth development programs can achieve positive social outcomes, however studies comparing the influence of different program components are rare. Structural equation modeling of longitudinal, multilevel data (N = 327) from Project K, a multi-component youth development program, assessed how experiences of engagement or support in each component affected social outcomes. Participants reported significant gains in social self-efficacy and sense of community after the program.

The Impact of the Project K Youth Development Program on Self-Efficacy: A Randomized Controlled Trial.

A key issue for youth development programs is whether the learning they provide is transferred to participants' daily lives. It is also important that they are effective for the diverse range of participants they attract. This study used a randomized controlled trial design to measure the impact of Project K, a New Zealand-based youth development program, on academic and social self-efficacy.