Regularized Bayesian algorithms for Q-matrix inference based on saturated cognitive diagnosis modelling.

Br J Math Stat Psychol

Faculty of Education, The University of Hong Kong, Hong Kong City, Hong Kong.

Published: November 2024

Q-matrices are crucial components of cognitive diagnosis models (CDMs), which are used to provide diagnostic information and classify examinees according to their attribute profiles. The absence of an appropriate Q-matrix that correctly reflects item-attribute relationships often limits the widespread use of CDMs. Rather than relying on expert judgment for specification and post-hoc methods for validation, there has been a notable shift towards Q-matrix estimation by adopting Bayesian methods. Nevertheless, their dependency on Markov chain Monte Carlo (MCMC) estimation requires substantial computational burdens and their exploratory tendency is unscalable to large-scale settings. As a scalable and efficient alternative, this study introduces the partially confirmatory framework within a saturated CDM, where the Q-matrix can be partially defined by experts and partially inferred from data. To address the dual needs of accuracy and efficiency, the proposed framework accommodates two estimation algorithms-an MCMC algorithm and a Variational Bayesian Expectation Maximization (VBEM) algorithm. This dual-channel approach extends the model's applicability across a variety of settings. Based on simulated and real data, the proposed framework demonstrated its robustness in Q-matrix inference.

Download full-text PDF

Source
http://dx.doi.org/10.1111/bmsp.12368DOI Listing

Publication Analysis

Top Keywords

q-matrix inference
8
cognitive diagnosis
8
proposed framework
8
q-matrix
5
regularized bayesian
4
bayesian algorithms
4
algorithms q-matrix
4
inference based
4
based saturated
4
saturated cognitive
4

Similar Publications

Q-matrices are crucial components of cognitive diagnosis models (CDMs), which are used to provide diagnostic information and classify examinees according to their attribute profiles. The absence of an appropriate Q-matrix that correctly reflects item-attribute relationships often limits the widespread use of CDMs. Rather than relying on expert judgment for specification and post-hoc methods for validation, there has been a notable shift towards Q-matrix estimation by adopting Bayesian methods.

View Article and Find Full Text PDF

Sufficient and Necessary Conditions for the Identifiability of DINA Models with Polytomous Responses.

Psychometrika

June 2024

Department of Statistics, University of Michigan, 456 West Hall, 1085 South University, Ann Arbor, 48109, MI, USA.

Article Synopsis
  • Cognitive Diagnosis Models (CDMs) are important tools used to gain detailed insights into respondents' latent traits, especially with the rising popularity of questions with multiple response options.
  • Identifiability is crucial for CDMs to ensure accurate parameter estimation and valid conclusions, but most existing studies focus only on binary response models.
  • This paper fills a gap by outlining the necessary and sufficient conditions for the identifiability of the DINA model when applied to polytomous data, aiding in the understanding and future research of CDMs in this context.
View Article and Find Full Text PDF

Going Deep in Diagnostic Modeling: Deep Cognitive Diagnostic Models (DeepCDMs).

Psychometrika

March 2024

Department of Statistics, Columbia University, Room 928 SSW, 1255 Amsterdam Avenue, New York, NY, 10027, USA.

Cognitive diagnostic models (CDMs) are discrete latent variable models popular in educational and psychological measurement. In this work, motivated by the advantages of deep generative modeling and by identifiability considerations, we propose a new family of DeepCDMs, to hunt for deep discrete diagnostic information. The new class of models enjoys nice properties of identifiability, parsimony, and interpretability.

View Article and Find Full Text PDF

The Qatari population's genetic structure and gene flow as revealed by the Y chromosome.

PLoS One

September 2023

School of Medicine, Faculty of Health, Social Care and Medicine (FHSCM), Edge Hill University, Ormskirk, United Kingdom.

The Y-chromosome has been widely used in forensic genetic applications and human population genetic studies due to its uniparental origins. A large database on the Qatari population was created for comparison with other databases from the Arabian Peninsula, the Middle East, and Africa. We provide a study of 23 Y-STR loci included in PowerPlex Y23 (Promega, USA) that were genotyped to produce haplotypes in 379 unrelated males from Qatar, a country at the crossroads of migration patterns.

View Article and Find Full Text PDF

Diagnostic classification models offer statistical tools to inspect the fined-grained attribute of respondents' strengths and weaknesses. However, the diagnosis accuracy deteriorates when misspecification occurs in the predefined item-attribute relationship, which is encoded into a Q-matrix. To prevent such misspecification, methodologists have recently developed several Bayesian Q-matrix estimation methods for greater estimation flexibility.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!