Cognitive diagnostic assessment (CDA) is widely used because it can provide refined diagnostic information. The Q-matrix is the basis of CDA, and can be specified by domain experts or by data-driven estimation methods based on observed response data. The data-driven Q-matrix estimation methods have become a research hotspot because of their objectivity, accuracy, and low calibration cost. However, most of the existing data-driven methods require known prior knowledge, such as initial Q-matrix, partial q-vector, or the number of attributes. Under the G-DINA model, we propose to estimate the number of attributes and Q-matrix elements simultaneously without any prior knowledge by the sparse non-negative matrix factorization (SNMF) method, which has the advantage of high scalability and universality. Simulation studies are carried out to investigate the performance of the SNMF. The results under a wide variety of simulation conditions indicate that the SNMF has good performance in the accuracy of attribute number and Q-matrix elements estimation. In addition, a set of real data is taken as an example to illustrate its application. Finally, we discuss the limitations of the current study and directions for future research.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.3758/s13428-024-02442-z | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Priority attribute algorithm for Q-matrix validation: A didactic.
Behav Res Methods
December 2024
Faculty of Psychology, Southwest University, Chongqing, China.
The Q-matrix is one of the core components of cognitive diagnostic assessment, which is a matrix describing the relationship between items and the attributes being assessed. Numerous studies have shown that inaccuracies in defining the Q-matrix can degrade parameter estimation and model fitting results. Currently, Q-matrix validation often involves exhaustive search algorithms (ESA), which traverse through all possible -vectors and determine the optimal -vector for items based on indicators or criteria corresponding to different validation methods.
View Article and Find Full Text PDFCognitive Diagnosis Models in educational measurement are restricted latent class models that describe ability in a knowledge domain as a composite of latent skills an examinee may have mastered or failed. Different combinations of skills define distinct latent proficiency classes to which examinees are assigned based on test performance. Items of cognitively diagnostic assessments are characterized by skill profiles specifying which skills are required for a correct item response.
View Article and Find Full Text PDFRegularized Bayesian algorithms for Q-matrix inference based on saturated cognitive diagnosis modelling.
Br J Math Stat Psychol
November 2024
Faculty of Education, The University of Hong Kong, Hong Kong City, Hong Kong.
Q-matrices are crucial components of cognitive diagnosis models (CDMs), which are used to provide diagnostic information and classify examinees according to their attribute profiles. The absence of an appropriate Q-matrix that correctly reflects item-attribute relationships often limits the widespread use of CDMs. Rather than relying on expert judgment for specification and post-hoc methods for validation, there has been a notable shift towards Q-matrix estimation by adopting Bayesian methods.
View Article and Find Full Text PDFAssessing the Adequacy of Morphological Models using Posterior Predictive Simulations.
Syst Biol
October 2024
GeoZentrum Nordbayern, Department of Geography and Geosciences, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany.
Article Synopsis
- Reconstructing evolutionary history involves using phylogenetic trees and models to understand how life evolved on Earth, incorporating both molecular and morphological data, particularly for extinct organisms.
- The study focuses on the effectiveness of different morphological models, particularly the Mk Lewis model, in analyzing empirical data from tetrapods and reveals that the choice of model can significantly affect results like tree topology and branch lengths.
- Through simulations, the research highlights the importance of using the posterior predictive simulations approach for model selection, while cautioning against relying solely on Bayesian model selection based on marginal likelihoods for varying partition schemes.
An exploratory Q-matrix estimation method based on sparse non-negative matrix factorization.
Behav Res Methods
October 2024
School of Psychology, Jiangxi Nomal University, Nanchang, China.
Cognitive diagnostic assessment (CDA) is widely used because it can provide refined diagnostic information. The Q-matrix is the basis of CDA, and can be specified by domain experts or by data-driven estimation methods based on observed response data. The data-driven Q-matrix estimation methods have become a research hotspot because of their objectivity, accuracy, and low calibration cost.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!