As a core component of most cognitive diagnosis models, the Q-matrix, or item and attribute association matrix, is typically developed by domain experts, and tends to be subjective. It is critical to validate the Q-matrix empirically because a misspecified Q-matrix could result in erroneous attribute estimation. Most existing Q-matrix validation procedures are developed for dichotomous responses. However, in this paper, we propose a method to empirically detect and correct the misspecifications in the Q-matrix for graded response data based on the sequential generalized deterministic inputs, noisy 'and' gate (G-DINA) model. The proposed Q-matrix validation procedure is implemented in a stepwise manner based on the Wald test and an effect size measure. The feasibility of the proposed method is examined using simulation studies. Also, a set of data from the Trends in International Mathematics and Science Study (TIMSS) 2011 mathematics assessment is analysed for illustration.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1111/bmsp.12156 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Post-Processing Kalman Filter Application for Improving Cooperative Awareness Messages' Position Data Accuracy.
Sensors (Basel)
December 2024
CARISSMA Institute of Electric, Connected and Secure Mobility, Technische Hochschule Ingolstadt, Esplanade 10, 85049 Ingolstadt, Germany.
Cooperative intelligent transportation systems continuously send self-referenced data about their current status in the Cooperative Awareness Message (CAM). Each CAM contains the current position of the vehicle based on GPS accuracy, which can have inaccuracies in the meter range. However, a high accuracy of the position data is crucial for many applications, such as electronic toll collection or the reconstruction of traffic accidents.
View Article and Find Full Text PDFPriority attribute algorithm for Q-matrix validation: A didactic.
Behav Res Methods
December 2024
Faculty of Psychology, Southwest University, Chongqing, China.
The Q-matrix is one of the core components of cognitive diagnostic assessment, which is a matrix describing the relationship between items and the attributes being assessed. Numerous studies have shown that inaccuracies in defining the Q-matrix can degrade parameter estimation and model fitting results. Currently, Q-matrix validation often involves exhaustive search algorithms (ESA), which traverse through all possible -vectors and determine the optimal -vector for items based on indicators or criteria corresponding to different validation methods.
View Article and Find Full Text PDFA new Q-matrix validation method based on signal detection theory.
Br J Math Stat Psychol
November 2024
Collaborative Innovation Center of Assessment for Basic Education Quality, Beijing Normal University, Beijing, China.
The Q-matrix is a crucial component of cognitive diagnostic theory and an important basis for the research and practical application of cognitive diagnosis. In practice, the Q-matrix is typically developed by domain experts and may contain some misspecifications, so it needs to be refined using Q-matrix validation methods. Based on signal detection theory, this paper puts forward a new Q-matrix validation method (i.
View Article and Find Full Text PDFCognitive Diagnosis Models in educational measurement are restricted latent class models that describe ability in a knowledge domain as a composite of latent skills an examinee may have mastered or failed. Different combinations of skills define distinct latent proficiency classes to which examinees are assigned based on test performance. Items of cognitively diagnostic assessments are characterized by skill profiles specifying which skills are required for a correct item response.
View Article and Find Full Text PDFRegularized Bayesian algorithms for Q-matrix inference based on saturated cognitive diagnosis modelling.
Br J Math Stat Psychol
November 2024
Faculty of Education, The University of Hong Kong, Hong Kong City, Hong Kong.
Q-matrices are crucial components of cognitive diagnosis models (CDMs), which are used to provide diagnostic information and classify examinees according to their attribute profiles. The absence of an appropriate Q-matrix that correctly reflects item-attribute relationships often limits the widespread use of CDMs. Rather than relying on expert judgment for specification and post-hoc methods for validation, there has been a notable shift towards Q-matrix estimation by adopting Bayesian methods.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!