AI Article Synopsis
- The paper examines how reliable measures operate in nested designs, where groups (like students) are linked to higher levels (like teachers), using item response theory.
- A simulation study looked at various factors affecting reliability measures, such as number of groups, group sizes, and test lengths, while testing different model setups.
- The findings suggest that using MMLE-multiple imputation for calculating reliability is generally the best choice, especially with specific conditions on clusters and items, and the paper also offers guidelines for reporting these reliability measures effectively.
Article Abstract
This paper evaluated multilevel reliability measures in two-level nested designs (e.g., students nested within teachers) within an item response theory framework. A simulation study was implemented to investigate the behavior of the multilevel reliability measures and the uncertainty associated with the measures in various multilevel designs regarding the number of clusters, cluster sizes, and intraclass correlations (ICCs), and in different test lengths, for two parameterizations of multilevel item response models with separate item discriminations or the same item discrimination over levels. Marginal maximum likelihood estimation (MMLE)-multiple imputation and Bayesian analysis were employed to evaluate the accuracy of the multilevel reliability measures and the empirical coverage rates of Monte Carlo (MC) confidence or credible intervals. Considering the accuracy of the multilevel reliability measures and the empirical coverage rate of the intervals, the results lead us to generally recommend MMLE-multiple imputation. In the model with separate item discriminations over levels, marginally acceptable accuracy of the multilevel reliability measures and empirical coverage rate of the MC confidence intervals were found in a limited condition, 200 clusters, 30 cluster size, .2 ICC, and 40 items, in MMLE-multiple imputation. In the model with the same item discrimination over levels, the accuracy of the multilevel reliability measures and the empirical coverage rate of the MC confidence intervals were acceptable in all multilevel designs we considered with 40 items under MMLE-multiple imputation. We discuss these findings and provide guidelines for reporting multilevel reliability measures.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1080/00273171.2019.1596780 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Attention activation network for bearing fault diagnosis under various noise environments.
Sci Rep
January 2025
School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, China.
Bearings are critical in mechanical systems, as their health impacts system reliability. Proactive monitoring and diagnosing of bearing faults can prevent significant safety issues. Among various diagnostic methods that analyze bearing vibration signals, deep learning is notably effective.
View Article and Find Full Text PDFAn optimized public opinion communication system in social media networks based on K-means cluster analysis.
Heliyon
December 2024
Xinxiang Medical University, Xinxiang, 453000, China.
This study proposes a public opinion monitoring model that combines the K-means clustering algorithm with Particle Swarm Optimization (PSO) to enhance the accuracy and effectiveness of public opinion monitoring on social media. The model's performance across various dissemination indicators is studied in detail. Through experiments conducted on social media datasets, the study comprehensively evaluates the model from four dimensions: dissemination speed, scope, depth, and sentiment dissemination effectiveness.
View Article and Find Full Text PDFA novel and efficient digital image steganography technique using least significant bit substitution.
Sci Rep
January 2025
Universidad Europea del Atlántico. Isabel Torres 21, Santander, 39011, Spain.
Steganography is used to hide sensitive types of data including images, audio, text, and videos in an invisible way so that no one can detect it. Image-based steganography is a technique that uses images as a cover media for hiding and transmitting sensitive information over the internet. However, image-based steganography is a challenging task due to transparency, security, computational efficiency, tamper protection, payload, etc.
View Article and Find Full Text PDFPercolation theory-based KMC simulation for scaled Fe-FET based multi-bit computing-in-memory with temperature compensation strategy.
Nanotechnology
January 2025
Chinese Academy of Sciences, Institute of Microelectronics, No.3, Beitucheng West Road, Chaoyang District, beijing, 100029, CHINA.
In this letter, we investigated the impact of percolation transport mechanisms on ferroelectric field effect transistor (FeFET) multi-value storage with Kinetic Monte-Carlo (KMC) simulation considering aspect ratio and temperature dependencies. It is found that the portion of the ferroelectric polarization, which dominated the threshold voltage shift of the FeFET, increases when aspect ratio of device decreases. Moreover, randomness of percolation path formation and variations of equivalent conductance can be suppressed, indicating mitigation of device-to-device variations and enhancement of separation of individual states.
View Article and Find Full Text PDF[A new validated ophthalmic patient questionnaire for cataract and lens surgery : CLOQ: cataract and lens ophthalmic questionnaire].
Ophthalmologie
December 2024
Ludwig-Maximilians-Universität München (LMU), München, Deutschland.
Background: The new patient cataract and lens ophthalmic questionnaire (CLOQ) determines subjective patient satisfaction before and after cataract surgery according to item response theory (IRT).
Methods: A total of 317 patients with bilateral cataract surgery and implantation of different intraocular lens (IOL) types were included. The questionnaire (37 questions) is divided into questions on visual acuity-relevant quality of life (VRQoL), quality of vision (QoV), spectacle dependence, and general satisfaction.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!