Specificity-enhanced reliability coefficients.

Psychol Methods

Departments of Psychology and Statistics, University of California.

Published: September 2017

Internal consistency reliability coefficients based on classical test theory, such as α, ω, λ₄, model-based ρ, and the greatest lower bound ρ, are computed as ratios of estimated common variance to total variance. They omit specific variance. As a result they are downward-biased and may fail to predict external criteria (McCrae et al., 2011). Some approaches for incorporating specific variance into reliability estimates are proposed and illustrated. The resulting specificity-enhanced coefficients α, ω, λ₄, ρ and ρ provide improved estimands of reliability and thus may be worth reporting in addition to their classical counterparts. The correction for attenuation, Spearman-Brown, and maximal reliability formulas also are extended to allow specificity. Limitations, future work, and implications are discussed, including the role of specificity to quantify the extent to which items represent important facets or nuances (McCrae, 2015) of content. (PsycINFO Database Record

Download full-text PDF

Source
http://dx.doi.org/10.1037/met0000092DOI Listing

Publication Analysis

Top Keywords

reliability coefficients
8
specific variance
8
specificity-enhanced reliability
4
coefficients internal
4
internal consistency
4
reliability
4
consistency reliability
4
coefficients based
4
based classical
4
classical test
4

Similar Publications

The social determinants of health (SDOH) have been recognized as an important contributor to an individual's health status. A valid and reliable instrument is needed for researchers and clinicians to measure SDOH. However, there is considerable variability in the screening methodologies, as well as a lack of standardization in definitions and methods for capturing and reporting SDOH data for both electronic health record software vendors and national experts on SDOH.

View Article and Find Full Text PDF

Background And Purpose: To develop a new test to assess the motor coordination of the upper limbs, and to investigate the test-retest and inter-rater reliability, construct validity, standard error of measurement (SEM), minimum detectable change (MDC), and the reference values.

Methods: The Upper Extremity Motor Coordination Test (UEMOCOT)was applied for 20 s, with the individual touching two targets (one right and one left) as quickly as possible, first with the hand (manual task) and then with the index finger (finger task). To test-retest reliability, the UEMOCOT was administered two times.

View Article and Find Full Text PDF

Apparent diffusion coefficient and magnetic resonance imaging characteristics in predicting response to radiosurgery in patients with vestibular schwannomas.

Neuroradiol J

January 2025

Division of Diagnostic Radiology, Department of Radiology, Faculty of Medicine, Chulalongkorn University, King Chulalongkorn Memorial Hospital, The Thai Red Cross Society, Bangkok, Thailand.

Objective: Predicting treatment response in patients with vestibular schwannomas (VSs) remains challenging. This study aimed to evaluate the use of pre-treatment normalized apparent diffusion coefficient (nADC) values and magnetic resonance (MR) imaging characteristics in predicting treatment outcomes in patients with VSs undergoing radiosurgery.

Methods: The MR images of 44 patients with VSs who underwent radiosurgery at our institution were retrospectively reviewed, and the patients were categorized into tumor control ( = 28) and progression ( = 16) groups based on treatment response after treatment initiation, with a median follow-up duration of 29.

View Article and Find Full Text PDF

Purpose: Reliable image quality assessment is crucial for evaluating new motion correction methods for magnetic resonance imaging. In this work, we compare the performance of commonly used reference-based and reference-free image quality metrics on a unique dataset with real motion artifacts. We further analyze the image quality metrics' robustness to typical pre-processing techniques.

View Article and Find Full Text PDF

[Purpose] This study aimed to investigate the reliability and validity of measuring isometric ankle plantar flexion strength using a handheld dynamometer (HHD) with a belt and metal plate. [Participants and Methods] This study enrolled 35 young healthy participants (22 men and 13 women, mean age; 21.2 years).

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!