Does Instruction Affect the Underlying Dimensionality of a Kinesiology Test?

Does effective instruction, which changes students' knowledge and possibly alters their cognitive functions, also affect the dimensionality of an achievement test? This question was examined by the parameterization of kinesiology test items (n = 42) with a Rasch dichotomous model, followed by an investigation of dimensionality in a pre- and post-test quasi-experimental study design. College students (n = 108) provided responses to kinesiology achievement test items. Then the stability of item difficulties, gender differences, and the interaction of item content categories with dimensionality were examined.

Automatic item generation implemented for measuring artistic judgment aptitude.

Automatic item generation (AIG) is a broad class of methods that are being developed to address psychometric issues arising from internet and computer-based testing. In general, issues emphasize efficiency, validity, and diagnostic usefulness of large scale mental testing. Rapid prominence of AIG methods and their implicit perspective on mental testing is bringing painful scrutiny to many sacred psychometric assumptions.

An external validation study of a classification of mixed connective tissue disease and systemic lupus erythematosus patients.

Mixed Connective Tissue Disease (MCTD) and Systemic Lupus Erythematosus (SLE) are autoimmune rheumatic diseases that are difficult for physicians to diagnose and to distinguish for a variety of reasons. The correct classification of these two diseases is a crucial issue for clinicians who treat autoimmune rheumatic diseases. In prior research, medical risk factors represented by instrument or laboratory measures and physician judgments (12 key features for MCTD and 12 key features for SLE) were parameterized with a one parameter logistic function in a Rasch model.

Multi-factor scale consolidation when theory is weak.

As a practical matter, Spirituality and Quality of Life in the health sciences are usually measured separately. Theoretical foundations for this distinction, however, are not strong. In this research, an empirical investigation was conducted into their joint calibration with a Rasch model.

Measurement of mothers' confidence to care for children assisted with tracheostomy technology in family homes.

The purpose of this research was to develop an objective, linear measure of mothers' confidence to care for children assisted with tracheostomy medical technology in their homes. Caregiver confidence is addressed in this research for three technologies, namely, a) trachesotomy, b) tracheostomy and ventilator, and c) BiPAP/CPAP although detailed measurement results are only reported for tracheostomy, and its co-calibration with tracheostomy and ventilator caregiving items. The sample consisted of 53 mothers responding to several caregiver questionnaires based on a caregiving task matrix after content and clinical validation.

An ADL measure for spinal cord injury.

Occupational therapists do not have a comprehensive, objective method for measuring how persons with tetraplegia perform activities of daily living (ADL) in their homes and communities, because SCI ADL performance is usually determined in rehabilitation. The ADL Habits Survey (ADLHS) is designed specifically to address this knowledge gap by surveying performance on relevant and meaningful activities in homes and communities. After a comprehensive task analysis and pilot development, 30 activities were selected that emphasize a broad range of hand and wrist, reaching, and grasping movements in compound activities.

Foreword: emergence of efficiency in health outcome measurement.

Psychosocial measurement in the 21st Century is a dynamic field that is addressing challenges unthinkable even a generation ago. Sophisticated methods and modern technology has brought psychometrics to the cusp of scientific objectivity. This Foreword provides historical context and intellectual foundations for appreciating contemporary psychometric advancements, as well as a perspective on issues that are determining future advances.

A Rasch analysis for classification of systemic lupus erythematosus and mixed connective tissue disease.

The classification of rheumatic diseases is challenging because these diseases have protean and frequently overlapping clinical and laboratory manifestations. This problem is typified by the difficulty of classification and differentiation of two prototypic multi-system autoimmune diseases, Systemic Lupus Erythematosus (SLE) and Mixed Connective Tissue Disease (MCTD). The researchers submitted medical risk factor data represented by instrument or laboratory measures and physician judgments (12 key features for SLE) from 43 patients diagnosed with SLE and 12 key features for MCTD from 51 patients diagnosed with MCTD to the WINSTEPS Rasch analysis program.

Substance use disorder symptoms: evidence of differential item functioning by age.

This study examined the applicability of substance abuse diagnostic criteria for adolescents, young adults, and adults using the Global Appraisal of Individual Need's Substance Problems Scale (SPS) from 7,408 clients. Rasch analysis was used to: 1) evaluate whether the SPS operationalized a single reliable dimension, and 2) examine the extent to which the severity of each symptom and the overall test functioned the same or differently by age. Rasch analysis indicated that the SPS was unidimensional with a person reliability of .

Nonequivalent survey consolidation: an example from functional caregiving.

Functional Caregiving (FC) is a construct about mothers caring for children (both old and young) with intellectual disabilities, which is operationally defined by two nonequivalent survey forms, urban and suburban, respectively. The purposes of this research are, first, to generalize school-based achievement test principles to survey methods by equating two nonequivalent survey forms. A second purpose is to expand FC foundations by a) establishing linear measurement properties for new caregiving items, b) replicate a hierarchical item structure across an urban, school-based population, c) consolidate survey forms to establish a calibrated item bank, and d) collect more external construct validity data.

Relative precision, efficiency and construct validity of different starting and stopping rules for a computerized adaptive test: the GAIN substance problem scale.

Substance abuse treatment programs are being pressed to measure and make clinical decisions more efficiently about an increasing array of problems. This computerized adaptive testing (CAT) simulation examined the relative efficiency, precision and construct validity of different starting and stopping rules used to shorten the Global Appraisal of Individual Needs' (GAIN) Substance Problem Scale (SPS) and facilitate diagnosis based on it. Data came from 1,048 adolescents and adults referred to substance abuse treatment centers in 5 sites.

Rasch analysis of a new construct: functional caregiving for adult children with intellectual disabilities.

This research examined empirical evidence for a new construct, Functional Caregiving, which is a theory about mothers' caregiving of their adult children with intellectual disabilities. A sample of 108 biological mothers and primary caregivers rated survey items about their confidence to perform caregiving tasks. Rasch rating scale analysis found 61 items defined an empirical construct with three caregiving levels: Advocacy, Personal Caregiving, and Community.

Breakthrough measuring neighborhoods.

An empirical strategy is presented for transforming ordinal counts and percentages to interval scale measures by recoding them as ordered categories and estimating Rasch model rating scale parameters. This strategy is demonstrated for a neighborhood construct socioeconomic disadvantage operationally defined by eight characteristics of Chicago neighborhoods (N = 77). Results show surprisingly sound model fit and satisfactory scale invariance between 1980 and 1990 census.

A multi-factor Rasch scale for artistic judgment.

Measurement properties are reported for a combined scale of abstract and figurative artistic judgment aptitude items. Abstract items are synthetic, rule-based images from Visual Designs Test which implements a statistical algorithm to control design complexity and redundancy, and figurative items are canvas paintings in five styles, Fauvism, Post-Impressionism, Surrealism, Renaissance, and Baroque especially created for this research. The paintings integrate syntactic structure from VDT Abstract designs with thematic content for each style at four levels of complexity while controlling redundancy.