International Test Commission guidelines for test adaptation: A criterion checklist.

Background: To improve the quality of test translation and adaptation, and hence the comparability of scores across cultures, the International Test Commission (ITC) proposed a number of guidelines for the adaptation process. Although these guidelines are well-known, they are not implemented as often as they should be. One possible reason for this is the broad scope of the guidelines, which makes them difficult to apply in practice.

Profiles of Mathematics Anxiety Among 15-Year-Old Students: A Cross-Cultural Study Using Multi-Group Latent Profile Analysis.

Using PISA 2012 data, the present study explored profiles of mathematics anxiety (MA) among 15-year old students from Finland, Korea, and the United States to determine the similarities and differences of MA across the three national samples by applying a multi-group latent profile analysis (LPA). The major findings were that (a) three MA profiles were found in all three national samples, i.e.

Detecting Item Preknowledge Using a Predictive Checking Method.

Repeatedly using items in high-stake testing programs provides a chance for test takers to have knowledge of particular items in advance of test administrations. A predictive checking method is proposed to detect whether a person uses preknowledge on repeatedly used items (i.e.

The Effect of Rating Unfamiliar Items on Angoff Passing Scores.

The Angoff standard setting method relies on content experts to review exam items and make judgments about the performance of the minimally proficient examinee. Unfortunately, at times content experts may have gaps in their understanding of specific exam content. These gaps are particularly likely to occur when the content domain is broad and/or highly technical, or when non-expert stakeholders are included in a standard setting panel (e.

Comparative Analyses of MIRT Models and Software (BMIRT and flexMIRT).

Application of MIRT modeling procedures is dependent on the quality of parameter estimates provided by the estimation software and techniques used. This study investigated model parameter recovery of two popular MIRT packages, BMIRT and flexMIRT, under some common measurement conditions. These packages were specifically selected to investigate the model parameter recovery of three item parameter estimation techniques, namely, Bock-Aitkin EM (BA-EM), Markov chain Monte Carlo (MCMC), and Metropolis-Hastings Robbins-Monro (MH-RM) algorithms.

Practical Consequences of Item Response Theory Model Misfit in the Context of Test Equating with Mixed-Format Test Data.

In item response theory (IRT) models, assessing model-data fit is an essential step in IRT calibration. While no general agreement has ever been reached on the best methods or approaches to use for detecting misfit, perhaps the more important comment based upon the research findings is that rarely does the research evaluate IRT misfit by focusing on the practical consequences of misfit. The study investigated the practical consequences of IRT model misfit in examining the equating performance and the classification of examinees into performance categories in a simulation study that mimics a typical large-scale statewide assessment program with mixed-format test data.

Tracking functional status across the spinal cord injury lifespan: linking pediatric and adult patient-reported outcome scores.

Objective: To use item response theory (IRT) methods to link scores from 2 recently developed contemporary functional outcome measures, the adult Spinal Cord Injury-Functional Index (SCI-FI) and the Pedi SCI (both the parent version and the child version).

Design: Secondary data analysis of the physical functioning items of the adult SCI-FI and the Pedi SCI instruments. We used a nonequivalent group design with items common to both instruments and the Stocking-Lord method for the linking.

The donor line break cannula: effect on the donation process, blood component quality and transfusion microbiology testing of an important new blood bag safety feature.

Background: The use of blood packs with an integral sampling system can result in anti-coagulant from the main bag reaching the sample pouch via the donor line, causing delayed coagulation of blood samples. In NHS Blood and Transplant, this has prevented the use of serum, the preferred matrix for transfusion microbiology (TM) testing, which has led to an increased false positive rate with ethylenediaminetetraacetic acid (EDTA) plasma. There is also a remote possibility of false negative results owing to sample dilution.

[International Test Commission Guidelines for test translation and adaptation: second edition].

Background: Adapting tests across cultures is a common practice that has increased in all evaluation areas in recent years. We live in an increasingly multicultural and multilingual world in which the tests are used to support decision-making in the educational, clinical, organizational and other areas, so the adaptation of tests becomes a necessity. The main goal of this paper is to present the second edition of the guidelines of the International Test Commission (ITC) for adapting tests across cultures.

A functional difficulty and functional pain instrument for hip and knee osteoarthritis.

Introduction: The objectives of this study were to develop a functional outcome instrument for hip and knee osteoarthritis research (OA-FUNCTION-CAT) using item response theory (IRT) and computer adaptive test (CAT) methods and to assess its psychometric performance compared to the current standard in the field.

Methods: We conducted an extensive literature review, focus groups, and cognitive testing to guide the construction of an item bank consisting of 125 functional activities commonly affected by hip and knee osteoarthritis. We recruited a convenience sample of 328 adults with confirmed hip and/or knee osteoarthritis.

Development of a parent-report computer-adaptive test to assess physical functioning in children with cerebral palsy I: lower-extremity and mobility skills.

The objective of this project was to develop computer-adaptive tests (CATs) using parent reports of physical function in children and adolescents with cerebral palsy (CP). The specific aims of this study were to (1) examine the psychometric properties of an item bank of lower-extremity and mobility skills for children with CP; (2) evaluate a CAT using this item bank; (3) examine the concurrent validity of the CAT with the Pediatric Outcomes Data Collection Instrument (PODCI) and the Functional Assessment Questionnaire (FAQ); and (4) establish the discriminant validity of simulated CATs with Gross Motor Function Classification System (GMFCS) levels and CP type (diplegia, hemiplegia, or quadriplegia). Parents (n=190) of children and adolescents with spastic diplegic (48%), hemiplegic (22%), or quadriplegic (30%) CP consisting of 108 males and 82 females with a mean age of 10 years 7 months (SD 4y 1mo, range 2-21y) and in GMFCS levels I to V participated in item pool calibration and completed the PODCI and FAQ.

Evaluation of an item bank for a computerized adaptive test of activity in children with cerebral palsy.

Background: Contemporary clinical assessments of activity are needed across the age span for children with cerebral palsy (CP). Computerized adaptive testing (CAT) has the potential to efficiently administer items for children across wide age spans and functional levels.

Objective: The objective of this study was to examine the psychometric properties of a new item bank and simulated computerized adaptive test to assess activity level abilities in children with CP.

Development of a parent-report computer-adaptive test to assess physical functioning in children with cerebral palsy II: upper-extremity skills.

The specific aims of this study were to (1) examine the psychometric properties (unidimensionality, differential item functioning, scale coverage) of an item bank of upper-extremity skills for children and adolescents with cerebral palsy (CP); (2) evaluate a simulated computer-adaptive test (CAT) using this item bank; (3) examine the concurrent validity of the CAT with the Pediatric Outcomes Data Collection Instrument (PODCI) upper-extremity core scale; and (4) determine the discriminant validity of the simulated CAT with Manual Ability Classification System (MACS) levels and CP type (i.e. diplegia, hemiplegia, or quadriplegia).

Measuring global physical health in children with cerebral palsy: illustration of a multidimensional bi-factor model and computerized adaptive testing.

Purpose: The purposes of this study were to apply a bi-factor model for the determination of test dimensionality and a multidimensional CAT using computer simulations of real data for the assessment of a new global physical health measure for children with cerebral palsy (CP).

Methods: Parent respondents of 306 children with cerebral palsy were recruited from four pediatric rehabilitation hospitals and outpatient clinics. We compared confirmatory factor analysis results across four models: (1) one-factor unidimensional; (2) two-factor multidimensional (MIRT); (3) bi-factor MIRT with fixed slopes; and (4) bi-factor MIRT with varied slopes.

A computer-adaptive disability instrument for lower extremity osteoarthritis research demonstrated promising breadth, precision, and reliability.

Objective: To develop and evaluate a prototype measure (OA-DISABILITY-CAT) for osteoarthritis research using item response theory (IRT) and computer-adaptive test (CAT) methodologies.

Study Design And Setting: We constructed an item bank consisting of 33 activities commonly affected by lower extremity (LE) osteoarthritis. A sample of 323 adults with LE osteoarthritis reported their degree of limitation in performing everyday activities, and completed the Health Assessment Questionnaire-II (HAQ-II).

Cyclic nucleotide phosphodiesterase PDE1C1 in human cardiac myocytes.

Isoforms in the PDE1 family of cyclic nucleotide phosphodiesterases were recently found to comprise a significant portion of the cGMP-inhibited cAMP hydrolytic activity in human hearts. We examined the expression of PDE1 isoforms in human myocardium, characterized their catalytic activity, and quantified their contribution to cAMP hydrolytic and cGMP hydrolytic activity in subcellular fractions of this tissue. Western blotting with isoform-selective anti-PDE1 monoclonal antibodies showed PDE1C1 to be the principal isoform expressed in human myocardium.

Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS).

Background: The construction and evaluation of item banks to measure unidimensional constructs of health-related quality of life (HRQOL) is a fundamental objective of the Patient-Reported Outcomes Measurement Information System (PROMIS) project.

Objectives: Item banks will be used as the foundation for developing short-form instruments and enabling computerized adaptive testing. The PROMIS Steering Committee selected 5 HRQOL domains for initial focus: physical functioning, fatigue, pain, emotional distress, and social role participation.

Computer adaptive testing improved accuracy and precision of scores over random item selection in a physical functioning item bank.

Background And Objective: Measuring physical functioning (PF) within and across postacute settings is critical for monitoring outcomes of rehabilitation; however, most current instruments lack sufficient breadth and feasibility for widespread use. Computer adaptive testing (CAT), in which item selection is tailored to the individual patient, holds promise for reducing response burden, yet maintaining measurement precision. We calibrated a PF item bank via item response theory (IRT), administered items with a post hoc CAT design, and determined whether CAT would improve accuracy and precision of score estimates over random item selection.

Isoforms of cyclic nucleotide phosphodiesterase PDE3 and their contribution to cAMP hydrolytic activity in subcellular fractions of human myocardium.

Three isoforms of PDE3 (cGMP-inhibited) cyclic nucleotide phosphodiesterase regulate cAMP content in different intracellular compartments of cardiac myocytes in response to different signals. We characterized the catalytic activity and inhibitor sensitivity of these isoforms by using recombinant proteins. We determined their contribution to cAMP hydrolysis in cytosolic and microsomal fractions of human myocardium at 0.

A work-centered approach for setting passing scores on performance-based assessments.

Standardized patient examinations are being used for high-stakes decisions (e.g., graduation, licensure, and certification) with growing frequency.

Scoring standardized patient examinations: lessons learned from the development and administration of the ECFMG Clinical Skills Assessment (CSA).

Throughout the 40 year history of standardized patient assessments and OSCEs, there have been numerous advancements, including many that involve scoring the simulated clinical encounters. While there is no clear agreement on how examinees' performance should be documented or scored in an encounter, there is a consensus that several well-chosen SP encounters are required to produce reliable examinee scores. There also continues to be some debate as to who should do the scoring on an SP-based assessment.

Blood pack fault monitoring.

Background And Objectives: The National Blood Service (NBS) has recalled blood components as a result of manufacturing faults, or defective blood pack component parts leading to the possibility of an 'open' system. There has been an increase in the complexity of blood packs as a result of leucodepletion, sample diversion and sampling. The NBS implemented a mechanism to collate and analyse blood pack faults as a safety and quality initiative in conjunction with blood pack manufacturers.

The effect of task exposure on repeat candidate scores in a high-stakes standardized patient assessment.

Background: Failing candidates often make multiple attempts on licensure and certification examinations. For performance-based assessments, where available test material is often limited, overlap in examination content is frequently inevitable.

Purpose: The purpose of this study was to investigate the performance of repeat candidates, both on new and exposed material, on a standardized patient clinical skills assessment.