Cognitive pretesting (CP) is an interview methodology for pretesting the validity of items during the development of self-report instruments. The present research evaluates a systematic approach to the analysis of CP data. Materials and procedures were developed to rate self-report item performance with CP interview text data. Five raters were trained in the application of that system. Estimates of inter-rater reliability found acceptable to substantial levels of inter-rater agreement. Results from the present study suggest that excellent inter-rater reliability can be achieved in the evaluation of CP data. Guidelines for systematically rating the qualitative data collected using CP methods are provided. Future research should focus on empirical demonstrations of how such rating procedures can lead to improvements in self-report instruments.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3109735PMC
http://dx.doi.org/10.1177/0013164405282467DOI Listing

Publication Analysis

Top Keywords

self-report item
8
self-report instruments
8
inter-rater reliability
8
development evaluation
4
evaluation procedures
4
procedures assess
4
assess child
4
self-report
4
child self-report
4
item validity
4

Similar Publications

Objective: This cross-sectional study examined depression and associated impairment in youth presenting to a pediatric emergency department (PED) with abdominal pain.

Methods: Participants were 11-17 years old, presenting to a PED with idiopathic abdominal pain. Participants completed demographics, pain, pain-related impairment, and depression surveys.

View Article and Find Full Text PDF

The knowledge, experience, and awareness of professionals working with older adults on the auditory-cognitive interactions.

J Commun Disord

December 2024

Department of Rehabilitation Sciences, Ghent University, Corneel Heymanslaan 10 (2P1), Ghent 9000, Belgium; Department of Oto-rhino-laryngology, Ghent University Hospital, Corneel Heymanslaan 10 (2P1), Ghent 9000, Belgium.

Introduction: Hearing loss is a commonly occurring condition with dementia. Research already presented a theoretical framework for the auditory-cognitive interactions, though it is still unclear if and how professionals beyond audiologists act upon this interactions in clinical practice.

Methods: An online 64-item questionnaire was developed and evaluated respondents' work setting as well as their knowledge, experience, and awareness regarding hearing loss, cognitive decline, and the auditory-cognitive link.

View Article and Find Full Text PDF

Translation, validation, and reliability of the Modified Occupational Questionnaire into Bahasa Melayu among older persons in Malaysia.

Aust Occup Ther J

February 2025

Centre for Rehabilitation and Special Needs Studies, Occupational Therapy Programme, Faculty of Health Sciences, Universiti Kebangsaan Malaysia, Jalan Raja Muda Abdul Aziz, Kuala Lumpur, 50300, Malaysia.

Introduction: A Modified Occupational Questionnaire (MOQ) is a self-report questionnaire that records the occupational engagement of an individual hourly, focusing on activity category, reason for doing the activity, value to self, and value to society. Understanding the patterns of occupational engagement and meaningful time use in older persons is crucial for predicting physical and psychological health and establishing occupation-based interventions to support healthy aging. However, the MOQ, originally developed in an English-speaking country and may potentially be less suitable for Malaysian older persons, who are predominantly Malay-speaking and have distinct cultural adaptations.

View Article and Find Full Text PDF

Background: The Maslach Burnout Inventory-General Survey (MBI-GS) is the leading measure of burnout for all occupations. The MBI-GS9, the 9-item version of the MBI-GS, was formulated based on the MBI-GS and has been used for several years. However, very few studies have systematically tested its psychometric properties, and none have focused on care aides working in nursing homes who are susceptible to burnout.

View Article and Find Full Text PDF

On the Measurement of Episodic Empowerment.

Br J Soc Psychol

January 2025

School of Psychology, The University of Adelaide, Adelaide, Australia.

This article reports the development and validation of the Episodic Empowerment Scale (EES): A manipulation check designed to measure a momentary psychological state. In Study 1, participants (n = 125) completed a selection of candidate items after being exposed to a low- or high-power manipulation. Exploratory factor analysis was used to reduce the number of items to a brief five-item measure.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!