Do delayed responses introduce bias in ecological momentary assessment? Evidence from comparisons between self-reported and objective physical activity.

Introduction: Delayed responses are a common yet often overlooked aspect of participant compliance in ecological momentary assessment (EMA) research. This study investigated whether response delays introduce selection bias in the moments captured by EMA.

Methods: Participants ( = 339) self-reported their physical activity behaviors using EMA five times a day over 7 days while wearing a continuous physical activity monitor.

Evidence Supports the Validity and Reliability of Response Times from a Brief Survey as a Digital Biomarker for Processing Speed in a Large Panel Study.

Survey response times (RTs) have hitherto untapped potential to allow researchers to gain more detailed insights into the cognitive performance of participants in online panel studies. We examined if RTs recorded from a brief online survey could serve as a digital biomarker for processing speed. Data from 9,893 adults enrolled in the nationally representative Understanding America Study were used in the analyses.

Evaluating the Psychometric Properties of a Physical Activity and Sedentary Behavior Identity Scale: Survey Study With Two Independent Samples of Adults in the United States.

Background: Emerging evidence suggests a positive association between relevant aspects of one's psychological identity and physical activity engagement, but the current understanding of this relationship is primarily based on scales designed to assess identity as a person who exercises, leaving out essential aspects of physical activities (eg, incidental and occupational physical activity) and sedentary behavior.

Objective: The goal of this study is to evaluate the validity of a new physical activity and sedentary behavior (PA/SB) identity scale using 2 independent samples of US adults.

Methods: In study 1, participants answered 21 candidate items for the PA/SB identity scale and completed the International Physical Activity Questionnaire-Short Form (IPAQ-SF).

Comparisons of Self-Report With Objective Measurements Suggest Faster Responding but Little Change in Response Quality Over Time in Ecological Momentary Assessment Studies.

Response times (RTs) to ecological momentary assessment (EMA) items often decrease after repeated EMA administration, but whether this is accompanied by lower response quality requires investigation. We examined the relationship between EMA item RTs and EMA response quality. In one data set, declining response quality was operationalized as decreasing correspondence over time between subjective and objective measures of blood glucose taken at the same time.

Can you tell people's cognitive ability level from their response patterns in questionnaires?

Questionnaires are ever present in survey research. In this study, we examined whether an indirect indicator of general cognitive ability could be developed based on response patterns in questionnaires. We drew on two established phenomena characterizing connections between cognitive ability and people's performance on basic cognitive tasks, and examined whether they apply to questionnaires responses.

Cognitive Functioning and the Quality of Survey Responses: An Individual Participant Data Meta-Analysis of 10 Epidemiological Studies of Aging.

Objectives: Self-reported survey data are essential for monitoring the health and well-being of the population as it ages. For studies of aging to provide precise and unbiased results, it is necessary that the self-reported information meets high psychometric standards. In this study, we examined whether the quality of survey responses in panel studies of aging depends on respondents' cognitive abilities.

Attrition from longitudinal ageing studies and performance across domains of cognitive functioning: an individual participant data meta-analysis.

Objectives: This paper examined the magnitude of differences in performance across domains of cognitive functioning between participants who attrited from studies and those who did not, using data from longitudinal ageing studies where multiple cognitive tests were administered.

Design: Individual participant data meta-analysis.

Participants: Data are from 10 epidemiological longitudinal studies on ageing (total n=209 518) from several Western countries (UK, USA, Mexico, etc).

Daily sampling frequency and sampling duration affect reliability of person-level estimates of physical activity outcomes: Optimizing Ecological Momentary Assessment studies of physical activities.

Studies on the interrelationship between physical activity (PA) behaviors and EMA-assessed constructs should use measures with high reliability of both the EMA-assessed constructs and the time-matched accelerometry-assessed PA behavior. The aim of this paper is to evaluate how the reliability of accelerometry-assessed PA outcomes is affected by different EMA sampling schemes. Emulating relevant sampling schemes in EMA studies, multiple random samples of real-world accelerometer data (measured via activPAL worn for ∼7 days) were drawn that varied in the number of daily samples (3, 5, and 7 daily samples) and in the duration of each sample (5 min, 60 min, and 120 min), totaling 9 sampling schemes.

Using Attributes of Survey Items to Predict Response Times May Benefit Survey Research.

Researchers have become increasingly interested in response times to survey items as a measure of cognitive effort. We used machine learning to develop a prediction model of response times based on 41 attributes of survey items (e.g.

Virtual Human-Delivered Interviews for Patients With Chronic Pain: Feasibility, Acceptability, and a Pilot Randomized Trial of Standard Medical, Psychosocial, and Educational Interviews.

Objective: Seminal advances in virtual human (VH) technology have introduced highly interactive, computer-animated VH interviewers. Their utility for aiding in chronic pain care is unknown. We developed three interactive telehealth VH interviews-a standard pain-focused, a psychosocial risk factor, and a pain psychology and neuroscience educational interview.

Shedding light on participant selection bias in Ecological Momentary Assessment (EMA) studies: Findings from an internet panel study.

Although the potential for participant selection bias is readily acknowledged in the momentary data collection literature, very little is known about uptake rates in these studies or about differences in the people that participate versus those who do not. This study analyzed data from an existing Internet panel of older people (age 50 and greater) who were offered participation into a momentary study (n = 3,169), which made it possible to compute uptake and to compare many characteristics of participation status. Momentary studies present participants with brief surveys multiple times a day over several days; these surveys ask about immediate or recent experiences.

Using Item Response Times in Online Questionnaires to Detect Mild Cognitive Impairment.

Objectives: With the increase in web-based data collection, response times (RTs) for survey items have become a readily available byproduct in most online studies. We examined whether RTs in online questionnaires can prospectively discriminate between cognitively normal respondents and those with cognitive impairment, no dementia (CIND).

Method: Participants were 943 members of a nationally representative internet panel, aged 50 and older.

Just-in-time adaptive ecological momentary assessment (JITA-EMA).

Interest in just-in-time adaptive interventions (JITAI) has rapidly increased in recent years. One core challenge for JITAI is the efficient and precise measurement of tailoring variables that are used to inform the timing of momentary intervention delivery. Ecological momentary assessment (EMA) is often used for this purpose, even though EMA in its traditional form was not designed specifically to facilitate momentary interventions.

Inferring Cognitive Abilities from Response Times to Web-Administered Survey Items in a Population-Representative Sample.

Monitoring of cognitive abilities in large-scale survey research is receiving increasing attention. Conventional cognitive testing, however, is often impractical on a population level highlighting the need for alternative means of cognitive assessment. We evaluated whether response times (RTs) to online survey items could be useful to infer cognitive abilities.

Evaluation of Pressing Issues in Ecological Momentary Assessment.

The use of repeated, momentary, real-world assessment methods known as the Experience Sampling Method and Ecological Momentary Assessment (EMA) has been broadly embraced over the last few decades. These methods have extended our assessment reach beyond lengthy retrospective self-reports as they can capture everyday experiences in their immediate context, including affect, behavior, symptoms, and cognitions. In this review we evaluate nine conceptual, methodological, and psychometric issues about EMA with the goal of stimulating conversation and guiding future research on these matters: the extent to which participants are actually reporting momentary experiences, respondents' interpretation of momentary questions, the use of comparison standards in responding, efforts to increase the EMA reporting period beyond the moment to longer periods within a day, training of EMA study participants, concerns about selection bias of respondents, the impact of missing EMA assessments, the reliability of momentary data, and for which purposes EMA might be considered a gold standard for assessment.

Quality of Survey Responses at Older Ages Predicts Cognitive Decline and Mortality Risk.

Background And Objectives: It is widely recognized that survey satisficing, inattentive, or careless responding in questionnaires reduce the quality of self-report data. In this study, we propose that such low-quality responding (LQR) can carry substantive meaning at older ages. Completing questionnaires is a cognitively demanding task and LQR among older adults may reflect early signals of cognitive deficits and pathological aging.

Momentary social interactions and affect in later life varied across the early stages of the COVID-19 pandemic.

The COVID-19 pandemic has impacted many different facets of life. The infectious nature of the disease has led to significant changes in social interactions in everyday life. The present study examined how older adults' patterns of everyday momentary social interactions (i.

Vague quantifiers demonstrate little susceptibility to frame of reference effects.

Comparison standards that people use when responding to survey questions, also called Frames of Reference (FoRs), can influence the validity of self-report responses. The effects of FoRs might be the stronger for items using vague quantifier (VQ) scales, which are particularly prominent in quality of life research, compared with numeric responses. This study aims to investigate the impact of FoRs on self-report measures by examining how imposing a specific FoR in survey questions affects (a) the response levels of VQ and numeric scales and (b) the relationship between VQs and a quantitative responses to the same question.

Improvements in anthropometric measures and gastrointestinal tolerance in patients with cystic fibrosis by using a digestive enzyme cartridge with overnight enteral nutrition.

Background: Patients with cystic fibrosis (CF) and pancreatic insufficiency are at risk for suboptimal fat absorption, inability to maintain weight, poor growth, and increased gastrointestinal (GI) symptoms due to malabsorption. Enteral nutrition (EN) is used to supplement caloric intake and requires pancreatic enzyme replacement for effective digestion. We evaluated the relationship between long-term use of an in-line digestive enzyme cartridge with EN and changes in anthropometric measures and GI symptoms in patients with CF.

Little evidence for consistent initial elevation bias in self-reported momentary affect: A coordinated analysis of ecological momentary assessment studies.

Response bias characterized by decreases in self-reported subjective states when measured repeatedly over short time-frames is a potential concern in social science. Recent work suggests that this initial elevation bias (IEB) is pronounced among young adult students' self-reports of affect when using ambulatory methods, but it is unclear if such bias extends broadly across samples, designs, and constructs. We examined the conditions wherein reliable and robust IEB may manifest by conducting a coordinated analysis of seven ecological momentary assessment (EMA) studies with diverse lifespan samples to test the generalizability of IEB across study designs and affective constructs (momentary negative and positive affect).

Subtle mistakes in self-report surveys predict future transition to dementia.

Introduction: We investigate whether indices of subtle reporting mistakes derived from responses in self-report surveys are associated with dementia risk.

Methods: We examined 13,831 participants without dementia from the prospective, population-based Health and Retirement Study (mean age 69 ± 10 years, 59% women). Participants' response patterns in 21 questionnaires were analyzed to identify implausible responses (multivariate outliers), incompatible responses (Guttman errors), acquiescent responses, random errors, and the proportion of skipped questions.

Explaining age differences in the memory-experience gap.

Emotions and symptoms are often overestimated in retrospective ratings, a phenomenon referred to as the "memory-experience gap." Some research has shown that this gap is less pronounced among older compared to younger adults for self-reported negative affect, but it is not known whether these age differences are evident consistently across domains of well-being and why these age differences emerge. In this study, we examined age differences in the memory-experience gap for emotional (positive and negative affect), social (loneliness), and physical (pain, fatigue) well-being.

Contrasting Effects of Finding Meaning and Searching for Meaning, and Political Orientation and Religiosity, on Feelings and Behaviors During the COVID-19 Pandemic.

Perceiving life as meaningful can buffer against negative experiences, whereas searching for meaning in life is often associated with negative outcomes. We examined how these individual differences, along with religiosity and political orientation, are associated with feelings and health-related behaviors during the COVID-19 pandemic ( = 7,220; U.S.

Varied and unexpected changes in the well-being of seniors in the United States amid the COVID-19 pandemic.

Recent evidence suggests that psychological health deteriorated during the COVID-19 pandemic but far less is known about changes in other measures of well-being. We examined changes in a broad set of measures of well-being among seniors just before and after the recognition of community spread of COVID-19 in the United States. We fielded two waves of a survey to a large, national online panel of adults ages 60 to 68 at wave 1.