Prior teleneuropsychological research has assessed the reliability between in-person and remote administration of cognitive assessments. Few, if any, studies have examined the test-retest reliability of cognitive assessments conducted in sequential clinic-to-home or home-to-home teleneuropsychological evaluations - a critical issue given the state of clinical practice during the COVID-19 pandemic. This study examined this key psychometric question for several cognitive tests administered over repeated videoconferencing visits 4-6 months apart in a sample of healthy English-speaking adults. A total of 44 participants (ages 18-75) completed baseline and follow-up cognitive testing 4-6 months apart. Testing was conducted in a home-to-home setting over HIPAA-compliant videoconferencing meetings on participants' audio-visual enabled laptop or desktop computers. The following measures were repeated at both virtual visits: the Controlled Oral Word Association Test (FAS), Category Fluency (Animals), and Digit Span Forward and Backward from the Wechsler Adult Intelligence Scale, Fourth Edition. Intraclass correlation coefficients (ICC), Pearson correlations, root mean square difference (RMSD), and concordance correlation coefficients (CCC) were calculated as test-retest reliability metrics, and practice effects were assessed using paired-samples t-tests. Some tests exhibited small practice effects, and test-retest reliability was marginal or worse for all measures except FAS, which had adequate reliability (based on ICC and ). Reliability estimates with RMSD suggested that change within +/- 1 SD on these measures may reflect typical test-retest variability. The included cognitive measures exhibited questionable reliability over repeated home-to-home videoconferencing evaluations. Future teleneuropsychology test-retest reliability research is needed with larger, more diverse samples and in clinical populations.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8789947PMC
http://dx.doi.org/10.1080/13854046.2021.1954244DOI Listing

Publication Analysis

Top Keywords

test-retest reliability
20
reliability
9
home-to-home teleneuropsychological
8
healthy english-speaking
8
english-speaking adults
8
cognitive assessments
8
4-6 months apart
8
correlation coefficients
8
practice effects
8
test-retest
6

Similar Publications

Two-dimensional cell membrane chromatography guided screening of myocardial protective compounds from Yindan Xinnaotong soft capsule.

Chin Med

January 2025

State Key Laboratory of Natural Medicines, School of Traditional Chinese Pharmacy, China Pharmaceutical University, No. 639 Longmian Road, Nanjing, 211198, China.

Background: Cell membrane chromatography (CMC) is a biochromatography with a dual function of recognition and separation, offering a distinct advantage in screening bioactive compounds from Chinese medicines (CMs). Yindan Xinnaotong soft capsule (YD), a CM formulation, has been widely utilized in the treatment of cardiovascular disease. However, a comprehensive mapping of the myocardial protective active compounds remains elusive.

View Article and Find Full Text PDF

Reliability and reproducibility of systematic reviews informing the 2020-2025 Dietary Guidelines for Americans: a pilot study.

Am J Clin Nutr

January 2025

School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada; Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada.

Background: Although high-quality nutrition systematic reviews (SRs) are important for clinical decision making, there remains debate on their methodological quality and reporting transparency.

Objectives: The objective of this study was to assess the reliability and reproducibility of a sample of SRs produced by the Nutrition Evidence Systematic Review (NESR) team to inform the 2020-2025 Dietary Guidelines for Americans (DGAs).

Methods: We evaluated a sample of 8 SRs from the DGA dietary patterns subcommittee for methodological quality using the Assessment of Multiple Systematic Reviews 2 (AMSTAR 2) tool and for reporting transparency using the PRISMA 2020 and PRISMA literature search extension (PRISMA-S) checklists.

View Article and Find Full Text PDF

Research demonstrates that self-objectification negatively impacts both cisgender heterosexual women and men. However, measures of self-objectification have primarily been designed for and validated in women, raising doubts about their applicability to men and demonstrated gender differences in self-objectification. This research investigated the psychometric properties of the Self-Objectification Beliefs and Behaviors Scale (SOBBS; Lindner & Tantleff-Dunn, 2017) in cisgender heterosexual women, and for the first time, in cisgender heterosexual men.

View Article and Find Full Text PDF

Objective: To establish an arterial spin labeling (ASL) protocol for rat livers that improves data reliability and reproducibility for perfusion quantification.

Methods: This study used respiratory-gated, single-slice, FAIR-based ASL imaging with multiple inversion times (TI) in rat livers. Quality assurance measures included: (1) introduction of mechanical ventilation to ensure consistent respiratory cycles by controlling the respiratory rate (45 bpm), tidal volume (10 ml/kg), and inspiration: expiration ratio (I:E ratio, 1:2), (2) optimization of the trigger window for consistent trigger points, and (3) use of fit residual map and coefficient of variance as metrics to assess data quality.

View Article and Find Full Text PDF

Background: The Minimum Information for Studies Evaluating Biologics in Orthopedics (MIBO) guidelines were developed in May 2017 to encourage improved reporting standards, promote increased transparency and reproducibility, and enhance clinical evaluation capabilities. The MIBO guidelines consist of 23 checklist items considered necessary to critically appraise clinical studies evaluating platelet-rich plasma (PRP).

Purpose: To assess randomized controlled trials that evaluated PRP for the treatment of knee osteoarthritis in order to systematically review their adherence to the MIBO guidelines.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!