Evaluation of activities of daily living using an electronic version of the Longshi Scale in patients with stroke: reliability, consistency, and preference.

Background: The Longshi Scale is a pictorial assessment tool for evaluating activities of daily living (ADL) in patients with stroke. The paper-based version presents challenges; thus, the WeChat version was created to enhance accessibility. Herein, we aimed to validate the inter-rater and test-retest reliabilities of the WeChat version of the Longshi Scale and explore its potential clinical applications.

Methods: We recruited 115 patients with stroke in the study. The ADL results of each patient were assessed using both the WeChat and paper-based version of the Longshi Scale; each evaluation was conducted by 28 health professionals and 115 caregivers separately. To explore the test-retest reliability of the WeChat version, 22 patients were randomly selected and re-evaluated by health professionals using the WeChat version. All evaluation criteria were recorded, and all evaluators were surveyed to indicate their preference between the two versions.

Results: Consistency between WeChat and the paper-based Longshi Scale was high for ADL scores by health professionals (ICC = 0.803-0.988) and caregivers (ICC = 0.845-0.983), as well as for degrees of disability (κw = 0.870 by professionals; κw = 0.800 by caregivers). Bland-Altman analysis showed no significant discrepancies. The WeChat version exhibited good test-retest reliability (κw = 0.880). The WeChat version showed similar inter-rater reliability in terms of the ADL score evaluated using the paper-based version (ICC = 0.781-0.941). The time to complete assessments did not differ significantly, although the WeChat version had a shorter information entry time (P < 0.001, 95% confidence interval: -43.463 to -15.488). Health professionals favored the WeChat version (53.6%), whereas caregivers had no significant preference.

Conclusions: The WeChat version of the Longshi Scale is reliable and serves as a suitable alternative for health professionals and caregivers to assess ADL levels in patients with stroke. The WeChat version of the Longshi Scale is considered user-friendly by health professionals, although it is not preferred by caregivers.

Trial Registration: This study was approved by the Ethics Committee of the Second People's Hospital of Shenzhen (approval number: 20210812003-FS01) and registered on the Clinical Trial Register Center website: clinicaltrials.gov on January 31, 2022 (registration no.: NCT05214638).