This multi-methods study describes the development of a pediatric rehabilitation telehealth intervention fidelity checklist, estimates its inter-rater reliability, and documents raters' implementation experience. A literature scan and expert consultation identified eighteen key behaviors and categorized them into three subdomains, measured using a 5-point measurement system. To estimate the checklist's inter-rater reliability, three raters scored 33 video recordings. A Shrout and Fleiss Class 1,1 intraclass correlation (ICC)) and 95% confidence intervals (CI) calculated ICCs = 0.5 (CI: 0, 0.9) for both the Therapist and the Parent-Therapists subdomains, and the Parent subdomain an ICC = 0.3 (CI: 0, 0.8). In the implementation surveys, raters reported high levels of satisfaction (100%), ease of use (84% to 88%), and confidence in their video ratings (87% to 100%). Changes in procedures and scoring were recommended. Capturing raters' implementation experiences is crucial in the early evaluation of the fidelity checklists for telehealth.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11249651PMC
http://dx.doi.org/10.5195/ijt.2024.6603DOI Listing

Publication Analysis

Top Keywords

fidelity checklist
8
telehealth intervention
8
inter-rater reliability
8
raters' implementation
8
development pilot
4
pilot testing
4
testing fidelity
4
checklist family-centered
4
family-centered telehealth
4
intervention parents
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!