Abstract:
This multi-methods study describes the development of a pediatric rehabilitation telehealth intervention fidelity checklist, estimates its inter-rater reliability, and documents raters\' implementation experience. A literature scan and expert consultation identified eighteen key behaviors and categorized them into three subdomains, measured using a 5-point measurement system. To estimate the checklist\'s inter-rater reliability, three raters scored 33 video recordings. A Shrout and Fleiss Class 1,1 intraclass correlation (ICC)) and 95% confidence intervals (CI) calculated ICCs = 0.5 (CI: 0, 0.9) for both the Therapist and the Parent-Therapists subdomains, and the Parent subdomain an ICC = 0.3 (CI: 0, 0.8). In the implementation surveys, raters reported high levels of satisfaction (100%), ease of use (84% to 88%), and confidence in their video ratings (87% to 100%). Changes in procedures and scoring were recommended. Capturing raters\' implementation experiences is crucial in the early evaluation of the fidelity checklists for telehealth.
摘要:
这项多方法研究描述了儿科康复远程健康干预保真度检查表的开发,估计其评估者间的可靠性,并记录评估者的实施经验。文献扫描和专家咨询确定了18个关键行为,并将它们分为三个子域,使用5点测量系统测量。要估计检查表的评分者间可靠性,三名评估者获得了33个视频记录。AShroutandFleissClass1,1组内相关性(ICC))和95%置信区间(CI)计算的ICC=0.5(CI:0,0.9),和父子域ICC=0.3(CI:0,0.8)。在执行情况调查中,评估者报告的满意度很高(100%),易用性(84%至88%),和对他们的视频收视率的信心(87%到100%)。建议更改程序和评分。捕获评估者的实施经验对于远程医疗保真度清单的早期评估至关重要。