METHODS: This study used acute-phase International Standards for Neurological Classification of SCI exams to forecast 6-month recovery of segmental motor scores as the primary evaluation endpoint. Secondary endpoints included severity grade improvement, independent walking, and self-care ability. Different similarity metrics were explored for k-nearest neighbor (kNN) matching within 1267 patients from the European Multicenter Study about Spinal Cord Injury before validation in 411 patients from the Sygen trial. The kNN performance was compared to linear and logistic regression models.
RESULTS: We obtained a population-wide root-mean-squared error (RMSE) in motor score sequence of 0.76(0.14, 2.77) and competitive functional score predictions (AUCwalker = 0.92, AUCself-carer = 0.83) for the kNN algorithm, improving beyond the linear regression task (RMSElinear = 0.98(0.22, 2.57)). The validation cohort showed comparable results (RMSE = 0.75(0.13, 2.57), AUCwalker = 0.92). We deploy the final historic control model as a web tool for easy user interaction (https://hicsci.ethz.ch/).
CONCLUSIONS: Our approach is the first to provide predictions across all motor segments independent of the level and severity of SCI. We provide a machine learning concept that is highly interpretable, i.e. the prediction formation process is transparent, that has been validated across European and American data sets, and provides reliable and validated algorithms to incorporate external control data to increase sensitivity and feasibility of multinational clinical trials.
方法:本研究使用急性期国际SCI检查神经学分类标准来预测6个月的节段性运动评分恢复作为主要评价终点。次要终点包括严重性等级改善,独立行走,和自理能力。在Sygen试验的411例患者中进行验证之前,对来自欧洲多中心脊髓损伤研究的1267例患者中的k最近邻(kNN)匹配进行了探索。将kNN性能与线性和逻辑回归模型进行比较。
结果:我们在kNN算法的运动分数序列中获得了0.76(0.14,2.77)和竞争功能分数预测(AUCwalker=0.92,AUCself-carer=0.83)的全人群均方根误差(RMSE),改进超出线性回归任务(RMSElinear=0.98(0.22,2.57))。验证队列显示出可比的结果(RMSE=0.75(0.13,2.57),AUCwalker=0.92)。我们将最终的历史控制模型部署为Web工具,以便于用户交互(https://hicsci。艾思兹.ch/)。
结论:我们的方法是第一个提供独立于SCI水平和严重程度的所有运动部分的预测。我们提供了一个高度可解释的机器学习概念,即预测形成过程是透明的,这已经在欧洲和美国的数据集中得到了验证,并提供可靠和经过验证的算法,以纳入外部控制数据,以提高多国临床试验的敏感性和可行性。