Cohen κ

  • 文章类型: Journal Article
    背景:准确预测疫苗接种行为可以为卫生保健专业人员制定有针对性的干预措施提供见解。
    目的:本研究的目的是建立中国儿童流感疫苗接种行为的预测模型。
    方法:我们从无锡的一项前瞻性观察研究中获得了数据,中国东部。预测结果是个体水平的疫苗摄取,协变量包括儿童和父母的社会人口统计学,父母的疫苗犹豫,对临床方便的看法,对诊所服务的满意度,并愿意接种疫苗。贝叶斯网络,逻辑回归,最小绝对收缩和选择算子(LASSO)回归,支持向量机(SVM),朴素贝叶斯(NB),随机森林(RF),用决策树分类器构建预测模型。各种性能指标,包括接受者工作特性曲线下面积(AUC),用于评估不同模型的预测性能。接收器工作特性曲线和校准图用于评估模型性能。
    结果:总共2383名参与者被纳入研究;这些儿童中83.2%(n=1982)<5岁,6.6%(n=158)以前接种过流感疫苗。超过一半(1356/2383,56.9%)的父母表示愿意为孩子接种流感疫苗。在2383名儿童中,26.3%(n=627)在2020-2021年季节接受了流感疫苗接种。在训练集中,RF模型在所有指标中显示出最佳性能。在验证集中,logistic回归模型和NB模型的AUC值最高;SVM模型的准确率最高;NB模型的召回率最高;logistic回归模型的准确率最高。F1得分,和科恩κ值。LASSO和逻辑回归模型得到了很好的校准。
    结论:开发的预测模型可用于量化中国儿童季节性流感疫苗接种的吸收。逐步逻辑回归模型可能更适合预测目的。
    BACKGROUND: Predicting vaccination behaviors accurately could provide insights for health care professionals to develop targeted interventions.
    OBJECTIVE: The aim of this study was to develop predictive models for influenza vaccination behavior among children in China.
    METHODS: We obtained data from a prospective observational study in Wuxi, eastern China. The predicted outcome was individual-level vaccine uptake and covariates included sociodemographics of the child and parent, parental vaccine hesitancy, perceptions of convenience to the clinic, satisfaction with clinic services, and willingness to vaccinate. Bayesian networks, logistic regression, least absolute shrinkage and selection operator (LASSO) regression, support vector machine (SVM), naive Bayes (NB), random forest (RF), and decision tree classifiers were used to construct prediction models. Various performance metrics, including area under the receiver operating characteristic curve (AUC), were used to evaluate the predictive performance of the different models. Receiver operating characteristic curves and calibration plots were used to assess model performance.
    RESULTS: A total of 2383 participants were included in the study; 83.2% of these children (n=1982) were <5 years old and 6.6% (n=158) had previously received an influenza vaccine. More than half (1356/2383, 56.9%) the parents indicated a willingness to vaccinate their child against influenza. Among the 2383 children, 26.3% (n=627) received influenza vaccination during the 2020-2021 season. Within the training set, the RF model showed the best performance across all metrics. In the validation set, the logistic regression model and NB model had the highest AUC values; the SVM model had the highest precision; the NB model had the highest recall; and the logistic regression model had the highest accuracy, F1 score, and Cohen κ value. The LASSO and logistic regression models were well-calibrated.
    CONCLUSIONS: The developed prediction model can be used to quantify the uptake of seasonal influenza vaccination for children in China. The stepwise logistic regression model may be better suited for prediction purposes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    椎体骨质量对脊柱融合术后疗效有显著影响。基于磁共振成像的新措施,例如椎骨骨质量(VBQ)评分,可以在没有与常规测试相关的辐射的情况下进行骨骼质量评估。在本研究中,我们试图评估由医学专业人员和受训人员计算的VBQ分数的内部和中间可靠性.
    招募了13名不同专业和培训水平的审稿人,并要求他们计算30名患者在相隔2个月的2个时间点的VBQ评分。从接受退行性和肿瘤适应症治疗的患者获得评分的体积。内部和评估者之间的协议,通过组内相关系数(ICC)量化,采用双向随机效应模型进行评估。使用平方权重Cohenκ和KendallTau-b来确定评估者在两次评估中是否分配了相似的分数。
    所有评估者对VBQ评分(ICC0.667-0.957;κ0.648-0.921)显示中等至优异的可靠性,以及用于计算VBQ评分的所有构成成分(ICC均≥0.97)的优异可靠性。在第一轮(ICC=0.818)和第二轮(ICC=0.800)评估中,还发现了VBQ得分的中间可靠性;组成成分的得分均具有组成成分的ICC值≥0.97。
    VBQ评分似乎具有良好的内部和中间可靠性。此外,评分可靠性和训练水平之间似乎没有相关性.有必要进行外部验证并进一步研究其准确建模骨生物力学特性的能力。
    Vertebral bone quality had a significant impact on postoperative outcomes in spinal fusion surgery. New magnetic resonance imaging-based measures, such as the Vertebral Bone Quality (VBQ) score, may allow for bone quality assessment without the radiation associated with conventional testing. In the present study, we sought to assess the intrarater and interrater reliability of VBQ scores calculated by medical professionals and trainees.
    Thirteen reviewers of various specialties and levels of training were recruited and asked to calculate VBQ scores for 30 patients at 2 time points separated by 2 months. Scored volumes were acquired from patients treated for both degenerative and oncologic indications. Intrarater and interrater agreement, quantified by intraclass correlation coefficient (ICC), was assessed using 2-way random effects modeling. Square-weight Cohen κ and Kendall Tau-b were used to determine whether raters assigned similar scores during both evaluations.
    All raters showed moderate to excellent reliability for VBQ score (ICC 0.667-0.957; κ0.648-0.921) and excellent reliability for all constituent components used to calculate VBQ score (ICC all ≥0.97). Interrater reliability was also found to be good for VBQ score on both the first (ICC = 0.818) and second (ICC = 0.800) rounds of assessment; scores for the constituent component all had ICC values ≥0.97 for the constituent components.
    The VBQ score appears to have both good intrarater and interrater reliability. In addition, there appeared to be no correlation between score reliability and level of training. External validation and further investigations of its ability to accurately model bone biomechanical properties are necessary.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号