convolutional network

卷积网络
  • 文章类型: Journal Article
    大体肿瘤体积(GTV)的准确描绘对于放射治疗至关重要。深度学习驱动的GTV分割技术在快速准确地描绘GTV、为放射科医师制定放射计划提供依据。现有的基于深度学习的GTV二维和三维分割模型分别受到空间特征损失和各向异性,并且都受到肿瘤特征变异性的影响,模糊的边界,背景干扰。所有这些因素都严重影响分割性能。为了解决上述问题,本研究提出了一种基于2D-3D架构的层-体并行注意力(LVPA)-UNet模型,其中介绍了三种策略。首先,在LVPA-UNet中引入了2D和3D工作流程。它们并行工作,可以相互引导。通过它们可以提取2DMRI的每个切片的精细特征以及肿瘤的3D解剖结构和空间特征。其次,平行多分支深度条带卷积使模型适应切片和体积空间内不同形状和大小的肿瘤,并实现模糊边界的精细处理。最后,提出了一种层-通道注意力机制,根据切片和通道的不同肿瘤信息自适应调整其权重,然后突出切片和肿瘤通道。LVPA-UNet对来自三个中心的1010个鼻咽癌(NPC)MRI数据集的实验显示,DSC为0.7907,精度为0.7929,召回率为0.8025,HD95为1.8702mm,优于八种典型型号。与基线模型相比,它使DSC提高了2.14%,精度为2.96%,召回率为1.01%,而减少HD950.5434毫米。因此,在通过深度学习确保分割效率的同时,LVPA-UNet能够为放射治疗提供优越的GTV勾画结果,为精准医学提供技术支持。
    Accurate delineation of Gross Tumor Volume (GTV) is crucial for radiotherapy. Deep learning-driven GTV segmentation technologies excel in rapidly and accurately delineating GTV, providing a basis for radiologists in formulating radiation plans. The existing 2D and 3D segmentation models of GTV based on deep learning are limited by the loss of spatial features and anisotropy respectively, and are both affected by the variability of tumor characteristics, blurred boundaries, and background interference. All these factors seriously affect the segmentation performance. To address the above issues, a Layer-Volume Parallel Attention (LVPA)-UNet model based on 2D-3D architecture has been proposed in this study, in which three strategies are introduced. Firstly, 2D and 3D workflows are introduced in the LVPA-UNet. They work in parallel and can guide each other. Both the fine features of each slice of 2D MRI and the 3D anatomical structure and spatial features of the tumor can be extracted by them. Secondly, parallel multi-branch depth-wise strip convolutions adapt the model to tumors of varying shapes and sizes within slices and volumetric spaces, and achieve refined processing of blurred boundaries. Lastly, a Layer-Channel Attention mechanism is proposed to adaptively adjust the weights of slices and channels according to their different tumor information, and then to highlight slices and channels with tumor. The experiments by LVPA-UNet on 1010 nasopharyngeal carcinoma (NPC) MRI datasets from three centers show a DSC of 0.7907, precision of 0.7929, recall of 0.8025, and HD95 of 1.8702 mm, outperforming eight typical models. Compared to the baseline model, it improves DSC by 2.14 %, precision by 2.96 %, and recall by 1.01 %, while reducing HD95 by 0.5434 mm. Consequently, while ensuring the efficiency of segmentation through deep learning, LVPA-UNet is able to provide superior GTV delineation results for radiotherapy and offer technical support for precision medicine.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:准确、及时地评估儿童的发育状况对于早期诊断和干预至关重要。由于缺乏训练有素的医疗保健提供者和不精确的父母报告,更准确和自动化的发展评估至关重要。在发展的各个领域,众所周知,幼儿的粗大运动发育可以预测随后的童年发展。
    目的:这项研究的目的是开发一种模型来评估粗大运动行为,并将结果整合以确定幼儿的整体粗大运动状态。这项研究还旨在确定在评估总体总体运动技能方面很重要的行为,并检测关键时刻和重要的身体部位,以评估每种行为。
    方法:我们使用了18-35个月幼儿的行为视频。为了评估电机总体发展,我们选择了4种行为(爬楼梯,走下楼梯,扔球,并站在1英尺上),已通过韩国婴儿和儿童发育筛查测试进行了验证。在儿童行为视频中,我们将每个孩子的位置估计为边界框,并在框内提取人类关键点。在第一阶段,使用基于图形卷积网络(GCN)的算法分别评估具有每种行为的提取的人类关键点的视频。在第一阶段模型中获得的每个标签的概率值用作第二阶段模型的输入,极端梯度提升(XGBoost)算法,预测总体运动状态。为了可解释性,我们使用梯度加权类激活映射(Grad-CAM)来识别运动过程中的重要时刻和相关身体部位。Shapley加性解释方法用于评估变量重要性,以确定对整体发展评估贡献最大的运动。
    结果:从147名儿童中收集了4种粗大运动技能的行为视频,共产生2395个视频。评估每种行为的阶段1GCN模型的接受者工作特征曲线下面积(AUROC)为0.79至0.90。关键点映射Grad-CAM可视化识别了每个行为中的重要时刻以及重要身体部位的差异。评估总体粗大运动状态的阶段2XGBoost模型的AUROC为0.90。在这四种行为中,“下楼梯”对整体发展评估的贡献最大。
    结论:使用18-35个月幼儿的运动视频,我们开发了客观和自动化的模型来评估每个行为和评估每个孩子的整体粗大运动表现。我们确定了评估总体电机性能的重要行为,并开发了在评估总体电机性能时识别重要力矩和身体部位的方法。
    BACKGROUND: Accurate and timely assessment of children\'s developmental status is crucial for early diagnosis and intervention. More accurate and automated developmental assessments are essential due to the lack of trained health care providers and imprecise parental reporting. In various areas of development, gross motor development in toddlers is known to be predictive of subsequent childhood developments.
    OBJECTIVE: The purpose of this study was to develop a model to assess gross motor behavior and integrate the results to determine the overall gross motor status of toddlers. This study also aimed to identify behaviors that are important in the assessment of overall gross motor skills and detect critical moments and important body parts for the assessment of each behavior.
    METHODS: We used behavioral videos of toddlers aged 18-35 months. To assess gross motor development, we selected 4 behaviors (climb up the stairs, go down the stairs, throw the ball, and stand on 1 foot) that have been validated with the Korean Developmental Screening Test for Infants and Children. In the child behavior videos, we estimated each child\'s position as a bounding box and extracted human keypoints within the box. In the first stage, the videos with the extracted human keypoints of each behavior were evaluated separately using a graph convolutional networks (GCN)-based algorithm. The probability values obtained for each label in the first-stage model were used as input for the second-stage model, the extreme gradient boosting (XGBoost) algorithm, to predict the overall gross motor status. For interpretability, we used gradient-weighted class activation mapping (Grad-CAM) to identify important moments and relevant body parts during the movements. The Shapley additive explanations method was used for the assessment of variable importance, to determine the movements that contributed the most to the overall developmental assessment.
    RESULTS: Behavioral videos of 4 gross motor skills were collected from 147 children, resulting in a total of 2395 videos. The stage-1 GCN model to evaluate each behavior had an area under the receiver operating characteristic curve (AUROC) of 0.79 to 0.90. Keypoint-mapping Grad-CAM visualization identified important moments in each behavior and differences in important body parts. The stage-2 XGBoost model to assess the overall gross motor status had an AUROC of 0.90. Among the 4 behaviors, \"go down the stairs\" contributed the most to the overall developmental assessment.
    CONCLUSIONS: Using movement videos of toddlers aged 18-35 months, we developed objective and automated models to evaluate each behavior and assess each child\'s overall gross motor performance. We identified the important behaviors for assessing gross motor performance and developed methods to recognize important moments and body parts while evaluating gross motor performance.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号