graph convolution

图卷积
  • 文章类型: Journal Article
    在塑料部件生产过程中引入的变形会降低其3D几何信息的准确性,物体检查过程的一个关键方面。这种现象在制造商的初级塑料制品中普遍存在。这项工作提出了一种仅使用单个RGB图像对无纹理塑料物体进行变形估计的解决方案。该解决方案包含五个变形部分的独特图像数据集,一种生成网格标签的新方法,顺序变形,和基于图卷积的训练模型。所提出的顺序变形方法在生成精确网格标签方面优于流行的倒角距离算法。训练模型将对象顶点投影为从输入图像中提取的特征,然后,根据投影特征预测顶点位置偏移。使用这些偏移的预测网格在合成图像上实现亚毫米精度,在真实图像上实现约2.0mm。
    Deformations introduced during the production of plastic components degrade the accuracy of their 3D geometric information, a critical aspect of object inspection processes. This phenomenon is prevalent among primary plastic products from manufacturers. This work proposes a solution for the deformation estimation of textureless plastic objects using only a single RGB image. This solution encompasses a unique image dataset of five deformed parts, a novel method for generating mesh labels, sequential deformation, and a training model based on graph convolution. The proposed sequential deformation method outperforms the prevalent chamfer distance algorithm in generating precise mesh labels. The training model projects object vertices into features extracted from the input image, and then, predicts vertex location offsets based on the projected features. The predicted meshes using these offsets achieve a sub-millimeter accuracy on synthetic images and approximately 2.0 mm on real images.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    深度学习与医学领域的结合最近取得了巨大的成功,特别是为患者推荐药物。然而,患者的临床记录通常包含可显著影响其健康状况的重复医疗信息。大多数现有的纵向患者信息建模方法忽略了个体诊断和程序对患者健康的影响,导致患者代表性不足和药物建议的准确性有限。因此,我们提出了一种名为KEAN的药物推荐模型,它基于注意力聚合网络和增强的图卷积。具体来说,KEAN可以在患者就诊时汇总个人诊断和程序,以捕获影响患者疾病的重要特征。我们进一步从复杂的药物组合中融入医学知识,减少药物-药物相互作用(DDI),并推荐对患者健康有益的药物。在MIMIC-III数据集上的实验结果表明,我们的模型优于现有的高级方法,这突出了所提出方法的有效性。
    The combination of deep learning and the medical field has recently achieved great success, particularly in recommending medicine for patients. However, patients\' clinical records often contain repeated medical information that can significantly impact their health condition. Most existing methods for modeling longitudinal patient information overlook the impact of individual diagnoses and procedures on the patient\'s health, resulting in insufficient patient representation and limited accuracy of medicine recommendations. Therefore, we propose a medicine recommendation model called KEAN, which is based on an attention aggregation network and enhanced graph convolution. Specifically, KEAN can aggregate individual diagnoses and procedures in patient visits to capture significant features that affect patients\' diseases. We further incorporate medicine knowledge from complex medicine combinations, reduce drug-drug interactions (DDIs), and recommend medicines that are beneficial to patients\' health. The experimental results on the MIMIC-III dataset demonstrate that our model outperforms existing advanced methods, which highlights the effectiveness of the proposed method.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    在自动乳腺超声(ABUS)图像中准确分割肿瘤区域在计算机辅助诊断(CAD)系统中至关重要。然而,肿瘤固有的多样性和影像学干扰对ABUS肿瘤分割提出了巨大挑战。在本文中,我们提出了一种结合图融合(GLGM)的全局和局部特征交互模型,用于3DABUS肿瘤分割。在GLGM,我们构造了一个双分支编码器-解码器,可以提取局部和全局特征。此外,设计了一个全局和局部特征融合(GLFF)模块,它采用最深层的语义交互来促进局部和全局特征之间的信息交换。此外,为了提高小肿瘤的分割性能,设计了基于图卷积的浅层特征融合模块(SFFGC)。它利用浅层特征来增强小肿瘤在局部和全局域中的特征表达。在私有ABUS数据集和公共ABUS数据集上对所提出的方法进行评估。对于私有ABUS数据集,小肿瘤(体积小于1厘米3)占整个数据集的50%以上。实验结果表明,所提出的GLGM模型在3DABUS肿瘤分割中优于几种最先进的分割模型,特别是在分割小肿瘤。
    Accurate segmentation of tumor regions in automated breast ultrasound (ABUS) images is of paramount importance in computer-aided diagnosis system. However, the inherent diversity of tumors and the imaging interference pose great challenges to ABUS tumor segmentation. In this paper, we propose a global and local feature interaction model combined with graph fusion (GLGM), for 3D ABUS tumor segmentation. In GLGM, we construct a dual branch encoder-decoder, where both local and global features can be extracted. Besides, a global and local feature fusion module is designed, which employs the deepest semantic interaction to facilitate information exchange between local and global features. Additionally, to improve the segmentation performance for small tumors, a graph convolution-based shallow feature fusion module is designed. It exploits the shallow feature to enhance the feature expression of small tumors in both local and global domains. The proposed method is evaluated on a private ABUS dataset and a public ABUS dataset. For the private ABUS dataset, the small tumors (volume smaller than 1 cm3) account for over 50% of the entire dataset. Experimental results show that the proposed GLGM model outperforms several state-of-the-art segmentation models in 3D ABUS tumor segmentation, particularly in segmenting small tumors.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    扩散加权成像(DWI)是一种非侵入性方法,用于研究大脑的微观结构特性。然而,在临床实践中,分辨率和扫描时间之间存在权衡。超分辨率已用于增强自然图像中的空间分辨率,但其在高维和非欧几里得DWI上的应用仍然具有挑战性。
    本研究旨在开发端到端的深度学习网络,以通过后处理增强DWI的空间分辨率。
    我们提出了一种空间定制的深度学习方法,该方法将卷积神经网络(CNN)用于网格结构域(x空间),将图CNN(GCNN)用于扩散梯度域(q空间)。此外,我们使用q空间中高斯核定义的相关性将CNN的输出表示为图形,以弥合CNN和GCNN特征格式之间的差距。
    我们的模型在HumanConnectome项目中进行了评估,用我们提出的方法证明了DWI质量的有效提高。扩展实验还强调了其在下游任务中的优势。
    混合卷积神经网络在增强DWI扫描的空间分辨率以用于异构空间数据的特征学习方面表现出明显的优势。
    UNASSIGNED: Diffusion-weighted imaging (DWI) is a noninvasive method used for investigating the microstructural properties of the brain. However, a tradeoff exists between resolution and scanning time in clinical practice. Super-resolution has been employed to enhance spatial resolution in natural images, but its application on high-dimensional and non-Euclidean DWI remains challenging.
    UNASSIGNED: This study aimed to develop an end-to-end deep learning network for enhancing the spatial resolution of DWI through post-processing.
    UNASSIGNED: We proposed a space-customized deep learning approach that leveraged convolutional neural networks (CNNs) for the grid structural domain (x-space) and graph CNNs (GCNNs) for the diffusion gradient domain (q-space). Moreover, we represented the output of CNN as a graph using correlations defined by a Gaussian kernel in q-space to bridge the gap between CNN and GCNN feature formats.
    UNASSIGNED: Our model was evaluated on the Human Connectome Project, demonstrating the effective improvement of DWI quality using our proposed method. Extended experiments also highlighted its advantages in downstream tasks.
    UNASSIGNED: The hybrid convolutional neural network exhibited distinct advantages in enhancing the spatial resolution of DWI scans for the feature learning of heterogeneous spatial data.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    磁共振指纹(MRF)是一种新颖的成像框架,用于快速和同时量化多个组织属性。最近,已经开发了3DMRF方法,但需要提高采集速度才能用于临床。这项研究的目的是开发一种新颖的深度学习方法,以加速沿k空间中切片编码方向的3DMRF采集。我们介绍了一种基于图的卷积神经网络,该网络可满足通常用于MRF采集的非笛卡尔螺旋轨迹。与现有技术相比,我们提高了组织量化的准确性。我们的方法可以实现具有高空间分辨率的快速3DMRF,在5分钟内允许全脑覆盖,使MRF在临床环境中更可行。
    Magnetic resonance fingerprinting (MRF) is a novel imaging framework for fast and simultaneous quantification of multiple tissue properties. Recently, 3D MRF methods have been developed, but the acquisition speed needs to be improved before they can be adopted for clinical use. The purpose of this study is to develop a novel deep learning approach to accelerate 3D MRF acquisition along the slice-encoding direction in k-space. We introduce a graph-based convolutional neural network that caters to non-Cartesian spiral trajectories commonly used for MRF acquisition. We improve tissue quantification accuracy compared with the state of the art. Our method enables fast 3D MRF with high spatial resolution, allowing whole-brain coverage within 5min, making MRF more feasible in clinical settings.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    miRNA是许多关键生物过程的重要调节因子。最近的许多研究表明,miRNAs与多种人类疾病密切相关,可以成为某些疾病的潜在生物标志物或治疗靶点。比如癌症。因此,准确预测miRNA与疾病的关联对于理解和治疗疾病具有重要意义。然而,如何有效利用miRNA和疾病的特征以及已知miRNA-疾病关联的信息进行预测仍未得到充分探索。在这项研究中,我们提出了一种预测miRNA-疾病关联的新计算方法。该方法结合了图卷积网络和超图卷积网络。图卷积网络用于从miRNA相似性数据以及疾病相似性数据中提取信息。基于图卷积网络学习的miRNA和疾病的表示,我们进一步使用超图卷积网络来捕获已知miRNA-疾病关联中复杂的高阶相互作用.我们使用不同的数据集和预测任务进行全面的实验。结果表明,该方法始终优于其他几种最新方法。我们还讨论了超参数和模型结构对我们方法性能的影响。一些案例研究还表明,该方法的预测结果可以通过独立实验得到验证。
    miRNAs are important regulators for many crucial biological processes. Many recent studies have shown that miRNAs are closely related to various human diseases and can be potential biomarkers or therapeutic targets for some diseases, such as cancers. Therefore, accurately predicting miRNA-disease associations is of great importance for understanding and curing diseases. However, how to efficiently utilize the characteristics of miRNAs and diseases and the information on known miRNA-disease associations for prediction is still not fully explored. In this study, we propose a novel computational method for predicting miRNA-disease associations. The proposed method combines the graph convolutional network and the hypergraph convolutional network. The graph convolutional network is utilized to extract the information from miRNA-similarity data as well as disease-similarity data. Based on the representations of miRNAs and diseases learned by the graph convolutional network, we further use the hypergraph convolutional network to capture the complex high-order interactions in the known miRNA-disease associations. We conduct comprehensive experiments with different datasets and predictive tasks. The results show that the proposed method consistently outperforms several other state-of-the-art methods. We also discuss the influence of hyper-parameters and model structures on the performance of our method. Some case studies also demonstrate that the predictive results of the method can be verified by independent experiments.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    在能谱CT成像中,通过材料分解技术获得的基础材料的系数图像可以估计组织成分,其准确性直接影响疾病诊断。尽管通过采用卷积神经网络(CNN)提高了材料分解的精度,传统的CNN卷积算子限制了从CT图像中提取非局部特征。将多尺度非局部自相似模式建立的图模型引入多材料分解(MMD)。我们提出了一种基于图边缘条件卷积U网(GECCU-net)的新型MMD方法,以增强材料图像质量。GECCU-net专注于开发多尺度编码器。在网络编码阶段,应用三条路径来捕获全面的图像特征。本地和非本地特征聚合(LNFA)块被设计为集成来自不同路径的本地和非本地特征。基于非欧氏空间的图边缘条件卷积挖掘非局部特征定义混合损失函数以适应多尺度输入图像并避免结果的过度平滑。将所提出的网络与模拟和真实数据集上的基础CNN模型进行了定量比较。GECCU-net生成的材料图像具有更少的噪声和伪影,同时保留了更多的组织信息。获得的腹部和胸部水图的结构相似性(SSIM)分别达到0.9976和0.9990,RMSE降至0.1218和0.4903g/cm3。提出的方法可以提高MMD的性能,具有潜在的应用前景。
    In spectral CT imaging, the coefficient image of the basis material obtained by the material decomposition technique can estimate the tissue composition, and its accuracy directly affects the disease diagnosis. Although the precision of material decomposition is increased by employing convolutional neural networks (CNN), extracting the non-local features from the CT image is restricted using the traditional CNN convolution operator. A graph model built by multi-scale non-local self-similar patterns is introduced into multi-material decomposition (MMD). We proposed a novel MMD method based on graph edge-conditioned convolution U-net (GECCU-net) to enhance material image quality. The GECCU-net focuses on developing a multi-scale encoder. At the network coding stage, three paths are applied to capture comprehensive image features. The local and non-local feature aggregation (LNFA) blocks are designed to integrate the local and non-local features from different paths. The graph edge-conditioned convolution based on non-Euclidean space excavates the non-local features. A hybrid loss function is defined to accommodate multi-scale input images and avoid over-smoothing of results. The proposed network is compared quantitatively with base CNN models on the simulated and real datasets. The material images generated by GECCU-net have less noise and artifacts while retaining more information on tissue. The Structural SIMilarity (SSIM) of the obtained abdomen and chest water maps reaches 0.9976 and 0.9990, respectively, and the RMSE reduces to 0.1218 and 0.4903 g/cm3. The proposed method can improve MMD performance and has potential applications.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    食管癌放疗计划的手动设计耗时耗力。自动计划(AP)是当今流行的提高物理学家的工作效率。由于AP评估中剂量分布的直观性,获得合理的剂量预测为产生满意的AP提供了有效的保证。现有的基于全卷积网络的预测食管癌放疗计划中剂量分布的方法通常在有限的感受场中捕获特征。此外,体素对之间的相关性经常被忽略。这项工作修改了U网架构,并利用图卷积来捕获食管癌计划中剂量预测的远程信息。同时,注意机制获得计划目标体积(PTV)与危险器官之间的相关性,并自适应地学习它们的特征权重。最后,一个新的损失函数,考虑体素对之间的特征被用来突出预测。在该研究中收集了152名具有50Gy或60Gy的处方剂量的受试者。合格指数的平均绝对误差和标准偏差,同质性指数,所提出的方法获得的PTV和最大剂量分别为0.036±0.030、0.036±0.027和0.930±1.162,优于其他最先进的模型。优越的性能表明,我们提出的方法具有巨大的AP生成潜力。
    The manual design of esophageal cancer radiotherapy plan is time-consuming and labor-intensive. Automatic planning (AP) is prevalent nowadays to increase physicists\' work efficiency. Because of the intuitiveness of dose distribution in AP evaluation, obtaining reasonable dose prediction provides effective guarantees to generate a satisfactory AP. Existing fully convolutional network-based methods for predicting dose distribution in esophageal cancer radiotherapy plans often capture features in a limited receptive field. Additionally, the correlations between voxel pairs are often ignored. This work modifies the U-net architecture and exploits graph convolution to capture long-range information for dose prediction in esophageal cancer plans. Meanwhile, attention mechanism gets correlations between planning target volume (PTV) and organs at risk, and adaptively learns their feature weights. Finally, a novel loss function that considers features between voxel pairs is used to highlight the predictions. 152 subjects with prescription doses of 50 Gy or 60 Gy are collected in this study. The mean absolute error and standard deviation of conformity index, homogeneity index, and max dose for PTV achieved by the proposed method are 0.036 ± 0.030, 0.036 ± 0.027, and 0.930 ± 1.162, respectively, which outperform other state-of-the-art models. The superior performance demonstrates that our proposed method has great potential for AP generation.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    如今,作为智能交通系统的重要组成部分,交通流量预测受到了广泛的关注。然而,现有的大多数研究都用不随时间和空间区分的模块提取时空特征,没有考虑时空异质性。此外,尽管以前的工作已经实现了时空依赖的同步建模,在他们的图结构中仍然缺乏对时间因果关系的考虑。为了解决这些缺点,提出了一种时空异构同步图卷积网络(STHSGCN)用于交通流预测。具体而言,各种节点集群的独立扩张因果时空同步图卷积网络(DCSTSGCN)旨在反映空间异构性,不同时间步长的扩张因果时空同步图卷积模块(DCSTSGCM)被部署以考虑时间异质性。此外,提出了因果时空同步图(CSTSG)来捕获时空同步学习中的时间因果关系。我们进一步对四个真实世界的数据集进行了广泛的实验,结果验证了我们提出的方法与各种现有基线相比具有一致的优越性。
    Nowadays, as a crucial component of intelligent transportation systems, traffic flow prediction has received extensive concern. However, most of the existing studies extracted spatial-temporal features with modules that do not differentiate with time and space, and failed to consider spatial-temporal heterogeneities. Furthermore, although previous works have achieved synchronous modeling of spatial-temporal dependencies, the consideration of temporal causality is still lacking in their graph structures. To address these shortcomings, a spatial-temporal heterogeneous and synchronous graph convolution network (STHSGCN) is proposed for traffic flow prediction. To be specific, separate dilated causal spatial-temporal synchronous graph convolutional networks (DCSTSGCNs) for various node clusters are designed to reflect spatial heterogeneity, different dilated causal spatial-temporal synchronous graph convolutional modules (DCSTSGCMs) for diverse time steps are deployed to take account of temporal heterogeneity. In addition, causal spatial-temporal synchronous graph (CSTSG) is proposed to capture temporal causality in spatial-temporal synchronous learning. We further conducted extensive experiments on four real-world datasets, and the results verified the consistent superiority of our proposed approach compared with various existing baselines.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    知识图以实体和这些实体之间的关系的形式表示信息。这种代表在药物发现中具有多种潜在应用,包括民主化获取生物医学数据,将数据上下文化或可视化,并通过应用机器学习方法产生新颖的见解。知识图谱将数据放入上下文中,因此提供了生成可解释预测的机会,这是当代人工智能的一个重要话题。在这一章中,我们概述了构建生物医学知识图时需要考虑的一些因素,研究挖掘此类系统的最新进展,以获得药物发现的见解,并确定未来进一步发展的潜在领域。
    Knowledge graphs represent information in the form of entities and relationships between those entities. Such a representation has multiple potential applications in drug discovery, including democratizing access to biomedical data, contextualizing or visualizing that data, and generating novel insights through the application of machine learning approaches. Knowledge graphs put data into context and therefore offer the opportunity to generate explainable predictions, which is a key topic in contemporary artificial intelligence. In this chapter, we outline some of the factors that need to be considered when constructing biomedical knowledge graphs, examine recent advances in mining such systems to gain insights for drug discovery, and identify potential future areas for further development.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

公众号