residual network

残差网络
  • 文章类型: Journal Article
    背景:进行传统的湿法实验以指导药物开发是昂贵的,耗时和风险的过程。分析药物功能和重新定位在确定已批准药物的新治疗潜力和发现未治疗疾病的治疗方法中起着关键作用。探索药物-疾病关联对于确定疾病的发病机制和治疗具有深远的意义。然而,通过传统方法可靠地检测药物-疾病关系是昂贵且缓慢的。因此,目前需要研究预测药物-疾病关联的计算方法。
    结果:本文提出了一种新的药物-疾病关联预测方法,RAFGAE.首先,RAFGAE将疾病和药物之间的已知关联整合到一个双向网络中。第二,RAFGAE设计Re_GAT框架,其中包括多层图注意网络(GAT)和两个残差网络。多层GAT用于学习节点嵌入,这是通过聚合来自多跳邻居的信息来实现的。两个残差网络用于缓解深度网络过平滑问题,引入了一种注意力机制来组合来自不同注意力层的节点嵌入。第三,构造了两个具有协作训练的图形自编码器(GAE)来模拟标签传播以预测潜在的关联。在此基础上,引入了免费多尺度对抗训练(FMAT)。FMAT通过小梯度对抗扰动迭代增强节点特征质量,提高预测性能。最后,对两个基准数据集的十倍交叉验证表明,RAFGAE优于当前方法。此外,个案研究证实RAFGAE可以检测新的药物-疾病关联.
    结论:综合实验结果验证了RAFGAE的实用性和准确性。我们认为这种方法可以作为识别未观察到的疾病-药物关联的极好预测指标。
    BACKGROUND: Conducting traditional wet experiments to guide drug development is an expensive, time-consuming and risky process. Analyzing drug function and repositioning plays a key role in identifying new therapeutic potential of approved drugs and discovering therapeutic approaches for untreated diseases. Exploring drug-disease associations has far-reaching implications for identifying disease pathogenesis and treatment. However, reliable detection of drug-disease relationships via traditional methods is costly and slow. Therefore, investigations into computational methods for predicting drug-disease associations are currently needed.
    RESULTS: This paper presents a novel drug-disease association prediction method, RAFGAE. First, RAFGAE integrates known associations between diseases and drugs into a bipartite network. Second, RAFGAE designs the Re_GAT framework, which includes multilayer graph attention networks (GATs) and two residual networks. The multilayer GATs are utilized for learning the node embeddings, which is achieved by aggregating information from multihop neighbors. The two residual networks are used to alleviate the deep network oversmoothing problem, and an attention mechanism is introduced to combine the node embeddings from different attention layers. Third, two graph autoencoders (GAEs) with collaborative training are constructed to simulate label propagation to predict potential associations. On this basis, free multiscale adversarial training (FMAT) is introduced. FMAT enhances node feature quality through small gradient adversarial perturbation iterations, improving the prediction performance. Finally, tenfold cross-validations on two benchmark datasets show that RAFGAE outperforms current methods. In addition, case studies have confirmed that RAFGAE can detect novel drug-disease associations.
    CONCLUSIONS: The comprehensive experimental results validate the utility and accuracy of RAFGAE. We believe that this method may serve as an excellent predictor for identifying unobserved disease-drug associations.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    作为遥感信号的典型组成部分,遥感图像(RSI)信息在显示宏,地球表面和环境的动态和准确信息,这对许多应用领域至关重要。核心技术之一是RSI信号(RSIS)的对象检测(OD)。现有的大多数OD算法只考虑中型和大型对象,不管小目标检测,导致检测精度和小物体的漏检率不理想。为了提高RSIS的整体OD性能,改进的检测框架,I-YOLO-V5被提议用于高海拔RSIS中的OD。首先,利用残差网络的思想构造新的残差单元,达到改进网络特征提取的目的。然后,为了避免网络的梯度衰落,密集连接的网络被集成到算法的结构中。同时,为了减少复杂环境下RSIS中小目标检测的不足,在算法结构中采用了第四检测层,并验证了其有效性。实验结果证实,与现有的先进OD算法相比,提出的I-YOLO-V5的平均精度提高了15.4%,在RSOD数据集上,漏检率降低了46.8%。
    As a typical component of remote sensing signals, remote sensing image (RSI) information plays a strong role in showing macro, dynamic and accurate information on the earth\'s surface and environment, which is critical to many application fields. One of the core technologies is the object detection (OD) of RSI signals (RSISs). The majority of existing OD algorithms only consider medium and large objects, regardless of small-object detection, resulting in an unsatisfactory performance in detection precision and the miss rate of small objects. To boost the overall OD performance of RSISs, an improved detection framework, I-YOLO-V5, was proposed for OD in high-altitude RSISs. Firstly, the idea of a residual network is employed to construct a new residual unit to achieve the purpose of improving the network feature extraction. Then, to avoid the gradient fading of the network, densely connected networks are integrated into the structure of the algorithm. Meanwhile, a fourth detection layer is employed in the algorithm structure in order to reduce the deficiency of small-object detection in RSISs in complex environments, and its effectiveness is verified. The experimental results confirm that, compared with existing advanced OD algorithms, the average accuracy of the proposed I-YOLO-V5 is improved by 15.4%, and the miss rate is reduced by 46.8% on the RSOD dataset.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    阿尔茨海默病(AD)在全球范围内构成重大健康风险,尤其是老年人。最近的研究强调了它的患病率,超过50%的日本老年人面临痴呆症的终生风险,主要归因于AD。作为痴呆症最常见的形式,AD逐渐侵蚀脑细胞,导致严重的神经衰退.在这种情况下,开发自动AD检测系统非常重要,许多研究人员一直在努力通过利用深度学习(DL)技术的进步来开发AD检测系统,在各个领域都显示出了有希望的结果,包括医学图像分析。然而,由于与训练分层卷积神经网络(CNN)相关联的复杂性,用于AD检测的现有方法通常遭受有限的性能。在本文中,我们引入了一种基于残差函数的多阶段深度神经网络架构,以解决现有AD检测方法的局限性。受残差网络(ResNets)在图像分类任务中的成功启发,我们拟议的系统包括五个阶段,每个都明确公式化,以增强特征有效性,同时保持模型深度。在特征提取之后,应用基于深度学习的特征选择模块来减轻过拟合,结合批量标准化,dropout和完全连接的层。随后,基于机器学习(ML)的分类算法,包括支持向量机(SVM),随机森林(RF)和SoftMax,用于分类任务。对三个基准数据集进行综合评价,即ADNI1:完成1年1.5T,MIRAID和OASISKaggle,证明了我们提出的模型的有效性。令人印象深刻的是,我们的模型达到了99.47%的准确率,ADNI1的99.10%和99.70%:完成1年1.5T,MIRAID和OASIS数据集,分别,在二进制类问题中优于现有系统。我们提出的模型代表了AD分析领域的重大进步。
    Alzheimer\'s Disease (AD) poses a significant health risk globally, particularly among the elderly population. Recent studies underscore its prevalence, with over 50% of elderly Japanese facing a lifetime risk of dementia, primarily attributed to AD. As the most prevalent form of dementia, AD gradually erodes brain cells, leading to severe neurological decline. In this scenario, it is important to develop an automatic AD-detection system, and many researchers have been working to develop an AD-detection system by taking advantage of the advancement of deep learning (DL) techniques, which have shown promising results in various domains, including medical image analysis. However, existing approaches for AD detection often suffer from limited performance due to the complexities associated with training hierarchical convolutional neural networks (CNNs). In this paper, we introduce a novel multi-stage deep neural network architecture based on residual functions to address the limitations of existing AD-detection approaches. Inspired by the success of residual networks (ResNets) in image-classification tasks, our proposed system comprises five stages, each explicitly formulated to enhance feature effectiveness while maintaining model depth. Following feature extraction, a deep learning-based feature-selection module is applied to mitigate overfitting, incorporating batch normalization, dropout and fully connected layers. Subsequently, machine learning (ML)-based classification algorithms, including Support Vector Machines (SVM), Random Forest (RF) and SoftMax, are employed for classification tasks. Comprehensive evaluations conducted on three benchmark datasets, namely ADNI1: Complete 1Yr 1.5T, MIRAID and OASIS Kaggle, demonstrate the efficacy of our proposed model. Impressively, our model achieves accuracy rates of 99.47%, 99.10% and 99.70% for ADNI1: Complete 1Yr 1.5T, MIRAID and OASIS datasets, respectively, outperforming existing systems in binary class problems. Our proposed model represents a significant advancement in the AD-analysis domain.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    在这项工作中,我们提出了一种利用混合深度学习方法的光倍频方法,该方法将残差网络(ResNet)与随机森林回归(RFR)算法集成在一起。采用三种不同的倍频调制方案来说明该方法,这可以为这些方案获得合适的参数。根据算法预测的参数,8-tupling,12元组,并通过数值模拟产生16倍频毫米波信号。仿真结果表明,对于8倍倍频,OSSR(光边带抑制比)为30.73dB,80GHz的RFSSR(射频杂散抑制比)为42.29dB。对于12倍倍频乘法,OSSR为30.09dB,120GHz毫米波的RFSSR为36.21dB。为了产生16倍频毫米波,获得29.86dB的OSSR和34.52dB的RFSSR。此外,还研究了幅度波动和偏置电压漂移对毫米波信号质量的影响。
    In this work, we present a method for optical frequency multiplication utilizing a hybrid deep learning approach that integrates the Residual Network (ResNet) with the Random Forest Regression (RFR) algorithm. Three different frequency multiplication modulation schemes are adopted to illustrate the method, which can obtain suitable parameters for these schemes. Based on the parameters predicted by the algorithm, the 8-tupling, 12-tupling, and 16-tupling mm-wave signals are generated by numerical simulation. The simulation results show that for 8-tupling frequency multiplication, an OSSR (optical sideband suppression ratio) is 30.73 dB and an RFSSR (radio frequency spurious suppression ratio) of 80 GHz is 42.29 dB. For 12-tupling frequency multiplication, the OSSR is 30.09 dB, and the RFSSR of the 120 GHz mm wave is 36.21 dB. For generating 16-tupling frequency mm-wave, an OSSR of 29.86 dB and an RFSSR of 34.52 dB are obtained. In addition, the impact of amplitude fluctuation and bias voltage drift on the quality of mm-wave signals is also studied.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    由于在现实世界的工业环境中收集大量生产质量数据的挑战,基于深度学习的生产质量预测模型实施效果不佳。为了实现用有限的数据预测生产质量的目标,解决深度学习网络训练过程中模型退化的问题,我们提出了基于残差网络(MLRN)模型的元学习,用于有限数据的生产质量预测。首先,MLRN模型在各种学习任务上进行训练,以获取用于预测生产质量的知识。此外,为了用有限的数据获取更多的特征,避免深度网络训练中梯度消失或爆炸的问题,选择具有有效信道注意(ECA)机制的增强型残差网络作为MLRN的基本网络结构。此外,实现了多批次多任务的数据输入方法,以防止过拟合。最后,MLRN模型的可用性通过使用数字和图形数据集与其他模型进行比较来证明。
    Due to the challenge of collecting a substantial amount of production-quality data in real-world industrial settings, the implementation of production quality prediction models based on deep learning is not effective. To achieve the goal of predicting production quality with limited data and address the issue of model degradation in the training process of deep learning networks, we propose Meta-Learning based on Residual Network (MLRN) models for production quality prediction with limited data. Firstly, the MLRN model is trained on a variety of learning tasks to acquire knowledge for predicting production quality. Furthermore, to obtain more features with limited data and avoid the issues of gradient disappearing or exploding in deep network training, the enhanced residual network with the effective channel attention (ECA) mechanism is chosen as the basic network structure of MLRN. Additionally, a multi-batch and multi-task data input approach is implemented to prevent overfitting. Finally, the availability of the MLRN model is demonstrated by comparing it with other models using both numerical and graphical datasets.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    动植物育种中复杂性状的遗传改良取决于对育种值的有效和准确估计。深度学习方法已被证明并不优于传统的基因组选择(GS)方法,部分是由于退化问题(即随着模型深度的增加,更深层次模型的性能恶化)。由于深度学习方法残差网络(ResNet)旨在解决梯度退化,我们检查了其性能和与GS预测精度相关的因素。在这里,我们比较了传统基因组最佳线性无偏预测的预测精度,贝叶斯方法(贝叶斯A,贝叶斯B,贝叶斯C,和贝叶斯套索),和两种深度学习方法,卷积神经网络和ResNet,在三个数据集上(小麦,模拟和真实猪数据)。ResNet在小麦和模拟数据上的Pearson相关系数(PCC)和均方误差(MSE)均优于其他方法。对于猪背脂深度性状,ResNet的MSE仍然最低,而贝叶斯套索的PCC最高。我们进一步将猪数据分为四组,在一个分离的组中,ResNet具有最高的预测精度(PCC和MSE)。采用迁移学习,能够提高卷积神经网络和ResNet的性能。一起来看,我们的研究结果表明,ResNet可以提高GS预测精度,可能受到复杂性状的遗传结构等因素的影响,数据量,和异质性。
    Genetic improvement of complex traits in animal and plant breeding depends on the efficient and accurate estimation of breeding values. Deep learning methods have been shown to be not superior over traditional genomic selection (GS) methods, partially due to the degradation problem (i.e. with the increase of the model depth, the performance of the deeper model deteriorates). Since the deep learning method residual network (ResNet) is designed to solve gradient degradation, we examined its performance and factors related to its prediction accuracy in GS. Here we compared the prediction accuracy of conventional genomic best linear unbiased prediction, Bayesian methods (BayesA, BayesB, BayesC, and Bayesian Lasso), and two deep learning methods, convolutional neural network and ResNet, on three datasets (wheat, simulated and real pig data). ResNet outperformed other methods in both Pearson\'s correlation coefficient (PCC) and mean squared error (MSE) on the wheat and simulated data. For the pig backfat depth trait, ResNet still had the lowest MSE, whereas Bayesian Lasso had the highest PCC. We further clustered the pig data into four groups and, on one separated group, ResNet had the highest prediction accuracy (both PCC and MSE). Transfer learning was adopted and capable of enhancing the performance of both convolutional neural network and ResNet. Taken together, our findings indicate that ResNet could improve GS prediction accuracy, affected potentially by factors such as the genetic architecture of complex traits, data volume, and heterogeneity.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    为了解决铝表面缺陷检测中的各种挑战,比如多尺度的错综复杂,对照明变化的敏感性,遮挡,和噪音,本研究提出了AluDef-ClassNet模型。首先,高斯差分金字塔用于捕获多尺度图像特征。其次,引入自注意机制来增强特征表示。此外,采用结合扩张卷积的改进残差网络结构来增加感受野,从而增强网络从广泛信息中学习的能力。使用CCD相机获取高质量铝表面缺陷图像的小规模数据集。为了更好地应对表面缺陷检测中的挑战,采用先进的深度学习技术和数据增强策略。为了解决数据标记的困难,利用基于微调的迁移学习方法,利用先验知识来提高模型训练的效率和准确性。在数据集测试中,我们的模型实现了97.6%的分类准确率,与其他分类模型相比,显示出显著的优势。
    To address the various challenges in aluminum surface defect detection, such as multiscale intricacies, sensitivity to lighting variations, occlusion, and noise, this study proposes the AluDef-ClassNet model. Firstly, a Gaussian difference pyramid is utilized to capture multiscale image features. Secondly, a self-attention mechanism is introduced to enhance feature representation. Additionally, an improved residual network structure incorporating dilated convolutions is adopted to increase the receptive field, thereby enhancing the network\'s ability to learn from extensive information. A small-scale dataset of high-quality aluminum surface defect images is acquired using a CCD camera. To better tackle the challenges in surface defect detection, advanced deep learning techniques and data augmentation strategies are employed. To address the difficulty of data labeling, a transfer learning approach based on fine-tuning is utilized, leveraging prior knowledge to enhance the efficiency and accuracy of model training. In dataset testing, our model achieved a classification accuracy of 97.6%, demonstrating significant advantages over other classification models.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    玉米是全球重要的粮食作物,然而,玉米叶部病害是危害它的最常见和最严重的病害之一。由于图像质量的变化,人工智能方法在识别和分类玉米叶片病害方面面临挑战,疾病之间的相似性,疾病严重程度,有限的数据集可用性,有限的可解释性。为了应对这些挑战,我们提出了一种基于残差的多尺度网络(MResNet),用于从玉米图像中分类多类型玉米叶片疾病。MResNet由两个不同规模的残差子网组成,使该模型能够在不同尺度下检测玉米叶片图像中的病害。我们进一步利用混合特征权重优化方法来优化和融合两个子网的特征映射权重。我们在玉米叶病数据集上验证了MResNet。MResNet达到97.45%的准确度。MResNet的性能超过了其他最先进的方法。各种实验和两个额外的数据集证实了我们模型的泛化性能。此外,热力学图分析增加了模型的可解释性。本研究为农业植物病害分类提供了技术支持。
    Maize is a globally important cereal crop, however, maize leaf disease is one of the most common and devastating diseases that afflict it. Artificial intelligence methods face challenges in identifying and classifying maize leaf diseases due to variations in image quality, similarity among diseases, disease severity, limited dataset availability, and limited interpretability. To address these challenges, we propose a residual-based multi-scale network (MResNet) for classifying multi-type maize leaf diseases from maize images. MResNet consists of two residual subnets with different scales, enabling the model to detect diseases in maize leaf images at different scales. We further utilize a hybrid feature weight optimization method to optimize and fuse the feature mapping weights of two subnets. We validate MResNet on a maize leaf diseases dataset. MResNet achieves 97.45% accuracy. The performance of MResNet surpasses other state-of-the-art methods. Various experiments and two additional datasets confirm the generalization performance of our model. Furthermore, thermodynamic diagram analysis increases the interpretability of the model. This study provides technical support for the disease classification of agricultural plants.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    简介:心房颤动(AF)是最常见的心律失常,临床上被确定为不规则和快速的心跳节律。房颤使患者有形成血凝块的风险,最终会导致心力衰竭,中风,甚至猝死.心电图(ECG),这包括从身体表面获取生物电信号来反映心脏活动,是用于检测AF的标准程序。然而,房颤的发生往往是间歇性的,医生花费大量的时间和精力来识别AF发作。此外,人为错误是不可避免的,即使是有经验的医疗专业人员也可能忽视或误解房颤的微妙迹象。因此,开发能够自动解释ECG信号并为AF诊断提供决策支持的高级分析模型至关重要.方法:本文,我们提出了一种创新的深度学习方法,用于使用单导联ECG进行自动AF识别。我们首先使用连续小波变换(CWT)从心电信号中提取时频特征。第二,利用残差学习增强的卷积神经网络(ReNet)作为函数逼近器来解释由CWT提取的时频特征。第三,我们建议将多分支结构纳入ResNet,以解决阶级不平衡的问题,在ECG数据集中,正常ECG的数量明显超过AF的实例。结果与讨论:我们使用两个ECG数据集评估了拟议的多分支Resnet与CWT(CWT-MB-Resnet),即,PhysioNet/CinC挑战2017和从俄克拉荷马大学健康科学中心(OUHSC)获得的ECG。提出的CWT-MB-Resnet展示了强大的预测性能,PhysioNet数据集的F1得分为0.8865,OUHSC数据集的F1得分为0.7369。实验结果表明,该模型在平衡精度和召回率方面具有优越的能力,这是确保可靠的医疗诊断所需的属性。
    Introduction: Atrial fibrillation (AF) is the most common cardiac arrhythmia, which is clinically identified with irregular and rapid heartbeat rhythm. AF puts a patient at risk of forming blood clots, which can eventually lead to heart failure, stroke, or even sudden death. Electrocardiography (ECG), which involves acquiring bioelectrical signals from the body surface to reflect heart activity, is a standard procedure for detecting AF. However, the occurrence of AF is often intermittent, costing a significant amount of time and effort from medical doctors to identify AF episodes. Moreover, human error is inevitable, as even experienced medical professionals can overlook or misinterpret subtle signs of AF. As such, it is of critical importance to develop an advanced analytical model that can automatically interpret ECG signals and provide decision support for AF diagnostics. Methods: In this paper, we propose an innovative deep-learning method for automated AF identification using single-lead ECGs. We first extract time-frequency features from ECG signals using continuous wavelet transform (CWT). Second, the convolutional neural networks enhanced with residual learning (ReNet) are employed as the functional approximator to interpret the time-frequency features extracted by CWT. Third, we propose to incorporate a multi-branching structure into the ResNet to address the issue of class imbalance, where normal ECGs significantly outnumber instances of AF in ECG datasets. Results and Discussion: We evaluate the proposed Multi-branching Resnet with CWT (CWT-MB-Resnet) with two ECG datasets, i.e., PhysioNet/CinC challenge 2017 and ECGs obtained from the University of Oklahoma Health Sciences Center (OUHSC). The proposed CWT-MB-Resnet demonstrates robust prediction performance, achieving an F1 score of 0.8865 for the PhysioNet dataset and 0.7369 for the OUHSC dataset. The experimental results signify the model\'s superior capability in balancing precision and recall, which is a desired attribute for ensuring reliable medical diagnoses.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:心电图(ECG)是有关人类心脏健康的重要信息来源,被广泛用于检测不同类型的心律失常。
    目标:随着深度学习的发展,建立了基于神经网络的端到端心电分类模型。然而,更深的网络层导致梯度消失。此外,ECG信号的不同通道和周期对于识别不同类型的ECG异常具有不同的意义。
    方法:为了解决这两个问题,提出了一种基于剩余注意神经网络的心电分类方法。残差网络(ResNet)用于解决梯度消失问题。此外,它的模型参数较少,它的结构更简单。增加了关注机制,以关注关键信息,集成通道功能,并改进投票方式,缓解数据不均衡的问题。
    结果:使用PhysioNet/CinCChallenge2017数据集进行实验和验证。平均F1值为0.817,比ResNet模型高0.064。与主流方法相比,表现非常出色。
    BACKGROUND: Electrocardiograms (ECG) are an important source of information on human heart health and are widely used to detect different types of arrhythmias.
    OBJECTIVE: With the advancement of deep learning, end-to-end ECG classification models based on neural networks have been developed. However, deeper network layers lead to gradient vanishing. Moreover, different channels and periods of an ECG signal hold varying significance for identifying different types of ECG abnormalities.
    METHODS: To solve these two problems, an ECG classification method based on a residual attention neural network is proposed in this paper. The residual network (ResNet) is used to solve the gradient vanishing problem. Moreover, it has fewer model parameters, and its structure is simpler. An attention mechanism is added to focus on key information, integrate channel features, and improve voting methods to alleviate the problem of data imbalance.
    RESULTS: Experiments and verifications are conducted using the PhysioNet/CinC Challenge 2017 dataset. The average F1 value is 0.817, which is 0.064 higher than that for the ResNet model. Compared with the mainstream methods, the performance is excellent.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

公众号