capsule network

胶囊网络
  • 文章类型: Journal Article
    泛素化是真核细胞中常见的蛋白质翻译后修饰,也是调节蛋白质生物学功能的重要方法。使用计算方法来预测泛素化位点可以取代昂贵且耗时的实验方法。现有的计算方法通常基于蛋白质序列信息构建分类器,氨基酸的物理和化学性质,进化信息,和结构参数。然而,大多数蛋白质的结构信息无法直接在现有数据库中找到。蛋白质的特征因物种而异,和一些物种有少量的泛素化的蛋白质。因此,有必要开发可应用于小样本数据集的特定物种模型。为了解决这些问题,我们提出了一个基于胶囊网络的物种特异性模型(SSUbi),它整合了蛋白质序列和结构信息。在这个模型中,特征提取模块由两个子模块组成,分别从序列和结构信息中提取多维特征。在子模块中,卷积运算用于提取编码维度特征,利用通道注意力机制提取特征图维度特征。这两种信息的多维特征集成后,物种特异性胶囊网络进一步将特征转化为胶囊载体,并对物种特异性泛素化位点进行分类。实验结果表明,SSUbi可以有效提高小样本物种的预测性能,优于其他模型。
    Ubiquitination is a common post-translational modification of proteins in eukaryotic cells, and it is also a significant method of regulating protein biological function. The use of computational methods for predicting ubiquitination sites can replace costly and time-consuming experimental methods. Existing computational methods often build classifiers based on protein sequence information, physical and chemical properties of amino acids, evolutionary information, and structural parameters. However, structural information about most proteins cannot be found in existing databases directly. The features of proteins differ among species, and some species have small amounts of ubiquitinated proteins. Therefore, it is necessary to develop species-specific models that can be applied to datasets with small sample sizes. To solve these problems, we propose a species-specific model (SSUbi) based on a capsule network, which integrates proteins\' sequence and structural information. In this model, the feature extraction module is composed of two sub-modules that extract multi-dimensional features from sequence and structural information respectively. In the submodule, the convolution operation is used to extract encoding dimension features, and the channel attention mechanism is used to extract feature map dimension features. After the multi-dimensional features of the two kinds of information are integrated, the species-specific capsule network further converts the features into capsule vectors and classifies species-specific ubiquitination sites. The experimental results show that SSUbi can effectively improve the prediction performance of species with small sample sizes and outperform other models.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    COVID-19对全球健康产生了重大影响,经济,教育,和日常生活。这种疾病可以从轻度到重度,65岁以上的人或有潜在疾病的人更容易患严重疾病。由于病毒潜伏期的变化,早期检测和分离是至关重要的。与CT扫描相比,胸部X光片(CXR)由于其效率和减少的辐射暴露而成为诊断工具的重要性。然而,CXR检测COVID-19的灵敏度可能较低。本文介绍了一种使用CXR图像对COVID-19进行准确分类和严重程度预测的深度学习框架。U-Net用于肺分割,达到0.9924的精度。使用Convulation-Capsule网络执行分类,COVID-19的真阳性率高达86%,肺炎的真阳性率高达93%,正常病例为85%。严重程度评估采用ResNet50、VGG-16和DenseNet201,DenseNet201具有出色的准确性。实证结果,用95%置信区间验证,确认框架的可靠性和健壮性。这种先进的深度学习技术与放射成像的集成增强了早期检测和严重程度评估。改善临床环境中的患者管理和资源分配。
    COVID-19 has resulted in a significant global impact on health, the economy, education, and daily life. The disease can range from mild to severe, with individuals over 65 or those with underlying medical conditions being more susceptible to severe illness. Early testing and isolation are vital due to the virus\'s variable incubation period. Chest radiographs (CXR) have gained importance as a diagnostic tool due to their efficiency and reduced radiation exposure compared to CT scans. However, the sensitivity of CXR in detecting COVID-19 may be lower. This paper introduces a deep learning framework for accurate COVID-19 classification and severity prediction using CXR images. U-Net is used for lung segmentation, achieving a precision of 0.9924. Classification is performed using a Convulation-capsule network, with high true positive rates of 86% for COVID-19, 93% for pneumonia, and 85% for normal cases. Severity assessment employs ResNet50, VGG-16, and DenseNet201, with DenseNet201 showing superior accuracy. Empirical results, validated with 95% confidence intervals, confirm the framework\'s reliability and robustness. This integration of advanced deep learning techniques with radiological imaging enhances early detection and severity assessment, improving patient management and resource allocation in clinical settings.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    影响脚跟骨的情况,如脚跟马刺和严重的疾病,对患者的日常活动构成重大挑战。虽然骨科和创伤科医生依靠足部X光片进行诊断,需要对这些条件进行更多基于AI的检测和分类。因此,这项研究通过提出MedcapsNet来解决这一需求,一种新颖的混合胶囊模型,将改进的DenseNet201与胶囊网络相结合,旨在准确地检测和分类脚跟骨骼疾病利用外侧脚跟X射线足部图像。我们用几个数据集对所提出的混合架构进行了一系列全面的实验,包括高跟鞋数据集,乳房呼吸KHisv1,HAM10000皮肤癌数据集,和JunCheng脑MRI数据集。第一个实验评估了所提出的脚跟疾病模型,而其他实验则在一系列医疗数据集上评估该模型,以证明其优于现有研究的性能。在脚跟数据集上,MedCapsNet的准确率为96.38%,AUC为98.35%,没有数据增加,交叉验证准确率为95.69%,AUC为98.87%。提出的模型,尽管采用了固定的架构和超参数,在四个不同的数据集中优于其他模型,包括核磁共振,X光片,和各种疾病的显微图像。这是值得注意的,因为不同类型的医学图像数据集通常需要不同的架构和超参数来实现最佳性能。
    Conditions affecting the heel bone, such as heel spurs and sever\'s disease, pose significant challenges to patients\' daily activities. While orthopedic and traumatology doctors rely on foot X-rays for diagnosis, there is a need for more AI-based detection and classification of these conditions. Therefore, this study addresses this need by proposing MedcapsNet, a novel hybrid capsule model combining modified DenseNet201 with a capsule network, designed to accurately detect and classify heel bone diseases utilizing lateral heel x-ray foot images. We conducted a comprehensive series of experiments on the proposed hybrid architecture with several datasets, including the Heel dataset, Breast BreaKHis v1, HAM10000 skin cancer dataset, and Jun Cheng Brain MRI dataset. The first experiment evaluates the proposed model for heel diseases, while the other experiments evaluate the model on a range of medical datasets to demonstrate its performance over existing studies. On the heel dataset, MedCapsNet achieves an accuracy of 96.38%, AUC of 98.35% without data augmentation, cross-validation accuracy of 95.69%, and AUC of 98.87%. The proposed model, despite employing a fixed architecture and hyperparameters, outperformed other models across four distinct datasets, including MRI, X-ray, and microscopic images with various diseases. This is notable because different types of medical image datasets typically require different architectures and hyperparameters to achieve optimal performance.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    基因是生物体蛋白质合成的基本单位,准确识别基因的翻译起始位点(TIS)对于理解调控至关重要,转录,和基因的翻译过程。然而,现有模型不能充分提取TIS序列中的特征信息,它们也不能充分捕获特征之间复杂的层次关系。因此,本文提出了一种新的预测因子CapsNet-TIS。CapsNet-TIS首先使用四种编码方法完全提取TIS序列信息,包括One-hot编码,物理结构属性(PSP)编码,核苷酸化学性质(NCP)编码,和核苷酸密度(ND)编码。接下来,利用多尺度卷积神经网络对编码特征进行特征融合,增强特征表示的全面性。最后,融合后的特征采用胶囊网络作为分类模型的主网络进行分类,以获取特征之间复杂的层次关系。此外,我们通过引入残差块来改进胶囊网络,注意频道,和BiLSTM,增强模型的特征提取和序列数据建模能力。在本文中,使用来自四个物种的TIS数据集评估CapsNet-TIS的性能:人类,鼠标,牛,果蝇,并且通过进行消融实验来证明每个部分的有效性。通过将实验结果与其他研究人员提出的模型进行比较,结果表明CapsNet-TIS具有优越的性能。
    Genes are the basic units of protein synthesis in organisms, and accurately identifying the translation initiation site (TIS) of genes is crucial for understanding the regulation, transcription, and translation processes of genes. However, the existing models cannot adequately extract the feature information in TIS sequences, and they also inadequately capture the complex hierarchical relationships among features. Therefore, a novel predictor named CapsNet-TIS is proposed in this paper. CapsNet-TIS first fully extracts the TIS sequence information using four encoding methods, including One-hot encoding, physical structure property (PSP) encoding, nucleotide chemical property (NCP) encoding, and nucleotide density (ND) encoding. Next, multi-scale convolutional neural networks are used to perform feature fusion of the encoded features to enhance the comprehensiveness of the feature representation. Finally, the fused features are classified using capsule network as the main network of the classification model to capture the complex hierarchical relationships among the features. Moreover, we improve the capsule network by introducing residual block, channel attention, and BiLSTM to enhance the model\'s feature extraction and sequence data modeling capabilities. In this paper, the performance of CapsNet-TIS is evaluated using TIS datasets from four species: human, mouse, bovine, and fruit fly, and the effectiveness of each part is demonstrated by performing ablation experiments. By comparing the experimental results with models proposed by other researchers, the results demonstrate the superior performance of CapsNet-TIS.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    预测转录因子的结合位点对于理解后者如何调节基因表达以及如何调节这种调节用于治疗目的是重要的。一致数量的参考文献用不同的方法解决了这个问题,机器学习是最成功的之一。然而,我们注意到,许多这样的方法未能提出一个强大的和有意义的方法来嵌入遗传数据的分析。我们试图通过提出一种基于双向变压器的编码器来克服这个问题,由双向长短期记忆层和负责最终预测的胶囊层授权。为了评估所提出方法的效率,我们使用ENCODE存储库中提供的五个细胞系的基准ChIP-seq数据集(A549,GM12878,Hep-G2,H1-hESC,和Hela)。结果表明,该方法能很好地预测5种不同细胞系内的TFBS;跨单元预测也提供了令人满意的结果。通过分析仅用于测试使用其他细胞系训练的模型的五个额外细胞系来加强跨细胞系进行的实验。结果证实,跨细胞系的预测仍然非常高,允许进行广泛的交叉转录因子分析,从中可以得出分子生物学的一些感兴趣的适应症。
    Prediction of binding sites for transcription factors is important to understand how the latter regulate gene expression and how this regulation can be modulated for therapeutic purposes. A consistent number of references address this issue with different approaches, Machine Learning being one of the most successful. Nevertheless, we note that many such approaches fail to propose a robust and meaningful method to embed the genetic data under analysis. We try to overcome this problem by proposing a bidirectional transformer-based encoder, empowered by bidirectional long-short term memory layers and with a capsule layer responsible for the final prediction. To evaluate the efficiency of the proposed approach, we use benchmark ChIP-seq datasets of five cell lines available in the ENCODE repository (A549, GM12878, Hep-G2, H1-hESC, and Hela). The results show that the proposed method can predict TFBS within the five different cell lines very well; moreover, cross-cell predictions provide satisfactory results as well. Experiments conducted across cell lines are reinforced by the analysis of five additional lines used only to test the model trained using the others. The results confirm that prediction across cell lines remains very high, allowing an extensive cross-transcription factor analysis to be performed from which several indications of interest for molecular biology may be drawn.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    猕猴桃软腐病具有高度传染性,造成严重的经济损失。因此,软腐病的早期发现和消除对猕猴桃的采后处理和贮藏具有重要意义。本研究旨在基于高光谱图像,利用深度学习方法进行图像分类,准确检测猕猴桃软腐病。为了提高分类精度,提出了一种双分支选择性注意胶囊网络(DBSACaps)。该网络使用两个分支分别提取光谱和空间特征,以减少它们之间的相互干扰,然后通过注意力机制融合这两个特征。使用胶囊网络代替卷积神经网络来提取特征并完成分类。与现有方法相比,该方法在猕猴桃软腐病数据集上表现出最佳的分类性能,总体准确率为97.08%,软腐准确率为97.83%。我们的结果证实,使用高光谱图像可以检测到猕猴桃的潜在软腐病,这可能有助于智慧农业的建设。
    Kiwifruit soft rot is highly contagious and causes serious economic loss. Therefore, early detection and elimination of soft rot are important for postharvest treatment and storage of kiwifruit. This study aims to accurately detect kiwifruit soft rot based on hyperspectral images by using a deep learning approach for image classification. A dual-branch selective attention capsule network (DBSACaps) was proposed to improve the classification accuracy. The network uses two branches to separately extract the spectral and spatial features so as to reduce their mutual interference, followed by fusion of the two features through the attention mechanism. Capsule network was used instead of convolutional neural networks to extract the features and complete the classification. Compared with existing methods, the proposed method exhibited the best classification performance on the kiwifruit soft rot dataset, with an overall accuracy of 97.08% and a 97.83% accuracy for soft rot. Our results confirm that potential soft rot of kiwifruit can be detected using hyperspectral images, which may contribute to the construction of smart agriculture.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    糖尿病视网膜病变被认为是在工作年龄可导致失明的最常见疾病之一,只要一个人患有糖尿病,发展它的机会就会增加。保护患者的视力或减缓这种疾病的发展取决于其早期发现以及确定这种病理的确切水平。这是由眼科医生手动完成的。这个手动过程在专家眼科医生的时间和经验方面非常耗时,这使得开发一种自动化方法来帮助诊断糖尿病视网膜病变成为必要和迫切需要。在本文中,我们的目标是提出一种新的混合深度学习方法,该方法基于微调视觉转换器和改进的胶囊网络,用于自动预测糖尿病视网膜病变的严重程度。所提出的方法包括一系列新的计算机视觉操作,预处理步骤包括幂律变换技术和对比度限制自适应直方图均衡技术。虽然分类步骤建立在微调视觉转换器上,改进的胶囊网络,以及与分类模型相结合的分类模型,使用四个数据集评估了我们方法的有效性,包括APTOS,Messidor-2,DDR,和EyePACS数据集,用于糖尿病视网膜病变的严重程度。我们在四个数据集上获得了出色的测试准确性分数,分别为:88.18%,87.78%,80.36%,78.64%。将我们的结果与最先进的结果进行比较,我们达到了更好的表现。
    Diabetic retinopathy is considered one of the most common diseases that can lead to blindness in the working age, and the chance of developing it increases as long as a person suffers from diabetes. Protecting the sight of the patient or decelerating the evolution of this disease depends on its early detection as well as identifying the exact levels of this pathology, which is done manually by ophthalmologists. This manual process is very consuming in terms of the time and experience of an expert ophthalmologist, which makes developing an automated method to aid in the diagnosis of diabetic retinopathy an essential and urgent need. In this paper, we aim to propose a new hybrid deep learning method based on a fine-tuning vision transformer and a modified capsule network for automatic diabetic retinopathy severity level prediction. The proposed approach consists of a new range of computer vision operations, including the power law transformation technique and the contrast-limiting adaptive histogram equalization technique in the preprocessing step. While the classification step builds up on a fine-tuning vision transformer, a modified capsule network, and a classification model combined with a classification model, The effectiveness of our approach was evaluated using four datasets, including the APTOS, Messidor-2, DDR, and EyePACS datasets, for the task of severity levels of diabetic retinopathy. We have attained excellent test accuracy scores on the four datasets, respectively: 88.18%, 87.78%, 80.36%, and 78.64%. Comparing our results with the state-of-the-art, we reached a better performance.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    裁剪和分割模式解析器通常将不同的内部相关性组合成一个单一的度量/方案,导致过度概括和冗余表示。建议通过使用带有胶囊注意力扭曲器(CATA)和胶囊注意力路由协议(CARA)的冗余关联消除网络(RAEN)来简化模式分析。CAT修剪零件和整体之间脆弱且可互换的微妙关系。高级实体只能由满足部件间多样性和对象内内聚性要求的主要实体更新。为了提高效果,CARA旨在防止传统路由协议的不必要的投票信号。涉及面部和人体分割的实验表明,RAEN优于当前的显着方法,特别是定义详细的语义边界。
    Cropping-and-segmenting pattern parsers often combine diverse inner correlations into a single metric/scheme, resulting in over-generalizations and redundant representations. It is proposed to streamline pattern parsing by using presenting a redundant association elimination network (RAEN) with capsule attention twisters (CATs) and capsule-attention routing agreement (CARA). CATs trim delicate relationships between parts and wholes that are weak and interchangeable. Senior entities can only be updated by primary entities that meet the requirements of inter-part diversity and intra-object cohesiveness. In order to enhance results, CARA is designed to protect against the unnecessary voting signals of traditional routing protocols. Experiments involving facial and human segmentation show that RAEN is better than current remarkable methods, particularly for defining detailed semantic boundaries.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    皮肤癌是全球范围内普遍存在的恶性肿瘤,早期准确的诊断对患者的生存至关重要。皮肤病变的临床评估是医学实践的关键方面,尽管它遇到了几个障碍,例如长时间的等待时间和误解。皮肤损伤的错综复杂的性质,加上外观和纹理的变化,对准确分类提出了重大障碍。因此,熟练的临床医生通常很难在皮肤图像中区分良性痣和早期恶性肿瘤。尽管卷积神经网络等基于深度学习的方法取得了重大进步,他们的稳定和概括继续遇到困难,以及它们在准确描绘病变边界方面的表现,捕获特征之间的精细空间连接,使用上下文信息进行分类是次优的。为了解决这些限制,我们提出了一种新的皮肤病变分类方法,该方法结合了主动轮廓(AC)分割的蛇模型,用于特征提取的ResNet50,以及融合了轻量级注意力机制的胶囊网络,以获得特征图中不同的特征通道和空间区域,增强特征辨别力,提高准确性。我们采用随机梯度下降(SGD)优化算法来优化模型的参数。所提出的模型是在公开可用的数据集上实现的,即,HAM10000和ISIC2020。实验结果表明,该模型的准确率为98%,AUC-ROC为97.3%,与现有的最先进的(SOTA)方法相比,在有效的模型泛化方面展示了巨大的潜力。这些结果凸显了我们重塑自动皮肤病学诊断方法的潜力,并为医生提供了有用的工具。
    Skin cancer is a prevalent type of malignancy on a global scale, and the early and accurate diagnosis of this condition is of utmost importance for the survival of patients. The clinical assessment of cutaneous lesions is a crucial aspect of medical practice, although it encounters several obstacles, such as prolonged waiting time and misinterpretation. The intricate nature of skin lesions, coupled with variations in appearance and texture, presents substantial barriers to accurate classification. As such, skilled clinicians often struggle to differentiate benign moles from early malignant tumors in skin images. Although deep learning-based approaches such as convolution neural networks have made significant improvements, their stability and generalization continue to experience difficulties, and their performance in accurately delineating lesion borders, capturing refined spatial connections among features, and using contextual information for classification is suboptimal. To address these limitations, we propose a novel approach for skin lesion classification that combines snake models of active contour (AC) segmentation, ResNet50 for feature extraction, and a capsule network with a fusion of lightweight attention mechanisms to attain the different feature channels and spatial regions within feature maps, enhance the feature discrimination, and improve accuracy. We employed the stochastic gradient descent (SGD) optimization algorithm to optimize the model\'s parameters. The proposed model is implemented on publicly available datasets, namely, HAM10000 and ISIC 2020. The experimental results showed that the proposed model achieved an accuracy of 98% and AUC-ROC of 97.3%, showcasing substantial potential in terms of effective model generalization compared to existing state-of-the-art (SOTA) approaches. These results highlight the potential for our approach to reshape automated dermatological diagnosis and provide a helpful tool for medical practitioners.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    DNAN6-甲基腺嘌呤(6mA)修饰在生长调节中起关键作用,发展,和生物体中的疾病。作为一个重要的表观遗传标记,6mA修饰广泛参与基因组的复杂调控网络。因此,深入了解6mA是如何错综复杂地参与这些生物过程的,对于破译生物体内的基因调控网络至关重要。在这项研究中,我们建议PSAC-6mA(位置-自我注意胶囊-6mA),基于序列位置的自注意胶囊网络。模型中的位置层可以对每个基础位置进行位置关系提取和独立的参数设置,避免卷积方法固有的参数共享。同时,自我注意力胶囊网络增强了维度,捕获胶囊之间的相关性信息,并在模型内的多个空间维度上实现特征提取的出色结果。实验结果表明,PSAC-6mA在识别各种物种的6mA基序方面具有优越的性能。
    DNA N6-methyladenine (6mA) modifications play a pivotal role in the regulation of growth, development, and diseases in organisms. As a significant epigenetic marker, 6mA modifications extensively participate in the intricate regulatory networks of the genome. Hence, gaining a profound understanding of how 6mA is intricately involved in these biological processes is imperative for deciphering the gene regulatory networks within organisms. In this study, we propose PSAC-6mA (Position-self-attention Capsule-6mA), a sequence-location-based self-attention capsule network. The positional layer in the model enables positional relationship extraction and independent parameter setting for each base position, avoiding parameter sharing inherent in convolutional approaches. Simultaneously, the self-attention capsule network enhances dimensionality, capturing correlation information between capsules and achieving exceptional results in feature extraction across multiple spatial dimensions within the model. Experimental results demonstrate the superior performance of PSAC-6mA in recognizing 6mA motifs across various species.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

公众号