关键词: ConvNeXt Hierarchical inverted residual fusion module Multi-level attention mechanisms Skin lesion images Swin-T

Mesh : Humans Skin Neoplasms / pathology diagnostic imaging classification Algorithms Diagnosis, Computer-Assisted / methods Skin / pathology Image Interpretation, Computer-Assisted / methods

来  源:   DOI:10.7507/1001-5515.202305025   PDF(Pubmed)

Abstract:
Skin cancer is a significant public health issue, and computer-aided diagnosis technology can effectively alleviate this burden. Accurate identification of skin lesion types is crucial when employing computer-aided diagnosis. This study proposes a multi-level attention cascaded fusion model based on Swin-T and ConvNeXt. It employed hierarchical Swin-T and ConvNeXt to extract global and local features, respectively, and introduced residual channel attention and spatial attention modules for further feature extraction. Multi-level attention mechanisms were utilized to process multi-scale global and local features. To address the problem of shallow features being lost due to their distance from the classifier, a hierarchical inverted residual fusion module was proposed to dynamically adjust the extracted feature information. Balanced sampling strategies and focal loss were employed to tackle the issue of imbalanced categories of skin lesions. Experimental testing on the ISIC2018 and ISIC2019 datasets yielded accuracy, precision, recall, and F1-Score of 96.01%, 93.67%, 92.65%, and 93.11%, respectively, and 92.79%, 91.52%, 88.90%, and 90.15%, respectively. Compared to Swin-T, the proposed method achieved an accuracy improvement of 3.60% and 1.66%, and compared to ConvNeXt, it achieved an accuracy improvement of 2.87% and 3.45%. The experiments demonstrate that the proposed method accurately classifies skin lesion images, providing a new solution for skin cancer diagnosis.
皮肤癌是一个重要的公共卫生问题,计算机辅助诊断技术可以有效地减轻这一负担。在采用计算机辅助诊断时,准确识别皮肤病变类型至关重要。为此,本文提出一种基于Swin-T与ConvNeXt的多级注意力逐级融合模型,采用分层Swin-T与ConvNeXt分别提取全局与局部特征,并提出残差通道注意力与空间注意力模块进一步提取有效特征;利用多级注意力机制对多尺度全局与局部特征进行处理;针对浅层特征因离分类器较远而丢失的问题,采用逐级聚合的思想,提出逐级倒置残差融合模块动态调整提取的特征信息。本文通过均衡采样策略以及焦点损失,解决皮肤病变类别不平衡的问题。在ISIC2018、ISIC2019数据集上进行测试,其准确率、精确率、召回率和F1-Score分别是96.01%、93.67%、92.65%、93.11%与92.79%、91.52%、88.90%、90.15%。与Swin-T相比,准确率分别提升了3.60%和1.66%;与ConvNeXt相比,准确率分别提升了2.87%和3.45%。实验表明,本文提出的方法能够准确分类皮肤病变图像,为皮肤癌的诊断提供了新的解决方案。.
摘要:
暂无翻译
公众号