medical image segmentation

医学图像分割
  • 文章类型: Journal Article
    医学图像分析在临床诊断中起着重要的作用。在本文中,我们研究了最近在医学图像上的分段任意模型(SAM),并报告九种医学图像分割基准的定量和定性零镜头分割结果,涵盖各种成像模式,如光学相干断层扫描(OCT),磁共振成像(MRI),和计算机断层扫描(CT),以及不同的应用,包括皮肤病学,眼科,和放射学。这些基准具有代表性,通常用于模型开发。我们的实验结果表明,虽然SAM在一般领域的图像上表现出显著的分割性能,对于分布外的图像,其零镜头分割能力仍然受到限制,例如,医学图像。此外,SAM在不同的未见过的医学领域中表现出不一致的零镜头分割性能。对于某些结构化目标,例如,血管,SAM的零射分割完全失败。相比之下,用少量数据对其进行简单的微调可以显着提高分割质量,显示了使用微调SAM实现精确医学图像分割以进行精确诊断的巨大潜力和可行性。我们的研究表明,通用视觉基础模型在医学成像上的多功能性,和他们的巨大潜力,以实现所需的性能,通过微调,并最终解决与访问大型和多样化的医疗数据集以支持临床诊断相关的挑战。
    Medical image analysis plays an important role in clinical diagnosis. In this paper, we examine the recent Segment Anything Model (SAM) on medical images, and report both quantitative and qualitative zero-shot segmentation results on nine medical image segmentation benchmarks, covering various imaging modalities, such as optical coherence tomography (OCT), magnetic resonance imaging (MRI), and computed tomography (CT), as well as different applications including dermatology, ophthalmology, and radiology. Those benchmarks are representative and commonly used in model development. Our experimental results indicate that while SAM presents remarkable segmentation performance on images from the general domain, its zero-shot segmentation ability remains restricted for out-of-distribution images, e.g., medical images. In addition, SAM exhibits inconsistent zero-shot segmentation performance across different unseen medical domains. For certain structured targets, e.g., blood vessels, the zero-shot segmentation of SAM completely failed. In contrast, a simple fine-tuning of it with a small amount of data could lead to remarkable improvement of the segmentation quality, showing the great potential and feasibility of using fine-tuned SAM to achieve accurate medical image segmentation for a precision diagnostics. Our study indicates the versatility of generalist vision foundation models on medical imaging, and their great potential to achieve desired performance through fine-turning and eventually address the challenges associated with accessing large and diverse medical datasets in support of clinical diagnostics.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    关节软骨磁共振(MR)图像的分析和分割属于膝关节区域肌肉骨骼系统诊断中最常见的常规任务之一。传统的区域分割方法,它们基于直方图分区(例如,Otsu方法)或聚类方法(例如,K-means),经常被用于区域分割的任务。这种方法是众所周知的在环境中快速和良好的工作,其中软骨图像特征是可靠可识别的。众所周知的事实是,这些方法的性能容易出现图像噪声和伪影。在这种情况下,区域细分战略,由遗传算法或选定的进化计算策略驱动,有可能克服这些传统方法,如Otsu阈值或K-means在其性能的背景下。这些优化策略连续生成一组可能的直方图阈值的金字塔,通过使用基于Kapur的熵最大化的适应度函数来评估其质量,以找到关节软骨分割的最佳阈值组合。另一方面,这样的优化策略通常对计算要求很高,这是针对MR图像的堆叠使用这种方法的限制。在这项研究中,我们发布了基于模糊软分割的优化方法的综合分析,由人工蜂群(ABC)驱动,粒子群优化(PSO),达尔文粒子群优化(DPSO)以及一种遗传算法,用于针对常规分割Otsu和K均值进行最佳阈值选择,以进行分析以及从MR图像中提取关节软骨的特征。本研究客观地分析了分割策略在动态强度可变噪声下的性能,以报告在各种图像条件下的分割鲁棒性,适用于各种数量的分割类(4、7和10)。软骨特征(面积,周边,和骨架)针对常规分割策略的提取精度,最后是计算时间,这代表了分割性能的一个重要因素。我们在单个优化策略上使用相同的设置:100次迭代和50次总体。这项研究表明,从附加动态噪声影响的分割影响的角度来看,与其他方法相比,模糊阈值与ABC算法的结合具有最佳性能。还用于软骨特征提取。另一方面,在某些情况下,使用遗传算法进行软骨分割并不能提供良好的性能。在大多数情况下,分析的优化策略显著克服了常规的分割方法,除了计算时间,对于常规算法,这通常较低。我们还发布了显著性统计检验,显示了个体优化策略与Otsu和K-means方法的性能差异。最后,作为这项研究的一部分,我们发布一个软件环境,整合了本研究的所有方法。
    The analysis and segmentation of articular cartilage magnetic resonance (MR) images belongs to one of the most commonly routine tasks in diagnostics of the musculoskeletal system of the knee area. Conventional regional segmentation methods, which are based either on the histogram partitioning (e.g., Otsu method) or clustering methods (e.g., K-means), have been frequently used for the task of regional segmentation. Such methods are well known as fast and well working in the environment, where cartilage image features are reliably recognizable. The well-known fact is that the performance of these methods is prone to the image noise and artefacts. In this context, regional segmentation strategies, driven by either genetic algorithms or selected evolutionary computing strategies, have the potential to overcome these traditional methods such as Otsu thresholding or K-means in the context of their performance. These optimization strategies consecutively generate a pyramid of a possible set of histogram thresholds, of which the quality is evaluated by using the fitness function based on Kapur\'s entropy maximization to find the most optimal combination of thresholds for articular cartilage segmentation. On the other hand, such optimization strategies are often computationally demanding, which is a limitation of using such methods for a stack of MR images. In this study, we publish a comprehensive analysis of the optimization methods based on fuzzy soft segmentation, driven by artificial bee colony (ABC), particle swarm optimization (PSO), Darwinian particle swarm optimization (DPSO), and a genetic algorithm for an optimal thresholding selection against the routine segmentations Otsu and K-means for analysis and the features extraction of articular cartilage from MR images. This study objectively analyzes the performance of the segmentation strategies upon variable noise with dynamic intensities to report a segmentation\'s robustness in various image conditions for a various number of segmentation classes (4, 7, and 10), cartilage features (area, perimeter, and skeleton) extraction preciseness against the routine segmentation strategies, and lastly the computing time, which represents an important factor of segmentation performance. We use the same settings on individual optimization strategies: 100 iterations and 50 population. This study suggests that the combination of fuzzy thresholding with an ABC algorithm gives the best performance in the comparison with other methods as from the view of the segmentation influence of additive dynamic noise influence, also for cartilage features extraction. On the other hand, using genetic algorithms for cartilage segmentation in some cases does not give a good performance. In most cases, the analyzed optimization strategies significantly overcome the routine segmentation methods except for the computing time, which is normally lower for the routine algorithms. We also publish statistical tests of significance, showing differences in the performance of individual optimization strategies against Otsu and K-means method. Lastly, as a part of this study, we publish a software environment, integrating all the methods from this study.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    最近,深度卷积神经网络在医学图像分割中取得了巨大的成功。然而,与自然图像的分割不同,大多数医学图像,如MRI和CT是体积数据。为了充分利用体积信息,3DCNN被广泛使用。然而,3DCNN遭受更高的推理时间和计算成本,这阻碍了它们进一步的临床应用。此外,随着参数数量的增加,过度拟合的风险更高,特别是对于数据和注释获取起来很昂贵的医学图像。要发出这个问题,已经提出了许多2.5D分割方法来利用体积空间信息,并且计算成本较低。尽管这些工作导致了各种细分任务的改进,据我们所知,以前没有对这些方法进行大规模的经验比较。在本文中,我们旨在对2.5D体积医学图像分割方法的最新进展进行综述。此外,为了比较这些方法的性能和有效性,我们对涉及不同模式和目标的三个代表性细分任务的这些方法进行了实证研究。我们的实验结果强调3DCNN可能并不总是最佳选择。尽管所有这些2.5D方法可以为2D基线带来性能增益,并非所有方法都在不同的数据集上拥有优势。我们希望我们的研究结果和结论将证明对社区探索和开发有效的体积医学图像分割方法有用。
    Recently, deep convolutional neural networks have achieved great success for medical image segmentation. However, unlike segmentation of natural images, most medical images such as MRI and CT are volumetric data. In order to make full use of volumetric information, 3D CNNs are widely used. However, 3D CNNs suffer from higher inference time and computation cost, which hinders their further clinical applications. Additionally, with the increased number of parameters, the risk of overfitting is higher, especially for medical images where data and annotations are expensive to acquire. To issue this problem, many 2.5D segmentation methods have been proposed to make use of volumetric spatial information with less computation cost. Despite these works lead to improvements on a variety of segmentation tasks, to the best of our knowledge, there has not previously been a large-scale empirical comparison of these methods. In this paper, we aim to present a review of the latest developments of 2.5D methods for volumetric medical image segmentation. Additionally, to compare the performance and effectiveness of these methods, we provide an empirical study of these methods on three representative segmentation tasks involving different modalities and targets. Our experimental results highlight that 3D CNNs may not always be the best choice. Despite all these 2.5D methods can bring performance gains to 2D baseline, not all the methods hold the benefits on different datasets. We hope the results and conclusions of our study will prove useful for the community on exploring and developing efficient volumetric medical image segmentation methods.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    尽管二维斑点追踪超声心动图在心脏病学的医学诊断技术中占有重要地位,它仍然需要进一步的发展,以提高其可重复性和可靠性。很少有工作试图将左心室分割结果纳入位移和应变估计的过程中以改善其性能。我们建议在基于弹性图像配准的位移估计中使用掩模信息作为额外的惩罚。使用短轴视图合成超声心动图数据研究了这种方法,使用活动轮廓方法分割。获得的掩模变形到不同程度,使用不同的方法来评估分割质量对位移和应变估计过程的影响。位移和周向应变估计的结果表明,即使该方法取决于掩模质量,在分割效果良好的情况下,由于分割质量差而导致的潜在精度损失远低于潜在精度增益。
    Although the two dimensional Speckle Tracking Echocardiography has gained a strong position among medical diagnostic techniques in cardiology, it still requires further developments to improve its repeatability and reliability. Few works have attempted to incorporate the left ventricle segmentation results in the process of displacements and strain estimation to improve its performance. We proposed the use of mask information as an additional penalty in the elastic image registration based displacements estimation. This approach was studied using a short axis view synthetic echocardiographic data, segmented using an active contour method. The obtained masks were distorted to a different degree, using different methods to assess the influence of the segmentation quality on the displacements and strain estimation process. The results of displacements and circumferential strain estimations show, that even though the method is dependent on the mask quality, the potential loss in accuracy due to the poor segmentation quality is much lower than the potential accuracy gain in cases where the segmentation performs well.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    Recently, the analysis of endolymphatic hydropses (EHs) via inner ear magnetic resonance imaging (MRI) for patients with Ménière disease has been attempted in various studies. In addition, artificial intelligence has rapidly been incorporated into the medical field. In our previous studies, an automated algorithm for EH analysis was developed by using a convolutional neural network. However, several limitations existed, and further studies were conducted to compensate for these limitations.
    The aim of this study is to develop a fully automated analytic system for measuring EH ratios that enhances EH analysis accuracy and clinical usability when studying Ménière disease via MRI.
    We proposed the 3into3Inception and 3intoUNet networks. Their network architectures were based on those of the Inception-v3 and U-Net networks, respectively. The developed networks were trained for inner ear segmentation by using the magnetic resonance images of 124 people and were embedded in a new, automated EH analysis system-inner-ear hydrops estimation via artificial intelligence (INHEARIT)-version 2 (INHEARIT-v2). After fivefold cross-validation, an additional test was performed by using 60 new, unseen magnetic resonance images to evaluate the performance of our system. The INHEARIT-v2 system has a new function that automatically selects representative images from a full MRI stack.
    The average segmentation performance of the fivefold cross-validation was measured via the intersection of union method, resulting in performance values of 0.743 (SD 0.030) for the 3into3Inception network and 0.811 (SD 0.032) for the 3intoUNet network. The representative magnetic resonance slices (ie, from a data set of unseen magnetic resonance images) that were automatically selected by the INHEARIT-v2 system only differed from a maximum of 2 expert-selected slices. After comparing the ratios calculated by experienced physicians and those calculated by the INHEARIT-v2 system, we found that the average intraclass correlation coefficient for all cases was 0.941; the average intraclass correlation coefficient of the vestibules was 0.968, and that of the cochleae was 0.914. The time required for the fully automated system to accurately analyze EH ratios based on a patient\'s MRI stack was approximately 3.5 seconds.
    In this study, a fully automated full-stack magnetic resonance analysis system for measuring EH ratios was developed (named INHEARIT-v2), and the results showed that there was a high correlation between the expert-calculated EH ratio values and those calculated by the INHEARIT-v2 system. The system is an upgraded version of the INHEARIT system; it has higher segmentation performance and automatically selects representative images from an MRI stack. The new model can help clinicians by providing objective analysis results and reducing the workload for interpreting magnetic resonance images.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    BACKGROUND: Medical three-dimensional (3D) digital reconstruction and printing have become common tools in medicine, but few undergraduate medical students understand its whole process and teaching and clinical application. Therefore, we designed an elective course of 3D reconstruction and printing for students and studied its significance and practicability.
    METHODS: Thirty undergraduate medical students in their second-year of study volunteered to participate in the course. The course started with three lessons on the theory of 3D digital reconstruction and printing in medicine. The students were then randomly divided into ten groups. Each group randomly selected its own original data set, which could contain a series of 2D images including sectional anatomical images, histological images, CT and MRI. Amira software was used to segment the structures of interest, to 3D reconstruct them and to smooth and simplify the models. These models were 3D printed and post-processed. Finally, the 3D digital and printed models were scored, and the students produced brief reports of their work and knowledge acquisition and filled out an anonymous questionnaire about their study perceptions.
    RESULTS: All the students finished this course. The average score of the 30 students was 83.1 ± 2.7. This course stimulated the students\' learning interest and satisfied them. It was helpful for undergraduate students to understand anatomical structures and their spatial relationship more deeply. Students understood the whole process of 3D reconstruction and printing and its teaching and clinical applications through this course.
    CONCLUSIONS: It is significant and necessary to develop this course for undergraduate medical students.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

公众号