Abstract:
Multiple instance learning (MIL)-based methods have been widely adopted to process the whole slide image (WSI) in the field of computational pathology. Due to the sparse slide-level supervision, these methods usually lack good localization on the tumor regions, leading to poor interpretability. Moreover, they lack robust uncertainty estimation of prediction results, leading to poor reliability. To solve the above two limitations, we propose an explainable and evidential multiple instance learning (E2-MIL) framework for whole slide image classification. E2-MIL is mainly composed of three modules: a detail-aware attention distillation module (DAM), a structure-aware attention refined module (SRM), and an uncertainty-aware instance classifier (UIC). Specifically, DAM helps the global network locate more detail-aware positive instances by utilizing the complementary sub-bags to learn detailed attention knowledge from the local network. In addition, a masked self-guidance loss is also introduced to help bridge the gap between the slide-level labels and instance-level classification tasks. SRM generates a structure-aware attention map that locates the entire tumor region structure by effectively modeling the spatial relations between clustering instances. Moreover, UIC provides accurate instance-level classification results and robust predictive uncertainty estimation to improve the model reliability based on subjective logic theory. Extensive experiments on three large multi-center subtyping datasets demonstrate both slide-level and instance-level performance superiority of E2-MIL.
摘要:
在计算病理学领域中,基于多实例学习(MIL)的方法已经被广泛采用来处理整个幻灯片图像(WSI)。由于幻灯片级监督稀疏,这些方法通常在肿瘤区域缺乏良好的定位,导致可解释性差。此外,它们缺乏对预测结果的稳健不确定性估计,导致可靠性差。为了解决上述两个限制,我们提出了一个可解释和证据的多实例学习(E2-MIL)框架,用于整个幻灯片图像分类。E2-MIL主要由三个模块组成:细节感知注意蒸馏模块(DAM),结构感知注意力细化模块(SRM),和不确定性感知实例分类器(UIC)。具体来说,DAM通过利用互补的子袋从本地网络中学习详细的注意力知识,帮助全球网络找到更多细节感知的正面实例。此外,还引入了屏蔽的自指导损失,以帮助弥合幻灯片级别标签和实例级别分类任务之间的差距。SRM生成结构感知注意力图,其通过有效地对聚类实例之间的空间关系建模来定位整个肿瘤区域结构。此外,UIC提供准确的实例级分类结果和稳健的预测不确定性估计,以提高基于主观逻辑理论的模型可靠性。在三个大型多中心子类型数据集上进行的大量实验证明了E2-MIL的幻灯片级和实例级性能优势。