关键词: Augmented reality High-intensity focused ultrasound (HIFU) PET/CT visualization neuroblastoma volume ray casting

来  源:   DOI:10.1117/12.3008663   PDF(Pubmed)

Abstract:
Neuroblastoma is the most common type of extracranial solid tumor in children and can often result in death if not treated. High-intensity focused ultrasound (HIFU) is a non-invasive technique for treating tissue that is deep within the body. It avoids the use of ionizing radiation, avoiding long-term side-effects of these treatments. The goal of this project was to develop the rendering component of an augmented reality (AR) system with potential applications for image-guided HIFU treatment of neuroblastoma. Our project focuses on taking 3D models of neuroblastoma lesions obtained from PET/CT and displaying them in our AR system in near real-time for use by physicians. We used volume ray casting with raster graphics as our preferred rendering method, as it allows for the real-time editing of our 3D radiologic data. Some unique features of our AR system include intuitive hand gestures and virtual user interfaces that allow the user to interact with the rendered data and process PET/CT images for optimal visualization. We implemented the feature to set a custom transfer function, set custom intensity cutoff points, and region-of-interest extraction via cutting planes. In the future, we hope to incorporate this work as part of a complete system for focused ultrasound treatment by adding ultrasound simulation, visualization, and deformable registration.
摘要:
神经母细胞瘤是儿童最常见的颅外实体瘤,如果不治疗,通常会导致死亡。高强度聚焦超声(HIFU)是一种用于治疗身体深处的组织的非侵入性技术。它避免了使用电离辐射,避免这些治疗的长期副作用。该项目的目标是开发增强现实(AR)系统的渲染组件,该组件具有用于神经母细胞瘤的图像引导HIFU治疗的潜在应用。我们的项目专注于获取从PET/CT获得的神经母细胞瘤病变的3D模型,并在我们的AR系统中近乎实时地显示它们以供医生使用。我们使用带有光栅图形的体射线投射作为我们首选的渲染方法,因为它允许实时编辑我们的3D放射学数据。我们的AR系统的一些独特功能包括直观的手势和虚拟用户界面,允许用户与渲染数据进行交互并处理PET/CT图像以实现最佳可视化。我们实现了设置自定义传递函数的功能,设置自定义强度截止点,以及通过切割平面提取感兴趣区域。在未来,我们希望通过添加超声模拟,将这项工作作为聚焦超声治疗的完整系统的一部分,可视化,和可变形的注册。
公众号