In vitro fenestration of stent-graft (IVFS) demands high-precision navigation methods to achieve optimal surgical outcomes. This study aims to propose an augmented reality (AR) navigation method for IVFS, which can provide in situ overlay display to locate fenestration positions.
We propose an AR navigation method to assist doctors in performing IVFS. A deep learning-based aorta segmentation algorithm is used to achieve automatic and rapid aorta segmentation. The Vuforia-based virtual-real registration and marker recognition algorithm are integrated to ensure accurate in situ AR image.
The proposed method can provide three-dimensional in situ AR image, and the fiducial registration error after virtual-real registration is 2.070 mm. The aorta segmentation experiment obtains dice similarity coefficient of 91.12% and Hausdorff distance of 2.59, better than conventional algorithms before improvement.
The proposed method can intuitively and accurately locate fenestration positions, and therefore can assist doctors in performing IVFS.

Non-contrast chest CT is widely used for lung cancer screening, and its images carry potential information of the thoracic aorta. The morphological assessment of the thoracic aorta may have potential value in the presymptomatic detection of thoracic aortic-related diseases and the risk prediction of future adverse events. However, due to low vasculature contrast in such images, visual assessment of aortic morphology is challenging and highly depends on physicians\' experience.
The main objective of this study is to propose a novel multi-task framework based on deep learning for simultaneous aortic segmentation and localization of key landmarks on unenhanced chest CT. The secondary objective is to use the algorithm to measure quantitative features of thoracic aorta morphology.
The proposed network is composed of two subnets to carry out segmentation and landmark detection, respectively. The segmentation subnet aims to demarcate the aortic sinuses of the Valsalva, aortic trunk and aortic branches, whereas the detection subnet is devised to locate five landmarks on the aorta to facilitate morphology measures. The networks share a common encoder and run decoders in parallel, taking full advantage of the synergy of the segmentation and landmark detection tasks. Furthermore, the volume of interest (VOI) module and the squeeze-and-excitation (SE) block with attention mechanisms are incorporated to further boost the capability of feature learning.
Benefiting from the multitask framework, we achieved a mean Dice score of 0.95, average symmetric surface distance of 0.53 mm, Hausdorff distance of 2.13 mm for aortic segmentation, and mean square error (MSE) of 3.23 mm for landmark localization in 40 testing cases.
We proposed a multitask learning framework which can perform segmentation of the thoracic aorta and localization of landmarks simultaneously and achieved good results. It can support quantitative measurement of aortic morphology for further analysis of aortic diseases, such as hypertension.