Abstract:
This work analyzed the use of Microsoft HoloLens 2 in orthopedic oncological surgeries and compares it to its predecessor (Microsoft HoloLens 1). Specifically, we developed two equivalent applications, one for each device, and evaluated the augmented reality (AR) projection accuracy in an experimental scenario using phantoms based on two patients. We achieved automatic registration between virtual and real worlds using patient-specific surgical guides on each phantom. They contained a small adaptor for a 3D-printed AR marker, the characteristic patterns of which were easily recognized using both Microsoft HoloLens devices. The newest model improved the AR projection accuracy by almost 25%, and both of them yielded an RMSE below 3 mm. After ascertaining the enhancement of the second model in this aspect, we went a step further with Microsoft HoloLens 2 and tested it during the surgical intervention of one of the patients. During this experience, we collected the surgeons\' feedback in terms of comfortability, usability, and ergonomics. Our goal was to estimate whether the improved technical features of the newest model facilitate its implementation in actual surgical scenarios. All of the results point to Microsoft HoloLens 2 being better in all the aspects affecting surgical interventions and support its use in future experiences.
摘要:
这项工作分析了MicrosoftHoloLens2在骨科肿瘤手术中的使用,并将其与其前身(MicrosoftHoloLens1)进行了比较。具体来说,我们开发了两个等效的应用程序,每个设备一个,并使用基于两名患者的体模评估了实验场景中的增强现实(AR)投影精度。我们在每个体模上使用患者特定的手术指南实现了虚拟世界和现实世界之间的自动配准。它们包含一个用于3D打印AR标记的小型适配器,其特征模式很容易识别使用MicrosoftHoloLens设备。最新的模型将AR投影精度提高了近25%,两者的RMSE均低于3mm。在确定第二模型在这方面的增强之后,我们进一步使用MicrosoftHoloLens2,并在其中一名患者的手术干预期间对其进行了测试。在这段经历中,我们收集了外科医生在舒适度方面的反馈,可用性,和人体工程学。我们的目标是评估最新模型的改进技术功能是否有助于其在实际手术场景中的实施。所有结果都表明MicrosoftHoloLens2在影响手术干预的所有方面都更好,并支持其在未来的经验中使用。