■医学图像可视化是许多类型的手术中的要求,例如骨科,脊柱,胸部手术或肿瘤切除术,以消除风险,如“错误级别的手术”。然而,直接接触物理设备如鼠标或触摸屏来控制图像是一个挑战,因为潜在的感染风险。为了防止感染在无菌环境中传播,已经开发出一种无传染性感染的医疗互动系统来操纵医疗图像。
■我们提出了一个具有三个关键模块的集成系统:手部地标检测,手指向,和手势识别。提出的深度增强算法与深度学习手界标检测器相结合以生成手界标。基于所设计的系统,与投影和光线指向技术相结合的拟议的手指向系统可以减少操作期间的疲劳。提出的地标几何约束算法和深度学习方法用于检测六种手势,包括点击,打开,关闭,缩放,拖动,和旋转。此外,开发了一个控制菜单来有效地激活常见功能。
■所提出的手动指向系统允许在垂直和水平方向上最大1200mm的大控制范围。所提出的手势识别方法具有超过97%的准确率和实时响应。
■本文描述了无传染性感染的医疗交互系统,该系统能够在较大的控制范围内对医疗图像进行精确有效的操纵,同时尽量减少手的疲劳。
UNASSIGNED: Medical image visualization is a requirement in many types of surgery such as orthopaedic, spinal, thoracic procedures or tumour resection to eliminate risk such as \"wrong level surgery\". However, direct contact with physical devices such as mice or touch screens to control images is a challenge because of the potential risk of infection. To prevent the spread of infection in sterile environments, a contagious infection-free medical interaction system has been developed for manipulating medical images.
UNASSIGNED: We proposed an integrated system with three key modules: hand landmark detection, hand pointing, and hand gesture recognition. A proposed depth enhancement algorithm is combined with a deep learning hand landmark detector to generate hand landmarks. Based on the designed system, a proposed hand-pointing system combined with projection and ray-pointing techniques allows for reducing fatigue during manipulation. A proposed landmark geometry constraint algorithm and deep learning method were applied to detect six gestures including click, open, close, zoom, drag, and rotation. Additionally, a control menu was developed to effectively activate common functions.
UNASSIGNED: The proposed hand-pointing system allowed for a large control range of up to 1200 mm in both vertical and horizontal direction. The proposed hand gesture recognition method showed high accuracy of over 97% and real-time response.
UNASSIGNED: This paper described the contagious infection-free medical interaction system that enables precise and effective manipulation of medical images within the large control range, while minimizing hand fatigue.