PDF(Pubmed)
Abstract：
We present a new rehabilitation system based on novel principles, which consists of an auditory augmented reality (AR) headset we originated. The auditory AR headset, which does not cover both ears, allows users to hear both Real and Virtual environmental sounds at the same time. It can also be used in combination with Hearing Aids. We have studied a system to support hearing-impaired people and conducted a test evaluation. The system was able to provide convenience akin to \"reading glasses for sound\" to those who had mild hearing disabilities. Furthermore, by combining the system with surrounding speakers, a completely novel virtual auditory illusion was created in which the sound image jumps into the ear and runs away. We name this \"proximal auditory AR (PAAR)\" system. This system directly affects the unconscious level of reflexes for maintaining a standing position and can generate very subtle body motion disturbance. Using this system, we can modulate the standing posture and observe the autonomic nerve system\'s ability to subliminally compensate for the disturbance, using a stabilometer that measures body sways by center of pressure (COP). We observed a significant difference in the declination of COP only when using the PAAR, which is combined with array speakers and the auditory AR headphone, compared using a conventional closed-type and a bone-conduction headphone. By analyzing such big data of physical movement through machine learning, we expect to realize new systems for diagnosis, rehabilitation, function maintenance, and fall prevention.
摘要：
我们提出了一种基于新颖原理的新康复系统，它由我们起源的听觉增强现实（AR）耳机组成。听觉AR耳机，它不覆盖两只耳朵，允许用户同时听到真实和虚拟环境的声音。它也可以与助听器结合使用。我们研究了一种支持听力受损人群的系统，并进行了测试评估。该系统能够为轻度听力障碍的人提供类似于“声音阅读眼镜”的便利。此外，通过将系统与周围的扬声器相结合，创造了一种全新的虚拟听觉错觉，其中声音图像跳入耳朵并消失。我们将此命名为“近端听觉AR（PAAR）”系统。该系统直接影响维持站立姿势的无意识反射水平，并可能产生非常微妙的身体运动干扰。使用这个系统，我们可以调节站立姿势和观察自主神经系统的能力，以下意识地补偿干扰，使用通过压力中心（COP）测量身体摇摆的稳定器。我们观察到只有当使用PAAR时，COP的偏角才有显著差异，它与阵列扬声器和听觉AR耳机相结合，使用传统的封闭式和骨传导耳机进行比较。通过机器学习分析物理运动的大数据，我们期望实现新的诊断系统，康复,功能维护,跌倒预防。
