关键词: Eye tracking Eye-Hand Dashboard Limb tracking Sensory-motor coordination Visualization techniques

来  源:   DOI:10.1016/j.mex.2024.102722   PDF(Pubmed)

Abstract:
Eye-hand coordination (EHC) is crucial to our daily activities, and its underlying mechanisms are being intensely studied. The analysis of simultaneous eye and hand movements can provide valuable insights into EHC, particularly for individuals struggling with dexterous control, such as might be caused by stroke or traumatic brain injuries. Despite advancements in motion-capture and eye tracking technologies, there is currently no automated method for visualizing concurrent eye- and hand-movement data. To address this need, we have developed a MATLAB-based dashboard designed for near instantaneous analysis and visualization of eye and hand-tracking data. This paper introduces the design of the dashboard and presents experimental results obtained from its application, leveraging simulated data inspired by our recent work in stroke. This testing suggests that our solution has the potential to significantly aid in understanding and investigating EHC by providing side-by-side and time-locked comparison of eye/hand movements along with their timing and spatio-temporal errors, offering novel opportunities for research and clinical applications.•Continuous eye movement data is collected throughout the experiment•Continuous hand movement data is collected throughout the experiment•Combine datasets and display time-locked eye-hand data in a single dashboard.
摘要:
眼手协调(EHC)对我们的日常活动至关重要,及其潜在机制正在被深入研究。对同时的眼睛和手运动的分析可以为EHC提供有价值的见解,特别是对于那些在灵巧控制中挣扎的人来说,例如可能由中风或创伤性脑损伤引起。尽管运动捕捉和眼动追踪技术取得了进步,目前还没有用于同时可视化眼睛和手移动数据的自动化方法。为了满足这一需求,我们开发了一个基于MATLAB的仪表板,用于眼睛和手跟踪数据的近瞬时分析和可视化。本文介绍了仪表板的设计,并给出了从其应用中获得的实验结果,利用受我们最近中风研究启发的模拟数据。该测试表明,我们的解决方案有可能通过提供眼睛/手运动的并排和时间锁定比较以及它们的时间和时空误差来显著帮助理解和研究EHC。为研究和临床应用提供新的机会。•在整个实验中收集连续的眼动数据•在整个实验中收集连续的手部运动数据•组合数据集并在单个仪表板中显示时间锁定的眼手数据。
公众号