binocular vision

双目视觉
  • 文章类型: Published Erratum
    [这更正了文章DOI:10.3389/fnins.2024.1349436。].
    [This corrects the article DOI: 10.3389/fnins.2024.1349436.].
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    视觉测距技术在无人驾驶和机器人导航等各个领域都具有广阔的前景。然而,复杂的动态环境对其准确性和鲁棒性提出了重大挑战。现有的单目视觉测距方法容易受到尺度不确定性的影响,而双目视觉测距对光照和纹理的变化很敏感。为了克服单一视觉测距的局限性,本文提出了一种基于自适应无迹卡尔曼滤波(AUKF)的单目和双目视觉测距融合方法。所提出的方法首先利用单目相机基于像素大小来估计初始距离,然后利用双目相机的三角测量原理来获得精确的深度。在这个基础上,构建了一个概率融合框架,使用AUKF动态融合单目和双目测距。AUKF采用非线性递归滤波来估计最佳距离及其不确定性,并介绍了一种自适应噪声调整机制,基于融合残差动态更新观测噪声,从而抑制异常干扰。此外,基于深度假设传播的自适应融合策略,通过结合当前环境特征和历史测量信息,自主调整AUKF的噪声先验,进一步增强了算法对复杂场景的适应性。为了验证该方法的有效性,对KITTI等大型公共数据集和在现实世界场景中收集的复杂场景数据进行了综合评估。定量结果表明,该融合方法显著提高了视觉测距的整体精度和稳定性,与单目和双目测距相比,8米范围内的平均相对误差分别降低了43.1%和40.9%,分别。与传统方法相比,该方法显著提高了测距精度,对光照变化和动态目标等因素具有较强的鲁棒性。敏感性分析进一步证实了AUKF框架和自适应噪声策略的有效性。总之,该融合方法有效地结合了单目视觉和双目视觉的优点,显著拓展了视觉测距技术在智能驾驶中的应用范围,机器人,和其他领域,同时确保准确性,鲁棒性,和实时性能。
    Visual ranging technology holds great promise in various fields such as unmanned driving and robot navigation. However, complex dynamic environments pose significant challenges to its accuracy and robustness. Existing monocular visual ranging methods are susceptible to scale uncertainty, while binocular visual ranging is sensitive to changes in lighting and texture. To overcome the limitations of single visual ranging, this paper proposes a fusion method for monocular and binocular visual ranging based on an adaptive Unscented Kalman Filter (AUKF). The proposed method first utilizes a monocular camera to estimate the initial distance based on the pixel size, and then employs the triangulation principle with a binocular camera to obtain accurate depth. Building upon this foundation, a probabilistic fusion framework is constructed to dynamically fuse monocular and binocular ranging using the AUKF. The AUKF employs nonlinear recursive filtering to estimate the optimal distance and its uncertainty, and introduces an adaptive noise-adjustment mechanism to dynamically update the observation noise based on fusion residuals, thus suppressing outlier interference. Additionally, an adaptive fusion strategy based on depth hypothesis propagation is designed to autonomously adjust the noise prior of the AUKF by combining current environmental features and historical measurement information, further enhancing the algorithm\'s adaptability to complex scenes. To validate the effectiveness of the proposed method, comprehensive evaluations were conducted on large-scale public datasets such as KITTI and complex scene data collected in real-world scenarios. The quantitative results demonstrate that the fusion method significantly improves the overall accuracy and stability of visual ranging, reducing the average relative error within an 8 m range by 43.1% and 40.9% compared to monocular and binocular ranging, respectively. Compared to traditional methods, the proposed method significantly enhances ranging accuracy and exhibits stronger robustness against factors such as lighting changes and dynamic targets. The sensitivity analysis further confirmed the effectiveness of the AUKF framework and adaptive noise strategy. In summary, the proposed fusion method effectively combines the advantages of monocular and binocular vision, significantly expanding the application range of visual ranging technology in intelligent driving, robotics, and other fields while ensuring accuracy, robustness, and real-time performance.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    本文介绍了一种新颖的仿生眼睛双目视觉系统,旨在模仿人眼的自然运动。该系统提供了更广阔的视野,并增强了复杂环境中的视觉感知。与同类仿生双目相机相比,本研究开发的JEWXONBC200仿生双目相机更加微型。它只消耗2.8W的功率,这使得它非常适合移动机器人。结合轴和相机旋转可以实现更无缝的全景图像合成,因此适用于自旋转仿生双目相机。此外,结合YOLO-V8模型,相机可以准确地识别物体,如时钟和键盘。该研究为机器人视觉系统的发展提供了新思路。
    This paper describes a novel bionic eye binocular vision system designed to mimic the natural movements of the human eye. The system provides a broader field of view and enhances visual perception in complex environments. Compared with similar bionic binocular cameras, the JEWXON BC200 bionic binocular camera developed in this study is more miniature. It consumes only 2.8 W of power, which makes it ideal for mobile robots. Combining axis and camera rotation enables more seamless panoramic image synthesis and is therefore suitable for self-rotating bionic binocular cameras. In addition, combined with the YOLO-V8 model, the camera can accurately recognize objects such as clocks and keyboards. This research provides new ideas for the development of robotic vision systems.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:Dichopic训练已成为改善斜视患者双眼视觉功能的一种有前途的康复方法。采用前瞻性观察性研究设计,以评估基于在线视频游戏的双视训练在间歇性外斜视手术患者双眼视觉功能康复中的有效性。
    方法:选择64例间歇性外斜视手术患者,根据是否接受双联训练分为训练组和对照组。训练组进行3个月的双视训练,对照组不接受任何形式的矫正治疗。在基线时进行双眼视觉功能和偏差的评估,3个月和6个月随访。
    结果:训练组29名参与者(平均9.69±2.66岁)和对照组26名参与者(平均8.41±2.64岁)完成随访。在3个月和6个月的随访中,与对照组相比,训练组显示出更好的距离立体视觉,近立体视在6个月的随访中仅显示出显着差异。此外,在这些时间,训练组的距离外偏差漂移明显少于对照组,两组间近外向漂移无显著差异。在3个月和6个月的随访中,对照组的手术结局次优率明显更高。然而,两组的同时感知和融合功能无显著差异.
    结论:基于在线视频游戏的双床训练有可能成为间歇性外斜视患者的一种新的术后康复策略。
    BACKGROUND: Dichoptic training has emerged as a promising rehabilitation approach for improving binocular visual function in patients with strabismus. A prospective observational study design was employed to assess the effectiveness of online video game-based dichoptic training in rehabilitating binocular visual function in patients who had undergone an operation for intermittent exotropia.
    METHODS: A total of 64 patients who had undergone an operation for intermittent exotropia were recruited and divided into the training group and the control group based on whether they would receive the dichoptic training. The dichoptic training was conducted for 3 months in the training group and the control group would not accept any form of orthoptic therapy. Assessments of binocular visual functions and deviation were conducted at baseline, 3-month and 6-month follow-up.
    RESULTS: Twenty-nine participants in the training group (mean 9.69 ± 2.66 years old) and 26 participants in the control group (mean 8.41 ± 2.64 years old) completed follow-up. At both 3- and 6-month follow-ups, the training group showed superior distance stereopsis compared to the control group, with near stereopsis only showing significant difference at the 6-month follow-up. Additionally, the training group exhibited significantly less distance exo-deviation drift than the control group at these times, and no significant difference was observed in near exo-deviation drift between the groups. The control group had a significantly higher rate of suboptimal surgical outcomes at both the 3- and 6-month follow-up. However, no significant differences were observed in simultaneous perception and fusion functions between the two groups.
    CONCLUSIONS: Online video game-based dichoptic training has the potential to become a novel postoperative rehabilitation strategy for patients with intermittent exotropia.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    基于光折射原理和双目测距,得到水下成像模型。为水下摄像机标定提供了理论依据。为了满足水下航行器对水下目标进行识别和测距的要求,提出了一种基于语义分割和双目视觉的水下机器人测距系统。该系统使用Deeplabv3+对双目相机捕获的水下目标进行识别并生成目标地图,然后用于双目测距。与使用原始图纸的双目测距相比,所提出的方法的测量精度没有改变,测量速度提高了30%,错误率控制在5%以内,满足水下机器人作业的需要。
    Based on the principle of light refraction and binocular ranging, the underwater imaging model is obtained. It provides a theoretical basis for underwater camera calibration. In order to meet the requirement of underwater vehicle to identify and distance underwater target, a new underwater vehicle distance measurement system based on semantic segmentation and binocular vision is proposed. The system uses Deeplabv3 + to identify the underwater target captured by the binocular camera and generate the target map, which is then used for binocular ranging. Compared with the binocular ranging using the original drawing, the measurement accuracy of the proposed method has not changed, the measurement speed is increased by 30%, and the error rate is controlled within 5%, which meets the needs of underwater robot operations.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    目的:徒手三维(3D)超声(US)对临床诊断和治疗具有重要意义,它通常是借助外部设备(光学和/或电磁,等。)监控美国探测器的位置和方向。然而,这种外部监测通常受到成像环境的影响,例如光学遮挡和/或电磁(EM)干扰。
    方法:为了解决上述问题,我们在美国探头上集成了双目相机和惯性测量单元(IMU)。随后,利用基于李群的无迹卡尔曼算法(UKF-LG)建立了紧耦合模型,结合视觉和惯性信息来推断探头的运动,通过它来计算US图像帧的位置和方向。最后,采用基于体素的孔洞填充方法重建体数据。
    结果:实验包括校准实验,跟踪绩效评估,幻影扫描,和真实场景扫描已经进行。结果表明,所提出的系统实现了3.78mm的累积帧位置误差和0.36°的方向误差,并且在幻像和真实场景中都具有高质量的重建3DUS图像。
    结论:所提出的方法已被证明可以增强徒手3DUS的鲁棒性和有效性。后续研究将侧重于提高多传感器融合的准确性和稳定性,以使该系统在临床环境中更具实用性。
    OBJECTIVE: Freehand three-dimensional (3D) ultrasound (US) is of great significance for clinical diagnosis and treatment, it is often achieved with the aid of external devices (optical and/or electromagnetic, etc.) that monitor the location and orientation of the US probe. However, this external monitoring is often impacted by imaging environment such as optical occlusions and/or electromagnetic (EM) interference.
    METHODS: To address the above issues, we integrated a binocular camera and an inertial measurement unit (IMU) on a US probe. Subsequently, we built a tight coupling model utilizing the unscented Kalman algorithm based on Lie groups (UKF-LG), combining vision and inertial information to infer the probe\'s movement, through which the position and orientation of the US image frame are calculated. Finally, the volume data was reconstructed with the voxel-based hole-filling method.
    RESULTS: The experiments including calibration experiments, tracking performance evaluation, phantom scans, and real scenarios scans have been conducted. The results show that the proposed system achieved the accumulated frame position error of 3.78 mm and the orientation error of 0.36° and reconstructed 3D US images with high quality in both phantom and real scenarios.
    CONCLUSIONS: The proposed method has been demonstrated to enhance the robustness and effectiveness of freehand 3D US. Follow-up research will focus on improving the accuracy and stability of multi-sensor fusion to make the system more practical in clinical environments.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    稳态视觉诱发电位脑机接口(SSVEP-BCI)由于其易于部署以及在信息传输速率(ITR)和准确性方面的高性能而引起了极大的关注,使它们成为与消费电子设备集成的有希望的候选人。然而,由于SSVEP特征与视觉刺激属性直接相关,立体视觉作为关键视觉属性对SSVEP的影响尚未得到充分探索。同时,虚拟现实(VR)设备和BCI应用的有希望的组合受到VR环境和传统2D显示器之间的显著差异的阻碍。这不仅是因为基于屏幕的SSVEP通常在静态下运行,具有简单和不变的视觉刺激的稳定条件,但也因为常规的亮度调制刺激可以迅速引起视觉疲劳。本研究试图通过设计具有立体相关属性的SSVEP范式,并在相同的VR环境下与传统的2D平面范式进行比较分析,来解决这些研究空白。本研讨提出了两个新的范式:3D范式和3D-Blink范式。3D范式通过调制球形目标的亮度来诱导SSVEP,而3D-Blink范例采用了球体不透明度的调制。离线4对象选择实验结果表明,典型相关分析(CCA)的3D和2D范式的准确率分别为85.67和86.17%,而滤波器组典型相关分析(FBCCA)的准确率分别为86.17和91.73%。这与在频域分析中观察到的3D范例的SSVEP谐波的信噪比(SNR)的降低是一致的。3D-Blink范例以0.8秒的刺激时间和任务相关成分分析(TRCA)算法实现了75.00%的检测精度和27.02位/分钟的ITR,证明其有效性。这些发现表明,VR支持的3D和3D-Blink范例可以提高用户舒适度和令人满意的性能,而立体相关范例需要进一步的算法优化和特征分析。总之,这项研究有助于更深入地了解双目立体视觉机制对SSVEP范式的影响,并促进SSVEP-BCI在不同VR环境中的应用。
    Steady-state visual evoked potential brain-computer interfaces (SSVEP-BCI) have attracted significant attention due to their ease of deployment and high performance in terms of information transfer rate (ITR) and accuracy, making them a promising candidate for integration with consumer electronics devices. However, as SSVEP characteristics are directly associated with visual stimulus attributes, the influence of stereoscopic vision on SSVEP as a critical visual attribute has yet to be fully explored. Meanwhile, the promising combination of virtual reality (VR) devices and BCI applications is hampered by the significant disparity between VR environments and traditional 2D displays. This is not only due to the fact that screen-based SSVEP generally operates under static, stable conditions with simple and unvaried visual stimuli but also because conventional luminance-modulated stimuli can quickly induce visual fatigue. This study attempts to address these research gaps by designing SSVEP paradigms with stereo-related attributes and conducting a comparative analysis with the traditional 2D planar paradigm under the same VR environment. This study proposed two new paradigms: the 3D paradigm and the 3D-Blink paradigm. The 3D paradigm induces SSVEP by modulating the luminance of spherical targets, while the 3D-Blink paradigm employs modulation of the spheres\' opacity instead. The results of offline 4-object selection experiments showed that the accuracy of 3D and 2D paradigm was 85.67 and 86.17% with canonical correlation analysis (CCA) and 86.17 and 91.73% with filter bank canonical correlation analysis (FBCCA), which is consistent with the reduction in the signal-to-noise ratio (SNR) of SSVEP harmonics for the 3D paradigm observed in the frequency-domain analysis. The 3D-Blink paradigm achieved 75.00% of detection accuracy and 27.02 bits/min of ITR with 0.8 seconds of stimulus time and task-related component analysis (TRCA) algorithm, demonstrating its effectiveness. These findings demonstrate that the 3D and 3D-Blink paradigms supported by VR can achieve improved user comfort and satisfactory performance, while further algorithmic optimization and feature analysis are required for the stereo-related paradigms. In conclusion, this study contributes to a deeper understanding of the impact of binocular stereoscopic vision mechanisms on SSVEP paradigms and promotes the application of SSVEP-BCI in diverse VR environments.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    目的:确定近视眼儿童调节功能和双眼功能变化与近视进展的关系,并确定从眼镜转换为角膜塑形镜(Ortho-K)后视觉功能的变化何时稳定。
    方法:这种前瞻性,自我对照研究追踪了36名参与者(年龄在8-14岁之间),他们从眼镜换成了Ortho-K。在开始正交试验之前和之后1、3、6、12、18和24个月评估调节和双眼功能。测量包括调节振幅,宽松的反应,住宿设施,调节会聚/调节(AC/A),眼对准,正相对适应(PRA),负相对调节(NRA),水平聚散度范围,阅读能力和立体敏锐度。通过眼轴长度的变化来量化近视进展。
    结果:眼睛对齐,单眼和双眼调节设施,PRA在1个月后稳定下来。收敛范围内的距离模糊点,发散范围内的距离突破和恢复点,调节振幅,计算的AC/A,立体敏锐度和阅读能力在6个月内稳定。在Ortho-K工作了两年之后,NRA显著增加(p=0.044),镜片佩戴一年后无显著性差异(p=0.49)。收敛范围内的距离断点没有显着差异(p=0.20),但一年后显著下降(p=0.005)。眼轴长度的变化与调节功能或双眼功能的变化之间没有显着相关性(p>0.05)。
    结论:从眼镜切换到Ortho-K后,调节和双眼功能发生了显着变化,并且大多数参数在前6个月内稳定。调节或双眼功能的变化与近视进展之间没有关联。
    OBJECTIVE: To determine the relationship between changes in accommodative and binocular function with myopia progression in myopic children over a two-year follow-up period, and to determine when changes in visual functions stabilized after switching from spectacles to orthokeratology (Ortho-K).
    METHODS: This prospective, self-controlled study followed thirty-six participants (aged 8-14 years) for two years after they switched from spectacles to Ortho-K. Accommodative and binocular function were assessed prior to and 1, 3, 6, 12, 18 and 24 months after commencing Ortho-K. Measurements included accommodative amplitude, accommodative response, accommodative facility, accommodative convergence/accommodation (AC/A), ocular alignment, positive relative accommodation (PRA), negative relative accommodation (NRA), horizontal vergence range, reading ability and stereoacuity. Myopia progression was quantified by the change in axial length.
    RESULTS: Ocular alignment, monocular and binocular accommodative facility, and PRA stabilized after 1 month. The distance blur point in the convergence range, the distance break and recovery point in the divergence range, accommodative amplitude, calculated AC/A, stereoacuity and reading ability stabilized within 6 months. After two years of Ortho-K, NRA significantly increased (p = 0.044), while it showed no significant difference after one-year of lens wear (p = 0.49). The distance break point in the convergence range showed no significant difference (p = 0.20), but significantly decreased after one-year (p = 0.005). There were no significant correlations between the change in axial length with changes in accommodative or binocular function (p > 0.05).
    CONCLUSIONS: Accommodative and binocular function changed significantly after switching from spectacles to Ortho-K and most of the parameters stabilized within the first 6 months. There was no association between the change in accommodative or binocular function and myopia progression.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    为解决使用双目相机检测表面纹理稀疏的物体时测量精度低、结果不稳定的问题,弱表面纹理,遮挡表面,低对比度表面,和强烈的光照变化的表面,提出了一种基于改进特征匹配算法的三维测量方法。最初,从双目相机获得的左右图像中提取特征。提取的特征点作为种子点,基于视差连续性和极线约束,准确地建立了一维搜索空间。利用粒子群优化算法获得最优搜索范围和种子点数量。零均值归一化互相关系系数被用作区域生长的相似性度量函数。随后,根据特征区域的灰度信息对左右图像进行匹配,在每个匹配区域内执行种子点匹配。最后,得到的匹配对用于利用三角剖分公式计算目标物体的三维信息。该算法在降低算法复杂度的同时显著提高了匹配精度。在Middlebury数据集上的实验结果表明,平均相对误差为0.75%,平均测量时间为0.82s。PSNR为34dB。该算法提高了纹理稀疏或弱的物体的测量精度,证明了对亮度变化和噪声干扰的鲁棒性。
    To address the issues of low measurement accuracy and unstable results when using binocular cameras to detect objects with sparse surface textures, weak surface textures, occluded surfaces, low-contrast surfaces, and surfaces with intense lighting variations, a three-dimensional measurement method based on an improved feature matching algorithm is proposed. Initially, features are extracted from the left and right images obtained by the binocular camera. The extracted feature points serve as seed points, and a one-dimensional search space is established accurately based on the disparity continuity and epipolar constraints. The optimal search range and seed point quantity are obtained using the particle swarm optimization algorithm. The zero-mean normalized cross-correlation coefficient is employed as a similarity measure function for region growing. Subsequently, the left and right images are matched based on the grayscale information of the feature regions, and seed point matching is performed within each matching region. Finally, the obtained matching pairs are used to calculate the three-dimensional information of the target object using the triangulation formula. The proposed algorithm significantly enhances matching accuracy while reducing algorithm complexity. Experimental results on the Middlebury dataset show an average relative error of 0.75% and an average measurement time of 0.82 s. The error matching rate of the proposed image matching algorithm is 2.02%, and the PSNR is 34 dB. The algorithm improves the measurement accuracy for objects with sparse or weak textures, demonstrating robustness against brightness variations and noise interference.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    近视在近视中普遍存在,并且研究已经报道了其表现出损害的双眼功能。我们调查了患有无性近视的成年人在空间频率上的双眼平衡,并将其与屈光不正差异较小的个体进行了比较。并检查了眼部特征是否可以预测双眼平衡。
    15个无同系异虫,招募了15个同系异卵和12个emmetrope。以0.5、1、2和4c/d定量测量双眼平衡。对前两组观察者进行了带和不带光学矫正的隐形眼镜测试。在没有光学校正的情况下测试Emmetrops。
    在光学校正的无同位异位杂交和同位异位杂交中跨空间频率的双眼平衡,以及Emmetrops被发现是相似的。尽管如此,它们的双眼平衡仍然随着空间频率的变化而恶化。然而,在光学校正之前,在较高的空间频率下,无同系异位杂交显示出明显的不平衡。在未矫正的近视中,双眼失衡的空间频率依赖性与视力的眼间差异之间存在显着相关性,以及球面等效折射的依赖性和眼间差异。
    与同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位同位光学矫正后,它们的平衡与屈光状态弱相关。然而,矫正前的双眼平衡和光学矫正后的双眼改善与眼睛之间的眼部特征差异密切相关。
    UNASSIGNED: Anisomyopia is prevalent in myopia and studies have reported it exhibits impaired binocular function. We investigated the binocular balance across spatial frequency in adults with anisomyopia and compared it to in individuals with less differences in refractive error, and examined whether ocular characteristics can predict binocular balance in anisomyopia.
    UNASSIGNED: Fifteen anisomyopes, 15 isomyopes and 12 emmetropes were recruited. Binocular balance was quantitatively measured at 0.5, 1, 2 and 4 c/d. The first two groups of the observers were tested with and without optical correction with contact lenses. Emmetropes were tested without optical correction.
    UNASSIGNED: Binocular balance across spatial frequency in optically corrected anisomyopes and isomyopes, as well as emmetropes were found to be similar. Their binocular balance nevertheless still got worse as a function of spatial frequency. However, before optical correction, anisomyopes but not isomyopes showed significant imbalance at higher spatial frequencies. There was a significant correlation between the dependence on spatial frequency of binocular imbalance in uncorrected anisomyopia and interocular difference in visual acuity, and between the dependence and interocular difference in spherical equivalent refraction.
    UNASSIGNED: Anisomyopes had intact binocular balance following correction across spatial frequency compared to those in isomyopes and emmetropes. Their balance was weakly correlated with their refractive status after optical correction. However, their binocular balance before correction and binocular improvement following optical correction were strongly correlated with differences in ocular characteristics between eyes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号