remote photoplethysmography (rPPG)

远程光电体积描记术 ( rPPG )
  • 文章类型: Journal Article
    医疗技术的进步导致了非接触式血流动力学监测方法的发展,例如远程光电体积描记术(rPPG)。rPPG使用摄像机来解释与血流相关的肤色变化,对其进行分析以生成生命体征读数。rPPG可能会改善与儿童常规探针相关的烦躁和脆弱的皮肤接触等问题。虽然rPPG已经在成年人中得到验证,之前未对儿童进行过验证.
    在2023年1月至4月进行了两阶段的前瞻性横截面单中心研究,以评估可行性,可接受性,和获得心率(HR)的准确性,使用rPPG的儿童呼吸频率(RR)和氧饱和度(SpO2),与目前的护理标准相比。在第1阶段,我们从新生儿和儿科病房招募了≤16岁的患者。我们排除了胎龄<35周的早产儿和<24小时的新生儿。rPPG网络摄像头位于距离面部30cm处。经过1分钟的面部扫描,将产生的读数与脉搏血氧饱和度测定HR和SpO2以及手动计数RR进行比较.进行相关性和Bland-Altman分析。在第2阶段,我们专注于rPPG与实际生命体征之间存在潜在相关性的人群。
    招募了10名新生儿和28名5至16岁的儿童进行第一阶段(765个数据点)。所有患者血流动力学稳定,体温正常。患者和护理人员对rPPG表现出很高的可接受性。<10岁儿童的rPPG值在临床上存在差异。对于那些≥10年的人,观察到HR的中度相关性,Spearman相关系数(Rs)为0.50[95%置信区间(CI):0.42,0.57]。我们对23名年龄在12至16岁(559个数据点)的患者进行了第二阶段。观察到HR的强相关性,Rs=0.82(95%CI:0.78,0.85)。SpO2和RR之间存在弱相关性(Rs分别为-0.25和-0.02)。
    我们的研究表明,rPPG对于5至16岁的新生儿和儿童是可以接受和可行的,年龄在12至16岁的大龄儿童的HR值与现行标准有很好的相关性。rPPG算法需要针对年幼的孩子进一步完善,并在所有儿童中获得RR和SpO2。如果成功,rPPG将为评估儿科生命体征提供可行的非接触替代方案,具有远程监控和远程医疗的潜在用途。
    UNASSIGNED: Advancements in medical technologies have led to the development of contact-free methods of haemodynamic monitoring such as remote photoplethysmography (rPPG). rPPG uses video cameras to interpret variations in skin colour related to blood flow, which are analysed to generate vital signs readings. rPPG potentially ameliorates problems like fretfulness and fragile skin contact associated with conventional probes in children. While rPPG has been validated in adults, no prior validation has been performed in children.
    UNASSIGNED: A two-phased prospective cross-sectional single-centre study was conducted from January to April 2023 to evaluate the feasibility, acceptability, and accuracy of obtaining heart rate (HR), respiratory rate (RR) and oxygen saturation (SpO2) using rPPG in children, compared to the current standard of care. In Phase 1, we recruited patients ≤16 years from the neonatal and paediatric wards. We excluded preterm neonates with gestational age <35 weeks and newborns <24 hours old. The rPPG webcam was positioned 30 cm from the face. After 1 minute of facial scanning, readings generated were compared with pulse oximetry for HR and SpO2, and manual counting for RR. Correlation and Bland-Altman analyses were performed. In Phase 2, we focused on the population in whom there was potential correlation between rPPG and the actual vital signs.
    UNASSIGNED: Ten neonates and 28 children aged 5 to 16 years were recruited for Phase 1 (765 datapoints). All patients were haemodynamically stable and normothermic. Patients and caregivers showed high acceptability to rPPG. rPPG values were clinically discrepant for children <10 years. For those ≥10 years, moderate correlation was observed for HR, with Spearman\'s correlation coefficient (Rs) of 0.50 [95% confidence intervals (CI): 0.42, 0.57]. We performed Phase 2 on 23 patients aged 12 to 16 years (559 datapoints). Strong correlation was observed for HR with Rs=0.82 (95% CI: 0.78, 0.85). There was weak correlation for SpO2 and RR (Rs=-0.25 and -0.02, respectively).
    UNASSIGNED: Our study showed that rPPG is acceptable and feasible for neonates and children aged 5 to 16 years, and HR values in older children aged 12 to 16 years correlated well with the current standard. The rPPG algorithms need to be further refined for younger children, and for obtaining RR and SpO2 in all children. If successful, rPPG will provide a viable contact-free alternative for assessing paediatric vital signs, with potential use in remote monitoring and telemedicine.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    压力已经成为现代社会的主要关注点,显着影响人类健康和福祉。统计证据强调了压力的广泛社会影响,特别是与工作相关的压力和相关的医疗费用。本文解决了精确应力检测的关键需求,强调其对健康和社会动态的深远影响。专注于远程压力监测,它提出了一种有效的深度学习方法,用于面部视频的压力检测。与可穿戴设备的研究相比,本文提出了新的混合深度学习(DL)网络,用于基于远程光电体积描记术(rPPG)的压力检测,雇佣(长短期记忆(LSTM),门控经常性单位(GRU),1D卷积神经网络(1D-CNN)模型,采用超参数优化和增强技术来提高性能。所提出的方法在应力检测的准确性和效率上有了实质性的提高,使用UBFC-Phys数据集实现高达95.83%的准确度,同时保持出色的计算效率。实验结果证明了所提出的混合DL模型用于基于rPPG的应力检测的有效性。
    Stress has emerged as a major concern in modern society, significantly impacting human health and well-being. Statistical evidence underscores the extensive social influence of stress, especially in terms of work-related stress and associated healthcare costs. This paper addresses the critical need for accurate stress detection, emphasising its far-reaching effects on health and social dynamics. Focusing on remote stress monitoring, it proposes an efficient deep learning approach for stress detection from facial videos. In contrast to the research on wearable devices, this paper proposes novel Hybrid Deep Learning (DL) networks for stress detection based on remote photoplethysmography (rPPG), employing (Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), 1D Convolutional Neural Network (1D-CNN)) models with hyperparameter optimisation and augmentation techniques to enhance performance. The proposed approach yields a substantial improvement in accuracy and efficiency in stress detection, achieving up to 95.83% accuracy with the UBFC-Phys dataset while maintaining excellent computational efficiency. The experimental results demonstrate the effectiveness of the proposed Hybrid DL models for rPPG-based-stress detection.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    基于视频的外周血氧饱和度(SpO2)估计,仅利用RGB相机,提供了一种非接触的方法来测量血氧水平。以往的研究以稳定不变的环境作为非接触血氧估计的前提。此外,他们利用少量标记数据进行系统训练和学习。然而,用小的数据集训练最优模型参数是具有挑战性的。血氧检测的准确性容易受到环境光和受试者运动的影响。为了解决这些问题,本文提出了一种对比学习的时空注意网络(CL-SPO2Net),基于视频的SpO2估计的创新半监督网络。在包含面部或手部区域的视频片段中发现了远程光电容积描记术(rPPG)信号的时空相似性。随后,将深度神经网络与机器学习专业知识相结合,可以估计SpO2。该方法在小规模标记数据集的情况下具有较好的可行性,在稳定环境下,相机与参考脉搏血氧计之间的平均绝对误差为0.85%,1.13%,照明波动,面部旋转情况为1.20%。
    Video-based peripheral oxygen saturation (SpO2) estimation, utilizing solely RGB cameras, offers a non-contact approach to measuring blood oxygen levels. Previous studies set a stable and unchanging environment as the premise for non-contact blood oxygen estimation. Additionally, they utilized a small amount of labeled data for system training and learning. However, it is challenging to train optimal model parameters with a small dataset. The accuracy of blood oxygen detection is easily affected by ambient light and subject movement. To address these issues, this paper proposes a contrastive learning spatiotemporal attention network (CL-SPO2Net), an innovative semi-supervised network for video-based SpO2 estimation. Spatiotemporal similarities in remote photoplethysmography (rPPG) signals were found in video segments containing facial or hand regions. Subsequently, integrating deep neural networks with machine learning expertise enabled the estimation of SpO2. The method had good feasibility in the case of small-scale labeled datasets, with the mean absolute error between the camera and the reference pulse oximeter of 0.85% in the stable environment, 1.13% with lighting fluctuations, and 1.20% in the facial rotation situation.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    在SARS-CoV-2大流行之后,远程健康监测已变得不可避免,并且在未来也将继续被接受为医疗保健措施。然而,非接触式生命体征测量,像心率(HR)一样很难测量,因为,生理信号的幅度非常弱,并且很容易由于噪声而降低。各种噪声源是头部运动,照明或采集设备的变化。在本文中,提出了一种基于视频的无噪声心肺测量。3D视频转换为2D时空图像(STI),它可以抑制噪声,同时保留远程光电容积描记术(rPPG)信号的时间信息。所提出的模型将新的运动表示投影到使用小波导出的CNN,这使得能够在异质照明条件和连续运动下估计HR。STI是通过对后续帧进行小波分解后获得的特征向量的级联而形成的。STI作为输入提供给CNN,用于映射相应的HR值。所提出的方法利用CNN的能力来可视化模式。建议的方法在四个基准数据集上的HR估计方面产生更好的结果,例如MAHNOB-HCI,MMSE-HR,UBFC-rPPG和VIPL-HR。
    Remote health monitoring has become quite inevitable after SARS-CoV-2 pandemic and continues to be accepted as a measure of healthcare in future too. However, contact-less measurement of vital sign, like Heart Rate(HR) is quite difficult to measure because, the amplitude of physiological signal is very weak and can be easily degraded due to noise. The various sources of noise are head movements, variation in illumination or acquisition devices. In this paper, a video-based noise-less cardiopulmonary measurement is proposed. 3D videos are converted to 2D Spatio-Temporal Images (STI), which suppresses noise while preserving temporal information of Remote Photoplethysmography(rPPG) signal. The proposed model projects a new motion representation to CNN derived using wavelets, which enables estimation of HR under heterogeneous lighting condition and continuous motion. STI is formed by the concatenation of feature vectors obtained after wavelet decomposition of subsequent frames. STI is provided as input to CNN for mapping the corresponding HR values. The proposed approach utilizes the ability of CNN to visualize patterns. Proposed approach yields better results in terms of estimation of HR on four benchmark dataset such as MAHNOB-HCI, MMSE-HR, UBFC-rPPG and VIPL-HR.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    利用低成本RGB相机的定点远程光电体积描记术(rPPG)设备由于其在非接触式和非侵入性生命体征监测中的便利性而引起了相当大的关注。在rPPG中,足够的光照条件对于通过观察完整的信号形态获得准确的诊断至关重要。照度强度和光源设置的影响在rPPG评估质量中起着重要作用,并且先前观察到不同的照明方案导致不同的信号质量和形态。本研究提供了定量的经验分析,其中在不同的光设置下评估了rPPG信号的质量和形态。参与者的脸暴露在白色LED聚光灯下,首先,当信号源直接安装在摄像机后面时,然后在交叉极化方案中安装源。因此,在增加的投影中可以观察到镜面反射对rPPG信号的影响。使用信噪比(SNR)度量在每个强度水平中分析信号质量。在7名参与者中,有3名将摄像机放置在同一水平的光源导致信号质量损失高达3分贝的范围30-60勒克斯。此外,分析了两个基本的形态学特征,并且在7名参与者中的6名发现导数相关特征随着照度强度而增加。
    Point-of-care remote photoplethysmography (rPPG) devices that utilize low-cost RGB cameras have drawn considerable attention due to their convenience in contactless and non-invasive vital signs monitoring. In rPPG, sufficient lighting conditions are essential for obtaining accurate diagnostics by observing the complete signal morphology. The effects of illuminance intensity and light source settings play a significant role in rPPG assessment quality, and it was previously observed that different lighting schemes result in different signal quality and morphology. This study presents a quantitative empirical analysis where the quality and morphology of rPPG signals were assessed under different light settings. Participants\' faces were exposed to the white LED spotlight, first when the sources were installed directly behind the video camera, and then when the sources were installed in a cross-polarized scheme. Hence, the effect of specular reflectance on rPPG signals could be observed in an increasing projection. The signal qualities were analyzed in each intensity level using a signal-to-noise (SNR) ratio metric. In 3 of 7 participants, placing the video camera on the same level as the light source led to signal quality loss of up to 3 dB for the range 30-60 Lux. In addition, two fundamental morphological features were analyzed, and the derivative-related feature was found to be increasing with illuminance intensity in 6 of 7 participants.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    Camera-based remote photoplethysmography (rPPG) is a low-cost and casual non-contact heart rate measurement method suitable for telemedicine. Several factors affect the accuracy of measuring the heart rate and heart rate variability (HRV) using rPPG despite HRV being an important indicator for healthcare monitoring. This study aimed to investigate the appropriate setup for precise HRV measurements using rPPG while considering the effects of possible factors including illumination, direction of the light, frame rate of the camera, and body motion. In the lighting conditions experiment, the smallest mean absolute R-R interval (RRI) error was obtained when light greater than 500 lux was cast from the front (among the following conditions-illuminance: 100, 300, 500, and 700 lux; directions: front, top, and front and top). In addition, the RRI and HRV were measured with sufficient accuracy at frame rates above 30 fps. The accuracy of the HRV measurement was greatly reduced when the body motion was not constrained; thus, it is necessary to limit the body motion, especially the head motion, in an actual telemedicine situation. The results of this study can act as guidelines for setting up the shooting environment and camera settings for rPPG use in telemedicine.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    背景:心率(HR)是评估新生婴儿生理状况的重要生命体征。最近,为了测量HR,与其他技术相比,新颖的基于RGB相机的非接触技术已经证明了它们的特定优势,如多普勒和热像仪。然而,由于频繁的身体运动,他们在婴儿HR测量中仍然表现出较差的鲁棒性。
    方法:本文介绍了一种框架,通过解决运动伪影问题来提高婴儿\'HR测量的鲁棒性。我们的解决方案基于以下步骤:基于形态学的过滤,感兴趣区域(ROI)划分,欧拉视频放大和多数投票。特别是,ROI划分提高了ROI信息利用率。多数投票方案通过选择具有最高概率的HR来提高统计稳健性。此外,我们确定了导致最准确的HR测量的分割参数。为了检查所提出方法的性能,我们收集了4小时的视频,并记录了9例住院新生儿在两种不同情况下的相应心电图(ECG)-静止和可见运动。
    结果:实验结果表明有希望的表现:静止和可见运动期间的平均绝对误差为每分钟3.39次搏动(BPM)和4.34BPM,分别,与以前的作品相比,它至少提高了2.00和1.88BPM。Bland-Altman图还显示了我们的结果和从地面实况心电图得出的HR的显着一致性。
    结论:据我们所知,这是第一项旨在提高使用RGB相机在运动伪影下进行新生儿HR测量的鲁棒性的研究。初步结果表明了该方法的前景。希望能降低医院的新生儿死亡率。
    BACKGROUND: Heart rate (HR) is an important vital sign for evaluating the physiological condition of a newborn infant. Recently, for measuring HR, novel RGB camera-based non-contact techniques have demonstrated their specific superiority compared with other techniques, such as dopplers and thermal cameras. However, they still suffered poor robustness in infants\' HR measurements due to frequent body movement.
    METHODS: This paper introduces a framework to improve the robustness of infants\' HR measurements by solving motion artifact problems. Our solution is based on the following steps: morphology-based filtering, region-of-interest (ROI) dividing, Eulerian video magnification and majority voting. In particular, ROI dividing improves ROI information utilization. The majority voting scheme improves the statistical robustness by choosing the HR with the highest probability. Additionally, we determined the dividing parameter that leads to the most accurate HR measurements. In order to examine the performance of the proposed method, we collected 4 hours of videos and recorded the corresponding electrocardiogram (ECG) of 9 hospitalized neonates under two different conditions-rest still and visible movements.
    RESULTS: Experimental results indicate a promising performance: the mean absolute error during rest still and visible movements are 3.39 beats per minute (BPM) and 4.34 BPM, respectively, which improves at least 2.00 and 1.88 BPM compared with previous works. The Bland-Altman plots also show the remarkable consistency of our results and the HR derived from the ground-truth ECG.
    CONCLUSIONS: To the best of our knowledge, this is the first study aimed at improving the robustness of neonatal HR measurement under motion artifacts using an RGB camera. The preliminary results have shown the promising prospects of the proposed method, which hopefully reduce neonatal mortality in hospitals.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    许多先前的研究表明,远程光电体积描记术(rPPG)可以非常高的精度测量心率(HR)信号。脉搏率变异性(PRV)信号的远程测量也是可能的,但这要复杂得多,因为然后需要检测时间rPPG信号上的峰值,这通常是相当嘈杂的,并且具有比通过接触设备获得的PPG信号更低的时间分辨率。由于PRV信号对于各种应用(如压力和情绪的远程识别)至关重要,通过rPPG改进PRV测量是一项关键任务。已经研究了基于接触的PRV测量,但是对远程测量PRV的研究非常有限。在本文中,我们建议使用周期性方差最大化(PVM)方法提取rPPG信号和事件相关的两窗口算法来改善PRV测量的峰值检测。我们已经做出了一些贡献。首先,我们证明了新提出的PVM方法和双窗口算法可用于非接触场景下的PRV测量。其次,我们提出了一种自适应确定双窗口方法参数的方法。第三,我们将该算法与其他改进非接触式PRV测量的尝试进行比较,例如斜率和函数(SSF)方法和局部最大值方法。我们根据接触设备提供的地面实况计算了几个特征并比较了准确性。我们的实验表明,该算法在所有算法中表现最好。
    Many previous studies have shown that the remote photoplethysmography (rPPG) can measure the Heart Rate (HR) signal with very high accuracy. The remote measurement of the Pulse Rate Variability (PRV) signal is also possible, but this is much more complicated because it is then necessary to detect the peaks on the temporal rPPG signal, which is usually quite noisy and has a lower temporal resolution than PPG signals obtained by contact equipment. Since the PRV signal is vital for various applications such as remote recognition of stress and emotion, the improvement of PRV measurement by rPPG is a critical task. Contact based PRV measurement has already been investigated, but the research on remotely measured PRV is very limited. In this paper, we propose to use the Periodic Variance Maximization (PVM) method to extract the rPPG signal and event-related Two-Window algorithm to improve the peak detection for PRV measurement. We have made several contributions. Firstly, we show that the newly proposed PVM method and Two-Window algorithm can be used for PRV measurement in the non-contact scenario. Secondly, we propose a method to adaptively determine the parameters of the Two-Window method. Thirdly, we compare the algorithm with other attempts for improving the non-contact PRV measurement such as the Slope Sum Function (SSF) method and the Local Maximum method. We calculated several features and compared the accuracy based on the ground truth provided by contact equipment. Our experiments showed that this algorithm performed the best of all the algorithms.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

公众号