• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于远程光体积描记和呼吸估计的多任务联体网络。

Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation.

机构信息

Department of Computer Engineering, Kwangwoon University, Seoul 01897, Korea.

Department of Information Convergence, Kwangwoon University, Seoul 01897, Korea.

出版信息

Sensors (Basel). 2022 Jul 7;22(14):5101. doi: 10.3390/s22145101.

DOI:10.3390/s22145101
PMID:35890781
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9321619/
Abstract

Heart and respiration rates represent important vital signs for the assessment of a person's health condition. To estimate these vital signs accurately, we propose a multitask Siamese network model (MTS) that combines the advantages of the Siamese network and the multitask learning architecture. The MTS model was trained by the images of the cheek including nose and mouth and forehead areas while sharing the same parameters between the Siamese networks, in order to extract the features about the heart and respiratory information. The proposed model was constructed with a small number of parameters and was able to yield a high vital-sign-prediction accuracy, comparable to that obtained from the single-task learning model; furthermore, the proposed model outperformed the conventional multitask learning model. As a result, we can simultaneously predict the heart and respiratory signals with the MTS model, while the number of parameters was reduced by 16 times with the mean average errors of heart and respiration rates being 2.84 and 4.21. Owing to its light weight, it would be advantageous to implement the vital-sign-monitoring model in an edge device such as a mobile phone or small-sized portable devices.

摘要

心率和呼吸率是评估人体健康状况的重要生命体征。为了准确估计这些生命体征,我们提出了一种多任务暹罗网络模型(MTS),它结合了暹罗网络和多任务学习架构的优势。MTS 模型通过包括鼻子和嘴以及额头区域的脸颊图像进行训练,同时在暹罗网络之间共享相同的参数,以提取有关心脏和呼吸信息的特征。所提出的模型使用少量参数构建,能够获得与从单任务学习模型获得的相当的高生命信号预测准确性,并且优于传统的多任务学习模型。结果,我们可以使用 MTS 模型同时预测心脏和呼吸信号,同时将参数数量减少了 16 倍,心率和呼吸率的平均误差分别为 2.84 和 4.21。由于其重量轻,因此在移动电话或小型便携式设备等边缘设备中实施生命信号监测模型将具有优势。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/49561a433214/sensors-22-05101-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/522ca12c0c84/sensors-22-05101-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/21ba91968c16/sensors-22-05101-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/8d16c0c3d9aa/sensors-22-05101-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/07d170910191/sensors-22-05101-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/a0122d6224f6/sensors-22-05101-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/35ccd4a045d8/sensors-22-05101-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/49561a433214/sensors-22-05101-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/522ca12c0c84/sensors-22-05101-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/21ba91968c16/sensors-22-05101-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/8d16c0c3d9aa/sensors-22-05101-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/07d170910191/sensors-22-05101-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/a0122d6224f6/sensors-22-05101-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/35ccd4a045d8/sensors-22-05101-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fff/9321619/49561a433214/sensors-22-05101-g007.jpg

相似文献

1
Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation.用于远程光体积描记和呼吸估计的多任务联体网络。
Sensors (Basel). 2022 Jul 7;22(14):5101. doi: 10.3390/s22145101.
2
Contactless face video based vital signs detection framework for continuous health monitoring using feature optimization and hybrid neural network.基于非接触式面部视频的生命体征检测框架,用于通过特征优化和混合神经网络进行连续健康监测。
Biotechnol Bioeng. 2024 Apr;121(4):1191-1215. doi: 10.1002/bit.28644. Epub 2024 Jan 14.
3
An Evaluation of Non-Contact Photoplethysmography-Based Methods for Remote Respiratory Rate Estimation.基于非接触光电容积脉搏波法的远程呼吸频率估计方法评估。
Sensors (Basel). 2023 Mar 23;23(7):3387. doi: 10.3390/s23073387.
4
Contactless Heart and Respiration Rates Estimation and Classification of Driver Physiological States Using CW Radar and Temporal Neural Networks.基于连续波雷达和时频神经网络的驾驶员生理状态的无接触式心、呼吸率估计与分类
Sensors (Basel). 2023 Nov 28;23(23):9457. doi: 10.3390/s23239457.
5
Remote photoplethysmography-based human vital sign prediction using cyclical algorithm.基于循环算法的远程光电容积脉搏波人体生命体征预测
J Biophotonics. 2024 Jan;17(1):e202300286. doi: 10.1002/jbio.202300286. Epub 2023 Sep 20.
6
Contactless Vital Signs Measurement System Using RGB-Thermal Image Sensors and Its Clinical Screening Test on Patients with Seasonal Influenza.基于 RGB-热成像传感器的非接触式生命体征测量系统及其在季节性流感患者中的临床筛查试验。
Sensors (Basel). 2020 Apr 13;20(8):2171. doi: 10.3390/s20082171.
7
Biometric Signals Estimation Using Single Photon Camera and Deep Learning.利用单光子相机和深度学习进行生物特征信号估计。
Sensors (Basel). 2020 Oct 27;20(21):6102. doi: 10.3390/s20216102.
8
Vital Sign Monitoring Using FMCW Radar in Various Sleeping Scenarios.利用 FMCW 雷达在各种睡眠场景下进行生命体征监测。
Sensors (Basel). 2020 Nov 14;20(22):6505. doi: 10.3390/s20226505.
9
Conventional and deep learning methods in heart rate estimation from RGB face videos.基于RGB面部视频进行心率估计的传统方法与深度学习方法
Physiol Meas. 2024 Feb 9;45(2). doi: 10.1088/1361-6579/ad1458.
10
Effectiveness of consumer-grade contactless vital signs monitors: a systematic review and meta-analysis.消费级非接触式生命体征监测仪的有效性:系统评价和荟萃分析。
J Clin Monit Comput. 2022 Feb;36(1):41-54. doi: 10.1007/s10877-021-00734-9. Epub 2021 Jul 9.

引用本文的文献

1
Deep learning and remote photoplethysmography powered advancements in contactless physiological measurement.深度学习与远程光电容积脉搏波描记术推动非接触式生理测量取得进展。
Front Bioeng Biotechnol. 2024 Jul 17;12:1420100. doi: 10.3389/fbioe.2024.1420100. eCollection 2024.
2
Contactless Blood Oxygen Saturation Estimation from Facial Videos Using Deep Learning.使用深度学习从面部视频中进行非接触式血氧饱和度估计。
Bioengineering (Basel). 2024 Mar 4;11(3):251. doi: 10.3390/bioengineering11030251.
3
A Multifunctional Network with Uncertainty Estimation and Attention-Based Knowledge Distillation to Address Practical Challenges in Respiration Rate Estimation.

本文引用的文献

1
Micro/nanotechnology-inspired rapid diagnosis of respiratory infectious diseases.受微纳技术启发的呼吸道传染病快速诊断
Biomed Eng Lett. 2021 Sep 8;11(4):335-365. doi: 10.1007/s13534-021-00206-8. eCollection 2021 Nov.
2
Wrist-Based Photoplethysmography Assessment of Heart Rate and Heart Rate Variability: Validation of WHOOP.基于手腕的光电容积脉搏波描记法评估心率和心率变异性:WHOOP 的验证。
Sensors (Basel). 2021 May 20;21(10):3571. doi: 10.3390/s21103571.
3
Assessment of physiological signs associated with COVID-19 measured using wearable devices.
一种具有不确定性估计和基于注意力的知识蒸馏的多功能网络,用于解决呼吸率估计中的实际挑战。
Sensors (Basel). 2023 Feb 1;23(3):1599. doi: 10.3390/s23031599.
使用可穿戴设备对与COVID-19相关的生理体征进行评估。
NPJ Digit Med. 2020 Nov 30;3(1):156. doi: 10.1038/s41746-020-00363-7.
4
Mobile sensor based human activity recognition: distinguishing of challenging activities by applying long short-term memory deep learning modified by residual network concept.基于移动传感器的人类活动识别:通过应用由残差网络概念改进的长短期记忆深度学习来区分具有挑战性的活动。
Biomed Eng Lett. 2020 Jun 29;10(3):419-430. doi: 10.1007/s13534-020-00160-x. eCollection 2020 Aug.
5
Remote Respiratory Monitoring in the Time of COVID-19.新冠疫情期间的远程呼吸监测
Front Physiol. 2020 May 29;11:635. doi: 10.3389/fphys.2020.00635. eCollection 2020.
6
Deep ECG-Respiration Network (DeepER Net) for Recognizing Mental Stress.用于识别精神压力的深度心电图-呼吸网络(DeepER Net)
Sensors (Basel). 2019 Jul 9;19(13):3021. doi: 10.3390/s19133021.
7
An open-source remote heart rate imaging method with practical apparatus and algorithms.一种具有实用仪器和算法的开源远程心率成像方法。
Behav Res Methods. 2019 Oct;51(5):2106-2119. doi: 10.3758/s13428-019-01256-8.
8
Breathing Rate Estimation From the Electrocardiogram and Photoplethysmogram: A Review.从心电图和光电容积脉搏波估算呼吸率:综述。
IEEE Rev Biomed Eng. 2018;11:2-20. doi: 10.1109/RBME.2017.2763681. Epub 2017 Oct 24.
9
Acquiring Respiration Rate from Photoplethysmographic Signal by Recursive Bayesian Tracking of Intrinsic Modes in Time-Frequency Spectra.从光电容积脉搏波信号中通过时频谱内固有模式的递归贝叶斯跟踪获取呼吸率。
Sensors (Basel). 2018 May 24;18(6):1693. doi: 10.3390/s18061693.
10
Comparison between Electrocardiographic and Earlobe Pulse Photoplethysmographic Detection for Evaluating Heart Rate Variability in Healthy Subjects in Short- and Long-Term Recordings.心电图和耳夹式脉搏光容积描记法检测在健康受试者短期和长期记录中心率变异性的比较。
Sensors (Basel). 2018 Mar 13;18(3):844. doi: 10.3390/s18030844.