• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

深度学习下的全卷积孪生网络算法在新生儿面部视频图像追踪中的应用

Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns.

作者信息

Wang Yun, Huang Lu, Yee Austin Lin

机构信息

Department of Computer Engineering, Shanxi Polytechnic College, Taiyuan, 030006 China.

Institute of Microelectronics, Chinese Academy of Sciences, Beijing, 100029 China.

出版信息

J Supercomput. 2022;78(12):14343-14361. doi: 10.1007/s11227-022-04439-x. Epub 2022 Apr 1.

DOI:10.1007/s11227-022-04439-x
PMID:35382385
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC8972989/
Abstract

This study was carried out with the aim of exploring the full-convolution Siamese network (SiamFC) in the application of neonatal facial video image tracking, achieving accurate recognition of neonatal pain and helping doctors evaluate neonatal emotions in an automatic manner. The current technology shows low accuracy on facial image recognition of newborns, so the SiamFC algorithm under the deep learning was optimized in this study. Besides, a newborn facial video image tracking model (FVIT model) was constructed based on the SiamFC algorithm in combination with the attention mechanism with face tracking algorithm, and the facial features of newborns were tracked and recognized. In addition, a newborn face database was constructed based on the adult face database to evaluate performance of the FVIT model. It was found that the accuracy of the improved algorithm is 0.889, higher by 0.036 in contrast to other models; the area under the curve (AUC) of success rate reaches 0.748, higher by 0.075 compared with other algorithms. What's more, the improved algorithm shows good performance in tracking the facial occlusion, facial expression changes, and scale conversion of newborns. Therefore, the improved algorithm shows higher accuracy and success rate and has good effect in capturing and tracking the facial images of newborns, thereby providing an experimental basis for facial recognition and pain assessment of newborns in the later stage.

摘要

本研究旨在探索全卷积孪生网络(SiamFC)在新生儿面部视频图像跟踪中的应用,实现对新生儿疼痛的准确识别,并帮助医生自动评估新生儿情绪。当前技术在新生儿面部图像识别方面准确率较低,因此本研究对深度学习下的SiamFC算法进行了优化。此外,基于SiamFC算法结合注意力机制与面部跟踪算法构建了新生儿面部视频图像跟踪模型(FVIT模型),并对新生儿面部特征进行跟踪和识别。另外,基于成人面部数据库构建了新生儿面部数据库,以评估FVIT模型的性能。结果发现,改进算法的准确率为0.889,相比其他模型提高了0.036;成功率的曲线下面积(AUC)达到0.748,比其他算法高0.075。此外,改进算法在跟踪新生儿面部遮挡、面部表情变化和尺度转换方面表现良好。因此,改进算法具有更高的准确率和成功率,在捕捉和跟踪新生儿面部图像方面效果良好,从而为后期新生儿面部识别和疼痛评估提供了实验依据。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/3ee4cc512049/11227_2022_4439_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/a08bec004fb7/11227_2022_4439_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/0f2a55a15a00/11227_2022_4439_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/fd6b88a9e886/11227_2022_4439_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/577e5a28a9f9/11227_2022_4439_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/41d62ed63c69/11227_2022_4439_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/f0322b5d2d93/11227_2022_4439_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/3ee4cc512049/11227_2022_4439_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/a08bec004fb7/11227_2022_4439_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/0f2a55a15a00/11227_2022_4439_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/fd6b88a9e886/11227_2022_4439_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/577e5a28a9f9/11227_2022_4439_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/41d62ed63c69/11227_2022_4439_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/f0322b5d2d93/11227_2022_4439_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/3ee4cc512049/11227_2022_4439_Fig7_HTML.jpg

相似文献

1
Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns.深度学习下的全卷积孪生网络算法在新生儿面部视频图像追踪中的应用
J Supercomput. 2022;78(12):14343-14361. doi: 10.1007/s11227-022-04439-x. Epub 2022 Apr 1.
2
Application Research on Face Image Evaluation Algorithm of Deep Learning Mobile Terminal for Student Check-In Management.深度学习移动端学生签到管理人脸图像评价算法的应用研究。
Comput Intell Neurosci. 2022 Aug 16;2022:3961910. doi: 10.1155/2022/3961910. eCollection 2022.
3
Athlete Behavior Recognition Technology Based on Siamese-RPN Tracker Model.基于孪生 RPN 跟踪器模型的运动员行为识别技术。
Comput Intell Neurosci. 2021 Oct 19;2021:6255390. doi: 10.1155/2021/6255390. eCollection 2021.
4
Improved Fully Convolutional Siamese Networks for Visual Object Tracking Based on Response Behaviour Analysis.基于响应行为分析的改进全卷积孪生网络的视觉目标跟踪
Sensors (Basel). 2022 Aug 30;22(17):6550. doi: 10.3390/s22176550.
5
SPT: Single Pedestrian Tracking Framework with Re-Identification-Based Learning Using the Siamese Model.SPT:基于 Siamese 模型的再识别学习的单人行人跟踪框架。
Sensors (Basel). 2023 May 19;23(10):4906. doi: 10.3390/s23104906.
6
Pain assessment in horses using automatic facial expression recognition through deep learning-based modeling.利用基于深度学习的建模进行自动面部表情识别评估马的疼痛。
PLoS One. 2021 Oct 19;16(10):e0258672. doi: 10.1371/journal.pone.0258672. eCollection 2021.
7
A Novel Deep Learning Approach for Tracking Regions of Interest in Ultrasound Images.一种用于追踪超声图像中感兴趣区域的新型深度学习方法。
Annu Int Conf IEEE Eng Med Biol Soc. 2021 Nov;2021:4095-4098. doi: 10.1109/EMBC46164.2021.9631026.
8
A Fusion Algorithm of Object Detection and Tracking for Unmanned Surface Vehicles.一种用于无人水面舰艇的目标检测与跟踪融合算法。
Front Neurorobot. 2022 Apr 27;16:808147. doi: 10.3389/fnbot.2022.808147. eCollection 2022.
9
Facial expression recognition based on deep learning.基于深度学习的面部表情识别。
Comput Methods Programs Biomed. 2022 Mar;215:106621. doi: 10.1016/j.cmpb.2022.106621. Epub 2022 Jan 6.
10
Facial expression recognition based on active region of interest using deep learning and parallelism.基于深度学习和并行性的利用感兴趣活动区域的面部表情识别
PeerJ Comput Sci. 2022 Mar 2;8:e894. doi: 10.7717/peerj-cs.894. eCollection 2022.

引用本文的文献

1
Automatic pain classification in older patients with hip fracture based on multimodal information fusion.基于多模态信息融合的老年髋部骨折患者疼痛自动分类
Sci Rep. 2025 Jul 1;15(1):21562. doi: 10.1038/s41598-025-09046-3.
2
Face-based automatic pain assessment: challenges and perspectives in neonatal intensive care units.基于面部的自动疼痛评估:新生儿重症监护病房的挑战与展望。
J Pediatr (Rio J). 2023 Nov-Dec;99(6):546-560. doi: 10.1016/j.jped.2023.05.005. Epub 2023 Jun 15.