Suppr超能文献

深度学习下的全卷积孪生网络算法在新生儿面部视频图像追踪中的应用

Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns.

作者信息

Wang Yun, Huang Lu, Yee Austin Lin

机构信息

Department of Computer Engineering, Shanxi Polytechnic College, Taiyuan, 030006 China.

Institute of Microelectronics, Chinese Academy of Sciences, Beijing, 100029 China.

出版信息

J Supercomput. 2022;78(12):14343-14361. doi: 10.1007/s11227-022-04439-x. Epub 2022 Apr 1.

Abstract

This study was carried out with the aim of exploring the full-convolution Siamese network (SiamFC) in the application of neonatal facial video image tracking, achieving accurate recognition of neonatal pain and helping doctors evaluate neonatal emotions in an automatic manner. The current technology shows low accuracy on facial image recognition of newborns, so the SiamFC algorithm under the deep learning was optimized in this study. Besides, a newborn facial video image tracking model (FVIT model) was constructed based on the SiamFC algorithm in combination with the attention mechanism with face tracking algorithm, and the facial features of newborns were tracked and recognized. In addition, a newborn face database was constructed based on the adult face database to evaluate performance of the FVIT model. It was found that the accuracy of the improved algorithm is 0.889, higher by 0.036 in contrast to other models; the area under the curve (AUC) of success rate reaches 0.748, higher by 0.075 compared with other algorithms. What's more, the improved algorithm shows good performance in tracking the facial occlusion, facial expression changes, and scale conversion of newborns. Therefore, the improved algorithm shows higher accuracy and success rate and has good effect in capturing and tracking the facial images of newborns, thereby providing an experimental basis for facial recognition and pain assessment of newborns in the later stage.

摘要

本研究旨在探索全卷积孪生网络(SiamFC)在新生儿面部视频图像跟踪中的应用,实现对新生儿疼痛的准确识别,并帮助医生自动评估新生儿情绪。当前技术在新生儿面部图像识别方面准确率较低,因此本研究对深度学习下的SiamFC算法进行了优化。此外,基于SiamFC算法结合注意力机制与面部跟踪算法构建了新生儿面部视频图像跟踪模型(FVIT模型),并对新生儿面部特征进行跟踪和识别。另外,基于成人面部数据库构建了新生儿面部数据库,以评估FVIT模型的性能。结果发现,改进算法的准确率为0.889,相比其他模型提高了0.036;成功率的曲线下面积(AUC)达到0.748,比其他算法高0.075。此外,改进算法在跟踪新生儿面部遮挡、面部表情变化和尺度转换方面表现良好。因此,改进算法具有更高的准确率和成功率,在捕捉和跟踪新生儿面部图像方面效果良好,从而为后期新生儿面部识别和疼痛评估提供了实验依据。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2924/8972989/a08bec004fb7/11227_2022_4439_Fig1_HTML.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验