Wang Yun, Huang Lu, Yee Austin Lin
Department of Computer Engineering, Shanxi Polytechnic College, Taiyuan, 030006 China.
Institute of Microelectronics, Chinese Academy of Sciences, Beijing, 100029 China.
J Supercomput. 2022;78(12):14343-14361. doi: 10.1007/s11227-022-04439-x. Epub 2022 Apr 1.
This study was carried out with the aim of exploring the full-convolution Siamese network (SiamFC) in the application of neonatal facial video image tracking, achieving accurate recognition of neonatal pain and helping doctors evaluate neonatal emotions in an automatic manner. The current technology shows low accuracy on facial image recognition of newborns, so the SiamFC algorithm under the deep learning was optimized in this study. Besides, a newborn facial video image tracking model (FVIT model) was constructed based on the SiamFC algorithm in combination with the attention mechanism with face tracking algorithm, and the facial features of newborns were tracked and recognized. In addition, a newborn face database was constructed based on the adult face database to evaluate performance of the FVIT model. It was found that the accuracy of the improved algorithm is 0.889, higher by 0.036 in contrast to other models; the area under the curve (AUC) of success rate reaches 0.748, higher by 0.075 compared with other algorithms. What's more, the improved algorithm shows good performance in tracking the facial occlusion, facial expression changes, and scale conversion of newborns. Therefore, the improved algorithm shows higher accuracy and success rate and has good effect in capturing and tracking the facial images of newborns, thereby providing an experimental basis for facial recognition and pain assessment of newborns in the later stage.
本研究旨在探索全卷积孪生网络(SiamFC)在新生儿面部视频图像跟踪中的应用,实现对新生儿疼痛的准确识别,并帮助医生自动评估新生儿情绪。当前技术在新生儿面部图像识别方面准确率较低,因此本研究对深度学习下的SiamFC算法进行了优化。此外,基于SiamFC算法结合注意力机制与面部跟踪算法构建了新生儿面部视频图像跟踪模型(FVIT模型),并对新生儿面部特征进行跟踪和识别。另外,基于成人面部数据库构建了新生儿面部数据库,以评估FVIT模型的性能。结果发现,改进算法的准确率为0.889,相比其他模型提高了0.036;成功率的曲线下面积(AUC)达到0.748,比其他算法高0.075。此外,改进算法在跟踪新生儿面部遮挡、面部表情变化和尺度转换方面表现良好。因此,改进算法具有更高的准确率和成功率,在捕捉和跟踪新生儿面部图像方面效果良好,从而为后期新生儿面部识别和疼痛评估提供了实验依据。