IEEE J Biomed Health Inform. 2024 May;28(5):3015-3028. doi: 10.1109/JBHI.2024.3371687. Epub 2024 May 6.
The infant sleep-wake behavior is an essential indicator of physiological and neurological system maturity, the circadian transition of which is important for evaluating the recovery of preterm infants from inadequate physiological function and cognitive disorders. Recently, camera-based infant sleep-wake monitoring has been investigated, but the challenges of generalization caused by variance in infants and clinical environments are not addressed for this application. In this paper, we conducted a multi-center clinical trial at four hospitals to improve the generalization of camera-based infant sleep-wake monitoring. Using the face videos of 64 term and 39 preterm infants recorded in NICUs, we proposed a novel sleep-wake classification strategy, called consistent deep representation constraint (CDRC), that forces the convolutional neural network (CNN) to make consistent predictions for the samples from different conditions but with the same label, to address the variances caused by infants and environments. The clinical validation shows that by using CDRC, all CNN backbones obtain over 85% accuracy, sensitivity, and specificity in both the cross-age and cross-environment experiments, improving the ones without CDRC by almost 15% in all metrics. This demonstrates that by improving the consistency of the deep representation of samples with the same state, we can significantly improve the generalization of infant sleep-wake classification.
婴儿的睡眠-觉醒行为是生理和神经系统成熟的重要指标,其昼夜节律的转变对于评估早产儿从生理功能不足和认知障碍中恢复的情况非常重要。最近,已经研究了基于摄像头的婴儿睡眠-觉醒监测,但由于婴儿和临床环境的差异导致的推广问题在该应用中尚未得到解决。在本文中,我们在四家医院进行了一项多中心临床试验,以提高基于摄像头的婴儿睡眠-觉醒监测的泛化能力。我们使用在 NICU 中记录的 64 名足月和 39 名早产儿的面部视频,提出了一种新的睡眠-觉醒分类策略,称为一致深度表示约束(CDRC),该策略迫使卷积神经网络(CNN)对来自不同条件但具有相同标签的样本做出一致的预测,以解决由婴儿和环境引起的差异。临床验证表明,通过使用 CDRC,所有 CNN 骨干网络在跨年龄和跨环境实验中均获得了超过 85%的准确率、灵敏度和特异性,在所有指标上都比没有 CDRC 的提高了近 15%。这表明,通过提高具有相同状态的样本的深度表示的一致性,我们可以显著提高婴儿睡眠-觉醒分类的泛化能力。