IEEE Trans Cybern. 2021 Jan;51(1):332-345. doi: 10.1109/TCYB.2018.2886012. Epub 2020 Dec 22.
How to track the attention of the pilot is a huge challenge. We are able to capture the pupil status of the pilot and analyze their anomalies and judge the attention of the pilot. This paper proposes a new approach to solve this problem through the integration of spherical Haar wavelet transform and deep learning methods. First, considering the application limitations of Haar wavelet and other wavelets in spherical signal decomposition and reconstruction, a feature learning method based on the spherical Haar wavelet is proposed. In order to obtain the salient features of the spherical signal, a rotating spherical Haar wavelet is also proposed, which has a consistent scale in the same direction between the reconstructed image and the original image. Second, in order to find a better characteristic representation of the spherical signal, a higher contractive autoencoder (HCAE) is designed for the potential representation of the spherical Haar wavelet coefficients, which has two penalty items, respectively, from Jacobian and two order items from Taylor expansion of the point x for the contract learning of sample space. Third, in order to improve the classification performance, this paper proposes a fuzzy Gaussian support vector machine (FGSVM) as the top classification tool of the deep learning model, which can punish some Gaussian noise from the output of the deep HCAE network (DHCAEN). Finally, a DHCAEN-FGSVM classifier is proposed to identify the location of the pupil center. The experimental results of the public data set and actual data show that our model is an effective method for spherical signal detection.
如何跟踪飞行员的注意力是一个巨大的挑战。我们能够捕捉到飞行员的瞳孔状态,分析他们的异常情况,并判断飞行员的注意力。本文提出了一种新的方法,通过球形 Haar 小波变换和深度学习方法的集成来解决这个问题。首先,考虑到 Haar 小波和其他小波在球面信号分解和重建中的应用局限性,提出了一种基于球形 Haar 小波的特征学习方法。为了获得球面信号的显著特征,还提出了一种旋转的球面 Haar 小波,在重构图像和原始图像之间,在同一方向上具有一致的尺度。其次,为了找到更好的球面信号特征表示,针对球形 Haar 小波系数的潜在表示设计了一个更高的压缩自编码器(HCAE),它有两个惩罚项,分别来自雅可比和点 x 的泰勒展开的二阶项,用于对样本空间进行合同学习。第三,为了提高分类性能,本文提出了一种模糊高斯支持向量机(FGSVM)作为深度学习模型的顶级分类工具,它可以从深层 HCAE 网络(DHCAEN)的输出中惩罚一些高斯噪声。最后,提出了一种 DHCAEN-FGSVM 分类器来识别瞳孔中心的位置。公共数据集和实际数据的实验结果表明,我们的模型是一种有效的球面信号检测方法。