Institute of Multimedia ICT, Slovak University of Technology in Bratislava, Bratislava, Slovakia.
Sci Rep. 2021 Aug 3;11(1):15687. doi: 10.1038/s41598-021-95275-1.
A new detection method for cognitive impairments is presented utilizing an eye tracking signals in a text reading test. This research enhances published articles that extract combination of various features. It does so by processing entire eye-tracking records either in time or frequency whereas applying only basic signal pre-processing. Such signals were classified as a whole by Convolutional Neural Networks (CNN) that hierarchically extract substantial features scatter either in time or frequency and nonlinearly binds them using machine learning to minimize a detection error. In the experiments we used a 100 fold cross validation and a dataset containing signals of 185 subjects (88 subjects with low risk and 97 subjects with high risk of dyslexia). In a series of experiments it was found that magnitude spectrum based representation of time interpolated eye-tracking signals recorded the best results, i.e. an average accuracy of 96.6% was reached in comparison to 95.6% that is the best published result on the same database. These findings suggest that a holistic approach involving small but complex enough CNNs applied to properly pre-process and expressed signals provides even better results than a combination of meticulously selected well-known features.
提出了一种利用文本阅读测试中的眼动信号来检测认知障碍的新方法。该研究通过对整个眼动记录进行时间或频率上的处理,提取出各种特征的组合,从而增强了已发表的文章。与仅应用基本信号预处理相比,该方法通过卷积神经网络 (CNN) 对整个眼动信号进行分类,CNN 可以分层提取时间或频率上分散的重要特征,并通过机器学习将它们非线性地结合起来,以最小化检测误差。在实验中,我们使用了 100 倍交叉验证和包含 185 个被试信号的数据集(88 个低风险和 97 个阅读障碍高风险被试)。在一系列实验中发现,基于时间内插眼动信号的幅度谱表示记录了最佳结果,即平均准确率达到 96.6%,而在同一数据库上发表的最佳结果为 95.6%。这些发现表明,涉及足够小但复杂的 CNN 的整体方法应用于适当的预处理和表达信号,可提供比精心选择的知名特征的组合更好的结果。