Suppr超能文献

见解:结合注视可视化和残差神经网络从眼动追踪数据中进行阅读障碍分类。

INSIGHT: Combining Fixation Visualisations and Residual Neural Networks for Dyslexia Classification From Eye-Tracking Data.

作者信息

Svaricek Roman, Dostalova Nicol, Sedmidubsky Jan, Cernek Andrej

机构信息

Department of Educational Sciences, Faculty of Arts, Masaryk University, Brno, Czech Republic.

Department of Machine Learning and Data Processing, Faculty of Informatics, Masaryk University, Brno, Czech Republic.

出版信息

Dyslexia. 2025 Feb;31(1):e1801. doi: 10.1002/dys.1801.

Abstract

Current diagnostic methods for dyslexia primarily rely on traditional paper-and-pencil tasks. Advanced technological approaches, including eye-tracking and artificial intelligence (AI), offer enhanced diagnostic capabilities. In this paper, we bridge the gap between scientific and diagnostic concepts by proposing a novel dyslexia detection method, called INSIGHT, which combines a visualisation phase and a neural network-based classification phase. The first phase involves transforming eye-tracking fixation data into 2D visualisations called Fix-images, which clearly depict reading difficulties. The second phase utilises the ResNet18 convolutional neural network for classifying these images. The INSIGHT method was tested on 35 child participants (13 dyslexic and 22 control readers) using three text-reading tasks, achieving a highest accuracy of 86.65%. Additionally, we cross-tested the method on an independent dataset of Danish readers, confirming the robustness and generalizability of our approach with a notable accuracy of 86.11%. This innovative approach not only provides detailed insight into eye movement patterns when reading but also offers a robust framework for the early and accurate diagnosis of dyslexia, supporting the potential for more personalised and effective interventions.

摘要

当前诵读困难的诊断方法主要依赖于传统的纸笔任务。包括眼动追踪和人工智能(AI)在内的先进技术方法提供了更强的诊断能力。在本文中,我们通过提出一种名为INSIGHT的新型诵读困难检测方法,弥合了科学概念与诊断概念之间的差距,该方法结合了一个可视化阶段和一个基于神经网络的分类阶段。第一阶段涉及将眼动追踪注视数据转换为称为Fix图像的二维可视化,清晰地描绘阅读困难。第二阶段利用ResNet18卷积神经网络对这些图像进行分类。INSIGHT方法在35名儿童参与者(13名诵读困难者和22名对照阅读者)身上使用三项文本阅读任务进行了测试,最高准确率达到86.65%。此外,我们在丹麦读者的独立数据集上对该方法进行了交叉测试,以86.11%的显著准确率证实了我们方法的稳健性和通用性。这种创新方法不仅提供了阅读时眼动模式的详细洞察,还为诵读困难的早期准确诊断提供了一个稳健的框架,支持了更个性化和有效干预的潜力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4b4f/11754147/1503f5fcb7b7/DYS-31-e1801-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验