• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

当我凝视你的双眼:计算机视觉在人类视线估计和追踪中的应用综述。

When I Look into Your Eyes: A Survey on Computer Vision Contributions for Human Gaze Estimation and Tracking.

机构信息

Interdisciplinary Center for Security, Reliability and Trust (SnT), University of Luxembourg, L-4364 Esch-sur-Alzette, Luxembourg.

National Research Council of Italy-Institute of Applied Sciences and Intelligent Systems, 73100 Lecce, Italy.

出版信息

Sensors (Basel). 2020 Jul 3;20(13):3739. doi: 10.3390/s20133739.

DOI:10.3390/s20133739
PMID:32635375
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7374327/
Abstract

The automatic detection of eye positions, their temporal consistency, and their mapping into a line of sight in the real world (to find where a person is looking at) is reported in the scientific literature as gaze tracking. This has become a very hot topic in the field of computer vision during the last decades, with a surprising and continuously growing number of application fields. A very long journey has been made from the first pioneering works, and this continuous search for more accurate solutions process has been further boosted in the last decade when deep neural networks have revolutionized the whole machine learning area, and gaze tracking as well. In this arena, it is being increasingly useful to find guidance through survey/review articles collecting most relevant works and putting clear pros and cons of existing techniques, also by introducing a precise taxonomy. This kind of manuscripts allows researchers and technicians to choose the better way to move towards their application or scientific goals. In the literature, there exist holistic and specifically technological survey documents (even if not updated), but, unfortunately, there is not an overview discussing how the great advancements in computer vision have impacted gaze tracking. Thus, this work represents an attempt to fill this gap, also introducing a wider point of view that brings to a new taxonomy (extending the consolidated ones) by considering gaze tracking as a more exhaustive task that aims at estimating gaze target from different perspectives: from the eye of the beholder (first-person view), from an external camera framing the beholder's, from a third-person view looking at the scene where the beholder is placed in, and from an external view independent from the beholder.

摘要

眼动位置的自动检测、它们的时间一致性,以及将其映射到现实世界中的视线(以找到人在看哪里)在科学文献中被报道为眼动追踪。在过去几十年中,计算机视觉领域中,这已经成为一个非常热门的话题,并且具有惊人的、不断增长的应用领域数量。从最初的开创性工作开始,已经走过了漫长的道路,在过去十年中,随着深度学习神经网络彻底改变了整个机器学习领域,这种对更准确解决方案的持续探索也得到了进一步推动,眼动追踪也是如此。在这个领域中,通过收集最相关工作并明确现有技术的优缺点,同时引入精确的分类法的调查/综述文章越来越有用。这种手稿可以帮助研究人员和技术人员选择更好的方法来实现他们的应用或科学目标。在文献中,存在整体的和专门的技术调查文件(即使没有更新),但不幸的是,没有一篇文章讨论计算机视觉的巨大进步如何影响眼动追踪。因此,这项工作试图填补这一空白,同时通过将眼动追踪视为一个更全面的任务来引入更广泛的观点,该任务旨在从不同的角度估计注视目标:从观察者的眼睛(第一人称视角)、从注视者的外部摄像机框架、从第三个人的视角观察观察者所处的场景,以及从独立于观察者的外部视角。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/6b8fdab04061/sensors-20-03739-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/66f57c3d8089/sensors-20-03739-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/e2906e99a528/sensors-20-03739-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/8270689f93dc/sensors-20-03739-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/4528ae0c5726/sensors-20-03739-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/cbe8f3785815/sensors-20-03739-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/6b8fdab04061/sensors-20-03739-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/66f57c3d8089/sensors-20-03739-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/e2906e99a528/sensors-20-03739-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/8270689f93dc/sensors-20-03739-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/4528ae0c5726/sensors-20-03739-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/cbe8f3785815/sensors-20-03739-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/27f5/7374327/6b8fdab04061/sensors-20-03739-g006.jpg

相似文献

1
When I Look into Your Eyes: A Survey on Computer Vision Contributions for Human Gaze Estimation and Tracking.当我凝视你的双眼:计算机视觉在人类视线估计和追踪中的应用综述。
Sensors (Basel). 2020 Jul 3;20(13):3739. doi: 10.3390/s20133739.
2
Shedding light on ai in radiology: A systematic review and taxonomy of eye gaze-driven interpretability in deep learning.解读放射学中的人工智能:深度学习中眼动驱动可解释性的系统综述与分类法
Eur J Radiol. 2024 Mar;172:111341. doi: 10.1016/j.ejrad.2024.111341. Epub 2024 Feb 1.
3
Dynamics of gaze control during prey capture in freely moving mice.自由活动的小鼠在捕食过程中注视控制的动力学。
Elife. 2020 Jul 24;9:e57458. doi: 10.7554/eLife.57458.
4
Automatic Visual Attention Detection for Mobile Eye Tracking Using Pre-Trained Computer Vision Models and Human Gaze.基于预训练计算机视觉模型和人眼注视的移动眼动追踪自动视觉注意力检测。
Sensors (Basel). 2021 Jun 16;21(12):4143. doi: 10.3390/s21124143.
5
An integrated neural network model for eye-tracking during human-computer interaction.一种用于人机交互过程中眼动追踪的集成神经网络模型。
Math Biosci Eng. 2023 Jun 21;20(8):13974-13988. doi: 10.3934/mbe.2023622.
6
Multiview Multitask Gaze Estimation With Deep Convolutional Neural Networks.基于深度卷积神经网络的多视图多任务注视估计。
IEEE Trans Neural Netw Learn Syst. 2019 Oct;30(10):3010-3023. doi: 10.1109/TNNLS.2018.2865525. Epub 2018 Sep 3.
7
Gaze Tracking and Point Estimation Using Low-Cost Head-Mounted Devices.使用低成本头戴式设备进行注视跟踪和点估计。
Sensors (Basel). 2020 Mar 30;20(7):1917. doi: 10.3390/s20071917.
8
In the eye of the beholder: a survey of models for eyes and gaze.在观察者的眼中:眼睛和注视模型的调查。
IEEE Trans Pattern Anal Mach Intell. 2010 Mar;32(3):478-500. doi: 10.1109/TPAMI.2009.30.
9
Deep learning models for webcam eye tracking in online experiments.在线实验中使用网络摄像头进行眼动追踪的深度学习模型。
Behav Res Methods. 2024 Apr;56(4):3487-3503. doi: 10.3758/s13428-023-02190-6. Epub 2023 Aug 22.
10
Estimation of Gaze Detection Accuracy Using the Calibration Information-Based Fuzzy System.基于校准信息的模糊系统对注视检测准确率的估计
Sensors (Basel). 2016 Jan 5;16(1):60. doi: 10.3390/s16010060.

引用本文的文献

1
Neuroscientific Analysis of Logo Design: Implications for Luxury Brand Marketing.标志设计的神经科学分析:对奢侈品牌营销的启示
Behav Sci (Basel). 2025 Apr 9;15(4):502. doi: 10.3390/bs15040502.
2
Improving Eye-Tracking Data Quality: A Framework for Reproducible Evaluation of Detection Algorithms.提高眼动追踪数据质量:一种可重复评估检测算法的框架。
Sensors (Basel). 2024 Apr 24;24(9):2688. doi: 10.3390/s24092688.
3
Comprehensive Assessment of Artificial Intelligence Tools for Driver Monitoring and Analyzing Safety Critical Events in Vehicles.

本文引用的文献

1
Gaze Estimation by Exploring Two-Eye Asymmetry.通过探索双眼不对称性进行注视估计
IEEE Trans Image Process. 2020 Mar 30. doi: 10.1109/TIP.2020.2982828.
2
A Differential Approach for Gaze Estimation.注视估计的差分方法。
IEEE Trans Pattern Anal Mach Intell. 2021 Mar;43(3):1092-1099. doi: 10.1109/TPAMI.2019.2957373. Epub 2021 Feb 4.
3
How is Gaze Influenced by Image Transformations? Dataset and Model.注视如何受到图像变换的影响?数据集与模型。
用于车辆驾驶员监测和安全关键事件分析的人工智能工具综合评估
Sensors (Basel). 2024 Apr 12;24(8):2478. doi: 10.3390/s24082478.
4
Artificial cognition vs. artificial intelligence for next-generation autonomous robotic agents.下一代自主机器人的人工认知与人工智能
Front Comput Neurosci. 2024 Mar 22;18:1349408. doi: 10.3389/fncom.2024.1349408. eCollection 2024.
5
Human behavior in free search online shopping scenarios can be predicted from EEG activation using Hjorth parameters.利用约尔特参数,可从脑电图激活情况预测人们在自由搜索式网上购物场景中的行为。
Front Neurosci. 2023 Nov 10;17:1191213. doi: 10.3389/fnins.2023.1191213. eCollection 2023.
6
ArbGaze: Gaze Estimation from Arbitrary-Sized Low-Resolution Images.ArbGaze:从任意大小的低分辨率图像估计注视点。
Sensors (Basel). 2022 Sep 30;22(19):7427. doi: 10.3390/s22197427.
7
Convolutional Neural Network-Based Technique for Gaze Estimation on Mobile Devices.基于卷积神经网络的移动设备注视估计技术
Front Artif Intell. 2022 Jan 26;4:796825. doi: 10.3389/frai.2021.796825. eCollection 2021.
8
Digital Phenotyping in Clinical Neurology.临床神经病学中的数字化表型
Semin Neurol. 2022 Feb;42(1):48-59. doi: 10.1055/s-0041-1741495. Epub 2022 Jan 11.
9
Design Guidelines of a Computer-Based Intervention for Computer Vision Syndrome: Focus Group Study and Real-World Deployment.基于计算机的计算机视觉综合征干预措施的设计指南:焦点小组研究和真实世界部署。
J Med Internet Res. 2021 Mar 29;23(3):e22099. doi: 10.2196/22099.
10
Gaze and Event Tracking for Evaluation of Recommendation-Driven Purchase.用于评估推荐驱动购买的注视和事件跟踪。
Sensors (Basel). 2021 Feb 16;21(4):1381. doi: 10.3390/s21041381.
IEEE Trans Image Process. 2019 Oct 11. doi: 10.1109/TIP.2019.2945857.
4
Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Model.基于长短期记忆网络的显著性注意力模型预测人眼注视点
IEEE Trans Image Process. 2018 Jun 29. doi: 10.1109/TIP.2018.2851672.
5
What Do Different Evaluation Metrics Tell Us About Saliency Models?不同的评估指标能告诉我们关于显著性模型的哪些信息?
IEEE Trans Pattern Anal Mach Intell. 2019 Mar;41(3):740-757. doi: 10.1109/TPAMI.2018.2815601. Epub 2018 Mar 13.
6
Using point cloud data to improve three dimensional gaze estimation.使用点云数据改进三维注视估计。
Annu Int Conf IEEE Eng Med Biol Soc. 2017 Jul;2017:795-798. doi: 10.1109/EMBC.2017.8036944.
7
Eye Tracking and Head Movement Detection: A State-of-Art Survey.眼动追踪和头部运动检测:最新研究综述。
IEEE J Transl Eng Health Med. 2013 Nov 6;1:2100212. doi: 10.1109/JTEHM.2013.2289879. eCollection 2013.
8
Adaptive Linear Regression for Appearance-Based Gaze Estimation.基于外观的视线估计的自适应线性回归。
IEEE Trans Pattern Anal Mach Intell. 2014 Oct;36(10):2033-46. doi: 10.1109/TPAMI.2014.2313123.
9
Deep learning.深度学习。
Nature. 2015 May 28;521(7553):436-44. doi: 10.1038/nature14539.
10
The eye-tracking of social stimuli in patients with Rett syndrome and autism spectrum disorders: a pilot study.雷特综合征和自闭症谱系障碍患者对社会刺激的眼动追踪:一项初步研究。
Arq Neuropsiquiatr. 2015 May;73(5):402-7. doi: 10.1590/0004-282X20150033.