Suppr超能文献

人类注视辅助人工智能:综述

Human Gaze Assisted Artificial Intelligence: A Review.

作者信息

Zhang Ruohan, Saran Akanksha, Liu Bo, Zhu Yifeng, Guo Sihang, Niekum Scott, Ballard Dana, Hayhoe Mary

机构信息

The University of Texas at Austin.

出版信息

IJCAI (U S). 2020 Jul;2020:4951-4958. doi: 10.24963/ijcai.2020/689.

Abstract

Human gaze reveals a wealth of information about internal cognitive state. Thus, gaze-related research has significantly increased in computer vision, natural language processing, decision learning, and robotics in recent years. We provide a high-level overview of the research efforts in these fields, including collecting human gaze data sets, modeling gaze behaviors, and utilizing gaze information in various applications, with the goal of enhancing communication between these research areas. We discuss future challenges and potential applications that work towards a common goal of human-centered artificial intelligence.

摘要

人类的目光揭示了大量有关内部认知状态的信息。因此,近年来,与目光相关的研究在计算机视觉、自然语言处理、决策学习和机器人技术等领域显著增加。我们对这些领域的研究工作进行了高层次概述,包括收集人类目光数据集、对目光行为进行建模以及在各种应用中利用目光信息,目的是加强这些研究领域之间的交流。我们讨论了朝着以人类为中心的人工智能这一共同目标发展的未来挑战和潜在应用。

相似文献

1
Human Gaze Assisted Artificial Intelligence: A Review.
IJCAI (U S). 2020 Jul;2020:4951-4958. doi: 10.24963/ijcai.2020/689.
2
Dentronics: Towards robotics and artificial intelligence in dentistry.
Dent Mater. 2020 Jun;36(6):765-778. doi: 10.1016/j.dental.2020.03.021. Epub 2020 Apr 27.
3
AAC and Artificial Intelligence (AI).
Top Lang Disord. 2019 Oct-Dec;39(4):389-403. doi: 10.1097/tld.0000000000000197.
4
Rethinking Autonomous Surgery: Focusing on Enhancement over Autonomy.
Eur Urol Focus. 2021 Jul;7(4):696-705. doi: 10.1016/j.euf.2021.06.009. Epub 2021 Jul 8.
5
Investigating the link between radiologists' gaze, diagnostic decision, and image content.
J Am Med Inform Assoc. 2013 Nov-Dec;20(6):1067-75. doi: 10.1136/amiajnl-2012-001503. Epub 2013 Jun 20.
6
The Use of Artificial Intelligence and Machine Learning in Surgery: A Comprehensive Literature Review.
Am Surg. 2023 May;89(5):1980-1988. doi: 10.1177/00031348211065101. Epub 2021 Dec 27.
7
Artificial intelligence in clinical applications for lung cancer: diagnosis, treatment and prognosis.
Clin Chem Lab Med. 2022 Jun 30;60(12):1974-1983. doi: 10.1515/cclm-2022-0291. Print 2022 Nov 25.
8
Advancements and Challenges in the Application of Artificial Intelligence in Surgical Arena: A Literature Review.
Cureus. 2023 Oct 29;15(10):e47924. doi: 10.7759/cureus.47924. eCollection 2023 Oct.
9
Bottom-up gaze shifts and fixations learning by imitation.
IEEE Trans Syst Man Cybern B Cybern. 2007 Apr;37(2):256-71. doi: 10.1109/tsmcb.2006.886950.
10
Using Eye Gaze to Enhance Generalization of Imitation Networks to Unseen Environments.
IEEE Trans Neural Netw Learn Syst. 2021 May;32(5):2066-2074. doi: 10.1109/TNNLS.2020.2996386. Epub 2021 May 3.

引用本文的文献

1
Using Gaze for Behavioural Biometrics.
Sensors (Basel). 2023 Jan 22;23(3):1262. doi: 10.3390/s23031262.
2
Gazing at Social Interactions Between Foraging and Decision Theory.
Front Neurorobot. 2021 Mar 30;15:639999. doi: 10.3389/fnbot.2021.639999. eCollection 2021.

本文引用的文献

1
Atari-HEAD: Atari Human Eye-Tracking and Demonstration Dataset.
Proc AAAI Conf Artif Intell. 2020 Feb;34(4):6811-6820. doi: 10.1609/aaai.v34i04.6161. Epub 2020 Apr 3.
2
Meaning Guides Attention during Real-World Scene Description.
Sci Rep. 2018 Sep 10;8(1):13504. doi: 10.1038/s41598-018-31894-5.
3
Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Model.
IEEE Trans Image Process. 2018 Jun 29. doi: 10.1109/TIP.2018.2851672.
4
Predicting the Driver's Focus of Attention: The DR(eye)VE Project.
IEEE Trans Pattern Anal Mach Intell. 2019 Jul;41(7):1720-1733. doi: 10.1109/TPAMI.2018.2845370. Epub 2018 Jun 8.
5
What Do Different Evaluation Metrics Tell Us About Saliency Models?
IEEE Trans Pattern Anal Mach Intell. 2019 Mar;41(3):740-757. doi: 10.1109/TPAMI.2018.2815601. Epub 2018 Mar 13.
6
MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation.
IEEE Trans Pattern Anal Mach Intell. 2019 Jan;41(1):162-175. doi: 10.1109/TPAMI.2017.2778103. Epub 2017 Nov 28.
7
Vision and Action.
Annu Rev Vis Sci. 2017 Sep 15;3:389-413. doi: 10.1146/annurev-vision-102016-061437. Epub 2017 Jul 17.
8
DeepFix: A Fully Convolutional Neural Network for Predicting Human Eye Fixations.
IEEE Trans Image Process. 2017 Sep;26(9):4446-4456. doi: 10.1109/TIP.2017.2710620.
9
Salient Object Detection: A Benchmark.
IEEE Trans Image Process. 2015 Dec;24(12):5706-22. doi: 10.1109/TIP.2015.2487833. Epub 2015 Oct 7.
10
Actions in the Eye: Dynamic Gaze Datasets and Learnt Saliency Models for Visual Recognition.
IEEE Trans Pattern Anal Mach Intell. 2015 Jul;37(7):1408-24. doi: 10.1109/TPAMI.2014.2366154.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验