• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

面部情绪识别:混合现实中的调查和真实用户体验。

Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality.

机构信息

EECS Department, The University of Toledo, Toledo, OH 43606, USA.

出版信息

Sensors (Basel). 2018 Feb 1;18(2):416. doi: 10.3390/s18020416.

DOI:10.3390/s18020416
PMID:29389845
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC5856132/
Abstract

Extensive possibilities of applications have made emotion recognition ineluctable and challenging in the field of computer science. The use of non-verbal cues such as gestures, body movement, and facial expressions convey the feeling and the feedback to the user. This discipline of Human-Computer Interaction places reliance on the algorithmic robustness and the sensitivity of the sensor to ameliorate the recognition. Sensors play a significant role in accurate detection by providing a very high-quality input, hence increasing the efficiency and the reliability of the system. Automatic recognition of human emotions would help in teaching social intelligence in the machines. This paper presents a brief study of the various approaches and the techniques of emotion recognition. The survey covers a succinct review of the databases that are considered as data sets for algorithms detecting the emotions by facial expressions. Later, mixed reality device Microsoft HoloLens (MHL) is introduced for observing emotion recognition in Augmented Reality (AR). A brief introduction of its sensors, their application in emotion recognition and some preliminary results of emotion recognition using MHL are presented. The paper then concludes by comparing results of emotion recognition by the MHL and a regular webcam.

摘要

在计算机科学领域,情感识别的广泛应用使其成为必然且具有挑战性。非言语线索(如手势、身体动作和面部表情)的使用向用户传达了感觉和反馈。人机交互这一学科依赖于算法的稳健性和传感器的敏感性来改善识别。传感器通过提供高质量的输入在准确检测中发挥着重要作用,从而提高了系统的效率和可靠性。人类情绪的自动识别将有助于在机器中教授社交智能。本文对情感识别的各种方法和技术进行了简要研究。该调查涵盖了对数据库的简要回顾,这些数据库被视为通过面部表情检测情绪的算法的数据集。随后,引入了混合现实设备 Microsoft HoloLens (MHL) 来观察增强现实 (AR) 中的情感识别。简要介绍了其传感器、在情感识别中的应用以及使用 MHL 进行情感识别的一些初步结果。然后,本文通过比较 MHL 和常规网络摄像头的情感识别结果进行总结。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/7d04db73259c/sensors-18-00416-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/5b9aa7f26a5f/sensors-18-00416-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/f0fe105e9a99/sensors-18-00416-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/a1b912c637cb/sensors-18-00416-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/a4962338efd9/sensors-18-00416-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/646c0c98192f/sensors-18-00416-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/f4199b73ec62/sensors-18-00416-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/7485459b13be/sensors-18-00416-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/7d04db73259c/sensors-18-00416-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/5b9aa7f26a5f/sensors-18-00416-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/f0fe105e9a99/sensors-18-00416-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/a1b912c637cb/sensors-18-00416-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/a4962338efd9/sensors-18-00416-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/646c0c98192f/sensors-18-00416-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/f4199b73ec62/sensors-18-00416-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/7485459b13be/sensors-18-00416-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5f4a/5856132/7d04db73259c/sensors-18-00416-g008.jpg

相似文献

1
Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality.面部情绪识别:混合现实中的调查和真实用户体验。
Sensors (Basel). 2018 Feb 1;18(2):416. doi: 10.3390/s18020416.
2
Recognition of Emotion Intensities Using Machine Learning Algorithms: A Comparative Study.基于机器学习算法的情感强度识别:一项比较研究。
Sensors (Basel). 2019 Apr 21;19(8):1897. doi: 10.3390/s19081897.
3
Neutral face classification using personalized appearance models for fast and robust emotion detection.基于个性化表观模型的中性表情分类用于快速稳健的情绪检测。
IEEE Trans Image Process. 2015 Sep;24(9):2701-11. doi: 10.1109/TIP.2015.2421437. Epub 2015 Apr 10.
4
Respiration Based Non-Invasive Approach for Emotion Recognition Using Impulse Radio Ultra Wide Band Radar and Machine Learning.基于呼吸的非侵入式情绪识别方法,使用脉冲无线电超宽带雷达和机器学习。
Sensors (Basel). 2021 Dec 13;21(24):8336. doi: 10.3390/s21248336.
5
A Review on Automatic Facial Expression Recognition Systems Assisted by Multimodal Sensor Data.基于多模态传感器数据的自动面部表情识别系统综述。
Sensors (Basel). 2019 Apr 18;19(8):1863. doi: 10.3390/s19081863.
6
Robust representation and recognition of facial emotions using extreme sparse learning.使用极端稀疏学习进行面部表情的鲁棒表示和识别。
IEEE Trans Image Process. 2015 Jul;24(7):2140-52. doi: 10.1109/TIP.2015.2416634. Epub 2015 Mar 25.
7
A facial expression controlled wheelchair for people with disabilities.一款可由面部表情控制的轮椅,供残疾人使用。
Comput Methods Programs Biomed. 2018 Oct;165:89-105. doi: 10.1016/j.cmpb.2018.08.013. Epub 2018 Aug 18.
8
Emotion Recognition Using Different Sensors, Emotion Models, Methods and Datasets: A Comprehensive Review.使用不同传感器、情绪模型、方法和数据集进行情绪识别:全面回顾。
Sensors (Basel). 2023 Feb 23;23(5):2455. doi: 10.3390/s23052455.
9
Adaptive user interface design and analysis using emotion recognition through facial expressions and body posture from an RGB-D sensor.使用 RGB-D 传感器通过面部表情和身体姿势进行情感识别,实现自适应用户界面设计和分析。
PLoS One. 2020 Jul 16;15(7):e0235908. doi: 10.1371/journal.pone.0235908. eCollection 2020.
10
Opportunities and Pitfalls in Applying Emotion Recognition Software for Persons With a Visual Impairment: Simulated Real Life Conversations.将情感识别软件应用于视障人士的机遇与挑战:模拟现实生活对话。
JMIR Mhealth Uhealth. 2019 Nov 21;7(11):e13722. doi: 10.2196/13722.

引用本文的文献

1
Effect of observer's cultural background and masking condition of target face on facial expression recognition for machine-learning dataset.观察者的文化背景和目标面部的掩蔽条件对机器学习面部表情识别数据集的影响。
PLoS One. 2024 Oct 30;19(10):e0313029. doi: 10.1371/journal.pone.0313029. eCollection 2024.
2
Comparative Assessment of Multimodal Sensor Data Quality Collected Using Android and iOS Smartphones in Real-World Settings.在真实环境中使用 Android 和 iOS 智能手机收集的多模态传感器数据质量的比较评估。
Sensors (Basel). 2024 Sep 26;24(19):6246. doi: 10.3390/s24196246.
3
The Application of Extended Reality in Treating Children with Autism Spectrum Disorder.

本文引用的文献

1
Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications.基于 RGB、3D、热成像和多模态的面部表情识别方法综述:历史、趋势及情感相关应用。
IEEE Trans Pattern Anal Mach Intell. 2016 Aug;38(8):1548-68. doi: 10.1109/TPAMI.2016.2515606. Epub 2016 Jan 7.
2
Local directional number pattern for face analysis: face and expression recognition.局部方向数模式在人脸分析中的应用:人脸与表情识别。
IEEE Trans Image Process. 2013 May;22(5):1740-52. doi: 10.1109/TIP.2012.2235848. Epub 2012 Dec 21.
3
Multi-PIE.
扩展现实技术在治疗自闭症谱系障碍儿童中的应用
Neurosci Bull. 2024 Aug;40(8):1189-1204. doi: 10.1007/s12264-024-01190-6. Epub 2024 Mar 18.
4
Building a Low-Cost Wireless Biofeedback Solution: Applying Design Science Research Methodology.构建低成本无线生物反馈解决方案:应用设计科学研究方法。
Sensors (Basel). 2023 Mar 8;23(6):2920. doi: 10.3390/s23062920.
5
Case Report: Application of Mixed Reality Combined With A Surgical Template for Precise Periapical Surgery.病例报告:混合现实结合手术模板在根尖周精准手术中的应用
Front Surg. 2022 Jun 10;9:923299. doi: 10.3389/fsurg.2022.923299. eCollection 2022.
6
Region Dual Attention-Based Video Emotion Recognition.基于区域双重注意力的视频情绪识别。
Comput Intell Neurosci. 2022 Jun 15;2022:6096325. doi: 10.1155/2022/6096325. eCollection 2022.
7
Communication in Human-Robot Interaction.人机交互中的沟通
Curr Robot Rep. 2020;1(4):279-285. doi: 10.1007/s43154-020-00026-1. Epub 2020 Aug 27.
8
Development and Progress in Sensors and Technologies for Human Emotion Recognition.人类情感识别传感器和技术的发展与进步。
Sensors (Basel). 2021 Aug 18;21(16):5554. doi: 10.3390/s21165554.
9
Incorporating Interpersonal Synchronization Features for Automatic Emotion Recognition from Visual and Audio Data during Communication.将人际同步特征纳入视觉和音频数据的自动情感识别中,用于交流期间。
Sensors (Basel). 2021 Aug 6;21(16):5317. doi: 10.3390/s21165317.
10
Application of Eye Tracking Technology in Aviation, Maritime, and Construction Industries: A Systematic Review.眼动追踪技术在航空、航海和建筑行业的应用:系统评价。
Sensors (Basel). 2021 Jun 23;21(13):4289. doi: 10.3390/s21134289.
多姿态、光照和表情数据库
Proc Int Conf Autom Face Gesture Recognit. 2010 May 1;28(5):807-813. doi: 10.1016/j.imavis.2009.08.002.
4
Face recognition by independent component analysis.基于独立成分分析的人脸识别。
IEEE Trans Neural Netw. 2002;13(6):1450-64. doi: 10.1109/TNN.2002.804287.
5
Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences.面部表情动态:从面部轮廓图像序列中识别面部动作及其时间片段。
IEEE Trans Syst Man Cybern B Cybern. 2006 Apr;36(2):433-49. doi: 10.1109/tsmcb.2005.859075.
6
Subject independent facial expression recognition with robust face detection using a convolutional neural network.使用卷积神经网络进行鲁棒人脸检测的独立于主体的面部表情识别。
Neural Netw. 2003 Jun-Jul;16(5-6):555-9. doi: 10.1016/S0893-6080(03)00115-1.