• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

LARNet:基于无损注意力残差网络的实时面部微表情检测

LARNet: Real-Time Detection of Facial Micro Expression Using Lossless Attention Residual Network.

机构信息

Department of Electronics and Communication Engineering, National Institute of Technology, Warangal 506004, India.

Viume, Hyderabad, India.

出版信息

Sensors (Basel). 2021 Feb 5;21(4):1098. doi: 10.3390/s21041098.

DOI:10.3390/s21041098
PMID:33562767
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7914525/
Abstract

Facial micro expressions are brief, spontaneous, and crucial emotions deep inside the mind, reflecting the actual thoughts for that moment. Humans can cover their emotions on a large scale, but their actual intentions and emotions can be extracted at a micro-level. Micro expressions are organic when compared with macro expressions, posing a challenge to both humans, as well as machines, to identify. In recent years, detection of facial expressions are widely used in commercial complexes, hotels, restaurants, psychology, security, offices, and education institutes. The aim and motivation of this paper are to provide an end-to-end architecture that accurately detects the actual expressions at the micro-scale features. However, the main research is to provide an analysis of the specific parts that are crucial for detecting the micro expressions from a face. Many states of the art approaches have been trained on the micro facial expressions and compared with our proposed Lossless Attention Residual Network (LARNet) approach. However, the main research on this is to provide analysis on the specific parts that are crucial for detecting the micro expressions from a face. Many CNN-based approaches extracts the features at local level which digs much deeper into the face pixels. However, the spatial and temporal information extracted from the face is encoded in LARNet for a feature fusion extraction on specific crucial locations, such as nose, cheeks, mouth, and eyes regions. LARNet outperforms the state-of-the-art methods with a slight margin by accurately detecting facial micro expressions in real-time. Lastly, the proposed LARNet becomes accurate and better by training with more annotated data.

摘要

面部微表情是短暂的、自发的、内心深处的关键情绪,反映了当时的真实想法。人类可以在很大程度上掩盖自己的情绪,但他们的真实意图和情绪可以在微观层面上被提取出来。与宏表情相比,微表情是有机的,这对人类和机器来说都是一个挑战。近年来,面部表情的检测被广泛应用于商业综合体、酒店、餐厅、心理学、安全、办公室和教育机构。本文的目的和动机是提供一种端到端的架构,能够准确地检测微观特征的实际表情。然而,主要的研究是提供一个分析,以确定从面部检测微表情的关键特定部分。许多最先进的方法已经在微面部表情上进行了训练,并与我们提出的无损失注意力残差网络(LARNet)方法进行了比较。然而,主要的研究是提供一个分析,以确定从面部检测微表情的关键特定部分。许多基于 CNN 的方法从局部水平提取特征,更深入地挖掘面部像素。然而,LARNet 对人脸进行特征融合提取时,在特定的关键位置(如鼻子、脸颊、嘴巴和眼睛区域)编码了从人脸中提取的空间和时间信息。LARNet 通过实时准确地检测面部微表情,以微小的优势超过了最先进的方法。最后,通过使用更多标注数据进行训练,所提出的 LARNet 变得更加准确和有效。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/82200a7fb5c7/sensors-21-01098-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/b2b31f04448c/sensors-21-01098-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/c7870ad94ef5/sensors-21-01098-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/0fc23ae00213/sensors-21-01098-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/9764d7828881/sensors-21-01098-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/2d986e87d8d1/sensors-21-01098-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/3ae6e479ce8b/sensors-21-01098-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/b6b8da302984/sensors-21-01098-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/414fbb1330c0/sensors-21-01098-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/f280e217877f/sensors-21-01098-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/fd3064dcbd2b/sensors-21-01098-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/8a428594675b/sensors-21-01098-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/82200a7fb5c7/sensors-21-01098-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/b2b31f04448c/sensors-21-01098-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/c7870ad94ef5/sensors-21-01098-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/0fc23ae00213/sensors-21-01098-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/9764d7828881/sensors-21-01098-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/2d986e87d8d1/sensors-21-01098-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/3ae6e479ce8b/sensors-21-01098-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/b6b8da302984/sensors-21-01098-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/414fbb1330c0/sensors-21-01098-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/f280e217877f/sensors-21-01098-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/fd3064dcbd2b/sensors-21-01098-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/8a428594675b/sensors-21-01098-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8777/7914525/82200a7fb5c7/sensors-21-01098-g012.jpg

相似文献

1
LARNet: Real-Time Detection of Facial Micro Expression Using Lossless Attention Residual Network.LARNet:基于无损注意力残差网络的实时面部微表情检测
Sensors (Basel). 2021 Feb 5;21(4):1098. doi: 10.3390/s21041098.
2
Facial Micro-Expression Recognition Enhanced by Score Fusion and a Hybrid Model from Convolutional LSTM and Vision Transformer.基于卷积长短期记忆网络和视觉Transformer融合的评分融合与混合模型增强的面部微表情识别。
Sensors (Basel). 2023 Jun 16;23(12):5650. doi: 10.3390/s23125650.
3
Hiding true emotions: micro-expressions in eyes retrospectively concealed by mouth movements.隐藏真实情感:眼部微表情会被嘴部动作事后掩盖。
Sci Rep. 2016 Feb 26;6:22049. doi: 10.1038/srep22049.
4
Hybrid Attention Cascade Network for Facial Expression Recognition.用于面部表情识别的混合注意力级联网络。
Sensors (Basel). 2021 Mar 12;21(6):2003. doi: 10.3390/s21062003.
5
Happy mouth and sad eyes: scanning emotional facial expressions.笑口与愁眼:扫描情感面部表情
Emotion. 2011 Aug;11(4):860-865. doi: 10.1037/a0022758.
6
Two-Level Spatio-Temporal Feature Fused Two-Stream Network for Micro-Expression Recognition.基于两级时空特征融合双流网络的微表情识别方法。
Sensors (Basel). 2024 Feb 29;24(5):1574. doi: 10.3390/s24051574.
7
A Convolutional Neural Network for Compound Micro-Expression Recognition.基于卷积神经网络的复合微表情识别。
Sensors (Basel). 2019 Dec 16;19(24):5553. doi: 10.3390/s19245553.
8
-Step Pre-Training and Décalcomanie Data Augmentation for Micro-Expression Recognition.- 用于微表情识别的分步预训练和转印数据增强。
Sensors (Basel). 2022 Sep 3;22(17):6671. doi: 10.3390/s22176671.
9
A Cascade Attention Based Facial Expression Recognition Network by Fusing Multi-Scale Spatio-Temporal Features.基于级联注意力的融合多尺度时空特征的面部表情识别网络。
Sensors (Basel). 2022 Feb 10;22(4):1350. doi: 10.3390/s22041350.
10
Mapping the emotional face. How individual face parts contribute to successful emotion recognition.绘制情感面孔。面部各个部分如何助力成功的情绪识别。
PLoS One. 2017 May 11;12(5):e0177239. doi: 10.1371/journal.pone.0177239. eCollection 2017.

引用本文的文献

1
Facial Expression Recognition for Measuring Jurors' Attention in Acoustic Jury Tests.用于测量声学陪审团测试中陪审员注意力的面部表情识别。
Sensors (Basel). 2024 Apr 4;24(7):2298. doi: 10.3390/s24072298.
2
Public mental health through social media in the post COVID-19 era.后 COVID-19 时代社交媒体在公共精神卫生中的作用。
Front Public Health. 2023 Dec 11;11:1323922. doi: 10.3389/fpubh.2023.1323922. eCollection 2023.
3
New Trends in Emotion Recognition Using Image Analysis by Neural Networks, A Systematic Review.基于神经网络的图像分析的情绪识别新趋势:系统综述。

本文引用的文献

1
Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition.用于姿态和遮挡鲁棒面部表情识别的区域注意力网络
IEEE Trans Image Process. 2020 Jan 29. doi: 10.1109/TIP.2019.2956143.
2
Attended End-to-end Architecture for Age Estimation from Facial Expression Videos.参与了“基于面部表情视频的年龄估计的端到端架构”。
IEEE Trans Image Process. 2019 Oct 24. doi: 10.1109/TIP.2019.2948288.
3
LEARNet: Dynamic Imaging Network for Micro Expression Recognition.LEARNet:用于微表情识别的动态成像网络。
Sensors (Basel). 2023 Aug 10;23(16):7092. doi: 10.3390/s23167092.
4
Using Facial Micro-Expressions in Combination With EEG and Physiological Signals for Emotion Recognition.结合面部微表情、脑电图和生理信号进行情绪识别
Front Psychol. 2022 Jun 28;13:864047. doi: 10.3389/fpsyg.2022.864047. eCollection 2022.
IEEE Trans Image Process. 2019 Sep 19. doi: 10.1109/TIP.2019.2912358.
4
Occlusion aware facial expression recognition using CNN with attention mechanism.基于带有注意力机制的卷积神经网络的遮挡感知面部表情识别
IEEE Trans Image Process. 2018 Dec 14. doi: 10.1109/TIP.2018.2886767.
5
HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition.超人脸:一个用于人脸检测、地标定位、姿势估计和性别识别的深度多任务学习框架。
IEEE Trans Pattern Anal Mach Intell. 2019 Jan;41(1):121-135. doi: 10.1109/TPAMI.2017.2781233. Epub 2017 Dec 8.
6
Dual Temporal Scale Convolutional Neural Network for Micro-Expression Recognition.用于微表情识别的双时间尺度卷积神经网络
Front Psychol. 2017 Oct 13;8:1745. doi: 10.3389/fpsyg.2017.01745. eCollection 2017.
7
CASME II: an improved spontaneous micro-expression database and the baseline evaluation.CASME II:一个改进的自发微表情数据库及基准评估。
PLoS One. 2014 Jan 27;9(1):e86041. doi: 10.1371/journal.pone.0086041. eCollection 2014.