• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于自发面部微表情识别的高效时空局部二值模式

Efficient spatio-temporal local binary patterns for spontaneous facial micro-expression recognition.

作者信息

Wang Yandan, See John, Phan Raphael C-W, Oh Yee-Hui

机构信息

School of Physics and Electronic Information Engineering, Wenzhou University, Wenzhou, Zhejiang, China; Faculty of Engineering, Multimedia University, Cyberjaya, Selangor, Malaysia.

Faculty of Computing & Informatics, Multimedia University, Cyberjaya, Selangor, Malaysia.

出版信息

PLoS One. 2015 May 19;10(5):e0124674. doi: 10.1371/journal.pone.0124674. eCollection 2015.

DOI:10.1371/journal.pone.0124674
PMID:25993498
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC4438071/
Abstract

Micro-expression recognition is still in the preliminary stage, owing much to the numerous difficulties faced in the development of datasets. Since micro-expression is an important affective clue for clinical diagnosis and deceit analysis, much effort has gone into the creation of these datasets for research purposes. There are currently two publicly available spontaneous micro-expression datasets--SMIC and CASME II, both with baseline results released using the widely used dynamic texture descriptor LBP-TOP for feature extraction. Although LBP-TOP is popular and widely used, it is still not compact enough. In this paper, we draw further inspiration from the concept of LBP-TOP that considers three orthogonal planes by proposing two efficient approaches for feature extraction. The compact robust form described by the proposed LBP-Six Intersection Points (SIP) and a super-compact LBP-Three Mean Orthogonal Planes (MOP) not only preserves the essential patterns, but also reduces the redundancy that affects the discriminality of the encoded features. Through a comprehensive set of experiments, we demonstrate the strengths of our approaches in terms of recognition accuracy and efficiency.

摘要

微表情识别仍处于初级阶段,这在很大程度上归因于数据集开发过程中面临的诸多困难。由于微表情是临床诊断和欺骗分析的重要情感线索,因此人们为了研究目的在创建这些数据集方面付出了很多努力。目前有两个公开可用的自发微表情数据集——SMIC和CASME II,两者都发布了使用广泛使用的动态纹理描述符LBP-TOP进行特征提取的基线结果。尽管LBP-TOP很受欢迎且被广泛使用,但它仍然不够紧凑。在本文中,我们通过提出两种有效的特征提取方法,从考虑三个正交平面的LBP-TOP概念中获得了进一步的启发。所提出的LBP-六个交点(SIP)和超紧凑的LBP-三个平均正交平面(MOP)所描述的紧凑鲁棒形式不仅保留了基本模式,还减少了影响编码特征判别性的冗余。通过一系列全面的实验,我们在识别准确性和效率方面展示了我们方法的优势。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/ea5b85cc25d6/pone.0124674.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/972951afbf5f/pone.0124674.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/266eb1403763/pone.0124674.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/64128d075642/pone.0124674.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/fd7281ea0ddc/pone.0124674.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/78b59553a75b/pone.0124674.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/0a58c1e5b0d9/pone.0124674.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/ea5b85cc25d6/pone.0124674.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/972951afbf5f/pone.0124674.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/266eb1403763/pone.0124674.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/64128d075642/pone.0124674.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/fd7281ea0ddc/pone.0124674.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/78b59553a75b/pone.0124674.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/0a58c1e5b0d9/pone.0124674.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6f1b/4438071/ea5b85cc25d6/pone.0124674.g007.jpg

相似文献

1
Efficient spatio-temporal local binary patterns for spontaneous facial micro-expression recognition.用于自发面部微表情识别的高效时空局部二值模式
PLoS One. 2015 May 19;10(5):e0124674. doi: 10.1371/journal.pone.0124674. eCollection 2015.
2
Dynamic texture recognition using local binary patterns with an application to facial expressions.基于局部二值模式的动态纹理识别及其在面部表情中的应用
IEEE Trans Pattern Anal Mach Intell. 2007 Jun;29(6):915-28. doi: 10.1109/TPAMI.2007.1110.
3
Two-Level Spatio-Temporal Feature Fused Two-Stream Network for Micro-Expression Recognition.基于两级时空特征融合双流网络的微表情识别方法。
Sensors (Basel). 2024 Feb 29;24(5):1574. doi: 10.3390/s24051574.
4
Rotation-invariant image and video description with local binary pattern features.基于局部二值模式特征的旋转不变图像和视频描述。
IEEE Trans Image Process. 2012 Apr;21(4):1465-77. doi: 10.1109/TIP.2011.2175739. Epub 2011 Nov 11.
5
Sparse Spatiotemporal Descriptor for Micro-Expression Recognition Using Enhanced Local Cube Binary Pattern.基于增强局部立方体二值模式的微表情识别的稀疏时空描述符
Sensors (Basel). 2020 Aug 8;20(16):4437. doi: 10.3390/s20164437.
6
Facial Feature Extraction Using a Symmetric Inline Matrix-LBP Variant for Emotion Recognition.基于对称串联矩阵 LBP 变体的人脸特征提取及其在情感识别中的应用。
Sensors (Basel). 2022 Nov 9;22(22):8635. doi: 10.3390/s22228635.
7
Facial Expression Recognition Methods in the Wild Based on Fusion Feature of Attention Mechanism and LBP.基于注意力机制和 LBP 融合特征的野外面部表情识别方法。
Sensors (Basel). 2023 Apr 22;23(9):4204. doi: 10.3390/s23094204.
8
A chi-squared-transformed subspace of LBP histogram for visual recognition.LBP 直方图的一个卡方变换子空间用于视觉识别。
IEEE Trans Image Process. 2015 Jun;24(6):1893-904. doi: 10.1109/TIP.2015.2409554. Epub 2015 Mar 6.
9
Local binary patterns variants as texture descriptors for medical image analysis.局部二值模式变体作为医学图像分析的纹理描述符。
Artif Intell Med. 2010 Jun;49(2):117-25. doi: 10.1016/j.artmed.2010.02.006. Epub 2010 Mar 24.
10
Development of a Robust Multi-Scale Featured Local Binary Pattern for Improved Facial Expression Recognition.发展一种稳健的多尺度特征局部二值模式以提高面部表情识别
Sensors (Basel). 2020 Sep 21;20(18):5391. doi: 10.3390/s20185391.

引用本文的文献

1
Automated deep learning model for estimating intraoperative blood loss using gauze images.利用纱布图像估算术中失血量的自动化深度学习模型。
Sci Rep. 2024 Jan 31;14(1):2597. doi: 10.1038/s41598-024-52524-3.
2
Multi-scale fusion visual attention network for facial micro-expression recognition.用于面部微表情识别的多尺度融合视觉注意力网络。
Front Neurosci. 2023 Jul 27;17:1216181. doi: 10.3389/fnins.2023.1216181. eCollection 2023.
3
Differences in brain activations between micro- and macro-expressions based on electroencephalography.

本文引用的文献

1
CASME II: an improved spontaneous micro-expression database and the baseline evaluation.CASME II:一个改进的自发微表情数据库及基准评估。
PLoS One. 2014 Jan 27;9(1):e86041. doi: 10.1371/journal.pone.0086041. eCollection 2014.
2
Enhanced local texture feature sets for face recognition under difficult lighting conditions.增强局部纹理特征集在困难光照条件下的人脸识别。
IEEE Trans Image Process. 2010 Jun;19(6):1635-50. doi: 10.1109/TIP.2010.2042645. Epub 2010 Feb 17.
3
Dynamic texture recognition using local binary patterns with an application to facial expressions.
基于脑电图的微表情与宏表情之间的大脑激活差异。
Front Neurosci. 2022 Sep 12;16:903448. doi: 10.3389/fnins.2022.903448. eCollection 2022.
4
FusionSense: Emotion Classification Using Feature Fusion of Multimodal Data and Deep Learning in a Brain-Inspired Spiking Neural Network.FusionSense:基于脑启发的尖峰神经网络的多模态数据特征融合和深度学习的情感分类。
Sensors (Basel). 2020 Sep 17;20(18):5328. doi: 10.3390/s20185328.
5
A Survey of Automatic Facial Micro-Expression Analysis: Databases, Methods, and Challenges.自动面部微表情分析综述:数据库、方法与挑战
Front Psychol. 2018 Jul 10;9:1128. doi: 10.3389/fpsyg.2018.01128. eCollection 2018.
6
Combining random forest with multi-block local binary pattern feature selection for multiclass head pose estimation.结合随机森林与多块局部二值模式特征选择进行多类头部姿态估计。
PLoS One. 2017 Jul 17;12(7):e0180792. doi: 10.1371/journal.pone.0180792. eCollection 2017.
基于局部二值模式的动态纹理识别及其在面部表情中的应用
IEEE Trans Pattern Anal Mach Intell. 2007 Jun;29(6):915-28. doi: 10.1109/TPAMI.2007.1110.
4
Nonverbal leakage and clues to deception.非语言泄密与欺骗线索。
Psychiatry. 1969 Feb;32(1):88-106. doi: 10.1080/00332747.1969.11023575.