• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

移动虚拟现实技术与神经网络在面部表情识别中的应用。

Application of Mobile Virtual Reality Technology Combined with Neural Network in Facial Expression Recognition.

机构信息

Qingdao Huanghai College, Qingdao, Shandong 266427, China.

出版信息

Comput Intell Neurosci. 2022 Aug 5;2022:4288187. doi: 10.1155/2022/4288187. eCollection 2022.

DOI:10.1155/2022/4288187
PMID:36035849
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9410955/
Abstract

In recent years, in the field of virtual reality, in more and more scenes, users interact with hardware or programs through facial expressions. In order to give full play to the advantages of program interaction between virtual reality devices and users, this paper proposes a mobile virtual reality expression recognition system combined with convolution neural network. Based on the optimized AlexNet network, an expression recognition algorithm is constructed and combined with LBP feature mapping technology to improve the performance of the algorithm. At the same time, according to the nature and characteristics of mobile virtual reality devices, the user face information acquisition algorithm is optimized. The performance test results of the expression recognition system show that the recognition accuracy of the system is higher than that of the traditional convolution neural network expression recognition algorithm, and the maximum difference is greater than 10%. At the same time, the average running speed of the whole system is about 37 ms, which can meet the accuracy and real-time requirements of expression recognition in virtual reality interaction. The experimental results show that the expression recognition system proposed in this paper can be applied to mobile virtual reality devices. At the same time, it also provides new ideas for industry researchers to optimize the identification function.

摘要

近年来,在虚拟现实领域,在越来越多的场景中,用户通过面部表情与硬件或程序进行交互。为了充分发挥虚拟现实设备与用户之间程序交互的优势,本文提出了一种结合卷积神经网络的移动虚拟现实表情识别系统。在优化的 AlexNet 网络的基础上,构建了表情识别算法,并结合 LBP 特征映射技术,提高了算法的性能。同时,根据移动虚拟现实设备的性质和特点,优化了用户面部信息采集算法。表情识别系统的性能测试结果表明,该系统的识别精度高于传统的卷积神经网络表情识别算法,最大差异大于 10%。同时,整个系统的平均运行速度约为 37ms,能够满足虚拟现实交互中表情识别的准确性和实时性要求。实验结果表明,本文提出的表情识别系统可以应用于移动虚拟现实设备,同时也为行业研究人员优化识别功能提供了新的思路。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/7c50855889b6/CIN2022-4288187.009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/549d01313a7e/CIN2022-4288187.001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/0494f5a7d78d/CIN2022-4288187.002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/e767fe636b06/CIN2022-4288187.003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/71f5568d1c33/CIN2022-4288187.004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/fedef7fa286d/CIN2022-4288187.005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/9c279e872d06/CIN2022-4288187.006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/1befeca5b465/CIN2022-4288187.007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/e945dea2b999/CIN2022-4288187.008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/7c50855889b6/CIN2022-4288187.009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/549d01313a7e/CIN2022-4288187.001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/0494f5a7d78d/CIN2022-4288187.002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/e767fe636b06/CIN2022-4288187.003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/71f5568d1c33/CIN2022-4288187.004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/fedef7fa286d/CIN2022-4288187.005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/9c279e872d06/CIN2022-4288187.006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/1befeca5b465/CIN2022-4288187.007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/e945dea2b999/CIN2022-4288187.008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/48f0/9410955/7c50855889b6/CIN2022-4288187.009.jpg

相似文献

1
Application of Mobile Virtual Reality Technology Combined with Neural Network in Facial Expression Recognition.移动虚拟现实技术与神经网络在面部表情识别中的应用。
Comput Intell Neurosci. 2022 Aug 5;2022:4288187. doi: 10.1155/2022/4288187. eCollection 2022.
2
3D Virtual Reality Implementation of Tourist Attractions Based on the Deep Belief Neural Network.基于深度置信神经网络的旅游景点 3D 虚拟现实实现。
Comput Intell Neurosci. 2021 Sep 11;2021:9004797. doi: 10.1155/2021/9004797. eCollection 2021.
3
Human Action Recognition in Smart Cultural Tourism Based on Fusion Techniques of Virtual Reality and SOM Neural Network.基于虚拟现实和自组织映射神经网络融合技术的智慧文化旅游中的人体行为识别。
Comput Intell Neurosci. 2021 Dec 3;2021:3495203. doi: 10.1155/2021/3495203. eCollection 2021.
4
3D Garment Design Model Based on Convolution Neural Network and Virtual Reality.基于卷积神经网络和虚拟现实的 3D 服装设计模型。
Comput Intell Neurosci. 2022 Jun 27;2022:9187244. doi: 10.1155/2022/9187244. eCollection 2022.
5
Design and research of music teaching system based on virtual reality system in the context of education informatization.基于虚拟现实系统的音乐教学系统在教育信息化背景下的设计与研究。
PLoS One. 2023 Oct 5;18(10):e0285331. doi: 10.1371/journal.pone.0285331. eCollection 2023.
6
Facial Motion Capture System Based on Facial Electromyogram and Electrooculogram for Immersive Social Virtual Reality Applications.基于面部肌电图和眼电图的沉浸式社交虚拟现实应用的面部运动捕捉系统。
Sensors (Basel). 2023 Mar 29;23(7):3580. doi: 10.3390/s23073580.
7
Construction and 3D Simulation of Virtual Animation Instant Network Communication System Based on Convolution Neural Networks.基于卷积神经网络的虚拟动画即时网络通信系统的构建与三维仿真。
Comput Intell Neurosci. 2021 Aug 28;2021:7277733. doi: 10.1155/2021/7277733. eCollection 2021.
8
Facial expression recognition based on deep learning.基于深度学习的面部表情识别。
Comput Methods Programs Biomed. 2022 Mar;215:106621. doi: 10.1016/j.cmpb.2022.106621. Epub 2022 Jan 6.
9
Utilizing a multilayer perceptron artificial neural network to assess a virtual reality surgical procedure.利用多层感知器人工神经网络评估虚拟现实手术。
Comput Biol Med. 2021 Sep;136:104770. doi: 10.1016/j.compbiomed.2021.104770. Epub 2021 Aug 18.
10
Application of Virtual Reality Based on 3D-CTA in Intracranial Aneurysm Surgery.基于 3D-CTA 的虚拟现实在颅内动脉瘤手术中的应用。
J Healthc Eng. 2021 May 29;2021:9913949. doi: 10.1155/2021/9913949. eCollection 2021.

本文引用的文献

1
Facial Recognition Technology in 2021: Masks, Bias, and the Future of Healthcare.2021年的面部识别技术:口罩、偏见与医疗保健的未来。
J Med Syst. 2021 Feb 18;45(4):39. doi: 10.1007/s10916-021-01723-w.
2
Application of facial recognition technology on identification of the dead during large scale disasters.面部识别技术在大规模灾难中死者身份识别中的应用。
Forensic Sci Int Synerg. 2020 Aug 7;2:238-239. doi: 10.1016/j.fsisyn.2020.07.001. eCollection 2020.
3
MR-Only Brain Radiation Therapy: Dosimetric Evaluation of Synthetic CTs Generated by a Dilated Convolutional Neural Network.
仅行磁共振脑放疗:利用扩张卷积神经网络生成的合成 CT 的剂量学评估。
Int J Radiat Oncol Biol Phys. 2018 Nov 15;102(4):801-812. doi: 10.1016/j.ijrobp.2018.05.058. Epub 2018 Jun 4.
4
Convolutional Neural Network Architecture for Geometric Matching.卷积神经网络几何匹配架构。
IEEE Trans Pattern Anal Mach Intell. 2019 Nov;41(11):2553-2567. doi: 10.1109/TPAMI.2018.2865351. Epub 2018 Aug 13.
5
Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists.人机大战:深度学习卷积神经网络与 58 位皮肤科医生诊断黑色素瘤皮肤镜图像的对比研究
Ann Oncol. 2018 Aug 1;29(8):1836-1842. doi: 10.1093/annonc/mdy166.
6
Training-Based Gradient LBP Feature Models for Multiresolution Texture Classification.基于训练的梯度 LBP 特征模型用于多分辨率纹理分类。
IEEE Trans Cybern. 2018 Sep;48(9):2683-2696. doi: 10.1109/TCYB.2017.2748500. Epub 2017 Sep 18.
7
The combined use of virtual reality and EEG to study language processing in naturalistic environments.虚拟现实和脑电图结合使用来研究自然环境中的语言处理。
Behav Res Methods. 2018 Apr;50(2):862-869. doi: 10.3758/s13428-017-0911-9.