Menon Alisha, Natarajan Anirudh, Agashe Reva, Sun Daniel, Aristio Melvin, Liew Harrison, Shao Yakun Sophia, Rabaey Jan M
Department of Electrical Engineering and Computer Science, University of California at Berkeley, Berkeley, CA, USA.
Brain Inform. 2022 Jun 27;9(1):14. doi: 10.1186/s40708-022-00162-8.
In this paper, a hardware-optimized approach to emotion recognition based on the efficient brain-inspired hyperdimensional computing (HDC) paradigm is proposed. Emotion recognition provides valuable information for human-computer interactions; however, the large number of input channels (> 200) and modalities (> 3 ) involved in emotion recognition are significantly expensive from a memory perspective. To address this, methods for memory reduction and optimization are proposed, including a novel approach that takes advantage of the combinatorial nature of the encoding process, and an elementary cellular automaton. HDC with early sensor fusion is implemented alongside the proposed techniques achieving two-class multi-modal classification accuracies of > 76% for valence and > 73% for arousal on the multi-modal AMIGOS and DEAP data sets, almost always better than state of the art. The required vector storage is seamlessly reduced by 98% and the frequency of vector requests by at least 1/5. The results demonstrate the potential of efficient hyperdimensional computing for low-power, multi-channeled emotion recognition tasks.
本文提出了一种基于高效脑启发式超维计算(HDC)范式的硬件优化情感识别方法。情感识别为人机交互提供了有价值的信息;然而,从内存角度来看,情感识别涉及的大量输入通道(>200)和模态(>3)成本高昂。为了解决这个问题,提出了内存减少和优化方法,包括一种利用编码过程组合性质的新颖方法以及一个基本细胞自动机。将具有早期传感器融合的HDC与所提出的技术一起实现,在多模态AMIGOS和DEAP数据集上,效价的两类多模态分类准确率>76%,唤醒度的两类多模态分类准确率>73%,几乎总是优于现有技术。所需的向量存储无缝减少了98%,向量请求频率至少降低了五分之一。结果证明了高效超维计算在低功耗、多通道情感识别任务中的潜力。