Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
Department of Psychology, University of Zurich, Zurich, Switzerland.
Behav Res Methods. 2024 Oct;56(7):7331-7344. doi: 10.3758/s13428-024-02421-4. Epub 2024 May 21.
Surface facial electromyography (EMG) is commonly used to detect emotions from subtle facial expressions. Although there are established procedures for collecting EMG data and some aspects of their processing, there is little agreement among researchers about the optimal way to process the EMG signal, so that the study-unrelated variability (noise) is removed, and the emotion-related variability is best detected. The aim of the current paper was to establish an optimal processing pipeline for EMG data for identifying emotional expressions in facial muscles. We identified the most common processing steps from existing literature and created 72 processing pipelines that represented all the different processing choices. We applied these pipelines to a previously published dataset from a facial mimicry experiment, where 100 adult participants observed happy and sad facial expressions, whilst the activity of their facial muscles, zygomaticus major and corrugator supercilii, was recorded with EMG. We used a resampling approach and subsets of the original data to investigate the effect and robustness of different processing choices on the performance of a logistic regression model that predicted the mimicked emotion (happy/sad) from the EMG signal. In addition, we used a random forest model to identify the most important processing steps for the sensitivity of the logistic regression model. Three processing steps were found to be most impactful: baseline correction, standardisation within muscles, and standardisation within subjects. The chosen feature of interest and the signal averaging had little influence on the sensitivity to the effect. We recommend an optimal processing pipeline, share our code and data, and provide a step-by-step walkthrough for researchers.
表面肌电图(EMG)常用于从细微的面部表情中检测情绪。虽然已经有了采集 EMG 数据的既定程序,以及对其进行处理的某些方面,但研究人员在处理 EMG 信号的最佳方法上几乎没有达成一致意见,以便去除与研究无关的可变性(噪声),并最好地检测到与情绪相关的可变性。本文的目的是为识别面部肌肉中的情绪表达建立一个 EMG 数据的最优处理流程。我们从现有文献中确定了最常见的处理步骤,并创建了 72 个处理管道,这些管道代表了所有不同的处理选择。我们将这些管道应用于先前发表的面部模仿实验数据集,在该实验中,100 名成年参与者观察了快乐和悲伤的面部表情,同时他们的面部肌肉(颧大肌和皱眉肌)的活动被 EMG 记录下来。我们使用重采样方法和原始数据的子集来研究不同处理选择对逻辑回归模型性能的影响和稳健性,该模型从 EMG 信号预测模仿的情绪(快乐/悲伤)。此外,我们使用随机森林模型来识别对逻辑回归模型敏感性最重要的处理步骤。发现有三个处理步骤最具影响力:基线校正、肌肉内标准化和受试者内标准化。所选的感兴趣特征和信号平均对敏感性影响很小。我们建议采用最优处理管道,共享我们的代码和数据,并为研究人员提供逐步操作指南。