Tcherkassof Anna, Dupré Damien
Psychology Department, Université Grenoble Alpes, Bâtiment Michel Dubois, 1251 Avenue Centrale, Saint-Martin-d'Hères, 38400, France.
Business School, Dublin City University, DCU Glasnevin Campus, Dublin, D09, Ireland.
Psychol Res. 2021 Nov;85(8):2954-2969. doi: 10.1007/s00426-020-01448-4. Epub 2020 Nov 24.
While it has been taken for granted in the development of several automatic facial expression recognition tools, the question of the coherence between subjective feelings and facial expressions is still a subject of debate. On one hand, the "Basic Emotion View" conceives emotions as genetically hardwired and, therefore, being genuinely displayed through facial expressions. Consequently, emotion recognition is perceiver independent. On the other hand, the constructivist approach conceives emotions as socially constructed, the emotional meaning of a facial expression being inferred by the perceiver. Hence, emotion recognition is perceiver dependent. In order (1) to evaluate the coherence between the subjective feeling of emotions and their spontaneous facial displays, and (2) to compare the recognition of such displays by human perceivers and by an automatic facial expression classifier, 232 videos of expressers recruited to carry out an emotion elicitation task were annotated by 1383 human perceivers as well as by Affdex, an automatic classifier. Results show a weak consistency between self-reported emotional states by expressers and their facial emotional displays. They also show low accuracy both of human perceivers and of the automatic classifier to infer the subjective feeling from the spontaneous facial expressions displayed by expressers. However, the results are more in favor of a perceiver-dependent view. Based on these results, the hypothesis of genetically hardwired emotion genuinely displayed is difficult to support, whereas the idea of emotion and facial expression as being socially constructed appears to be more likely. Accordingly, automatic emotion recognition tools based on facial expressions should be questioned.
虽然在几种自动面部表情识别工具的开发过程中，主观感受与面部表情之间的一致性问题一直被视为理所当然，但它仍然是一个有争议的话题。一方面，“基本情绪观点”将情绪视为基因决定的，因此可以通过面部表情真实地展现出来。因此，情绪识别不依赖于感知者。另一方面，建构主义方法认为情绪是社会建构的，面部表情的情感意义由感知者推断得出。因此，情绪识别依赖于感知者。为了（1）评估情绪的主观感受与其自发面部表现之间的一致性，以及（2）比较人类感知者和自动面部表情分类器对这些表现的识别，1383名人类感知者以及自动分类器Affdex对232段招募来执行情绪诱发任务的表达者的视频进行了标注。结果显示，表达者自我报告的情绪状态与其面部情绪表现之间的一致性较弱。研究结果还表明，人类感知者和自动分类器从表达者自发的面部表情推断主观感受的准确率都很低。然而，结果更倾向于感知者依赖的观点。基于这些结果，基因决定的真实展现情绪的假设难以得到支持，而情绪和面部表情是社会建构的观点似乎更有可能成立。因此，基于面部表情的自动情绪识别工具应该受到质疑。
