Wang Shuang, Liu Jinyu, Feng Yiming, Ren Xiaomeng, Hu Huibo, Zhang Mengfei, Su Zhibin
State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China.
Key Laboratory of Acoustic Visual Technology and Intelligent Control System, Communication University of China, Ministry of Culture and Tourism, Beijing 100024, China.
Sensors (Basel). 2024 Dec 4;24(23):7770. doi: 10.3390/s24237770.
This article investigates the impact of visual color perception on fine-grained emotion prediction in videos, analyzing the contribution of color perception features in fine-grained emotion prediction. A total of 20 subjects were involved in this experiment. First, 10 subjects conducted a fine-grained emotional subjective evaluation experiment on 50 video clips. Then, another 10 subjects conducted a subjective evaluation experiment of color perception annotation for these 50 video clips. On this basis, the correlation and mechanism between color perceptual features and fine-grained emotions were analyzed. Finally, a fine-grained emotion prediction model was established based on the combination of objective features and color perceptual features. It was also observed that, compared to using only objective features, incorporating perceptual features enhanced the model's accuracy. This article also compared the importance of different perceptual features for each emotion and explained the mechanism between color perception and fine-grained emotions. By selecting the top 24 important features to predict emotions, the association between perceptual features and emotions was more effectively captured.
本文研究视觉颜色感知对视频中细粒度情感预测的影响，分析颜色感知特征在细粒度情感预测中的贡献。共有20名受试者参与了本实验。首先，10名受试者对50个视频片段进行了细粒度情感主观评价实验。然后，另外10名受试者对这50个视频片段进行了颜色感知标注的主观评价实验。在此基础上，分析了颜色感知特征与细粒度情感之间的相关性及机制。最后，基于客观特征和颜色感知特征的组合建立了细粒度情感预测模型。研究还发现，与仅使用客观特征相比，纳入感知特征提高了模型的准确性。本文还比较了不同感知特征对每种情感的重要性，并解释了颜色感知与细粒度情感之间的机制。通过选择预测情感的前24个重要特征，更有效地捕捉了感知特征与情感之间的关联。
