User-Adapted Communication and Ambient Intelligence Lab, Faculty of Electrical Engineering, University of Ljubljana, SI 1000 Ljubljana, Slovenia.
Scientific Research Centre, ZRC SAZU, SI 1000 Ljubljana, Slovenia.
Sensors (Basel). 2023 Aug 3;23(15):6916. doi: 10.3390/s23156916.
This study investigated the use of affect and physiological signals of heart rate, electrodermal activity, pupil dilation, and skin temperature to classify advertising engagement. The ground truth for the affective and behavioral aspects of ad engagement was collected from 53 young adults using the User Engagement Scale. Three gradient-boosting classifiers, LightGBM (LGBM), HistGradientBoostingClassifier (HGBC), and XGBoost (XGB), were used along with signal fusion to evaluate the performance of different signal combinations as predictors of engagement. The classifiers trained on the fusion of skin temperature, valence, and tiredness (features = 5) performed better than those trained on all signals (features n = 30). The average AUC ROC scores for the fusion set were XGB = 0.68 (0.10), LGBM = 0.69 (0.07), and HGBC = 0.70 (0.11), compared to the lower scores for the set of all signals (XGB = 0.65 (0.11), LGBM = 0.66 (0.11), HGBC = 0.64 (0.10)). The results also show that the signal fusion set based on skin temperature outperforms the fusion sets of the other three signals. The main finding of this study is the role of specific physiological signals and how their fusion aids in more effective modeling of ad engagement while reducing the number of features.
本研究探讨了使用情感和生理信号(心率、皮肤电活动、瞳孔扩张和皮肤温度)来对广告参与度进行分类。使用用户参与度量表从 53 名年轻人那里收集了广告情感和行为参与度的真实数据。使用了三个梯度提升分类器,即 LightGBM(LGBM)、HistGradientBoostingClassifier(HGBC)和 XGBoost(XGB),以及信号融合,以评估不同信号组合作为参与度预测因子的性能。基于皮肤温度、效价和疲劳的融合特征(特征数 = 5)训练的分类器的性能优于基于所有信号(特征数 n = 30)训练的分类器。融合组的平均 AUC ROC 分数为 XGB = 0.68(0.10),LGBM = 0.69(0.07),HGBC = 0.70(0.11),而所有信号组的分数较低(XGB = 0.65(0.11),LGBM = 0.66(0.11),HGBC = 0.64(0.10))。结果还表明,基于皮肤温度的信号融合组优于其他三个信号的融合组。本研究的主要发现是特定生理信号的作用以及它们的融合如何帮助更有效地建模广告参与度,同时减少特征数量。