The Augmented Cognition Lab, Aalborg University, Copenhagen 2450, Denmark
Department of Marketing and Market Research, University of Valencia, Valencia 46022, Spain.
eNeuro. 2023 Jul 17;10(7). doi: 10.1523/ENEURO.0484-22.2023. Print 2023 Jul.
Past cognitive neuroscience studies using naturalistic stimuli have considered narratives holistically and focused on cognitive processes. In this study, we incorporated the narrative structure, the dramatic arc, as an object of investigation, to examine how engagement levels fluctuate across a narrative-aligned dramatic arc. We explored the possibility of predicting self-reported engagement ratings from neural activity and investigated the idiosyncratic effects of each phase of the dramatic arc on brain responses as well as the relationship between engagement and brain responses. We presented a movie excerpt following the six-phase narrative arc structure to female and male participants while collecting EEG signals. We then asked this group of participants to recall the excerpt, another group to segment the video based on the dramatic arc model, and a third to rate their engagement levels while watching the movie. The results showed that the self-reported engagement ratings followed the pattern of the narrative dramatic arc. Moreover, while EEG amplitude could not predict group-averaged engagement ratings, other features comprising dynamic intersubject correlation (dISC), including certain frequency bands, dynamic functional connectivity patterns and graph features were able to achieve this. Furthermore, neural activity in the last two phases of the dramatic arc significantly predicted engagement patterns. This study is the first to explore the cognitive processes behind the dramatic arc and its phases. By demonstrating how neural activity predicts self-reported engagement, which itself aligns with the narrative structure, this study provides insights on the interrelationships between narrative structure, neural responses, and viewer engagement.
过去使用自然刺激的认知神经科学研究整体考虑了叙事,并侧重于认知过程。在这项研究中,我们将叙事结构,即戏剧性弧线作为研究对象,以检验在与叙事一致的戏剧性弧线中参与度如何波动。我们探讨了从神经活动预测自我报告的参与度评分的可能性,并研究了戏剧性弧线的每个阶段对大脑反应的特有影响,以及参与度与大脑反应之间的关系。我们向女性和男性参与者展示了一段符合六阶段叙事弧线结构的电影片段,同时收集 EEG 信号。然后,我们要求这组参与者回忆这段摘录,另一组参与者根据戏剧性弧线模型对视频进行分段,第三组参与者在观看电影时对其参与度进行评分。结果表明,自我报告的参与度评分遵循叙事戏剧性弧线的模式。此外,虽然 EEG 幅度不能预测组平均参与度评分,但包括某些频带、动态跨主体相关性(dISC)的其他特征,包括动态功能连接模式和图特征,能够实现这一点。此外,戏剧性弧线的最后两个阶段的神经活动显著预测了参与模式。这项研究首次探索了戏剧性弧线及其阶段背后的认知过程。通过展示神经活动如何预测自我报告的参与度,而自我报告的参与度本身与叙事结构一致,这项研究提供了关于叙事结构、神经反应和观众参与之间相互关系的见解。