Multisensory Research Group, Centre for Brain and Cognition, Universitat Pompeu Fabra, Carrer de Ramon Trias Fargas, 25-27, 08005 Barcelona, Spain.
Institució Catalana de Recerca i Estudis Avançats (ICREA), 08010 Barcelona, Spain.
Philos Trans R Soc Lond B Biol Sci. 2024 Jan 29;379(1895):20220426. doi: 10.1098/rstb.2022.0426. Epub 2023 Dec 18.
During film viewing, humans parse sequences of individual shots into larger narrative structures, often weaving transitions at edit points into an apparently seamless and continuous flow. Editing helps filmmakers manipulate visual transitions to induce feelings of fluency/disfluency, tension/relief, curiosity, expectation and several emotional responses. We propose that the perceptual dynamics induced by film editing can be captured by a predictive processing (PP) framework. We hypothesise that visual discontinuities at edit points produce discrepancies between anticipated and actual sensory input, leading to prediction error. Further, we propose that the magnitude of prediction error depends on the predictability of each shot within the narrative flow, and lay out an account based on conflict monitoring. We test this hypothesis in two empirical studies measuring electroencephalography (EEG) during passive viewing of film excerpts, as well as behavioural responses during an active edit detection task. We report the neural and behavioural modulations at editing boundaries across three levels of narrative depth, showing greater modulations for edits spanning less predictable, deeper narrative transitions. Overall, our contribution lays the groundwork for understanding film editing from a PP perspective. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectivess'.
在观看电影时,人类会将连续的镜头序列解析成更大的叙事结构,通常会将编辑点处的过渡编织成一种明显流畅且连续的流程。编辑可以帮助电影制作人操纵视觉过渡,以引起流畅/不流畅、紧张/放松、好奇、期待和几种情绪反应。我们提出,电影编辑引起的感知动态可以用预测处理(PP)框架来捕捉。我们假设,编辑点处的视觉不连续性会导致预期和实际感觉输入之间产生差异,从而产生预测误差。此外,我们提出,预测误差的大小取决于叙事流程中每个镜头的可预测性,并基于冲突监测提出了一个解释。我们通过两项实证研究来检验这一假设,这些研究在被动观看电影片段时测量了脑电图(EEG),并在主动编辑检测任务中测量了行为反应。我们报告了在三个叙事深度层次上的编辑边界处的神经和行为调制,结果表明,跨越不可预测性更大、更深的叙事过渡的编辑会产生更大的调制。总的来说,我们的贡献为从 PP 角度理解电影编辑奠定了基础。本文是“艺术、美学和预测处理:理论和实证视角”专题的一部分。