Primett William, Mukhina Ksenia, Burak Yilmaz Mehmet, Rietdijk Willeke, Tikka Pia
Baltic Film, Media, Arts and Communication School, Tallinn University, Tallinn, Estonia.
Social Sciences, Institute for Globally Distributed Open Research and Education (IGDORE), Stockholm, Sweden.
Front Neurosci. 2025 Aug 13;19:1613485. doi: 10.3389/fnins.2025.1613485. eCollection 2025.
Film and actor-driven narratives showcase a structured and authentic depiction of emotions, and are considered a reliable resource for validating affective states when coupled with physiological data. In affective computing studies, emotional engagement is often portrayed and perceived as a single-directional mode of interaction between the viewer and the elicitation material. We design a study from the perspective of the cinematographer, who is actively engaged in the creation of the source material while witnessing it. Thus, the image emerges in the interaction between the cinematographer "reading" the actors during the filming, and visa-versa. The captured movement, physiological data, and first-person accounts are gathered from six participants and organized into a multimodal dataset. From this, we introduce a phenomenological data explorer framework, a visualization tool that's used to assess the affective and motor responses during the filming process, while considering the phenomenological experience and narrative immediacy. In turn, we draw triangulations between visual perception, sensorimotor patterns and narrative structures to inform the bidirectional nature of empathic engagement in cinematic storytelling. Our findings emphasize the role of kinaesthetic empathy, in which embodied decision-making responds to predicted inner states, shaping and modulating emotional understanding throughout the filming process.
以电影和演员为主导的叙事展现了情感的结构化和真实描绘，并且当与生理数据相结合时，被视为验证情感状态的可靠资源。在情感计算研究中，情感参与通常被描绘和理解为观众与引发材料之间的单向互动模式。我们从电影摄影师的角度设计了一项研究，电影摄影师在见证素材创作的同时积极参与其中。因此，图像在拍摄过程中电影摄影师“解读”演员以及演员“解读”电影摄影师的互动中产生。从六名参与者那里收集了捕捉到的动作、生理数据和第一人称叙述，并将其整理成一个多模态数据集。据此，我们引入了一个现象学数据探索者框架，这是一种可视化工具，用于在考虑现象学体验和叙事即时性的同时，评估拍摄过程中的情感和运动反应。反过来，我们在视觉感知、感觉运动模式和叙事结构之间进行三角测量，以揭示电影叙事中移情参与的双向性质。我们的研究结果强调了动觉移情的作用，即在整个拍摄过程中，身体化决策对预测的内在状态做出反应，塑造和调节情感理解。
