Ziemer Tim, Schultheis Holger
Bremen Spatial Cognition Center, University of Bremen, Bremen, Germany.
Front Neurosci. 2022 Oct 6;16:930944. doi: 10.3389/fnins.2022.930944. eCollection 2022.
The sonification of data to communicate information to a user is a relatively new approach that established itself around the 1990s. To date, many researchers have designed their individual sonification from scratch. There are no standards in sonification design and evaluation. But researchers and practitioners have formulated several requirements and established several methods. There is a wide consensus that psychoacocustics could play an important role in the sonification design and evaluation phase. But this requires a) an adaption of psychoacoustic methods to the signal types of sonification and b) a preparation of the sonification for the psychoacoustic experiment procedure. In this method paper, we present a PsychoAcoustical Method for the Perceptual Analysis of multidimensional Sonification (PAMPAS) dedicated to the researchers of sonification. A well-defined and well-established, efficient, reliable, and replicable just noticeable difference (JND) experiment using the maximum likelihood procedure (MLP) serves as the basis to achieve perceptual linearity of parameter mapping during the sonification design stage and to identify and quantify perceptual effects during the sonification evaluation stage, namely the perceptual resolution, hysteresis effects and perceptual interferences. The experiment results are scores from standardized data space and a standardized procedure. These scores can serve to compare multiple sonification designs of a single researcher or even among different research groups. This method can supplement other sonification designs and evaluation methods from a perceptual viewpoint.
将数据进行可听化处理以向用户传达信息是一种相对较新的方法,它在20世纪90年代左右开始确立。迄今为止,许多研究人员都是从头开始设计他们各自的可听化方案。在可听化设计和评估方面没有标准。但研究人员和从业者已经制定了一些要求并确立了一些方法。人们普遍认为,心理声学在可听化设计和评估阶段可以发挥重要作用。但这需要:a)使心理声学方法适应可听化的信号类型;b)为心理声学实验程序准备可听化方案。在这篇方法论文中,我们为可听化研究人员提出了一种用于多维可听化感知分析的心理声学方法(PAMPAS)。一个使用最大似然程序(MLP)的定义明确、成熟、高效、可靠且可重复的恰可察觉差异(JND)实验,是在可听化设计阶段实现参数映射的感知线性以及在可听化评估阶段识别和量化感知效应(即感知分辨率、滞后效应和感知干扰)的基础。实验结果是来自标准化数据空间和标准化程序的分数。这些分数可用于比较单个研究人员的多个可听化设计,甚至不同研究小组之间的设计。该方法可以从感知角度补充其他可听化设计和评估方法。