Dubus Gaël, Bresin Roberto
Department of Speech, Music and Hearing, School of Computer Science and Communication, KTH Royal Institute of Technology, Stockholm, Sweden.
PLoS One. 2013 Dec 17;8(12):e82491. doi: 10.1371/journal.pone.0082491. eCollection 2013.
The field of sonification has progressed greatly over the past twenty years and currently constitutes an established area of research. This article aims at exploiting and organizing the knowledge accumulated in previous experimental studies to build a foundation for future sonification works. A systematic review of these studies may reveal trends in sonification design, and therefore support the development of design guidelines. To this end, we have reviewed and analyzed 179 scientific publications related to sonification of physical quantities. Using a bottom-up approach, we set up a list of conceptual dimensions belonging to both physical and auditory domains. Mappings used in the reviewed works were identified, forming a database of 495 entries. Frequency of use was analyzed among these conceptual dimensions as well as higher-level categories. Results confirm two hypotheses formulated in a preliminary study: pitch is by far the most used auditory dimension in sonification applications, and spatial auditory dimensions are almost exclusively used to sonify kinematic quantities. To detect successful as well as unsuccessful sonification strategies, assessment of mapping efficiency conducted in the reviewed works was considered. Results show that a proper evaluation of sonification mappings is performed only in a marginal proportion of publications. Additional aspects of the publication database were investigated: historical distribution of sonification works is presented, projects are classified according to their primary function, and the sonic material used in the auditory display is discussed. Finally, a mapping-based approach for characterizing sonification is proposed.
在过去二十年中，可听化领域取得了巨大进展，目前已成为一个既定的研究领域。本文旨在利用和整理先前实验研究中积累的知识，为未来的可听化工作奠定基础。对这些研究进行系统回顾可能会揭示可听化设计的趋势，从而支持设计指南的制定。为此，我们回顾并分析了179篇与物理量可听化相关的科学出版物。我们采用自下而上的方法，列出了属于物理和听觉领域的概念维度清单。识别出所回顾作品中使用的映射，形成了一个包含495个条目的数据库。分析了这些概念维度以及更高级别类别中的使用频率。结果证实了在初步研究中提出的两个假设：在可听化应用中，音高是迄今为止最常用的听觉维度，空间听觉维度几乎仅用于对运动量进行可听化。为了检测成功和不成功的可听化策略，我们考虑了在所回顾作品中进行的映射效率评估。结果表明，只有极少数出版物对可听化映射进行了适当评估。我们还研究了出版物数据库的其他方面：展示了可听化作品的历史分布，根据项目的主要功能对项目进行了分类，并讨论了听觉显示中使用的声音材料。最后，提出了一种基于映射的可听化表征方法。
