Palamara Jason, Deal W Scott
Department of Music and Arts Technology, Indiana University-Purdue University Indianapolis, Indianapolis, IN, United States.
Donald Tavel Arts and Technology Research Center, Department of Music and Arts Technology, Indiana University-Purdue University Indianapolis, Indianapolis, IN, United States.
Front Artif Intell. 2020 May 8;3:29. doi: 10.3389/frai.2020.00029. eCollection 2020.
This paper illuminates some root causes of confusion about dynamic representation in music technology and introduces a system that addresses this problem to provide context-dependent dynamics for machine learning-aided performance. While terms used for dynamic representations like forte and mezzo-forte have been extant for centuries, the canon gives us no straight answer on how these terms must be applied to literal decibel ranges. The common conception that dynamic terms should be understood as context-dependent is ubiquitous and reasonably simple for most human musicians to grasp. This logic breaks down when applied to digital music technologies. At a fundamental level, these technologies define all musical parameters using discrete numbers, rather than with continuous data, making it impossible for these technologies to make context-dependent decisions. The authors give examples in which this lack of contextual inputs in music technology often leads musicians, composers, and producers to ignore dynamics altogether as a concern in their given practice. The authors then present a system that uses an adaptive process to maximize its ability to hear relevant audio events, and which establishes its own definition for context-dependent dynamics for situations involving music technologies. The authors also describe a generative program that uses these context-dependent dynamic systems in conjunction with a Markov model culled from a living performer-composer as a choice engine for new music improvisations.
本文阐明了音乐技术中动态表示混乱的一些根本原因，并介绍了一个解决该问题的系统，为机器学习辅助演奏提供上下文相关的动态效果。虽然用于动态表示的术语，如强音和中强音，已经存在了几个世纪，但规范并没有直接告诉我们这些术语应如何应用于实际的分贝范围。动态术语应被理解为依赖于上下文的这一普遍概念，对于大多数人类音乐家来说是无处不在且相当容易理解的。但当应用于数字音乐技术时，这种逻辑就不成立了。从根本层面上讲，这些技术使用离散数字而非连续数据来定义所有音乐参数，这使得这些技术无法做出依赖于上下文的决策。作者给出了一些例子，说明音乐技术中缺乏上下文输入常常导致音乐家、作曲家和制作人在他们的特定实践中完全忽略动态效果这一因素。然后，作者提出了一个系统，该系统使用自适应过程来最大化其感知相关音频事件的能力，并为涉及音乐技术的情况建立自己的上下文相关动态效果的定义。作者还描述了一个生成程序，该程序将这些上下文相关的动态系统与从一位在世的演奏 - 作曲家那里挑选出的马尔可夫模型结合起来，作为新音乐即兴创作的选择引擎。
