Computer Aided Medical Procedures, Technische Universität München, Munich, Germany.
Augenklinik rechts der Isar, Technische Universität München, Munich, Germany.
Int J Comput Assist Radiol Surg. 2018 Sep;13(9):1345-1355. doi: 10.1007/s11548-018-1827-2. Epub 2018 Jul 27.
PURPOSE: Advances in sensing and digitalization enable us to acquire and present various heterogeneous datasets to enhance clinical decisions. Visual feedback is the dominant way of conveying such information. However, environments rich with many sources of information all presented through the same channel pose the risk of over stimulation and missing crucial information. The augmentation of the cognitive field by additional perceptual modalities such as sound is a workaround to this problem. A major challenge in auditory augmentation is the automatic generation of pleasant and ergonomic audio in complex routines, as opposed to overly simplistic feedback, to avoid alarm fatigue. METHODS: In this work, without loss of generality to other procedures, we propose a method for aural augmentation of medical procedures via automatic modification of musical pieces. RESULTS: Evaluations of this concept regarding recognizability of the conveyed information along with qualitative aesthetics show the potential of our method. CONCLUSION: In this paper, we proposed a novel sonification method for automatic musical augmentation of tasks within surgical procedures. Our experimental results suggest that these augmentations are aesthetically pleasing and have the potential to successfully convey useful information. This work opens a path for advanced sonification techniques in the operating room, in order to complement traditional visual displays and convey information more efficiently.
目的:传感和数字化技术的进步使我们能够获取和呈现各种异构数据集,以增强临床决策。视觉反馈是传递此类信息的主要方式。然而,充满多种信息源的环境都通过相同的渠道呈现,这存在过度刺激和错过关键信息的风险。通过声音等额外感知模式来增强认知领域是解决此问题的一种方法。听觉增强的一个主要挑战是在复杂的常规操作中自动生成令人愉悦且符合人体工程学的音频,而不是过于简单的反馈,以避免警报疲劳。
方法:在这项工作中,我们提出了一种通过自动修改音乐作品来实现医学程序听觉增强的方法,这在不失一般性的情况下适用于其他程序。
结果:对所传达信息的可识别性以及定性美学的评估表明了我们方法的潜力。
结论:本文提出了一种新颖的用于手术过程中任务自动音乐增强的声音合成方法。我们的实验结果表明,这些增强具有美学吸引力,并有可能成功传达有用信息。这项工作为手术室中的高级声音合成技术开辟了道路,以便补充传统的视觉显示并更有效地传达信息。
Int J Comput Assist Radiol Surg. 2018-7-27
IEEE Trans Vis Comput Graph. 2017-8-10
BMC Bioinformatics. 2017-4-24
Int J Comput Assist Radiol Surg. 2017-2-17
Sensors (Basel). 2020-6-5
Medicina (B Aires). 2013
Sci Rep. 2019-11-27
J Craniomaxillofac Surg. 2014-12
Pac Symp Biocomput. 1999
Proc IEEE Inst Electr Electron Eng. 2020-1
IEEE Trans Vis Comput Graph. 2017-8-10
Int J Med Robot. 2012-11-28
Int J Comput Assist Radiol Surg. 2012-11-16
Surg Innov. 2013-10
Annu Int Conf IEEE Eng Med Biol Soc. 2010
IEEE Trans Biomed Eng. 2007-4
Injury. 2008-5