Bhat Gautam Shreedhar, Shankar Nikhil, Panahi Issa M S
Department of Electrical and Computer Engineering, The University of Texas at Dallas, Richardson, TX 75080, USA.
IEEE Access. 2020;8:106296-106309. doi: 10.1109/access.2020.2999546.
Alert signals like sirens and home alarms are important as they warn people of precarious situations. This work presents the detection and separation of these acoustically important alert signals, not to be attenuated as noise, to assist the hearing impaired listeners. The proposed method is based on convolutional neural network (CNN) and convolutional-recurrent neural network (CRNN). The developed method consists of two blocks, the detector block, and the separator block. The entire setup is integrated with speech enhancement (SE) algorithms, and before the compression stage, used in a hearing aid device (HAD) signal processing pipeline. The detector recognizes the presence of alert signal in various noisy environments. The separator block separates the alert signal from the mixture of noisy signals before passing it through SE to ensure minimal or no attenuation of the alert signal. It is implemented on a smartphone as an application that seamlessly works with HADs in real-time. This smartphone assistive setup allows the hearing aid users to know the presence of the alert sounds even when these are out of sight. The algorithm is computationally efficient with a low processing delay. The key contribution of this paper includes the development and integration of alert signal separator block with SE and the realization of the entire setup on a smartphone in real-time. The proposed method is compared with several state-of-the-art techniques through objective measures in various noisy conditions. The experimental analysis demonstrates the effectiveness and practical usefulness of the developed setup in real-world noisy scenarios.
像警报器和家庭报警器这样的警报信号很重要,因为它们能警告人们危险情况。这项工作提出了对这些声学上重要的警报信号进行检测和分离,使其不被当作噪声衰减,以帮助听力受损的听众。所提出的方法基于卷积神经网络(CNN)和卷积循环神经网络(CRNN)。所开发的方法由两个模块组成,即检测器模块和分离器模块。整个装置与语音增强(SE)算法集成,并在压缩阶段之前,用于助听器设备(HAD)的信号处理流程中。检测器能识别各种嘈杂环境中警报信号的存在。分离器模块在将警报信号通过SE之前,将其从噪声信号的混合中分离出来,以确保警报信号的衰减最小或无衰减。它作为一个应用程序在智能手机上实现,能与HAD实时无缝协作。这种智能手机辅助装置能让助听器用户即使在看不到警报源的情况下也知道警报声的存在。该算法计算效率高,处理延迟低。本文的关键贡献包括将警报信号分离器模块与SE进行开发和集成,以及在智能手机上实时实现整个装置。通过在各种噪声条件下的客观测量,将所提出的方法与几种先进技术进行了比较。实验分析证明了所开发装置在现实世界嘈杂场景中的有效性和实际实用性。