Li Jingwei, Tong Yifei, Guan Li, Wu Shaofeng, Li Dongbo
School of Mechanical Engineer, Nanjing University of Science and Technology Nanjing 210014 P. R. China
RSC Adv. 2018 Feb 23;8(16):8558-8568. doi: 10.1039/c7ra13202f.
When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly affects the subsequent quantitative analysis and information mining. Choosing an appropriate denoising method is key to improve the spectral analysis accuracy and promote the spectral analysis ability. In this paper, a new UV-visible absorption spectrum denoising method is proposed: a denoising method based on ensemble empirical mode decomposition (EEMD) and improved universal threshold filtering (EEMD-based method). The noisy UV-visible absorption spectrum signal is firstly decomposed into a finite set of band limited signals called intrinsic mode functions (IMFs) EEMD. Spearman's rank correlation coefficient (Spearman's rho) is then used as a criterion for the IMFs dominated by noise or useful signals, and the improved universal threshold filtering method is applied to the noise dominant IMFs to eliminate the noise. Finally, the denoised UV-visible absorption spectrum signal is reconstructed. In order to discuss the effectiveness of the EEMD-based denoising method proposed in this paper, we compare it with various wavelet-based threshold denoising methods. Both methods have been implemented on synthetic signals with diverse waveforms ('Blocks', 'Bumps' and 'Heavy sine'). It is demonstrated that the proposed method outperforms the wavelet-based methods. Then, the measured UV-visible absorption spectra with different SNR were denoised by the wavelet and proposed methods. The method proposed also performs well in the spectrum denoising experiment.
在使用紫外可见光谱法检测水质参数时,测得的吸收光谱信号通常包含大量干扰信息。因此,去噪在光谱数据处理与分析中极为重要,它直接影响后续的定量分析和信息挖掘。选择合适的去噪方法是提高光谱分析精度和提升光谱分析能力的关键。本文提出了一种新的紫外可见吸收光谱去噪方法:基于总体经验模态分解(EEMD)和改进的通用阈值滤波的去噪方法(基于EEMD的方法)。首先,利用EEMD将带噪的紫外可见吸收光谱信号分解为一组有限的、称为本征模态函数(IMF)的带宽受限信号。然后,将斯皮尔曼等级相关系数用作判断由噪声或有用信号主导的IMF的标准,并将改进的通用阈值滤波方法应用于由噪声主导的IMF以消除噪声。最后,重建去噪后的紫外可见吸收光谱信号。为了讨论本文提出的基于EEMD的去噪方法的有效性,我们将其与各种基于小波的阈值去噪方法进行了比较。这两种方法均已在具有不同波形(“方块波”、“脉冲波”和“重正弦波”)的合成信号上实现。结果表明,所提方法优于基于小波的方法。然后,分别用小波方法和本文提出的方法对具有不同信噪比的实测紫外可见吸收光谱进行去噪。所提方法在光谱去噪实验中也表现良好。