Ran Guihao, Wang Yijing, Zhang Han, Cheng Jiahui, Lai Dakun
School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
Sensors (Basel). 2025 Aug 24;25(17):5263. doi: 10.3390/s25175263.
Electrocardiogram (ECG) and phonocardiogram (PCG) signals are widely used in the early prevention and diagnosis of cardiovascular diseases (CVDs) due to their ability to accurately reflect cardiac conditions from different physiological perspectives and their ease of acquisition. Currently, some studies have explored the joint use of ECG and PCG signals for disease screening, but few studies have considered the trade-off between classification performance and energy consumption in model design. In this study, we propose a multimodal CVDs detection framework based on Spiking Neural Networks (SNNs), which integrates ECG and PCG signals. A differential fusion strategy at the signal level is employed to generate a fused EPCG signal, from which time-frequency features are extracted using the Adaptive Superlets Transform (ASLT). Two separate Spiking Convolutional Neural Network (SCNN) models are then trained on the ECG and EPCG signals, respectively. A confidence-based dynamic decision-level (CDD) fusion strategy is subsequently employed to perform the final classification. The proposed method is validated on the PhysioNet/CinC Challenge 2016 dataset, achieving an accuracy of 89.74%, an AUC of 89.08%, and an energy consumption of 209.6 μJ. This method not only achieves better balancing performance compared to unimodal signals but also realizes an effective balance between model energy consumption and classification effect, which provides an effective idea for the development of low-power, multimodal medical diagnostic systems.
心电图(ECG)和心音图(PCG)信号因其能够从不同生理角度准确反映心脏状况且易于获取,而被广泛应用于心血管疾病(CVD)的早期预防和诊断。目前,一些研究已经探索了联合使用ECG和PCG信号进行疾病筛查,但在模型设计中很少有研究考虑分类性能和能量消耗之间的权衡。在本研究中,我们提出了一种基于脉冲神经网络(SNN)的多模态CVD检测框架,该框架整合了ECG和PCG信号。采用信号级别的差分融合策略生成融合后的EPCG信号,并使用自适应超小波变换(ASLT)从中提取时频特征。然后分别在ECG和EPCG信号上训练两个独立的脉冲卷积神经网络(SCNN)模型。随后采用基于置信度的动态决策级(CDD)融合策略进行最终分类。该方法在PhysioNet/CinC Challenge 2016数据集上得到验证,准确率达到89.74%,AUC为89.08%,能量消耗为209.6 μJ。该方法不仅与单模态信号相比实现了更好的平衡性能,还在模型能量消耗和分类效果之间实现了有效平衡,为低功耗多模态医疗诊断系统的发展提供了有效思路。