Department of Biomedical Engineering, Worcester Polytechnic Institute, MA 01609, USA; Vascular Biology Program, Boston Children's Hospital, Boston, MA 02115, USA.
Department of Biomedical Engineering, Worcester Polytechnic Institute, MA 01609, USA.
Artif Intell Med. 2023 Jun;140:102548. doi: 10.1016/j.artmed.2023.102548. Epub 2023 Apr 11.
Deep learning has been successfully applied to ECG data to aid in the accurate and more rapid diagnosis of acutely decompensated heart failure (ADHF). Previous applications focused primarily on classifying known ECG patterns in well-controlled clinical settings. However, this approach does not fully capitalize on the potential of deep learning, which directly learns important features without relying on a priori knowledge. In addition, deep learning applications to ECG data obtained from wearable devices have not been well studied, especially in the field of ADHF prediction.
We used ECG and transthoracic bioimpedance data from the SENTINEL-HF study, which enrolled patients (≥21 years) who were hospitalized with a primary diagnosis of heart failure or with ADHF symptoms. To build an ECG-based prediction model of ADHF, we developed a deep cross-modal feature learning pipeline, termed ECGX-Net, that utilizes raw ECG time series and transthoracic bioimpedance data from wearable devices. To extract rich features from ECG time series data, we first adopted a transfer learning approach in which ECG time series were transformed into 2D images, followed by feature extraction using ImageNet-pretrained DenseNet121/VGG19 models. After data filtering, we applied cross-modal feature learning in which a regressor was trained with ECG and transthoracic bioimpedance. Then, we concatenated the DenseNet121/VGG19 features with the regression features and used them to train a support vector machine (SVM) without bioimpedance information.
The high-precision classifier using ECGX-Net predicted ADHF with a precision of 94 %, a recall of 79 %, and an F1-score of 0.85. The high-recall classifier with only DenseNet121 had a precision of 80 %, a recall of 98 %, and an F1-score of 0.88. We found that ECGX-Net was effective for high-precision classification, while DenseNet121 was effective for high-recall classification.
We show the potential for predicting ADHF from single-channel ECG recordings obtained from outpatients, enabling timely warning signs of heart failure. Our cross-modal feature learning pipeline is expected to improve ECG-based heart failure prediction by handling the unique requirements of medical scenarios and resource limitations.
深度学习已成功应用于心电图数据,以帮助准确、更快速地诊断急性失代偿性心力衰竭(ADHF)。以前的应用主要集中在分类已知的心电图模式,这些模式是在控制良好的临床环境中获得的。然而,这种方法并没有充分利用深度学习的潜力,深度学习可以直接学习重要特征,而无需依赖先验知识。此外,深度学习在可穿戴设备获得的心电图数据中的应用尚未得到很好的研究,特别是在 ADHF 预测领域。
我们使用了 SENTINEL-HF 研究中的心电图和经胸生物阻抗数据,该研究纳入了因心力衰竭或 ADHF 症状住院的患者(≥21 岁)。为了建立基于心电图的 ADHF 预测模型,我们开发了一种深度跨模态特征学习管道,称为 ECGX-Net,它利用来自可穿戴设备的原始心电图时间序列和经胸生物阻抗数据。为了从心电图时间序列数据中提取丰富的特征,我们首先采用了一种迁移学习方法,即将心电图时间序列转换为 2D 图像,然后使用经过 ImageNet 预训练的 DenseNet121/VGG19 模型进行特征提取。在数据过滤之后,我们应用了跨模态特征学习,其中使用 ECG 和经胸生物阻抗训练回归器。然后,我们将 DenseNet121/VGG19 特征与回归特征串联起来,并使用它们来训练一个没有生物阻抗信息的支持向量机(SVM)。
使用 ECGX-Net 的高精度分类器预测 ADHF 的准确率为 94%,召回率为 79%,F1 得分为 0.85。仅使用 DenseNet121 的高召回率分类器的准确率为 80%,召回率为 98%,F1 得分为 0.88。我们发现,ECGX-Net 适用于高精度分类,而 DenseNet121 适用于高召回率分类。
我们展示了从门诊患者获得的单通道心电图记录中预测 ADHF 的潜力,从而能够及时预警心力衰竭。我们的跨模态特征学习管道有望通过处理医疗场景的独特要求和资源限制来提高基于心电图的心力衰竭预测。