Wang Jing, Xie Wanqing, Cheng Mingmei, Wu Qun, Wang Fangyun, Li Pei, Fan Bo, Zhang Xin, Wang Binbin, Liu Xiaofeng
School of Basic Medical Sciences, Capital Medical University, Beijing 10069, China.
Department of Intelligent Medical Engineering, School of Biomedical Engineering, Anhui Medical University, Hefei 230032, China.
Research (Wash D C). 2022 Oct 21;2022:9790653. doi: 10.34133/2022/9790653. eCollection 2022.
Automated echocardiogram interpretation with artificial intelligence (AI) has the potential to facilitate the serial diagnosis of heart defects by primary clinician. However, the fully automated and interpretable analysis pipeline for suggesting a treatment plan is largely underexplored. The present study targets to build an automatic and interpretable assistant for the transthoracic echocardiogram- (TTE-) based assessment of atrial septal defect (ASD) with deep learning (DL). We developed a novel deep keypoint stadiometry (DKS) model, which learns to precisely localize the keypoints, i.e., the endpoints of defects and followed by the absolute distance measurement with the scale. The closure plan and the size of the ASD occluder for transcatheter closure are derived based on the explicit clinical decision rules. A total of 3,474 2D and Doppler TTE from 579 patients were retrospectively collected from two clinical groups. The accuracy of closure classification using DKS (0.9425 ± 0.0052) outperforms the "black-box" model (0.7646 ± 0.0068; < 0.0001) for within-center evaluation. The results in cross-center cases or using the quadratic weighted kappa as an evaluation metric are consistent. The fine-grained keypoint label provides more explicit supervision for network training. While DKS can be fully automated, clinicians can intervene and edit at different steps of the process as well. Our deep learning keypoint localization can provide an automatic and transparent way for assessing size-sensitive congenital heart defects, which has huge potential value for application in primary medical institutions in China. Also, more size-sensitive treatment planning tasks may be explored in the future.
利用人工智能(AI)进行自动超声心动图解读有潜力促进初级临床医生对心脏缺陷的系列诊断。然而,用于提出治疗方案的全自动且可解释的分析流程在很大程度上尚未得到充分探索。本研究旨在构建一个基于深度学习(DL)的自动且可解释的辅助工具,用于经胸超声心动图(TTE)对房间隔缺损(ASD)的评估。我们开发了一种新颖的深度关键点测量法(DKS)模型,该模型学习精确地定位关键点,即缺损的端点,随后用比例尺进行绝对距离测量。基于明确的临床决策规则得出经导管封堵的封堵方案和ASD封堵器的尺寸。从两个临床组中回顾性收集了来自579名患者的总共3474份二维和多普勒TTE。在中心内评估中,使用DKS进行封堵分类的准确率(0.9425±0.0052)优于“黑箱”模型(0.7646±0.0068;<0.0001)。跨中心病例的结果或使用二次加权kappa作为评估指标的结果是一致的。细粒度的关键点标签为网络训练提供了更明确的监督。虽然DKS可以完全自动化,但临床医生也可以在该过程的不同步骤进行干预和编辑。我们的深度学习关键点定位可以为评估尺寸敏感的先天性心脏缺陷提供一种自动且透明的方法,这在中国基层医疗机构的应用中具有巨大的潜在价值。此外,未来可能会探索更多尺寸敏感的治疗规划任务。