School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran.
Research and Development Department, Med Fanavarn Plus Co., Karaj, Iran; Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran.
Phys Med. 2020 Feb;70:65-74. doi: 10.1016/j.ejmp.2020.01.011. Epub 2020 Jan 23.
Convolutional neural networks (CNNs) are extensively used in cardiac image analysis. However, heart localization has become a prerequisite to these networks since it decreases the size of input images. Accordingly, recent CNNs benefit from deeper architectures in gaining abstract semantic information. In the present study, a deep learning-based method was developed for heart localization in cardiac MR images. Further, Network in Network (NIN) was used as the region proposal network (RPN) of the faster R-CNN, and then NIN Faster-RCNN (NF-RCNN) was proposed. NIN architecture is formed based on "MLPCONV" layer, a combination of convolutional network and multilayer perceptron (MLP). Therefore, it could deal with the complicated structures of MR images. Furthermore, two sets of cardiac MRI dataset were used to evaluate the network, and all the evaluation metrics indicated an absolute superiority of the proposed network over all related networks. In addition, FROC curve, precision-recall (PR) analysis, and mean localization error were employed to evaluate the proposed network. In brief, the results included an AUC value of 0.98 for FROC curve, a mean average precision of 0.96 for precision-recall curve, and a mean localization error of 6.17 mm. Moreover, a deep learning-based approach for the right ventricle wall motion analysis (WMA) was performed on the first dataset and the effect of the heart localization on this algorithm was studied. The results revealed that NF-RCNN increased the speed and decreased the required memory significantly.
卷积神经网络(CNN)广泛应用于心脏图像分析。然而,心脏定位已成为这些网络的前提条件,因为它可以减小输入图像的大小。因此,最近的 CNN 受益于更深的架构,以获得抽象的语义信息。在本研究中,开发了一种基于深度学习的心脏磁共振图像心脏定位方法。此外,将网络中的网络(NIN)用作更快的 R-CNN 的区域提议网络(RPN),然后提出了 NIN Faster-RCNN(NF-RCNN)。NIN 架构是基于“MLPCONV”层构建的,它是卷积网络和多层感知机(MLP)的组合。因此,它可以处理复杂的磁共振图像结构。此外,使用两组心脏 MRI 数据集来评估网络,所有评估指标均表明所提出的网络优于所有相关网络。此外,采用 FROC 曲线、精度-召回率(PR)分析和平均定位误差来评估所提出的网络。总之,FROC 曲线的 AUC 值为 0.98,PR 曲线的平均准确率为 0.96,平均定位误差为 6.17mm。此外,还对第一个数据集执行了基于深度学习的右心室壁运动分析(WMA)方法,并研究了心脏定位对该算法的影响。结果表明,NF-RCNN 显著提高了速度并减少了所需的内存。