Rahmani Mahdiyeh, Moghaddasi Hadis, Pour-Rashidi Ahmad, Ahmadian Alireza, Najafzadeh Ebrahim, Farnia Parastoo
Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran 1461884513, Iran.
Research Center for Biomedical Technologies and Robotics (RCBTR), Advanced Medical Technologies and Equipment Institute (AMTEI), Imam Khomeini Hospital Complex, Tehran University of Medical Sciences (TUMS), Tehran 1419733141, Iran.
Diagnostics (Basel). 2024 Jun 21;14(13):1319. doi: 10.3390/diagnostics14131319.
During neurosurgical procedures, the neuro-navigation system's accuracy is affected by the brain shift phenomenon. One popular strategy is to compensate for brain shift using intraoperative ultrasound (iUS) registration with pre-operative magnetic resonance (MR) scans. This requires a satisfactory multimodal image registration method, which is challenging due to the low image quality of ultrasound and the unpredictable nature of brain deformation during surgery. In this paper, we propose an automatic unsupervised end-to-end MR-iUS registration approach named the Dual Discriminator Bayesian Generative Adversarial Network (DBGAN). The proposed network consists of two discriminators and a generator optimized by a Bayesian loss function to improve the functionality of the generator, and we add a mutual information loss function to the discriminator for similarity measurements. Extensive validation was performed on the RESECT and BITE datasets, where the mean target registration error (mTRE) of MR-iUS registration using DBGAN was determined to be 0.75 ± 0.3 mm. The DBGAN illustrated a clear advantage by achieving an 85% improvement in the mTRE over the initial error. Moreover, the results confirmed that the proposed Bayesian loss function, rather than the typical loss function, improved the accuracy of MR-iUS registration by 23%. The improvement in registration accuracy was further enhanced by the preservation of the intensity and anatomical information of the input images.
在神经外科手术过程中,神经导航系统的准确性会受到脑移位现象的影响。一种常用的策略是通过术中超声(iUS)与术前磁共振(MR)扫描配准来补偿脑移位。这需要一种令人满意的多模态图像配准方法,由于超声图像质量低以及手术过程中脑变形的不可预测性,这具有挑战性。在本文中,我们提出了一种名为双判别器贝叶斯生成对抗网络(DBGAN)的自动无监督端到端MR-iUS配准方法。所提出的网络由两个判别器和一个通过贝叶斯损失函数优化的生成器组成,以提高生成器的功能,并且我们在判别器中添加了互信息损失函数用于相似性测量。在RESECT和BITE数据集上进行了广泛的验证,其中使用DBGAN进行MR-iUS配准的平均目标配准误差(mTRE)被确定为0.75±0.3毫米。DBGAN显示出明显的优势,与初始误差相比,mTRE提高了85%。此外,结果证实,所提出的贝叶斯损失函数而非典型损失函数将MR-iUS配准的准确性提高了23%。输入图像的强度和解剖信息的保留进一步提高了配准精度。