Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA.
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA.
Med Image Anal. 2019 Dec;58:101553. doi: 10.1016/j.media.2019.101553. Epub 2019 Sep 4.
Cochlear implants (CIs) are surgically implanted neural prosthetic devices that are used to treat severe-to-profound hearing loss. These devices are programmed post implantation and precise knowledge of the implant position with respect to the intra cochlear anatomy (ICA) can help the programming audiologists. Over the years, we have developed algorithms that permit determining the position of implanted electrodes relative to the ICA using pre- and post-implantation CT image pairs. However, these do not extend to CI recipients for whom pre-implantation CT (Pre-CT) images are not available. This is so because post-operative images are affected by strong artifacts introduced by the metallic implant. To overcome this issue, we have proposed two methods to segment the ICA in post-implantation CT (Post-CT) images, but they lead to segmentation errors that are substantially larger than errors obtained with Pre-CT images. Recently, we have proposed an approach that uses 2D-conditional generative adversarial nets (cGANs) to synthesize pre-operative images from post-operative images. This permits to use segmentation algorithms designed to operate on Pre-CT images even when these are not available. We have shown that it substantially and significantly improves the results obtained with methods designed to operate directly on post-CT images. In this article, we expand on our earlier work by moving from a 2D architecture to a 3D architecture. We perform a large validation and comparative study that shows that the 3D architecture improves significantly the quality of the synthetic images measured by the commonly used MSSIM (Mean Structural SIMilarity index). We also show that the segmentation results obtained with the 3D architecture are better than those obtained with the 2D architecture although differences have not reached statistical significance.
人工耳蜗是一种经过手术植入的神经假体设备,用于治疗重度至极重度听力损失。这些设备在植入后进行编程,而精确了解植入物相对于内耳蜗解剖结构 (ICA) 的位置可以帮助编程听力学家。多年来,我们已经开发出了一些算法,这些算法允许使用植入前后的 CT 图像对来确定植入电极相对于 ICA 的位置。然而,这些算法不适用于那些没有植入前 CT(Pre-CT)图像的人工耳蜗接受者。这是因为术后图像受到由金属植入物引入的强烈伪影的影响。为了解决这个问题,我们提出了两种方法来分割植入后的 CT(Post-CT)图像中的 ICA,但它们导致的分割误差比使用 Pre-CT 图像获得的误差大得多。最近,我们提出了一种使用 2D 条件生成对抗网络(cGANs)从术后图像中合成术前图像的方法。这使得即使没有 Pre-CT 图像,也可以使用设计用于操作 Pre-CT 图像的分割算法。我们已经证明,与直接操作 Post-CT 图像的方法相比,它大大提高了结果。在本文中,我们通过从 2D 架构转移到 3D 架构来扩展我们早期的工作。我们进行了大量的验证和比较研究,表明 3D 架构显著提高了常用的 MSSIM(平均结构相似性指数)测量的合成图像的质量。我们还表明,尽管 3D 架构获得的分割结果比 2D 架构获得的分割结果要好,但差异没有达到统计学意义。