Widya Aji Resindra, Monno Yusuke, Okutomi Masatoshi, Suzuki Sho, Gotoda Takuji, Miki Kenji
Annu Int Conf IEEE Eng Med Biol Soc. 2020 Jul;2020:1848-1852. doi: 10.1109/EMBC44109.2020.9176016.
Gastric endoscopy is a standard clinical process that enables medical practitioners to diagnose various lesions inside a patient's stomach. If any lesion is found, it is very important to perceive the location of the lesion relative to the global view of the stomach. Our previous research showed that this could be addressed by reconstructing the whole stomach shape from chromoendoscopic images using a structure-from-motion (SfM) pipeline, in which indigo carmine (IC) blue dye-sprayed images were used to increase feature matches for SfM by enhancing stomach surface's textures. However, spraying the IC dye to the whole stomach requires additional time, labor, and cost, which is not desirable for patients and practitioners. In this paper, we propose an alternative way to achieve whole stomach 3D reconstruction without the need of the IC dye by generating virtual IC-sprayed (VIC) images based on image-to-image style translation trained on unpaired real no-IC and IC-sprayed images. We have specifically investigated the effect of input and output color channel selection for generating the VIC images and found that translating no-IC green-channel images to IC-sprayed red-channel images gives the best SfM reconstruction result.
胃镜检查是一种标准的临床程序，可使医生诊断患者胃内的各种病变。如果发现任何病变，了解病变相对于整个胃部的位置非常重要。我们之前的研究表明，这可以通过使用运动结构（SfM）管道从染色内镜图像重建整个胃部形状来解决，在该管道中，使用靛胭脂（IC）蓝色染料喷洒的图像通过增强胃表面纹理来增加SfM的特征匹配。然而，将IC染料喷洒到整个胃部需要额外的时间、人力和成本，这对患者和医生来说都是不可取的。在本文中，我们提出了一种替代方法，通过基于在未配对的真实无IC和IC喷洒图像上训练的图像到图像风格转换生成虚拟IC喷洒（VIC）图像，无需IC染料即可实现整个胃部的三维重建。我们专门研究了生成VIC图像时输入和输出颜色通道选择的影响，发现将无IC绿色通道图像转换为IC喷洒红色通道图像可获得最佳的SfM重建结果。
