Venkatesh Vishal, Sharma Neeraj, Srivastava Vivek, Singh Munendra
Department of Mechatronics Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka 576104, India.
School of Biomedical Engineering, Indian Institute of Technology (Banaras Hindu University), Varanasi 221005, India.
Comput Biol Med. 2020 Aug;123:103873. doi: 10.1016/j.compbiomed.2020.103873. Epub 2020 Jun 24.
In laparoscopic surgery, energized dissecting devices and laser ablation causes smoke, which degrades the visual quality of the operative field. This paper proposes an unsupervised approach to desmoke laparoscopic images called Cyclic-DesmokeGAN. In the generator, multi-scale residual blocks help to alleviate the smoke component at multiple scales, while refinement module helps to obtain desmoked images with sharper boundaries. As the presence of smoke degrades contrast and fine structure, the proposed method utilizes high boost filtered image at each encoder layer. The contrast loss improves overall contrast, thereby reducing the smoke, while Unsharp Regularization loss helps to stabilize the network. The proposed Cyclic-DesmokeGAN is tested on 200 smoke images obtained from Cholec80 dataset consisting of videos of cholecystectomy surgeries. The results depict effectiveness, as proposed approach achieved 3.47±0.09 Contrast-Distorted Images Quality, 4.15±0.74 Naturalness Image Quality Evaluator, and 0.23±0.00 Fog Aware Density Evaluator, these indexes are best in comparison to other state-of-the-art methods.
在腹腔镜手术中,通电的解剖器械和激光消融会产生烟雾,这会降低手术视野的视觉质量。本文提出了一种用于去除腹腔镜图像烟雾的无监督方法,称为循环去烟生成对抗网络(Cyclic-DesmokeGAN)。在生成器中,多尺度残差块有助于在多个尺度上减轻烟雾成分,而细化模块有助于获得边界更清晰的去烟图像。由于烟雾的存在会降低对比度和精细结构,该方法在每个编码器层利用高增强滤波图像。对比度损失提高了整体对比度,从而减少了烟雾,而反锐化正则化损失有助于稳定网络。所提出的循环去烟生成对抗网络在从包含胆囊切除术视频的Cholec80数据集中获取的200张烟雾图像上进行了测试。结果表明了该方法的有效性,因为所提出的方法实现了3.47±0.09的对比度失真图像质量、4.15±0.74的自然度图像质量评估器以及0.23±0.00的雾感知密度评估器,与其他现有最先进方法相比,这些指标是最好的。