Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria.
Carl Zeiss AG, Jena, Germany.
Sci Rep. 2023 Apr 8;13(1):5760. doi: 10.1038/s41598-023-32695-1.
By providing three-dimensional visualization of tissues and instruments at high resolution, live volumetric optical coherence tomography (4D-OCT) has the potential to revolutionize ophthalmic surgery. However, the necessary imaging speed is accompanied by increased noise levels. A high data rate and the requirement for minimal latency impose major limitations for real-time noise reduction. In this work, we propose a low complexity neural network for denoising, directly incorporated into the image reconstruction pipeline of a microscope-integrated 4D-OCT prototype with an A-scan rate of 1.2 MHz. For this purpose, we trained a blind-spot network on unpaired OCT images using a self-supervised learning approach. With an optimized U-Net, only a few milliseconds of additional latency were introduced. Simultaneously, these architectural adaptations improved the numerical denoising performance compared to the basic setup, outperforming non-local filtering algorithms. Layers and edges of anatomical structures in B-scans were better preserved than with Gaussian filtering despite comparable processing time. By comparing scenes with and without denoising employed, we show that neural networks can be used to improve visual appearance of volumetric renderings in real time. Enhancing the rendering quality is an important step for the clinical acceptance and translation of 4D-OCT as an intra-surgical guidance tool.
通过提供高分辨率的组织和器械的三维可视化,实时容积光相干断层扫描(4D-OCT)有可能彻底改变眼科手术。然而,必要的成像速度伴随着噪声水平的增加。高数据率和最小延迟的要求对实时降噪施加了重大限制。在这项工作中,我们提出了一种用于降噪的低复杂度神经网络,直接集成到显微镜集成的 4D-OCT 原型的图像重建管道中,该原型的 A 扫描率为 1.2MHz。为此,我们使用自监督学习方法在未配对的 OCT 图像上训练了盲点网络。通过优化的 U-Net,仅引入了几毫秒的额外延迟。同时,与基本设置相比,这些架构上的调整提高了数值降噪性能,优于非局部滤波算法。与高斯滤波相比,B 扫描中解剖结构的层和边缘得到了更好的保留,尽管处理时间相当。通过比较有和无降噪的场景,我们表明神经网络可用于实时改善容积渲染的视觉效果。提高渲染质量是将 4D-OCT 作为术中引导工具进行临床接受和转化的重要步骤。