Mukherjee Lopamudra, Keikhosravi Adib, Bui Dat, Eliceiri Kevin W
Department of Computer Science, University of Wisconsin Whitewater, Whitewater, WI 53190, USA.
University of Wisconsin Madison, Madison, WI 53705, USA.
Biomed Opt Express. 2018 Oct 12;9(11):5368-5386. doi: 10.1364/BOE.9.005368. eCollection 2018 Nov 1.
We present a computational approach for improving the quality of the resolution of images acquired from commonly available low magnification commercial slide scanners. Images from such scanners can be acquired cheaply and are efficient in terms of storage and data transfer. However, they are generally of poorer quality than images from high-resolution scanners and microscopes and do not have the necessary resolution needed in diagnostic or clinical environments, and hence are not used in such settings. The driving question of this presented research is whether the resolution of these images could be enhanced such that it would serve the same diagnostic purpose as high-resolution images from expensive scanners or microscopes. This need is generally known as the image super-resolution (SR) problem in image processing, and it has been studied extensively. Even so, none of the existing methods directly work for the slide scanner images, due to the unique challenges posed by this modality. Here, we propose a convolutional neural network (CNN) based approach, which is specifically trained to take low-resolution slide scanner images of cancer data and convert it into a high-resolution image. We validate these resolution improvements with computational analysis to show the enhanced images offer the same quantitative results. In summary, our extensive experiments demonstrate that this method indeed produces images that are similar to images from high-resolution scanners, both in quality and quantitative measures. This approach opens up new application possibilities for using low-resolution scanners, not only in terms of cost but also in access and speed of scanning for both research and possible clinical use.
我们提出了一种计算方法,用于提高从常见的低倍商业幻灯片扫描仪获取的图像分辨率质量。此类扫描仪获取的图像成本低廉,在存储和数据传输方面效率较高。然而,它们的质量通常比高分辨率扫描仪和显微镜获取的图像差,并且不具备诊断或临床环境所需的必要分辨率,因此在这些环境中未被使用。本研究的核心问题是,这些图像的分辨率能否提高,使其能与昂贵的扫描仪或显微镜所产生的高分辨率图像达到相同的诊断目的。在图像处理中,这种需求通常被称为图像超分辨率(SR)问题,并且已经得到了广泛研究。即便如此,由于这种成像方式带来的独特挑战,现有的方法都无法直接应用于幻灯片扫描仪图像。在此,我们提出一种基于卷积神经网络(CNN)的方法,该方法经过专门训练,用于处理癌症数据的低分辨率幻灯片扫描仪图像,并将其转换为高分辨率图像。我们通过计算分析验证了这些分辨率的提升,以表明增强后的图像能提供相同的定量结果。总之,我们的大量实验表明,该方法确实能生成在质量和定量指标上都与高分辨率扫描仪所产生的图像相似的图像。这种方法为低分辨率扫描仪开辟了新的应用可能性,不仅在成本方面,而且在研究和可能的临床应用中的扫描获取途径和速度方面。