Suppr超能文献

利用生成对抗网络和人工智能进行医学图像分析抗击新冠疫情:综述

Combating COVID-19 Using Generative Adversarial Networks and Artificial Intelligence for Medical Images: Scoping Review.

作者信息

Ali Hazrat, Shah Zubair

机构信息

College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar.

出版信息

JMIR Med Inform. 2022 Jun 29;10(6):e37365. doi: 10.2196/37365.

Abstract

BACKGROUND

Research on the diagnosis of COVID-19 using lung images is limited by the scarcity of imaging data. Generative adversarial networks (GANs) are popular for synthesis and data augmentation. GANs have been explored for data augmentation to enhance the performance of artificial intelligence (AI) methods for the diagnosis of COVID-19 within lung computed tomography (CT) and X-ray images. However, the role of GANs in overcoming data scarcity for COVID-19 is not well understood.

OBJECTIVE

This review presents a comprehensive study on the role of GANs in addressing the challenges related to COVID-19 data scarcity and diagnosis. It is the first review that summarizes different GAN methods and lung imaging data sets for COVID-19. It attempts to answer the questions related to applications of GANs, popular GAN architectures, frequently used image modalities, and the availability of source code.

METHODS

A search was conducted on 5 databases, namely PubMed, IEEEXplore, Association for Computing Machinery (ACM) Digital Library, Scopus, and Google Scholar. The search was conducted from October 11-13, 2021. The search was conducted using intervention keywords, such as "generative adversarial networks" and "GANs," and application keywords, such as "COVID-19" and "coronavirus." The review was performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) guidelines for systematic and scoping reviews. Only those studies were included that reported GAN-based methods for analyzing chest X-ray images, chest CT images, and chest ultrasound images. Any studies that used deep learning methods but did not use GANs were excluded. No restrictions were imposed on the country of publication, study design, or outcomes. Only those studies that were in English and were published from 2020 to 2022 were included. No studies before 2020 were included.

RESULTS

This review included 57 full-text studies that reported the use of GANs for different applications in COVID-19 lung imaging data. Most of the studies (n=42, 74%) used GANs for data augmentation to enhance the performance of AI techniques for COVID-19 diagnosis. Other popular applications of GANs were segmentation of lungs and superresolution of lung images. The cycleGAN and the conditional GAN were the most commonly used architectures, used in 9 studies each. In addition, 29 (51%) studies used chest X-ray images, while 21 (37%) studies used CT images for the training of GANs. For the majority of the studies (n=47, 82%), the experiments were conducted and results were reported using publicly available data. A secondary evaluation of the results by radiologists/clinicians was reported by only 2 (4%) studies.

CONCLUSIONS

Studies have shown that GANs have great potential to address the data scarcity challenge for lung images in COVID-19. Data synthesized with GANs have been helpful to improve the training of the convolutional neural network (CNN) models trained for the diagnosis of COVID-19. In addition, GANs have also contributed to enhancing the CNNs' performance through the superresolution of the images and segmentation. This review also identified key limitations of the potential transformation of GAN-based methods in clinical applications.

摘要

背景

利用肺部图像诊断新型冠状病毒肺炎(COVID-19)的研究受到成像数据稀缺的限制。生成对抗网络(GAN)在合成和数据增强方面很受欢迎。人们已经探索了利用GAN进行数据增强,以提高人工智能(AI)方法在肺部计算机断层扫描(CT)和X射线图像中诊断COVID-19的性能。然而,GAN在克服COVID-19数据稀缺方面的作用尚未得到充分理解。

目的

本综述全面研究了GAN在应对与COVID-19数据稀缺和诊断相关挑战方面的作用。这是第一篇总结用于COVID-19的不同GAN方法和肺部成像数据集的综述。它试图回答与GAN应用、流行的GAN架构、常用图像模态以及源代码可用性相关的问题。

方法

在5个数据库中进行了检索,即PubMed、IEEE Xplore、美国计算机协会(ACM)数字图书馆、Scopus和谷歌学术。检索时间为2021年10月11日至13日。使用干预关键词(如“生成对抗网络”和“GAN”)和应用关键词(如“COVID-19”和“冠状病毒”)进行检索。本综述按照系统评价和范围综述的系统评价和Meta分析扩展的首选报告项目(PRISMA-ScR)指南进行系统和范围综述。仅纳入那些报告了基于GAN分析胸部X射线图像、胸部CT图像和胸部超声图像的方法的研究。任何使用深度学习方法但未使用GAN的研究均被排除。对发表国家、研究设计或结果不设限制。仅纳入2020年至2022年发表的英文研究。2020年以前的研究均未纳入。

结果

本综述纳入了57篇全文研究,这些研究报告了GAN在COVID-19肺部成像数据中的不同应用。大多数研究(n=42,74%)使用GAN进行数据增强,以提高AI技术在COVID-19诊断中的性能。GAN的其他常见应用是肺部分割和肺部图像超分辨率。循环GAN和条件GAN是最常用的架构,各有9项研究使用。此外,29项(51%)研究使用胸部X射线图像,而21项(37%)研究使用CT图像训练GAN。对于大多数研究(n=47,82%),实验是使用公开可用数据进行的,结果也进行了报告。只有2项(4%)研究报告了放射科医生/临床医生对结果的二次评估。

结论

研究表明,GAN在应对COVID-19肺部图像数据稀缺挑战方面具有巨大潜力。用GAN合成的数据有助于改进为诊断COVID-19而训练的卷积神经网络(CNN)模型的训练。此外,GAN还通过图像超分辨率和分割提高了CNN的性能。本综述还确定了基于GAN的方法在临床应用中潜在转化的关键局限性。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验