Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Nat Biomed Eng. 2021 Jun;5(6):571-585. doi: 10.1038/s41551-021-00733-w. Epub 2021 Jun 10.
In machine learning for image-based medical diagnostics, supervised convolutional neural networks are typically trained with large and expertly annotated datasets obtained using high-resolution imaging systems. Moreover, the network's performance can degrade substantially when applied to a dataset with a different distribution. Here, we show that adversarial learning can be used to develop high-performing networks trained on unannotated medical images of varying image quality. Specifically, we used low-quality images acquired using inexpensive portable optical systems to train networks for the evaluation of human embryos, the quantification of human sperm morphology and the diagnosis of malarial infections in the blood, and show that the networks performed well across different data distributions. We also show that adversarial learning can be used with unlabelled data from unseen domain-shifted datasets to adapt pretrained supervised networks to new distributions, even when data from the original distribution are not available. Adaptive adversarial networks may expand the use of validated neural-network models for the evaluation of data collected from multiple imaging systems of varying quality without compromising the knowledge stored in the network.
在基于图像的医学诊断的机器学习中,监督卷积神经网络通常使用使用高分辨率成像系统获得的大型专业注释数据集进行训练。此外,当将网络应用于具有不同分布的数据集时,其性能会大大降低。在这里,我们表明对抗性学习可用于开发针对不同图像质量的未注释医学图像进行训练的高性能网络。具体来说,我们使用廉价的便携式光学系统获取低质量图像,来训练用于评估人类胚胎、量化人类精子形态和诊断血液中疟疾感染的网络,并表明这些网络在不同的数据分布下表现良好。我们还表明,对抗性学习可用于来自未见域移位数据集的无标签数据,以使预先训练的监督网络适应新的分布,即使没有原始分布的数据。自适应对抗性网络可以扩展经过验证的神经网络模型的使用,用于评估来自不同质量的多个成像系统收集的数据,而不会损害网络中存储的知识。