Suppr超能文献

[模拟痣:通过深度学习模型生成再现黑素细胞痣共聚焦模式的合成图像]

[MOCK MOLE: PRODUCING SYNTHETIC IMAGES THAT RECAPITULATE CONFOCAL PATTERNS OF MELANOCYTIC NEVI VIA DEEP-LEARNING MODELS].

作者信息

Ben Shachar Miriam, Yampolsky Aviv, Benayoun Mor, Kleinman Elana, Katz Eyal, Scope Alon

机构信息

Kittner Skin Cancer Screening and Research Institute, Medical Screening Institute, Sheba Medical Center, Adelson School of Medicine, Ariel University, Arrow Program for Medical Research Education, Sheba Medical Center, Ramat-Gan, Israel.

School of Software Engineering, Afeka, Tel Aviv College of Engineering.

出版信息

Harefuah. 2023 Dec;162(10):650-655.

Abstract

INTRODUCTION

Melanocytic nevi present microscopic patterns, which differ in their associated melanoma risk, and can be non-invasively recognized under Reflectance Confocal Microscopy (RCM).

AIMS

To train a Generative Adversarial Network (GAN) deep-learning model to produce synthetic images that recapitulate RCM patterns of nevi, enabling reliable classification by human readers and by a Convolutional Neural Network (CNN) computer model.

METHODS

A dataset of RCM images of nevi, presenting a uniform pattern, were chosen and classified into one of three patterns - Meshwork, Ring or Clod. Images were used for training a GAN model, which in turn, produced synthetic images recapitulating RCM patterns of nevi. A random sample of synthetic images was classified by two independent human readers and by a CNN model. Human and computer-model classifications were compared.

RESULTS

The training set for the GAN model included 1496 RCM images, including 977 images (65.3%) with Meshwork pattern, 261 (17.4%) with Ring and 258 (17.2%) with Clod pattern. The GAN model produced 6000 synthetic RCM-like images. Of these, 302 images were randomly chosen and classified by human readers, including 83 (27.5%) classified as Meshwork, 131 (43.4%) as Ring, and 88 (29.1%) as Clod pattern. Human inter-observer concordance in pattern classification was 91.7%, and human-to-CNN concordance was 87.7%.

CONCLUSIONS

We demonstrate feasibility of producing synthetic images, which recapitulate RCM patterns of nevi and can be reproducibly recognized by human readers and by deep-learning models. Synthetic image datasets may allow teaching RCM patterns to novices, training of computer models, and data sharing between research centers.

摘要

引言

黑素细胞痣呈现出微观模式,其与相关黑色素瘤风险不同,并且可以在反射共聚焦显微镜(RCM)下被非侵入性识别。

目的

训练一个生成对抗网络(GAN)深度学习模型,以生成概括痣的RCM模式的合成图像,从而使人类读者和卷积神经网络(CNN)计算机模型能够进行可靠的分类。

方法

选择一组呈现统一模式的痣的RCM图像数据集,并将其分类为三种模式之一——网格状、环状或团块状。图像用于训练GAN模型,该模型进而生成概括痣的RCM模式的合成图像。由两名独立的人类读者和一个CNN模型对合成图像的随机样本进行分类。比较人类和计算机模型的分类结果。

结果

GAN模型的训练集包括1496张RCM图像,其中977张(65.3%)为网格状模式,261张(17.4%)为环状,258张(17.2%)为团块状模式。GAN模型生成了6000张类似RCM的合成图像。其中,302张图像被随机选择并由人类读者分类,包括83张(27.5%)被分类为网格状,131张(43.4%)为环状,88张(29.1%)为团块状模式。人类观察者之间在模式分类上的一致性为91.7%,人类与CNN之间的一致性为87.7%。

结论

我们证明了生成概括痣的RCM模式且能被人类读者和深度学习模型可重复识别的合成图像的可行性。合成图像数据集可能有助于向新手教授RCM模式、训练计算机模型以及研究中心之间的数据共享。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验