Ren Zhihang, Canas-Bajo Teresa, Ghirardo Cristina, Manassi Mauro, Yu Stella X, Whitney David
University of California, Berkeley, Vision Science Graduate Group, Berkeley, California, United States.
University of California, Berkeley, Department of Psychology, Berkeley, California, United States.
J Med Imaging (Bellingham). 2023 Jul;10(4):045501. doi: 10.1117/1.JMI.10.4.045501. Epub 2023 Jul 4.
Human perception and decisions are biased toward previously seen stimuli. This phenomenon is known as serial dependence and has been extensively studied for the last decade. Recent evidence suggests that clinicians' judgments of mammograms might also be impacted by serial dependence. However, the stimuli used in previous psychophysical experiments on this question, consisting of artificial geometric shapes and healthy tissue backgrounds, were unrealistic. We utilized realistic and controlled generative adversarial network (GAN)-generated radiographs to mimic images that clinicians typically encounter.
Mammograms from the digital database for screening mammography (DDSM) were utilized to train a GAN. This pretrained GAN was then adopted to generate a large set of authentic-looking simulated mammograms: 20 circular morph continuums, each with 147 images, for a total of 2940 images. Using these stimuli in a standard serial dependence experiment, participants viewed a random GAN-generated mammogram on each trial and subsequently matched the GAN-generated mammogram encountered using a continuous report. The characteristics of serial dependence from each continuum were analyzed.
We found that serial dependence affected the perception of all naturalistic GAN-generated mammogram morph continuums. In all cases, the perceptual judgments of GAN-generated mammograms were biased toward previously encountered GAN-generated mammograms. On average, perceptual decisions had 7% categorization errors that were pulled in the direction of serial dependence.
Serial dependence was found even in the perception of naturalistic GAN-generated mammograms created by a GAN. This supports the idea that serial dependence could, in principle, contribute to decision errors in medical image perception tasks.
人类的感知和决策会偏向于先前见过的刺激。这种现象被称为序列依赖性,在过去十年中得到了广泛研究。最近的证据表明,临床医生对乳房X光片的判断也可能受到序列依赖性的影响。然而,此前关于这个问题的心理物理学实验中使用的刺激物,由人工几何形状和健康组织背景组成,并不现实。我们利用逼真且可控的生成对抗网络(GAN)生成的X光片来模拟临床医生通常会遇到的图像。
利用来自数字乳腺筛查数据库(DDSM)的乳房X光片训练一个GAN。然后采用这个预训练的GAN生成大量看起来逼真的模拟乳房X光片:20个圆形形态连续体,每个连续体有147张图像,总共2940张图像。在一个标准的序列依赖性实验中使用这些刺激物,参与者在每次试验中观看一张随机的GAN生成的乳房X光片,随后使用连续报告来匹配所遇到的GAN生成的乳房X光片。分析了每个连续体的序列依赖性特征。
我们发现序列依赖性影响了所有自然主义的GAN生成的乳房X光片形态连续体的感知。在所有情况下,对GAN生成的乳房X光片的感知判断都偏向于先前遇到的GAN生成的乳房X光片。平均而言,感知决策有7%的分类错误,这些错误朝着序列依赖性的方向被拉动。
即使在对由GAN创建的自然主义的GAN生成的乳房X光片的感知中也发现了序列依赖性。这支持了序列依赖性原则上可能导致医学图像感知任务中的决策错误这一观点。