Department of Computer Science, Western University, London, ON, Canada.
Western Institute for Neuroscience, Western University, London, ON, Canada.
Sci Rep. 2024 Jan 13;14(1):1246. doi: 10.1038/s41598-023-49904-6.
With the advent of social media in our daily life, we are exposed to a plethora of images, particularly face photographs, every day. Recent behavioural studies have shown that some of these photographs stick in the mind better than others. Previous research have shown that memorability is an intrinsic property of an image, hence the memorability of an image can be computed from that image. Moreover, various works found that the memorability of an image is highly consistent across people and also over time. Recently, researchers employed deep neural networks to predict image memorability. Here, we show although those models perform well on scene and object images, they perform poorly on photographs of human faces. We demonstrate and explain why generic memorability models do not result in an acceptable performance on face photographs and propose seven different models to estimate the memorability of face images. In addition, we show that these models outperform the previous classical methods, which were used for predicting face memorability.
随着社交媒体在日常生活中的出现,我们每天都会接触到大量的图像,尤其是面部照片。最近的行为研究表明,这些照片中的一些比其他的更能让人记住。以前的研究表明,可记性是图像的固有属性,因此可以从图像本身计算出图像的可记性。此外,各种研究发现,图像的可记性在人与人之间以及随着时间的推移非常一致。最近,研究人员使用深度神经网络来预测图像的可记性。在这里,我们表明,尽管这些模型在场景和物体图像上表现良好,但它们在人脸照片上的表现却很差。我们展示并解释了为什么通用的可记性模型不能对面部照片产生可接受的性能,并提出了七种不同的模型来估计人脸图像的可记性。此外,我们还表明,这些模型优于以前用于预测人脸可记性的经典方法。