College of Information Science and Engineering, Northeastern University, China.
Faculty of Robot Science and Engineering, Northeastern University, China.
Comput Intell Neurosci. 2020 Jan 9;2020:3062706. doi: 10.1155/2020/3062706. eCollection 2020.
In recent years, with the rapid development of artificial intelligence, image caption has gradually attracted the attention of many researchers in the field of artificial intelligence and has become an interesting and arduous task. Image caption, automatically generating natural language descriptions according to the content observed in an image, is an important part of scene understanding, which combines the knowledge of computer vision and natural language processing. The application of image caption is extensive and significant, for example, the realization of human-computer interaction. This paper summarizes the related methods and focuses on the attention mechanism, which plays an important role in computer vision and is recently widely used in image caption generation tasks. Furthermore, the advantages and the shortcomings of these methods are discussed, providing the commonly used datasets and evaluation criteria in this field. Finally, this paper highlights some open challenges in the image caption task.
近年来,随着人工智能的飞速发展,图像字幕逐渐引起了人工智能领域众多研究人员的关注,并成为一项有趣且艰巨的任务。图像字幕根据图像中观察到的内容自动生成自然语言描述,是场景理解的重要组成部分,它结合了计算机视觉和自然语言处理的知识。图像字幕的应用广泛且意义重大,例如,实现人机交互。本文总结了相关方法,并重点介绍了在计算机视觉中发挥重要作用且最近在图像字幕生成任务中广泛使用的注意力机制。此外,还讨论了这些方法的优缺点,提供了该领域常用的数据集和评估标准。最后,本文突出了图像字幕任务中的一些开放性挑战。