Rawat Waseem, Wang Zenghui
Department of Electrical and Mining Engineering, University of South Africa, Florida 1710, South Africa
Neural Comput. 2017 Sep;29(9):2352-2449. doi: 10.1162/NECO_a_00990. Epub 2017 Jun 9.
Convolutional neural networks (CNNs) have been applied to visual tasks since the late 1980s. However, despite a few scattered applications, they were dormant until the mid-2000s when developments in computing power and the advent of large amounts of labeled data, supplemented by improved algorithms, contributed to their advancement and brought them to the forefront of a neural network renaissance that has seen rapid progression since 2012. In this review, which focuses on the application of CNNs to image classification tasks, we cover their development, from their predecessors up to recent state-of-the-art deep learning systems. Along the way, we analyze (1) their early successes, (2) their role in the deep learning renaissance, (3) selected symbolic works that have contributed to their recent popularity, and (4) several improvement attempts by reviewing contributions and challenges of over 300 publications. We also introduce some of their current trends and remaining challenges.
自20世纪80年代末以来,卷积神经网络(CNN)已被应用于视觉任务。然而,尽管有一些零散的应用,但在2000年代中期之前它们一直处于休眠状态。当时,计算能力的发展、大量标注数据的出现,再加上算法的改进,推动了它们的进步,并使它们处于自2012年以来迅速发展的神经网络复兴的前沿。在本综述中,我们重点关注CNN在图像分类任务中的应用,涵盖了它们从前身到近期最先进的深度学习系统的发展历程。在此过程中,我们分析了:(1)它们早期的成功;(2)它们在深度学习复兴中的作用;(3)促成其近期流行的一些标志性作品;(4)通过回顾300多篇出版物的贡献和挑战所进行的几次改进尝试。我们还介绍了它们当前的一些趋势和仍然存在的挑战。