He Nanjun, Fang Leyuan, Li Shutao, Plaza Javier, Plaza Antonio
IEEE Trans Neural Netw Learn Syst. 2020 May;31(5):1461-1474. doi: 10.1109/TNNLS.2019.2920374. Epub 2019 Jul 11.
This paper proposes a novel end-to-end learning model, called skip-connected covariance (SCCov) network, for remote sensing scene classification (RSSC). The innovative contribution of this paper is to embed two novel modules into the traditional convolutional neural network (CNN) model, i.e., skip connections and covariance pooling. The advantages of newly developed SCCov are twofold. First, by means of the skip connections, the multi-resolution feature maps produced by the CNN are combined together, which provides important benefits to address the presence of large-scale variance in RSSC data sets. Second, by using covariance pooling, we can fully exploit the second-order information contained in such multi-resolution feature maps. This allows the CNN to achieve more representative feature learning when dealing with RSSC problems. Experimental results, conducted using three large-scale benchmark data sets, demonstrate that our newly proposed SCCov network exhibits very competitive or superior classification performance when compared with the current state-of-the-art RSSC techniques, using a much lower amount of parameters. Specifically, our SCCov only needs 10% of the parameters used by its counterparts.
本文提出了一种用于遥感场景分类(RSSC)的新型端到端学习模型,称为跳跃连接协方差(SCCov)网络。本文的创新贡献在于将两个新颖的模块嵌入到传统卷积神经网络(CNN)模型中,即跳跃连接和协方差池化。新开发的SCCov有两个优点。首先,通过跳跃连接,将CNN产生的多分辨率特征图组合在一起,这为解决RSSC数据集中存在的大规模方差提供了重要益处。其次,通过使用协方差池化,我们可以充分利用此类多分辨率特征图中包含的二阶信息。这使得CNN在处理RSSC问题时能够实现更具代表性的特征学习。使用三个大规模基准数据集进行的实验结果表明,与当前最先进的RSSC技术相比,我们新提出的SCCov网络在使用少得多的参数的情况下,展现出极具竞争力或更优的分类性能。具体而言,我们的SCCov只需要其同类模型所使用参数的10%。