Liu Ni, Rogers Mitchell, Cui Hua, Liu Weiyu, Li Xizhi, Delmas Patrice
School of Information Engineering, Chang'an University, Xi'an, ShaanXi Province, China.
Department of Computer Science, The University of Auckland, Auckland, New Zealand.
PeerJ Comput Sci. 2022 Feb 9;8:e869. doi: 10.7717/peerj-cs.869. eCollection 2022.
Regular textures are frequently found in man-made environments and some biological and physical images. There are a wide range of applications for recognizing and locating regular textures. In this work, we used deep convolutional neural networks (CNNs) as a general method for modelling and classifying regular and irregular textures. We created a new regular texture database and investigated two sets of deep CNNs-based methods for regular and irregular texture classification. First, the classic CNN models (. inception, residual network, .) were used in a standard way. These two-class CNN classifiers were trained by fine-tuning networks using our new regular texture database. Next, we transformed the trained filter features of the last convolutional layer into a vector representation using Fisher Vector pooling (FV). Such representations can be efficiently used for a wide range of machine learning tasks such as classification or clustering, thus more transferable from one domain to another. Our experiments show that the standard CNNs attained sufficient accuracy for regular texture recognition tasks. The Fisher representations combined with support vector machine (SVM) also showed high performance for regular and irregular texture classification. We also find CNNs performs sub-optimally for long-range patterns, despite the fact that their fully-connected layers pool local features into a global image representation.
规则纹理在人造环境以及一些生物和物理图像中经常出现。规则纹理的识别与定位有着广泛的应用。在这项工作中,我们使用深度卷积神经网络(CNN)作为对规则和不规则纹理进行建模与分类的通用方法。我们创建了一个新的规则纹理数据库,并研究了两组基于深度CNN的规则和不规则纹理分类方法。首先,以标准方式使用经典的CNN模型(如Inception、残差网络等)。使用我们新的规则纹理数据库对这些二分类CNN分类器进行网络微调训练。接下来,我们使用Fisher向量池化(FV)将最后一个卷积层训练得到的滤波器特征转换为向量表示。这种表示可以有效地用于诸如分类或聚类等广泛的机器学习任务,因此更易于在不同领域之间迁移。我们的实验表明,标准的CNN在规则纹理识别任务中达到了足够的准确率。Fisher表示与支持向量机(SVM)相结合在规则和不规则纹理分类中也表现出高性能。我们还发现,尽管CNN的全连接层将局部特征汇聚成全局图像表示,但对于远距离模式,其性能并不理想。