College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518060, China.
College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518160, China; Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen, 518060, China.
Neural Netw. 2024 Dec;180:106701. doi: 10.1016/j.neunet.2024.106701. Epub 2024 Sep 11.
Real-world data is typically distributed on low-dimensional manifolds embedded in high-dimensional Euclidean spaces. Accurately extracting spatial distribution features on general manifolds that reflect the intrinsic characteristics of data is crucial for effective feature representation. Therefore, we propose a generalized geodesic basis function neural network (GBFNN) architecture. The generalized geodesic basis functions (GBF) are defined based on generalized geodesic distances. The generalized geodesic distance metric (GDM) is obtained by learning the manifold structure. To implement this architecture, a specific GBFNN, named discriminative local preserving projection-based GBFNN (DLPP-GBFNN) is proposed. DLPP-GBFNN mainly contains two modules, namely the manifold structure learning module (MSLM) and the network mapping module (NMM). In the MSLM module, a supervised adjacency graph matrix is constructed to constrain the learning of the manifold structure. This enables the learned features in the embedding subspace to maintain the manifold structure while enhancing the discriminability. The features and GDM learned in the MSLM are fed into the NMM. Through the GBF in the NMM, the spatial distribution features on manifold are obtained. Finally, the output of the network is obtained through the fully connected layer. Compared with the local response neural network based on Euclidean distance, the proposed network can reveal more essential spatial structure characteristics of the data. Meanwhile, the proposed GBFNN is a generalized network architecture that can be combined with any manifold learning method, showcasing high scalability. The experimental results demonstrate that the proposed DLPP-GBFNN outperforms existing methods by utilizing fewer kernels while achieving higher recognition performance.
真实世界的数据通常分布在低维流形中,这些流形嵌入在高维欧几里得空间中。准确提取反映数据内在特征的一般流形上的空间分布特征对于有效的特征表示至关重要。因此,我们提出了一种广义测地线基函数神经网络(GBFNN)架构。广义测地线基函数(GBF)是基于广义测地线距离定义的。广义测地线距离度量(GDM)是通过学习流形结构获得的。为了实现这个架构,我们提出了一个具体的 GBFNN,称为基于判别局部保持投影的广义测地线基函数神经网络(DLPP-GBFNN)。DLPP-GBFNN 主要包含两个模块,即流形结构学习模块(MSLM)和网络映射模块(NMM)。在 MSLM 模块中,构建了一个有监督的邻接图矩阵来约束流形结构的学习。这使得嵌入子空间中学习到的特征保持流形结构的同时增强了可辨别性。在 MSLM 中学习到的特征和 GDM 被馈送到 NMM 中。通过 NMM 中的 GBF,得到了流形上的空间分布特征。最后,通过全连接层得到网络的输出。与基于欧几里得距离的局部响应神经网络相比,所提出的网络可以揭示数据更本质的空间结构特征。同时,所提出的 GBFNN 是一种通用的网络架构,可以与任何流形学习方法结合,具有很高的可扩展性。实验结果表明,所提出的 DLPP-GBFNN 在使用较少核的情况下优于现有方法,同时实现了更高的识别性能。