Kavran Domen, Mongus Domen, Žalik Borut, Lukač Niko
Faculty of Electrical Engineering and Computer Science, University of Maribor, Koroška Cesta 46, 2000 Maribor, Slovenia.
Sensors (Basel). 2023 Jul 24;23(14):6648. doi: 10.3390/s23146648.
Multispectral satellite imagery offers a new perspective for spatial modelling, change detection and land cover classification. The increased demand for accurate classification of geographically diverse regions led to advances in object-based methods. A novel spatiotemporal method is presented for object-based land cover classification of satellite imagery using a Graph Neural Network. This paper introduces innovative representation of sequential satellite images as a directed graph by connecting segmented land region through time. The method's novel modular node classification pipeline utilises the Convolutional Neural Network as a multispectral image feature extraction network, and the Graph Neural Network as a node classification model. To evaluate the performance of the proposed method, we utilised EfficientNetV2-S for feature extraction and the GraphSAGE algorithm with Long Short-Term Memory aggregation for node classification. This innovative application on Sentinel-2 L2A imagery produced complete 4-year intermonthly land cover classification maps for two regions: Graz in Austria, and the region of Portorož, Izola and Koper in Slovenia. The regions were classified with Corine Land Cover classes. In the level 2 classification of the Graz region, the method outperformed the state-of-the-art UNet model, achieving an average F1-score of 0.841 and an accuracy of 0.831, as opposed to UNet's 0.824 and 0.818, respectively. Similarly, the method demonstrated superior performance over UNet in both regions under the level 1 classification, which contains fewer classes. Individual classes have been classified with accuracies up to 99.17%.
多光谱卫星图像为空间建模、变化检测和土地覆盖分类提供了新的视角。对地理上不同区域进行准确分类的需求增加,推动了基于对象的方法的发展。本文提出了一种新颖的时空方法,用于使用图神经网络对卫星图像进行基于对象的土地覆盖分类。本文通过在时间上连接分割后的陆地区域,将连续卫星图像创新地表示为有向图。该方法新颖的模块化节点分类管道利用卷积神经网络作为多光谱图像特征提取网络,利用图神经网络作为节点分类模型。为了评估所提方法的性能,我们使用EfficientNetV2-S进行特征提取,并使用带有长短期记忆聚合的GraphSAGE算法进行节点分类。这种在哨兵2 L2A图像上的创新应用为奥地利的格拉茨以及斯洛文尼亚的皮兰、伊佐拉和科佩尔地区生成了完整的4年逐月土地覆盖分类地图。这些区域按照《欧洲环境观测网络陆地覆盖分类系统》(Corine Land Cover)类别进行分类。在格拉茨地区的二级分类中,该方法优于当前最先进的U-Net模型,平均F1分数达到0.841,准确率为0.831,而U-Net的这两个指标分别为0.824和0.818。同样,在一级分类(类别较少)中,该方法在两个区域均表现出优于U-Net的性能。个别类别的分类准确率高达99.17%。