Key Laboratory of Spectral Imaging Technology of Chinese Academy of Sciences, Xi'an Institute of Optics and Precision Mechanics of CAS, Xi'an, 710119, China.
University of Chinese Academy of Sciences, Beijing, 100049, China.
Sci Rep. 2022 Jan 10;12(1):320. doi: 10.1038/s41598-021-03880-x.
Developing an efficient and quality remote sensing (RS) technology using volume and efficient modelling in different aircraft RS images is challenging. Generative models serve as a natural and convenient simulation method. Because aircraft types belong to the fine class under the rough class, the issue of feature entanglement may occur while modelling multiple aircraft classes. Our solution to this issue was a novel first-generation realistic aircraft type simulation system (ATSS-1) based on the RS images. It realised fine modelling of the seven aircraft types based on a real scene by establishing an adaptive weighted conditional attention generative adversarial network and joint geospatial embedding (GE) network. An adaptive weighted conditional batch normalisation attention block solved the subclass entanglement by reassigning the intra-class-wise characteristic responses. Subsequently, an asymmetric residual self-attention module was developed by establishing a remote region asymmetric relationship for mining the finer potential spatial representation. The mapping relationship between the input RS scene and the potential space of the generated samples was explored through the GE network construction that used the selected prior distribution z, as an intermediate representation. A public RS dataset (OPT-Aircraft_V1.0) and two public datasets (MNIST and Fashion-MNIST) were used for simulation model testing. The results demonstrated the effectiveness of ATSS-1, promoting further development of realistic automatic RS simulation.
开发一种高效、高质量的遥感(RS)技术,在不同的飞机 RS 图像中使用体积和高效建模,具有挑战性。生成模型是一种自然和方便的模拟方法。由于飞机类型属于粗糙类别下的精细类别,因此在对多个飞机类别进行建模时,可能会出现特征纠缠的问题。我们的解决方案是基于 RS 图像的新一代真实飞机类型模拟系统(ATSS-1)。它通过建立自适应加权条件注意力生成对抗网络和联合地理空间嵌入(GE)网络,实现了基于真实场景的七种飞机类型的精细建模。自适应加权条件批量归一化注意块通过重新分配类内特征响应来解决子类纠缠问题。随后,通过建立远程区域不对称关系来挖掘更精细的潜在空间表示,开发了非对称残差自注意模块。通过使用选定的先验分布 z 作为中间表示来构建 GE 网络,探索输入 RS 场景和生成样本潜在空间之间的映射关系。使用公共 RS 数据集(OPT-Aircraft_V1.0)和两个公共数据集(MNIST 和 Fashion-MNIST)对模拟模型进行了测试。结果表明,ATSS-1 是有效的,促进了逼真的自动 RS 模拟的进一步发展。