Zhu Zhenyue, Lyu Shujing, Lu Yue
Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China.
J Xray Sci Technol. 2021;29(3):397-409. doi: 10.3233/XST-210846.
With the rapid development of deep learning, several neural network models have been proposed for automatic segmentation of prohibited items. These methods usually based on a substantial amount of labelled training data. However, for some prohibited items of rarely appearing, it is difficult to obtain enough labelled samples. Furthermore, the category of prohibited items varies in different scenarios and security levels, and new items may appear from time to time.
In order to predict prohibited items with only a few annotated samples and inspect prohibited items of new categories without the requirement of retraining, we introduce an Attention-Based Graph Matching Network.
This model applies a few-shot semantic segmentation network to address the issue of prohibited item inspection. First, a pair of graphs are modelled between a query image and several support images. Then, after the pair of graphs are entered into two Graph Attention Units with similarity weights and equal weights, the attentive matching results will be obtained. According to the matching results, the prohibited items can be segmented from the query image.
Experiment results and comparison using the Xray-PI dataset and SIXray dataset show that our model outperforms several other state-of-the-art learning models.
This study demonstrates that the similarity loss function and the space restriction module proposed by our model can effectively remove noise and supplement spatial information, which makes the segmentation of the prohibited items on X-ray images more accurate.
随着深度学习的快速发展,已经提出了几种神经网络模型用于违禁物品的自动分割。这些方法通常基于大量带标注的训练数据。然而,对于一些很少出现的违禁物品,很难获得足够的带标注样本。此外,违禁物品的类别在不同场景和安全级别中有所不同,并且新的物品可能会不时出现。
为了仅用少量标注样本预测违禁物品,并在无需重新训练的情况下检测新类别的违禁物品,我们引入了一种基于注意力的图匹配网络。
该模型应用少样本语义分割网络来解决违禁物品检测问题。首先,在查询图像和几个支持图像之间构建一对图。然后,将这对图输入到两个具有相似性权重和相等权重的图注意力单元中,将获得注意力匹配结果。根据匹配结果,可以从查询图像中分割出违禁物品。
使用Xray-PI数据集和SIXray数据集进行的实验结果和比较表明,我们的模型优于其他几种先进的学习模型。
本研究表明,我们模型提出的相似性损失函数和空间限制模块可以有效地去除噪声并补充空间信息,这使得X射线图像上违禁物品的分割更加准确。