Suppr超能文献

基于知识推理与渐进式蒸馏的电气施工违规行为检测

Knowledge Reasoning- and Progressive Distillation-Integrated Detection of Electrical Construction Violations.

作者信息

Ma Bin, Liang Gang, Rao Yufei, Guo Wei, Zheng Wenjie, Wang Qianming

机构信息

State Grid Henan Electric Power Company Electric Power Science Research Institute, Zhengzhou 450052, China.

State Grid Henan Electric Power Company, Zhengzhou 450052, China.

出版信息

Sensors (Basel). 2024 Dec 23;24(24):8216. doi: 10.3390/s24248216.

Abstract

To address the difficulty in detecting workers' violation behaviors in electric power construction scenarios, this paper proposes an innovative method that integrates knowledge reasoning and progressive multi-level distillation techniques. First, standards, norms, and guidelines in the field of electric power construction are collected to build a comprehensive knowledge graph, aiming to provide accurate knowledge representation and normative analysis. Then, the knowledge graph is combined with the object-detection model in the form of triplets, where detected objects and their interactions are represented as subject-predicate-object relationship. These triplets are embedded into the model using an adaptive connection network, which dynamically weights the relevance of external knowledge to enhance detection accuracy. Furthermore, to enhance the model's performance, the paper designs a progressive multi-level distillation strategy. On one hand, knowledge transfer is conducted at the object level, region level, and global level, significantly reducing the loss of contextual information during distillation. On the other hand, two teacher models of different scales are introduced, employing a two-stage distillation strategy where the advanced teacher guides the primary teacher in the first stage, and the primary teacher subsequently distills this knowledge to the student model in the second stage, effectively bridging the scale differences between the teacher and student models. Experimental results demonstrate that under the proposed method, the model size is reduced from 14.5 MB to 3.8 MB, and the floating-point operations (FLOPs) are reduced from 15.8 GFLOPs to 5.9 GFLOPs. Despite these optimizations, the AP50 reaches 92.4%, showing a 1.8% improvement compared to the original model. These results highlight the method's effectiveness in accurately detecting workers' violation behaviors, providing a quantitative basis for its superiority and offering a novel approach for safety management and monitoring at construction sites.

摘要

为了解决电力建设场景中检测工人违规行为的困难,本文提出了一种创新方法,该方法集成了知识推理和渐进式多级蒸馏技术。首先,收集电力建设领域的标准、规范和指南,构建一个全面的知识图谱,旨在提供准确的知识表示和规范性分析。然后,知识图谱以三元组的形式与目标检测模型相结合,其中检测到的对象及其相互作用表示为主谓宾关系。这些三元组通过自适应连接网络嵌入到模型中,该网络动态加权外部知识的相关性以提高检测精度。此外,为了提高模型的性能,本文设计了一种渐进式多级蒸馏策略。一方面,在对象级别、区域级别和全局级别进行知识转移,显著减少蒸馏过程中上下文信息的损失。另一方面,引入两个不同规模的教师模型,采用两阶段蒸馏策略,其中先进的教师模型在第一阶段指导初级教师模型,初级教师模型随后在第二阶段将这些知识蒸馏到学生模型中,有效弥合教师模型和学生模型之间的规模差异。实验结果表明,在所提出的方法下,模型大小从14.5MB减少到3.8MB,浮点运算次数(FLOPs)从15.8 GFLOPs减少到5.9 GFLOPs。尽管进行了这些优化,AP50仍达到92.4%,与原始模型相比提高了1.8%。这些结果突出了该方法在准确检测工人违规行为方面的有效性,为其优越性提供了定量依据,并为建筑工地的安全管理和监测提供了一种新方法。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3847/11679740/a553615b6869/sensors-24-08216-g001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验