• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

FIAEPI-KD:一种用于精确检测输电线路中缺失绝缘子的新型知识蒸馏方法。

FIAEPI-KD: A novel knowledge distillation approach for precise detection of missing insulators in transmission lines.

作者信息

Cui Hanzhi, Huang Dawei, Feng Wancheng, Li Zhengao, Ouyang Qiuxue, Zhong Conghan

机构信息

College of Computer Engineering, Qingdao City University, Qingdao, China.

School of Intelligent Equipment, Shandong University of Science and Technology, Tai'an, China.

出版信息

PLoS One. 2025 May 30;20(5):e0324524. doi: 10.1371/journal.pone.0324524. eCollection 2025.

DOI:10.1371/journal.pone.0324524
PMID:40445919
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12124544/
Abstract

Ensuring transmission line safety is crucial. Detecting insulator defects is a key task. UAV-based insulator detection faces challenges: complex backgrounds, scale variations, and high computational costs. To address these, we propose FIAEPI-KD, a knowledge distillation framework integrating Feature Indicator Attention (FIA) and Edge Preservation Index (EPI). The method employs ResNet and FPN for multi-scale feature extraction. The FIA module dynamically focuses on multi-scale insulator edges via dual-path attention mechanisms, suppressing background interference. The EPI module quantifies edge differences between teacher and student models through gradient-aware distillation. The training objective combines Euclidean distance, KL divergence, and FIA-EPI losses to align feature-space similarities and edge details, enabling multi-level knowledge distillation. Experiments demonstrate significant improvements on our custom dataset containing farmland and waterbody scenarios. The RetinaNet-ResNet18 student model achieves a 10.5% mAP improvement, rising from 42.7% to 53.2%. Meanwhile, the Faster R-CNN-ResNet18 model achieves a 7.4% mAP improvement, rising from 42.7% to 50.1%. Additionally, the RepPoints-ResNet18 model achieves a 7.7% mAP improvement, rising from 49.6% to 57.3%. These results validate the effectiveness of FIAEPI-KD in enhancing detection accuracy across diverse detector architectures and backbone networks. On the MSCOCO dataset, FIAEPI-KD outperformed mainstream distillation methods like FKD and PKD. Ablation studies confirmed FIA's role in feature focus and EPI's edge difference quantification. Using FIA alone increased RetinaNet-ResNet50's mAP by 0.9%. Combined FIA+EPI achieved a total 3.0% improvement, the method utilizes a lightweight student model for efficient deployment, providing an effective solution for detecting insulation defects in transmission lines.

摘要

确保输电线路安全至关重要。检测绝缘子缺陷是一项关键任务。基于无人机的绝缘子检测面临挑战:背景复杂、尺度变化和计算成本高。为解决这些问题,我们提出了FIAEPI-KD,这是一个集成了特征指标注意力(FIA)和边缘保留指数(EPI)的知识蒸馏框架。该方法采用ResNet和FPN进行多尺度特征提取。FIA模块通过双路径注意力机制动态聚焦于多尺度绝缘子边缘,抑制背景干扰。EPI模块通过梯度感知蒸馏量化教师模型和学生模型之间的边缘差异。训练目标结合了欧几里得距离、KL散度和FIA-EPI损失,以对齐特征空间相似度和边缘细节,实现多层次知识蒸馏。实验表明,在我们包含农田和水体场景的自定义数据集上有显著改进。RetinaNet-ResNet18学生模型的平均精度均值(mAP)提高了10.5%,从42.7%升至53.2%。同时,Faster R-CNN-ResNet18模型的mAP提高了7.4%,从42.7%升至50.1%。此外,RepPoints-ResNet18模型的mAP提高了7.7%,从49.6%升至57.3%。这些结果验证了FIAEPI-KD在提高不同检测器架构和骨干网络的检测精度方面的有效性。在MSCOCO数据集上,FIAEPI-KD优于FKD和PKD等主流蒸馏方法。消融研究证实了FIA在特征聚焦方面的作用以及EPI在边缘差异量化方面的作用。仅使用FIA可使RetinaNet-ResNet50的mAP提高0.9%。FIA+EPI组合总共实现了3.0%的提升,该方法使用轻量级学生模型进行高效部署,为检测输电线路中的绝缘缺陷提供了有效解决方案。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/31832f6a02a8/pone.0324524.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/d49d4d9884f1/pone.0324524.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/5f329f2ab754/pone.0324524.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/41f5c70453bb/pone.0324524.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/ed91dffdffa0/pone.0324524.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/2ab3bd2957e6/pone.0324524.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/9803d906e6b9/pone.0324524.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/31832f6a02a8/pone.0324524.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/d49d4d9884f1/pone.0324524.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/5f329f2ab754/pone.0324524.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/41f5c70453bb/pone.0324524.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/ed91dffdffa0/pone.0324524.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/2ab3bd2957e6/pone.0324524.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/9803d906e6b9/pone.0324524.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1033/12124544/31832f6a02a8/pone.0324524.g007.jpg

相似文献

1
FIAEPI-KD: A novel knowledge distillation approach for precise detection of missing insulators in transmission lines.FIAEPI-KD:一种用于精确检测输电线路中缺失绝缘子的新型知识蒸馏方法。
PLoS One. 2025 May 30;20(5):e0324524. doi: 10.1371/journal.pone.0324524. eCollection 2025.
2
Learning lightweight tea detector with reconstructed feature and dual distillation.基于重建特征和双重蒸馏的轻量化茶检测器学习。
Sci Rep. 2024 Oct 10;14(1):23669. doi: 10.1038/s41598-024-73674-4.
3
Cosine similarity-guided knowledge distillation for robust object detectors.用于鲁棒目标检测器的余弦相似度引导的知识蒸馏
Sci Rep. 2024 Aug 14;14(1):18888. doi: 10.1038/s41598-024-69813-6.
4
Inferior and Coordinate Distillation for Object Detectors.对象检测器的下推与坐标蒸馏。
Sensors (Basel). 2022 Jul 30;22(15):5719. doi: 10.3390/s22155719.
5
RFAG-YOLO: A Receptive Field Attention-Guided YOLO Network for Small-Object Detection in UAV Images.RFAG-YOLO:一种用于无人机图像中小目标检测的感受野注意力引导YOLO网络。
Sensors (Basel). 2025 Mar 30;25(7):2193. doi: 10.3390/s25072193.
6
Multiview attention networks for fine-grained watershed categorization via knowledge distillation.通过知识蒸馏实现细粒度流域分类的多视图注意力网络
PLoS One. 2025 Jan 16;20(1):e0313115. doi: 10.1371/journal.pone.0313115. eCollection 2025.
7
Feature distance-weighted adaptive decoupled knowledge distillation for medical image segmentation.用于医学图像分割的特征距离加权自适应解耦知识蒸馏
Int J Comput Assist Radiol Surg. 2025 Apr 22. doi: 10.1007/s11548-025-03346-9.
8
Cross-View Gait Recognition Method Based on Multi-Teacher Joint Knowledge Distillation.基于多教师联合知识蒸馏的跨视角步态识别方法
Sensors (Basel). 2023 Nov 20;23(22):9289. doi: 10.3390/s23229289.
9
Mitigating carbon footprint for knowledge distillation based deep learning model compression.减轻基于知识蒸馏的深度学习模型压缩的碳足迹。
PLoS One. 2023 May 15;18(5):e0285668. doi: 10.1371/journal.pone.0285668. eCollection 2023.
10
Cross-domain visual prompting with spatial proximity knowledge distillation for histological image classification.基于空间邻近度知识蒸馏的跨领域视觉提示在组织学图像分类中的应用。
J Biomed Inform. 2024 Oct;158:104728. doi: 10.1016/j.jbi.2024.104728. Epub 2024 Sep 21.

本文引用的文献

1
Extreme R-CNN: Few-Shot Object Detection via Sample Synthesis and Knowledge Distillation.极端区域卷积神经网络:通过样本合成与知识蒸馏实现少样本目标检测
Sensors (Basel). 2024 Dec 7;24(23):7833. doi: 10.3390/s24237833.
2
Research on a Cross-Domain Few-Shot Adaptive Classification Algorithm Based on Knowledge Distillation Technology.基于知识蒸馏技术的跨域少样本自适应分类算法研究
Sensors (Basel). 2024 Mar 18;24(6):1939. doi: 10.3390/s24061939.
3
Efficient Cross-Modality Insulator Augmentation for Multi-Domain Insulator Defect Detection in UAV Images.
用于无人机图像中多域绝缘子缺陷检测的高效跨模态绝缘子增强技术
Sensors (Basel). 2024 Jan 10;24(2):428. doi: 10.3390/s24020428.
4
Multilayer Semantic Features Adaptive Distillation for Object Detectors.用于目标检测器的多层语义特征自适应蒸馏
Sensors (Basel). 2023 Sep 2;23(17):7613. doi: 10.3390/s23177613.
5
Structured Knowledge Distillation for Accurate and Efficient Object Detection.用于精确高效目标检测的结构化知识蒸馏
IEEE Trans Pattern Anal Mach Intell. 2023 Dec;45(12):15706-15724. doi: 10.1109/TPAMI.2023.3300470. Epub 2023 Nov 3.
6
Detection of Power Line Insulators in Digital Images Based on the Transformed Colour Intensity Profiles.基于变换颜色强度分布的数字图像中电力线绝缘子的检测。
Sensors (Basel). 2023 Mar 22;23(6):3343. doi: 10.3390/s23063343.
7
Dynamic Knowledge Distillation with Noise Elimination for RGB-D Salient Object Detection.基于噪声消除的动态知识蒸馏的 RGB-D 显著目标检测。
Sensors (Basel). 2022 Aug 18;22(16):6188. doi: 10.3390/s22166188.
8
Multi-Geometric Reasoning Network for Insulator Defect Detection of Electric Transmission Lines.多几何推理网络在输电线路绝缘子缺陷检测中的应用。
Sensors (Basel). 2022 Aug 15;22(16):6102. doi: 10.3390/s22166102.
9
An Improved CenterNet Model for Insulator Defect Detection Using Aerial Imagery.基于航空图像的绝缘子缺陷检测的改进 CenterNet 模型。
Sensors (Basel). 2022 Apr 8;22(8):2850. doi: 10.3390/s22082850.
10
Semantic Segmentation Using Pixel-Wise Adaptive Label Smoothing via Self-Knowledge Distillation for Limited Labeling Data.基于自知识蒸馏的像素级自适应标签平滑的有限标注数据语义分割。
Sensors (Basel). 2022 Mar 29;22(7):2623. doi: 10.3390/s22072623.