Computer Science ›› 2025, Vol. 52 ›› Issue (6): 286-296.doi: 10.11896/jsjkx.240300146

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Few-shot Insulator Defect Detection Based on Local and Global Feature Representation

CUI Kebin1,2, HU Zhenzhen1   

  1. 1 Department of Computer,North China Electric Power University,Baoding,Hebei 071003,China
    2 Engineering Research Center of Intelligent Computing for Complex Energy Systems,Ministry of Education,Baoding,Hebei 071003,China
  • Received:2024-03-20 Revised:2024-07-05 Online:2025-06-15 Published:2025-06-11
  • About author:CUI Kebin,born in 1979,Ph.D,professor.His main research interests include image processing,pattern recognition and machine learning.
    HU Zhenzhen,born in 2000,postgra-duate.Her main research interests include object detection and few-shot learning.
  • Supported by:
    State Grid Corporation of China Headquarters Management Science and Technology Project(5700-202340289A-1-1-ZN).

Abstract: In order to solve the problem that the small number of insulator defect samples and small defect targets lead to the current low accuracy of insulator defect detection,this paper proposes a few-shot object detection model(C-TFSIDD) combining CNN and Transformer,which fuses local and global features of images to realize insulator defect detection more effectively.Firstly,Next-ViT,which integratesthe local detail capture capability of CNN and the global information integration capability of Transformer,is used as the feature extraction module to accurately capture local and global feature information of insulator images.Secondly,the improved path aggregation feature pyramid network(PAFPN) is used for bidirectional multi-scale feature fusion to enhance the underlying feature representation and improve the detection effect of small targets.Finally,a metric-based discriminative loss is proposed to optimize the classifier in the fine-tuning stage to learn more discriminative feature representations to increase the separability between classes and reduce the effect of intra-class variations.Trained and evaluated on two public insulator defect datasets,the experimental results show that C-TFSIDD improves the detection results with samples of 5shot,10shot,and 20shot by 28.7%,35.5%,and 47.7%,respectively,compared to the baseline model TFA,and compared with the few-shot object detection model FSCE,the proposed method improved by 21.8%,26.7%,and 21.1%,respectively.The results show that C-TFSIDD can effectively improve the defect detection accuracy of few-shot insulator samples.

Key words: Defect detection, Insulator, Few-shot, CNN-Transformer, Metric learning

CLC Number: 

  • TP391
[1]LIU C Y,WU Y Q.Research Progress of Vision DetectionMethods Based on Deep Learning for Transmission Lines[J].Proceedings of the CSEE,2023,43(19):7423-7446.
[2]ZHAO Z B,JIANG Z G,LI Y X,et al.Overview of visual defect detection of transmission line components[J].Journal of Image and Graphics,2021,26(11):2545-2560.
[3]LIU Y,HUANG X.Efficient Cross-Modality Insulator Aug-mentation for Multi-Domain Insulator Defect Detection in UAV Images[J].Sensors,2024,24(2):428.
[4]MA B,FU Y K,WANG C P,et al.High Performance lnsulators Location Scheme Based on YOLOv4 with GDloU Loss Function[J].Computer Science,2022,49(S1):412-417.
[5]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:779-788.
[6]ZHAO W Q,CHENG X F,ZHAO Z B,et al.Insulator recognition based on attention mechanism and Faster RCNN[J].CAAI Transactions on Intelligent Systems,2020,15(1):92-98.
[7]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards real-time object detection with region proposal networks[C]//Proceedings of the 29th International Conference on Neural Information Processing Systems.Cambridge.MA:MIT,2015:91-99.
[8]LIU J H,ZHAO Z,FU J R,et al.Active small sample learning based the pipe weld defect detection method[J].Chinese Journal of Scientific Instrument,2022,43(11):252-261.
[9]ZHAO Z F,HUANG J H,LUO H J,et al.Simulation Research on Ultrasonic Total Focus Method Detection of Internal Defects of Composite Insulators[J].Piezoelectrics and Acoustooptics,2024,46(1):136-142.
[10]WANG X,HUANG T E,DARRELL T,et al.Frustratingly simplefew-shot object detection[J].arXiv:2003.06957,2020.
[11]LI J,XIA X,LI W,et al.Next-vit:Next generation vision transformer for efficient deployment in realistic industrial scenarios[J].arXiv:2207.05501,2022.
[12]LIU S,QI L,QIN H,et al.Path aggregation network for instance segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:8759-8768.
[13]ZHANG T,ZHANG X,ZHU P,et al.Generalized few-shot object detection in remote sensing images[J].ISPRS Journal of Photogrammetry and Remote Sensing,2023,195:353-364.
[14]KÖHLER M,EISENBACH M,GROSS H M.Few-shot object detection:A comprehensive survey[J].arXiv:2112.11699,2021.
[15]SHI Y D,WANG H M,JING C,et al.A Few-Shot Defect Detection Method for Transmission Lines Based on Meta-Attention and Feature Reconstruction[J].Applied Sciences,2023,13(10):5896.
[16]ZHAI Y J,YANG K,WANG Q M,et al.Disc Insulator Defect Detection Based on Mixed Sample Transfer Learning[J].Proceedings of the CSEE,2023,43(7):2867-2877.
[17]CUI K B,PAN F.A CycleGAN small sample library amplification method for faulty insulator detection[J].Computer Engineering & Science,2022,44(3):509-515.
[18]KARLINSKY L,SHTOK J,HARARY S,et al.Repmet:Representative-based metric learning for classification and few-shot object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:5197-5206.
[19]EVERINGHAM M,VAN GOOL L,WILLIAMS C K I,et al.The pascal visual object classes(VOC) challenge[J].International Journal of Computer Vision,2010,88:303-338.
[20]LIU K P,LI B Q,QIN L,et al.Review of Application Research of Deep Learning Object Detection Algorithms in Insulator Defect Detection of Overhead Transmission Lines[J].High Vol-tage Engineering,2023,49(9):3584-3595.
[21]ZHOU L J,MAO J N.Vision Transformer-based recognitiontasks:a critical review[J].Journal of Image and Graphics,2023,28(10):2969-3003.
[22]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C]//Proceedings of the 31st International Confe-rence on Neural Information Processing Systems.Red Hook,NY:Curran Associates Inc.,2017:6000-6010.
[23]XI Y,ZHOU K,MENG L W,et al.Transmission Line Insulator Defect Detection Based on Swin Transformer and Context[J].Machine Intelligence Research,2023,20:729-740.
[24]GUO J,LI T,DU B.Segmentation Head Networks with Har-nessing Self-Attention and Transformer for Insulator Surface Defect Detection[J].Applied Sciences,2023,13(16):9109.
[25]DU Z W,ZHOU H,LI C Y,et al.Small Object Detection Based on Deep Convolutional Neural Networks:A Review[J].Computer Science,2022,49(12):205-218.
[26]ZHAO Y,YANG L.Distance metric learning based on the class center and nearest neighbor relationship[J].Neural Networks,2023,164:631-644.
[27]LIN T Y,GOYAL P,GIRSHICK R,et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2980-2988.
[28]RAIMUNDO A.Insulator data set-Chinese power line insulator dataset(CPLID)[DB/OL].https://github.com/InsulatorData/InsulatorDataSet.
[29]DENG J H,GUO W Q,CHEN H J,et al.Few-shot diatom detection combining multi-scale multi-head self-attention and online hard example mining[J].Journal of Computer Applications,2022,42(8):2593-2600.
[30]SUN B,LI B,CAI S,et al.FSCE:Few-shot object detection via contrastive proposal encoding[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE,2021:7352-7362.
[31]XIAO Y,LEPETIT V,MARLET R.Few-shot object detection and viewpoint estimation for objects in the wild[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,45(3):3090-3106.
[32]YAN X,CHEN Z,XU A,et al.Meta R-CNN:Towards general solver for instance-level low-shot learning[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:9577-9586.
[33]WU J,LIU S,HUANG D,et al.Multi-scale positive sample refinement for few-shot object detection[M]//Lecture Notes in Computer Science.Cham:Springer,2020:456-472.
[34]PANG J,CHEN K,SHI J,et al.Libra R-CNN:Towards ba-lanced learning for object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:821-830.
[1] WANG Rui, TANG Zhanjun. Multi-feature Fusion and Ensemble Learning-based Wind Turbine Blade Defect Detection Method [J]. Computer Science, 2025, 52(6A): 240900138-8.
[2] DING Xuxing, ZHOU Xueding, QIAN Qiang, REN Yueyue, FENG Youhong. High-precision and Real-time Detection Algorithm for Photovoltaic Glass Edge Defects Based onFeature Reuse and Cheap Operation [J]. Computer Science, 2025, 52(6A): 240400146-10.
[3] CHEN Yadang, GAO Yuxuan, LU Chuhan, CHE Xun. Saliency Mask Mixup for Few-shot Image Classification [J]. Computer Science, 2025, 52(6): 256-263.
[4] LUO Hangyu, WANG Xiaoping, MEI Meng, ZHAO Wenhao, LIU Sichun. Contrastive Representation Learning for Industrial Defect Detection [J]. Computer Science, 2025, 52(1): 210-220.
[5] WANG Jiahui, PENG Guangling, DUAN Liang, YUAN Guowu, YUE Kun. Few-shot Shadow Removal Method for Text Recognition [J]. Computer Science, 2024, 51(9): 147-154.
[6] HE Zhilin, GU Tianhao, XU Guanhua. Few-shot Semi-supervised Semantic Image Translation Algorithm Based on Prototype Correction [J]. Computer Science, 2024, 51(8): 224-231.
[7] TANG Ruiqi, XIAO Ting, CHI Ziqiu, WANG Zhe. Few-shot Image Classification Based on Pseudo-label Dependence Enhancement and NoiseInterferenceReduction [J]. Computer Science, 2024, 51(8): 152-159.
[8] ZHANG Rui, WANG Ziqi, LI Yang, WANG Jiabao, CHEN Yao. Task-aware Few-shot SAR Image Classification Method Based on Multi-scale Attention Mechanism [J]. Computer Science, 2024, 51(8): 160-167.
[9] WANG Jinghong, TIAN Changshen, LI Haokang, WANG Wei. Lagrangian Dual-based Privacy Protection and Fairness Constrained Method for Few-shot Learning [J]. Computer Science, 2024, 51(7): 405-412.
[10] SONG Zhen, WANG Jiqiang, HOU Moyu, ZHAO Lin. Conveyor Belt Defect Detection Network Combining Attention Mechanism with Line Laser Assistance [J]. Computer Science, 2024, 51(6A): 230800115-6.
[11] LANG Lang, CHEN Xiaoqin, LIU Sha, ZHOU Qiang. Detection of Pitting Defects on the Surface of Ball Screw Drive Based on Improved Deeplabv3+ Algorithm [J]. Computer Science, 2024, 51(6A): 240200058-6.
[12] YIN Xudong, CHEN Junyang, ZHOU Bo. Study on Industrial Defect Augmentation Data Filtering Based on OOD Scores [J]. Computer Science, 2024, 51(6A): 230700111-7.
[13] DAI Yongdong, JIN Yang, DAI Yufan, FU Jing, WANG Maofei, LIU Xi. Study on Intelligent Defect Recognition Algorithm of Aerial Insulator Image [J]. Computer Science, 2024, 51(6A): 230700172-5.
[14] HUANG Haixin, WU Di. Steel Defect Detection Based on Improved YOLOv7 [J]. Computer Science, 2024, 51(6A): 230800018-5.
[15] WU Chunming, WANG Tiaojun. Study on Defect Detection Algorithm of Transmission Line in Complex Background [J]. Computer Science, 2024, 51(6A): 230500178-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!