Computer Science ›› 2023, Vol. 50 ›› Issue (6A): 220200096-7.doi: 10.11896/jsjkx.220200096

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion

WU Liuchen1, ZHANG Hui2, LIU Jiaxuan1, ZHAO Chenyang1   

  1. 1 School of Electrical & Information Engineering,Changsha University of Science & Technology,Changsha 410000,China;
    2 School of Robotics,Hunan University,Changsha 410000,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:WU Liuchen,born in 1996,B.S degree,master.His main research interests include image processing,deep learning and so on. ZHANG Hui,born in 1963,Ph.D,professor.His main research interests include machine vision and sparse representation.
  • Supported by:
    Major Research Plan of the National Natural Science Foundation of China(92148204),National Key R&D Program of China(2018YFB1308200),National Natural Science Foundation of China(61971071,62027810,62133005),Hunan Science Fund for Distinguished Young Scholars(2021JJ10025),Hunan Key Research and Development Program(2021GK4011,2022GK2011),Changsha Science and Technology Major Project(kh2003026),Joint Open Foundation of State Key Laboratory of Robotics(2021-KF-22-17) and China University Industry-University-research Innovation Fund(2020HYA06006).

Abstract: Bolts play a role in fixing the connection between lines in transmission lines.Once loose or detached,it may cause po-wer transmission failures and cause large-scale power outages.Obviously,regular inspection of bolts in transmission lines is essential to ensure the safety and stability of the entire power system.Most of the existing detection methods are based on deep convolutional neural networks.However,the unobvious features and small size of the bolts pose a challenge to the detection work.Aiming at the above problems,this paper proposes a bolt defect detection method for transmission lines based on region attention mechanism and multi-scale feature fusion.Firstly,a region attention module suitable for object detection is proposed,which is embedded in the residual block of ResNet50 to enhance the network’s feature extraction for bolts.Secondly,based on the feature pyramid networks(FPN),a bottom-up path is extended,and shallow features are fully utilized to improve the detection accuracy of small objects.Finally,in order to alleviate the imbalance between samples,the PrIme Sample Attention(PISA) soft sample sampling strategy is introduced.Experimental results show that the proposed method achieves a mean average precision(mAP) of 74.3% and an average recall(AR) of 86.4% with a detection speed of 8.2 FPS when detecting transmission line bolts.Compared with other detection networks,the proposed method improves the detection accuracy of bolt defects without sacrificing too much detection speed.

Key words: Transmission line bolts, Small object detection, Attention mechanism, Multi-scale feature fusion, Sampling strategy

CLC Number: 

  • TM933
[1]SHAO G W,LIU Z,FU J,et al.Research progress in unmanned aerial vehicle inspection technology on overhead transmission lines[J].High Voltage Engineering,2020,46(1):14-22.
[2]WU L Y,BI J G,CHANG W Z,et al.Research of UnmannedAerial Vehicle Comprehensive Inspection for Distribution Network Overhead Transmission Lines[J].Electric Power,2018,51(1):6.
[3]SUIY,NING P F,NIU P J.Review on mounted UAV for transmission line inspection[J].Power System Technology,2020,45(9):3636-3648.
[4]GUC Y,LI Z,SHI J T,et al.Detection for Pin Defects of Overhead Lines by UAV Patrol Image Based on Improved Faster-RCNN[J].High Voltage Engineering,2020,46(9):3089-3096.
[5]VIOLA P,JONES M J.Robust real-time face detection[J].International Journal of Computer Vision,2004,57(2):137-154.
[6]DALAL N,TRIGGS B.Histograms of oriented gradients forhuman detection[C]//2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR’05).IEEE,2005:886-893.
[7]FFELZENSZWALB P,GIRSHICK R B,MCALLESTER D,et al.Object detection with discriminatively trained part-based models[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2009,32(9):1627-1645.
[8]CAO Y,CHEN K,LOY C C,et al.Prime sample attention inobject detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:11583-11591.
[9]HUANG X B,ZHANG X L,ZHANG Y,et al.A method ofidentifying rust status of dampers based on image processing[J].IEEE Transactions on Instrumentation and Measurement,2020,69(8):5407-5417.
[10]ZHAO Z B,LIU N,WANG L.Localization of multiple insulators by orientation angle detection and binary shape prior knowledge[J].IEEE Transactions on Dielectrics and Electrical Insulation,2015,22(6):3421-3428.
[11]TAO X,ZHANG D P,WANG Z H,et al.Detection of powerline insulator defects using aerial images analyzed with convolutional neural networks[J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2018,50(4):1486-1498.
[12]ZHAOZ B,CUI Y P,QI Y C,et al.Detection method of insulator in aerial inspection image based on modified R-FCN[J].Computer Science,2019,46(3):159-163.
[13]LI F G,YILIHAMU Y,et al.Real-time Detection Model of Insulator Defect Based on Improved CenterNet[J].Computer Science,2022,49(5):84-91.
[14]Xinren M,Zhicheng L,Hao J,et al.Fault Detection of Power Tower Anti-bird Spurs Based on Deep Convolutional Neural Network[J].Power System Technology,2021,45(1):126-133.
[15]LUO Y T,JIANG PF,DUAN C,et al.Small Object Detection Oriented Improved-RetinaNet Model and Its Application[J].Power System Technology,2021,48(10):233-238.
[16]LIANG X,ZHANG J,ZHUO L,et al.Small object detection in unmanned aerial vehicle images using feature fusion and scaling-based single shot detector with spatial context analysis[J].IEEE Transactions on Circuits and Systems for Video Technology,2019,30(6):1758-1770.
[17]ZHAO Z B,QI H Y,QI Y C,et al.Detection method based on automatic visual shape clustering for pin-missing defect in transmission lines[J].IEEE Transactions on Instrumentation and Measurement,2020,69(9):6080-6091.
[18]LI X F,LIU H Y,LIU G H,et al.Transmission Line Pin Defect Detection Based on Deep Learning[J].Power System Technology,2021,45(8):8.
[19]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:7132-7141.
[20]WOO S,PARK J,LEE J Y,et al.Cbam:Convolutional block attention module[C]//Proceedings of the European conference on computer vision(ECCV).2018:3-19.
[21]WANG X L,GIRSHICK R,GUPTA A,et al.Nonlocal neural networks[C]//Proceedings of the IEEE Conference on Compu-ter Vision and Pattern Recognition.2018:7794-7803.
[22]FU J,LIU J,TIAN H J,et al.Dual attention network for scene segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:3146-3154.
[23]YIN M H,YAO Z L,CAO Y,et al.Disentangled non-local neural networks[C]//European Conference on Computer Vision.Springer,2020:191-207.
[24]LIN T Y,DOLLÁR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2117-2125.
[25]LIN T Y,GOYAL P,GIRSHICK R,et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2980-2988.
[26]LI Y,CHEN Y,WANG N,et al.Scale-aware trident networks for object detection[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:6054-6063.
[1] WANG Jiahao, ZHONG Xin, LI Wenxiong, ZHAO Dexin. Human Activity Recognition with Meta-learning and Attention [J]. Computer Science, 2023, 50(8): 193-201.
[2] WANG Yu, WANG Zuchao, PAN Rui. Survey of DGA Domain Name Detection Based on Character Feature [J]. Computer Science, 2023, 50(8): 251-259.
[3] ZHANG Yian, YANG Ying, REN Gang, WANG Gang. Study on Multimodal Online Reviews Helpfulness Prediction Based on Attention Mechanism [J]. Computer Science, 2023, 50(8): 37-44.
[4] TENG Sihang, WANG Lie, LI Ya. Non-autoregressive Transformer Chinese Speech Recognition Incorporating Pronunciation- Character Representation Conversion [J]. Computer Science, 2023, 50(8): 111-117.
[5] YAN Mingqiang, YU Pengfei, LI Haiyan, LI Hongsong. Arbitrary Image Style Transfer with Consistent Semantic Style [J]. Computer Science, 2023, 50(7): 129-136.
[6] ZHANG Shunyao, LI Huawang, ZHANG Yonghe, WANG Xinyu, DING Guopeng. Image Retrieval Based on Independent Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220300092-6.
[7] LIU Haowei, YAO Jingchi, LIU Bo, BI Xiuli, XIAO Bin. Two-stage Method for Restoration of Heritage Images Based on Muti-scale Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220600129-8.
[8] LI Fan, JIA Dongli, YAO Yumin, TU Jun. Graph Neural Network Few Shot Image Classification Network Based on Residual and Self-attention Mechanism [J]. Computer Science, 2023, 50(6A): 220500104-5.
[9] SUN Kaiwei, WANG Zhihao, LIU Hu, RAN Xue. Maximum Overlap Single Target Tracking Algorithm Based on Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220400023-5.
[10] ZHANG Shuaiyu, PENG Li, DAI Feifei. Person Re-identification Method Based on Progressive Attention Pyramid [J]. Computer Science, 2023, 50(6A): 220200084-8.
[11] LUO Huilan, LONG Jun, LIANG Miaomiao. Attentional Feature Fusion Approach for Siamese Network Based Object Tracking [J]. Computer Science, 2023, 50(6A): 220300237-9.
[12] DOU Zhi, HU Chenguang, LIANG Jingyi, ZHENG Liming, LIU Guoqi. Lightweight Target Detection Algorithm Based on Improved Yolov4-tiny [J]. Computer Science, 2023, 50(6A): 220700006-7.
[13] ZENG Zehua, LUO Huilan. Cross-dataset Learning Combining Multi-object Tracking and Human Pose Estimation [J]. Computer Science, 2023, 50(6A): 220400199-7.
[14] DAI Tianhong, SONG Jieqi. Multimodal MRI Brain Tumor Segmentation Based on Multi-encoder Architecture [J]. Computer Science, 2023, 50(6A): 220200108-6.
[15] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!