Computer Science ›› 2024, Vol. 51 ›› Issue (3): 135-140.doi: 10.11896/jsjkx.230600109

• Database & Big Data & Data Science • Previous Articles     Next Articles

Deep Neural Network Model for Transmission Line Defect Detection Based on Dual-branch Sequential Mixed Attention

HAO Ran, WANG Hongjun, LI Tianrui   

  1. School of Computing and Artificial Intelligence,Southwest Jiaotong University,Chengdu 611756,China
    Engineering Research Center of Sustainable Urban Intelligent Transportation,Ministry of Education,Chengdu 611756,China
  • Received:2023-06-13 Revised:2023-10-04 Online:2024-03-15 Published:2024-03-13
  • About author:HAO Ran,born in 1999,postgraduate.His main research interests include deep learning and defect detection.WANG Hongjun,born in 1977,Ph.D,associate researcher,Ph.D supervisor,is a senior member of CCF(No.19036S).His main research interests include artificial intelligence,machine learning,and data mining.
  • Supported by:
    National Natural Science Foundation of China(62176221,62276216).

Abstract: Detecting defects in transmission lines and repairing them in a timely manner is of great practical significance for ensuring the safety and stability of the power grid.However,due to the complex background and small component size of transmission line images,existing object detection models cannot achieve satisfactory results.Therefore,this paper proposes a deep neural network model for detecting defects in transmission lines based on dual-branch serial attention.The model designs dual-branch serial attention(DBSA) to allow the model to focus more weight on the defects,and proposes well-connected feature pyramid network(WCFPN) to enable full fusion of the features extracted by DBSA,thereby improving the model's ability to detect small targets.DBSA compresses the feature map along the height and width branches and extracts attention using one-dimensional convolution to achieve fine-grained control over the features.WCFPN designs a new fusion path that includes cross-scale fusion and skip-layer connections,allowing high-level semantic information and low-level spatial information extracted by DBSA to interact more fully.Finally,experiments are conducted on five transmission line datasets,including insulator explosion,damaged anti-vibration hammer,bird's nest debris,broken cementpole and transmission line defect,and the proposed model achieves the best detection performance.The average AP50and AP of the five datasets is 84.3% and 46.1%,respectively,which is 3.7% and 3% higher than that of the state-of-the-art model YOLOv7.

Key words: Power defect, Object detection, Attention mechanism, Feature pyramid network

CLC Number: 

  • TP391
[1]ZHAO Z,QI H,QI Y,et al.Detection method based on auto-matic visual shape clustering for pin-missing defect in transmission lines[J].IEEE Transactions on Instrumentation and Mea-surement,2020,69(9):6080-6091.
[2]ZHANG X,ZHANG Y,LIU J,et al.InsuDet:A fault detection method for insulators of overhead transmission lines using con-volutional neural networks[J].IEEE Transactions on Instrumentation and Measurement,2021,70:1-12.
[3]LV F C,NIU L L,WANG S H,et al.Intelligent detection and parameter adjustment strategy of major electrical equipment based on optimized YOLOv4[J].Transactions of China Electrotechnical Society,2021,36(22):4837-4848.
[4]LIU M,LI Z,LI Y,et al.A fast and accurate method of power line intelligent inspection based on edge computing[J].IEEE Transactions on Instrumentation and Measurement,2022,71:1-12.
[5]LIU W,ANGUELOV D,ERHAN D,et al.Ssd:Single Shot Multibox Detector[C]//Computer Vision--ECCV 2016:14th European Conference.Springer International Publishing,2016:21-37.
[6]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:779-788.
[7]BOCHKOVSKIY A,WANG C Y,LIAO H Y M.Yolov4:Optimal speed and accuracy of object detection[J].arXiv:2004.10934,2020.
[8]REN S,HE K,GIRSHICK R,et al.Faster r-cnn:Towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
[9]HE K,GKIOXARI G,DOLLÁR P,et al.Mask r-cnn[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2961-2969.
[10]GLENN J.YOLOv5 release v6.1.[OL]https://github.com/ultralytics/yolov5/releases/tag/v6.1,2022.2,7,10.
[11]WANG C Y,BOCHKOVSKIY A,LIAO H Y M.YOLOv7:Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[J].arXiv:2207.02696,2022.
[12]NIU Z,ZHONG G,YU H.A review on the attention mechanism of deep learning[J].Neurocomputing,2021,452:48-62.
[13]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:7132-7141.
[14]WOO S,PARK J,LEE J Y,et al.Cbam:Convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision(ECCV).2018:3-19.
[15]WANG Q,WU B,ZHU P,et al.ECA-Net:Efficient channel attention for deep convolutional neural networks[C]//Procee-dings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:11534-11542.
[16]LIN T Y,DOLLÁR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2117-2125.
[17]LIU S,QI L,QIN H,et al.Path aggregation network for instance segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:8759-8768.
[18]ZHAO Q,SHENG T,WANG Y,et al.M2det:A single-shot object detector based on multi-level feature pyramid network[C]//Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence.2019:9259-9266.
[19]LU X,LI B Y,YUE Y X,et al.Grid R-CNN plus:faster and better [J].arXiv:1906.05688,2019.
[20]CAI Z,VASCONCELOS N.Cascade r-cnn:Delving into highquality object detection[C]//Proceedings of the IEEE Confe-rence on Computer Vision and Pattern Recognition.2018:6154-6162.
[21]CHEN Z,YANG C,LI Q,et al.Disentangle your dense object detector[C]//Proceedings of the 29th ACM International Conference on Multimedia.2021:4939-4948.
[1] WANG Ruiping, WU Shihong, ZHANG Meihang, WANG Xiaoping. Review of Vision-based Neural Network 3D Dynamic Gesture Recognition Methods [J]. Computer Science, 2024, 51(4): 193-208.
[2] XU Hao, LI Fengrun, LU Lu. Metal Surface Defect Detection Method Based on Dual-stream YOLOv4 [J]. Computer Science, 2024, 51(4): 209-216.
[3] LIU Zeyu, LIU Jianwei. Video and Image Salient Object Detection Based on Multi-task Learning [J]. Computer Science, 2024, 51(4): 217-228.
[4] ZHANG Mingdao, ZHOU Xin, WU Xiaohong, QING Linbo, HE Xiaohai. Unified Fake News Detection Based on Semantic Expansion and HDGCN [J]. Computer Science, 2024, 51(4): 299-306.
[5] WANG Zihong, SHAO Yingxia, HE Jiyuan, LIU Jinbao. Sequential Recommendation Based on Multi-space Attribute Information Fusion [J]. Computer Science, 2024, 51(3): 102-108.
[6] ZHANG Yang, XIA Ying. Object Detection Method with Multi-scale Feature Fusion for Remote Sensing Images [J]. Computer Science, 2024, 51(3): 165-173.
[7] LI Yu, YANG Xiangli, ZHANG Le, LIANG Yalin, GAO Xian, YANG Jianxi. Combined Road Segmentation and Contour Extraction for Remote Sensing Images Based on Cascaded U-Net [J]. Computer Science, 2024, 51(3): 174-182.
[8] LIAO Meng, JIA Zhen, LI Tianrui. Chinese Named Entity Recognition Based on Label Information Fusion and Multi-task Learning [J]. Computer Science, 2024, 51(3): 198-204.
[9] SUN Shounan, WANG Jingbin, WU Renfei, YOU Changkai, KE Xifan, HUANG Hao. TMGAT:Graph Attention Network with Type Matching Constraint [J]. Computer Science, 2024, 51(3): 235-243.
[10] LIU Xuheng, BAI Zhengyao, XU Zhu, DU Jiajin, XIAO Xiao. Multi-guided Point Cloud Registration Network Combined with Attention Mechanism [J]. Computer Science, 2024, 51(2): 142-150.
[11] ZHANG Guodong, CHEN Zhihua, SHENG Bin. Infrared Small Target Detection Based on Dilated Convolutional Conditional GenerativeAdversarial Networks [J]. Computer Science, 2024, 51(2): 151-160.
[12] ZHANG Feng, HUANG Shixin, HUA Qiang, DONG Chunru. Novel Image Classification Model Based on Depth-wise Convolution Neural Network andVisual Transformer [J]. Computer Science, 2024, 51(2): 196-204.
[13] LIAO Xingbin, QIAN Yangge, WANG Qianlei, QIN Xiaolin. Hierarchical Document Classification Method Based on Improved Self-attention Mechanism and Representation Learning [J]. Computer Science, 2024, 51(2): 238-244.
[14] WANG Weijia, XIONG Wenzhuo, ZHU Shengjie, SONG Ce, SUN He, SONG Yulong. Method of Infrared Small Target Detection Based on Multi-depth Feature Connection [J]. Computer Science, 2024, 51(1): 175-183.
[15] SHI Dianxi, LIU Yangyang, SONG Linna, TAN Jiefu, ZHOU Chenlei, ZHANG Yi. FeaEM:Feature Enhancement-based Method for Weakly Supervised Salient Object Detection via Multiple Pseudo Labels [J]. Computer Science, 2024, 51(1): 233-242.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!