基于区域注意力机制和多尺度特征融合的输电线路螺栓缺陷检测

doi:10.11896/jsjkx.220200096

计算机科学 ›› 2023, Vol. 50 ›› Issue (6A): 220200096-7.doi: 10.11896/jsjkx.220200096

• 图像处理&多媒体技术 • 上一篇下一篇

基于区域注意力机制和多尺度特征融合的输电线路螺栓缺陷检测

吴刘宸¹, 张辉², 刘嘉轩¹, 赵晨阳¹

1 长沙理工大学电气与信息工程学院长沙 410000;
2 湖南大学机器人学院长沙 410000

出版日期:2023-06-10 发布日期:2023-06-12
通讯作者: 张辉(zhanghuihby@126.com)
作者简介:(liuchen1019@stu.csust.edu.cn)
基金资助:
国家重大研究计划-重点支持项目(92148204);国家重点研发计划(2018YFB1308200);国家自然科学基金(61971071,62027810,62133005);湖南省杰出青年科学基金项目(2021JJ10025);湖南省重点研发计划(2021GK4011,2022GK2011);长沙市科技重大专项(kh2003026);机器人学国家重点实验室联合开放基金(2021-KF-22-17);中国高校产学研创新基金(2020HYA06006)

Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion

WU Liuchen¹, ZHANG Hui², LIU Jiaxuan¹, ZHAO Chenyang¹

1 School of Electrical & Information Engineering,Changsha University of Science & Technology,Changsha 410000,China;
2 School of Robotics,Hunan University,Changsha 410000,China

Online:2023-06-10 Published:2023-06-12
About author:WU Liuchen,born in 1996,B.S degree,master.His main research interests include image processing,deep learning and so on. ZHANG Hui,born in 1963,Ph.D,professor.His main research interests include machine vision and sparse representation.
Supported by:
Major Research Plan of the National Natural Science Foundation of China(92148204),National Key R&D Program of China(2018YFB1308200),National Natural Science Foundation of China(61971071,62027810,62133005),Hunan Science Fund for Distinguished Young Scholars(2021JJ10025),Hunan Key Research and Development Program(2021GK4011,2022GK2011),Changsha Science and Technology Major Project(kh2003026),Joint Open Foundation of State Key Laboratory of Robotics(2021-KF-22-17) and China University Industry-University-research Innovation Fund(2020HYA06006).

摘要/Abstract

摘要： 螺栓在输电线路中起到了固定线路间连接的作用,一旦出现松动或者脱落,就可能会导致电力传输发生故障而引起大范围停电事故。显然,定时对输电线上的螺栓进行检测,对确保整个电力系统的安全稳定有着至关重要的作用。现有的检测方法大多基于深度卷积神经网络,然而螺栓特征不明显、尺寸小的特点给检测工作带来了挑战。针对上述问题,提出了一种基于区域注意力机制和多尺度特征融合的输电线路螺栓缺陷检测方法。首先,提出了适用于目标检测的区域注意模块,将该模块嵌入至ResNet50的残差块中以增强网络对螺栓的特征提取。其次,在特征金字塔结构(FPN)的基础上,扩展一条自下而上的路径,同时对浅层特征进行充分利用,以提高对小物体的检测精度。最后,为了缓解样本间的不平衡问题,引入了PrIme Sample Attention(PISA)软样本采样策略。实验结果表明,所提方法在检测输电线螺栓时,均值平均精度(mAP)达到了74.3%,平均召回率(AR)达到了86.4%,检测速度为8.2FPS。与其他检测网络相比,所提方法在不牺牲太多检测速度的基础上,提高了对螺栓缺陷的检测精度。

关键词: 输电线螺栓, 小目标检测, 注意力机制, 多尺度特征融合, 采样策略

Abstract: Bolts play a role in fixing the connection between lines in transmission lines.Once loose or detached,it may cause po-wer transmission failures and cause large-scale power outages.Obviously,regular inspection of bolts in transmission lines is essential to ensure the safety and stability of the entire power system.Most of the existing detection methods are based on deep convolutional neural networks.However,the unobvious features and small size of the bolts pose a challenge to the detection work.Aiming at the above problems,this paper proposes a bolt defect detection method for transmission lines based on region attention mechanism and multi-scale feature fusion.Firstly,a region attention module suitable for object detection is proposed,which is embedded in the residual block of ResNet50 to enhance the network’s feature extraction for bolts.Secondly,based on the feature pyramid networks(FPN),a bottom-up path is extended,and shallow features are fully utilized to improve the detection accuracy of small objects.Finally,in order to alleviate the imbalance between samples,the PrIme Sample Attention(PISA) soft sample sampling strategy is introduced.Experimental results show that the proposed method achieves a mean average precision(mAP) of 74.3% and an average recall(AR) of 86.4% with a detection speed of 8.2 FPS when detecting transmission line bolts.Compared with other detection networks,the proposed method improves the detection accuracy of bolt defects without sacrificing too much detection speed.

Key words: Transmission line bolts, Small object detection, Attention mechanism, Multi-scale feature fusion, Sampling strategy

中图分类号:

TM933

吴刘宸, 张辉, 刘嘉轩, 赵晨阳. 基于区域注意力机制和多尺度特征融合的输电线路螺栓缺陷检测[J]. 计算机科学, 2023, 50(6A): 220200096-7. https://doi.org/10.11896/jsjkx.220200096

WU Liuchen, ZHANG Hui, LIU Jiaxuan, ZHAO Chenyang. Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion[J]. Computer Science, 2023, 50(6A): 220200096-7. https://doi.org/10.11896/jsjkx.220200096

参考文献

[1]SHAO G W,LIU Z,FU J,et al.Research progress in unmanned aerial vehicle inspection technology on overhead transmission lines[J].High Voltage Engineering,2020,46(1):14-22.
[2]WU L Y,BI J G,CHANG W Z,et al.Research of UnmannedAerial Vehicle Comprehensive Inspection for Distribution Network Overhead Transmission Lines[J].Electric Power,2018,51(1):6.
[3]SUIY,NING P F,NIU P J.Review on mounted UAV for transmission line inspection[J].Power System Technology,2020,45(9):3636-3648.
[4]GUC Y,LI Z,SHI J T,et al.Detection for Pin Defects of Overhead Lines by UAV Patrol Image Based on Improved Faster-RCNN[J].High Voltage Engineering,2020,46(9):3089-3096.
[5]VIOLA P,JONES M J.Robust real-time face detection[J].International Journal of Computer Vision,2004,57(2):137-154.
[6]DALAL N,TRIGGS B.Histograms of oriented gradients forhuman detection[C]//2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR’05).IEEE,2005:886-893.
[7]FFELZENSZWALB P,GIRSHICK R B,MCALLESTER D,et al.Object detection with discriminatively trained part-based models[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2009,32(9):1627-1645.
[8]CAO Y,CHEN K,LOY C C,et al.Prime sample attention inobject detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:11583-11591.
[9]HUANG X B,ZHANG X L,ZHANG Y,et al.A method ofidentifying rust status of dampers based on image processing[J].IEEE Transactions on Instrumentation and Measurement,2020,69(8):5407-5417.
[10]ZHAO Z B,LIU N,WANG L.Localization of multiple insulators by orientation angle detection and binary shape prior knowledge[J].IEEE Transactions on Dielectrics and Electrical Insulation,2015,22(6):3421-3428.
[11]TAO X,ZHANG D P,WANG Z H,et al.Detection of powerline insulator defects using aerial images analyzed with convolutional neural networks[J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2018,50(4):1486-1498.
[12]ZHAOZ B,CUI Y P,QI Y C,et al.Detection method of insulator in aerial inspection image based on modified R-FCN[J].Computer Science,2019,46(3):159-163.
[13]LI F G,YILIHAMU Y,et al.Real-time Detection Model of Insulator Defect Based on Improved CenterNet[J].Computer Science,2022,49(5):84-91.
[14]Xinren M,Zhicheng L,Hao J,et al.Fault Detection of Power Tower Anti-bird Spurs Based on Deep Convolutional Neural Network[J].Power System Technology,2021,45(1):126-133.
[15]LUO Y T,JIANG PF,DUAN C,et al.Small Object Detection Oriented Improved-RetinaNet Model and Its Application[J].Power System Technology,2021,48(10):233-238.
[16]LIANG X,ZHANG J,ZHUO L,et al.Small object detection in unmanned aerial vehicle images using feature fusion and scaling-based single shot detector with spatial context analysis[J].IEEE Transactions on Circuits and Systems for Video Technology,2019,30(6):1758-1770.
[17]ZHAO Z B,QI H Y,QI Y C,et al.Detection method based on automatic visual shape clustering for pin-missing defect in transmission lines[J].IEEE Transactions on Instrumentation and Measurement,2020,69(9):6080-6091.
[18]LI X F,LIU H Y,LIU G H,et al.Transmission Line Pin Defect Detection Based on Deep Learning[J].Power System Technology,2021,45(8):8.
[19]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:7132-7141.
[20]WOO S,PARK J,LEE J Y,et al.Cbam:Convolutional block attention module[C]//Proceedings of the European conference on computer vision(ECCV).2018:3-19.
[21]WANG X L,GIRSHICK R,GUPTA A,et al.Nonlocal neural networks[C]//Proceedings of the IEEE Conference on Compu-ter Vision and Pattern Recognition.2018:7794-7803.
[22]FU J,LIU J,TIAN H J,et al.Dual attention network for scene segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:3146-3154.
[23]YIN M H,YAO Z L,CAO Y,et al.Disentangled non-local neural networks[C]//European Conference on Computer Vision.Springer,2020:191-207.
[24]LIN T Y,DOLLÁR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2117-2125.
[25]LIN T Y,GOYAL P,GIRSHICK R,et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2980-2988.
[26]LI Y,CHEN Y,WANG N,et al.Scale-aware trident networks for object detection[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:6054-6063.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

基于区域注意力机制和多尺度特征融合的输电线路螺栓缺陷检测

Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

Metrics

本文评价

推荐阅读 0