计算机科学 ›› 2019, Vol. 46 ›› Issue (3): 159-163.doi: 10.11896/j.issn.1002-137X.2019.03.024

• 2018 中国多媒体大会 • 上一篇    下一篇

基于改进的R-FCN航拍巡线图像中的绝缘子检测方法

赵振兵1,崔雅萍1,戚银城1,杜丽群1,张珂1,翟永杰2   

  1. (华北电力大学电子与通信工程系 河北 保定 071003)1
    (华北电力大学自动化系 河北 保定 071003)2
  • 收稿日期:2018-07-02 修回日期:2018-09-20 出版日期:2019-03-15 发布日期:2019-03-22
  • 通讯作者: 赵振兵(1979-),男,博士,副教授,CCF会员,主要研究方向为图像处理与电力设备智能检测,E-mail:zhaozhenbing@ncepu.edu.cn(通信作者)
  • 作者简介:崔雅萍(1993-),女,硕士生,主要研究方向为图像检测与深度学习;戚银城(1968-),男,博士,教授,主要研究方向为电力系统通信与信息处理,E-mail:qiych@126.com;杜丽群(1994-),女,硕士生,主要研究方向为目标检测与深度学习;张珂(1980-),男,博士,主要研究方向为计算机视觉、深度学习、机器学习、机器人导航;翟永杰(1972-),男,博士,副教授,主要研究方向为机器学习和图像处理在电力系统中的应用。
  • 基金资助:
    国家自然科学基金项目(61871182,61401154,61773160,61302163),河北省自然科学基金项目(F2016502101,F2017502016,F2015502062),中央高校基本科研业务费专项资金项目(2018MS095,2018MS094)资助

Detection Method of Insulator in Aerial Inspection Image Based on Modified R-FCN

ZHAO Zhen-bing1,CUI Ya-ping1,QI Yin-cheng1,DU Li-qun1,ZHANG Ke1,ZHAI Yong-jie2   

  1. (Department of Electronic and Communication Engineering,North China Electric Power University,Baoding,Hebei 071003,China)1
    (Department of Automation,North China Electric Power University,Baoding,Hebei 071003,China)2
  • Received:2018-07-02 Revised:2018-09-20 Online:2019-03-15 Published:2019-03-22

摘要: 航拍巡线图像中的绝缘子目标存在部分遮挡的情况,利用区域全卷积网络(Region-based Fully Convolutional Networks,R-FCN)模型对其进行检测,出现了绝缘子目标检测效果较差且检测框无法完全贴合目标的问题。基于此,文中提出了一种基于改进的R-FCN航拍巡线图像中的绝缘子目标检测方法。首先,根据绝缘子目标的宽高比特征,将R-FCN模型中RPN的建议框的宽高比修改为1∶4,1∶2,1∶1,2∶1,4∶1;然后,针对遮挡问题,在R-FCN模型中引入对抗空间丢弃网络(Adversarial Spatial Dropout Network,ASDN)层,对特征图的部分位置生成掩码以获得目标特征的不完整样本,从而提高模型对目标特征较差的样本检测性能。在包含7433个绝缘子目标框的数据集中,R-FCN模型的平均检测率达到了77.27%,而改进的R-FCN检测方法的平均检测率达到了84.29%,性能提升了7.02%,且检测框更贴合目标。

关键词: 建议框比例, 区域全卷积网络, 数据集, 掩码

Abstract: In the case of partial occlusion of insulator target in aerial inspection images,the region-based fully convolutional networks (R-FCN) model is used for detection,however,the insulator target detection effect is poor and the detection frame cannot completely fit the target.Based on this,this paper proposed an insulator target detection method based on modified R-FCN in aerial inspection image.Firstly,according to the aspect ratio feature of insulator targets,the aspect ratios of proposals in the R-FCN model are modified to 1∶4,1∶2,1∶1,2∶1,4∶1.Then,in view of the occlusion problem in insulator image,an adversarial spatial dropout network (ASDN) layer is introduced into the R-FCN model to generate the samples of incomplete target feature by masking part of feature map,which can improve the detection performance of the model for samples with poor target feature.The average detection rate of R-FCN model reaches 77.27% on the dataset containing 7433 insulator targets.The average detection rate of the modified R-FCN detection method is 84.29%,which improves 7.02%,and the detection frame is more suitable for the target.

Key words: Database, Mask, Recommended box ratio, R-FCN

中图分类号: 

  • TN919.8
[1]MA X Y.Research on automatic inspection technology of transmission lines based on aerial image[D].Beijing:North China Electric Power University,2016.(in Chinese)
马兴誉.基于航拍图像的输电线路自动巡检相关技术研究[D].北京:华北电力大学,2016.
[2]JIANG S,JIANG W,HUANG W,et al.UAV-Based oblique photogrammetry for outdoor data acquisition and offsite visual inspection of transmission line[J].Remote Sensing,2017,9(3):278-303.
[3]MATIKAINEN L,LEHTOMAKI M,AHOKAS E,et al.Remote sensing methods for power line corridor surveys[J].Isprs Journal of Photogrammetry & Remote Sensing,2016,119:10-31.
[4]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[J].Communications of the Acm,2012,60(2):1097-1105.
[5]DAI J F,LI Y,HE K M,et al.R-FCN:Object Detection via Region-based Fully Convolutional Networks[C]∥Conference and Workshop on Neural Information Processing Systems(NIPS).2016:379-387.
[6]HOSANG J,BENENSON R,DOLLAR P,et al.What Makes for
Effective Detection Proposals?[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,38(4):814.
[7]GIRSHICK R,DONAHUE J,DARRELL T,et al.Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation[C]∥IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2013:580-587.
[8]SANDE K,UIJLINGS J,GEVERS T,et al.Segmentation as selective search for object recognition[C]∥IEEE International Conference on Computer Vision (ICCV).2012:1879-1886.
[9]HE K M,ZHANG X,REN S Q,et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2014,37(9):1904-1916.
[10]GIRSHICK R.Fast R-CNN[C]∥IEEE International Confe-
rence on Computer Vision(ICCV).2015:1440-1448.
[11]REN S Q,HE K M,GIRSHICK R,et al.Faster R-CNN:to-
wards real-Time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,39(6):1137-1149.
[12]LIU W,ANGUELOV D,ERHAN D,et al.SSD:single shot
multiboxdetector[C]∥European Conference on Computer Vision(ECCV).2015:21-37.
[13]HUANG X N,ZHANG Z L.A method to extract insulator
image from aerial image of helicopter patrol[J].Power System Technology,2010,34(1):194-197.(in Chinese)
黄宵宁,张真良.直升机巡检航拍图像中绝缘子图像的提取算法[J].电网技术,2010,34(1):194-197.
[14]XU Y L,ZHANG S C,YANG N,et al.An algorithm to extract
insulator image from aerial image[J].Journal of Shanghai University of Electric Power,2011,27(5):515-518.(in Chinese)
徐耀良,张少成,杨宁,等.航拍图像中绝缘子的提取算法[J].上海电力学院学报,2011,27(5):515-518.
[15]YAO C Y,JIN L J,YAN S J.Recognition of insulator string in power grid patrol images[J].Journal of System Simulation,2012,24(9):1818-1822.(in Chinese)
姚春羽,金立军,闫书佳.电网巡检图像中绝缘子的识别[J].系统仿真学报,2012,24(9):1818-1822.
[16]XU X J,WANG S P,JI Q C,et al.Insulator infrared image recognition method based on gaussian scale-space and GHT[J].Infrared Technology,2014,36(7):596-599.(in Chinese)
徐向军,王生鹏,纪青春,等.基于高斯尺度空间GHT的绝缘子红外图像识别方法[J].红外技术,2014,36(7):596-599.
[17]ZHAO Z B,WANG L.Aerial insulator string image automatic location method[J].Chinese Journal of Scientific Instrument,2014,35(3):558-565.(in Chinese)
赵振兵,王乐.一种航拍绝缘子串图像自动定位方法[J].仪器仪表学报,2014,35(3):558-565.
[18]ZHAO Z B,XU G Z,QI Y C,et al.Multi-patch deep features for power line insulator status classification from aerial images[C]∥IEEE International Joint Conference on Neural Networks (IJCNN).2016:3187-3194.
[19]ZHAO Z B,FAN X Q,XU G Z,et al.Aggregating deep convolutional feature maps for insulator detection in infrared images[J].IEEE Access,2017,5(1):21831-21839.
[20]ZHAO Z B,XU G Z,QI Y C.Representation of binary feature pooling for detection of insulator strings in infrared images[J].IEEE Transactions on Dielectrics and Electrical Insulation,2016,23(5):2858-2866.
[21]WANG X,SHRIVASTAVA A,GUPTA A.A-Fast-RCNN:
hard positive generation via adversary for object detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2017:3039-3048.
[1] 戴禹, 许林峰.
基于文本行匹配的跨图文本阅读方法
Cross-image Text Reading Method Based on Text Line Matching
计算机科学, 2022, 49(9): 139-145. https://doi.org/10.11896/jsjkx.220600032
[2] 颜敏, 罗晓清, 张战成.
基于光传输模型学习的红外和可见光图像融合网络设计
Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning
计算机科学, 2022, 49(4): 215-220. https://doi.org/10.11896/jsjkx.210200174
[3] 江昊琛, 魏子麒, 刘璘, 陈俊.
非均衡数据分类经典方法综述与面向医疗领域的实验分析
Imbalanced Data Classification:A Survey and Experiments in Medical Domain
计算机科学, 2022, 49(1): 80-88. https://doi.org/10.11896/jsjkx.210200124
[4] 郑小萌, 高猛, 滕俊元.
航天器软件缺陷预测数据集构建方法研究
Research on Construction Method of Defect Prediction Dataset for Spacecraft Software
计算机科学, 2021, 48(6A): 575-580. https://doi.org/10.11896/jsjkx.200900133
[5] 和青芳, 王慧, 程光.
自适应小数据集乳腺癌病理组织分类研究
Research on Classification of Breast Cancer Pathological Tissues with Adaptive Small Data Set
计算机科学, 2021, 48(6A): 67-73. https://doi.org/10.11896/jsjkx.201000188
[6] 张曼, 李杰, 朱新忠, 沈霁, 成昊天.
基于改进DCGAN算法的遥感数据集增广方法
Augmentation Technology of Remote Sensing Dataset Based on Improved DCGAN Algorithm
计算机科学, 2021, 48(6A): 80-84. https://doi.org/10.11896/jsjkx.200700185
[7] 周彦, 陈少昌, 吴可, 宁明强, 陈宏昆, 张鹏.
SCTD1.0:声呐常见目标检测数据集
SCTD 1.0:Sonar Common Target Detection Dataset
计算机科学, 2021, 48(11A): 334-339. https://doi.org/10.11896/jsjkx.210100138
[8] 王萧萧, 王亭雯, 马玉玲, 范佳奕, 崔超然.
基于深度森林的P2P网贷借款人信用风险评估方法
Credit Risk Assessment Method of P2P Online Loan Borrowers Based on Deep Forest
计算机科学, 2021, 48(11A): 429-434. https://doi.org/10.11896/jsjkx.201000013
[9] 杨连平, 孙玉波, 张红良, 李封, 张祥德.
基于编解码残差的人体关键点匹配网络
Human Keypoint Matching Network Based on Encoding and Decoding Residuals
计算机科学, 2020, 47(6): 114-120. https://doi.org/10.11896/jsjkx.200300079
[10] 宋传鸣, 洪旭, 王相海.
空-频域联合投票的交通视频阴影去除方法
Shadow Removal of Traffic Surveillance Video by Joint Voting in Spatial-Frequency Domain
计算机科学, 2020, 47(5): 129-136. https://doi.org/10.11896/jsjkx.190400040
[11] 张鹏飞, 李冠宇, 贾彩燕.
面向自然语言推理的基于截断高斯距离的自注意力机制
Truncated Gaussian Distance-based Self-attention Mechanism for Natural Language Inference
计算机科学, 2020, 47(4): 178-183. https://doi.org/10.11896/jsjkx.190600149
[12] 蔡强, 邓毅彪, 李海生, 余乐, 明少锋.
基于深度学习的人体行为识别方法综述
Survey on Human Action Recognition Based on Deep Learning
计算机科学, 2020, 47(4): 85-93. https://doi.org/10.11896/jsjkx.190300005
[13] 王莹, 郑丽伟, 张禹尧, 张晓妘.
面向中文APP用户评论数据的软件需求挖掘方法
Software Requirement Mining Method for Chinese APP User Review Data
计算机科学, 2020, 47(12): 56-64. https://doi.org/10.11896/jsjkx.201200031
[14] 沈琦, 陈逸伦, 刘枢, 刘利刚.
基于两级网络的三维目标检测算法
3D Object Detection Algorithm Based on Two-stage Network
计算机科学, 2020, 47(10): 145-150. https://doi.org/10.11896/jsjkx.190900172
[15] 张昉, 赵书良, 武永亮.
面向多尺度数据挖掘的数据尺度划分方法
Data Scaling Method for Multi-scale Data Mining
计算机科学, 2019, 46(4): 57-65. https://doi.org/10.11896/j.issn.1002-137X.2019.04.009
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!