计算机科学 ›› 2018, Vol. 45 ›› Issue (7): 271-277.doi: 10.11896/j.issn.1002-137X.2018.07.047

• 图形图像与模式识别 • 上一篇    下一篇

基于稀疏表示和多特征融合的路面裂缝检测

张玉雪,唐振民,钱彬,徐威   

  1. 南京理工大学计算机科学与工程学院 南京210094
  • 收稿日期:2017-01-21 出版日期:2018-07-30 发布日期:2018-07-30
  • 作者简介:张玉雪(1994-),女,硕士生,CCF会员,主要研究方向为计算机视觉、模式识别,E-mail:zyx_njust@163.com;唐振民(1961-),男,教授,博士生导师,主要研究方向为智能机器人、图像处理,E-mail:tang.zm@163.com(通信作者);钱 彬(1989-),男,博士生,主要研究方向为计算机视觉、模式识别;徐 威(1987-),男,博士,主要研究方向为计算机视觉、图像处理。
  • 基金资助:
    本文受中国博士后科学基金(2014M551599),国家军口核高基“×××软件支撑平台”(2015ZX01041101)资助。

Pavement Crack Detection Based on Sparse Representation and Multi-feature Fusion

ZHANG Yu-xue,TANG Zhen-min ,QIAN Bin ,XU Wei   

  1. School of Computer Science and Engineering,Nanjing University of Science and Technology,Nanjing 210094,China
  • Received:2017-01-21 Online:2018-07-30 Published:2018-07-30

摘要: 为了提高在实际复杂背景噪声下对路面裂缝检测的精度,提出了一种基于稀疏表示和多特征融合的路面裂缝检测改进算法。该算法首先以图像子块为单位,提取对裂缝识别有效的统计、纹理和形状特征。然后,分别在各个特征矩阵下利用稀疏表示分类方法实现对裂缝子块的识别,再融合不同特征下的识别结果,设计综合识别分类器进行子块检测。最后,在识别出的裂缝子块上,采用基于视觉显著性的像素级检测方法精确提取裂缝细节。在实际高速公路路面数据库上的实验结果表明,该算法有效地提升了路面裂缝检测的精度,具有良好的鲁棒性。

关键词: 多特征融合, 裂缝检测, 视觉显著性, 稀疏表示, 像素级检测

Abstract: In order to improve the performance of the practical pavement crack detection under complex background noise,an improved pavement crack detection algorithm based on sparse representation and multi-feature fusion was proposed.Firstly,this algorithm takes image sub-block as unit,and extracts statistics,texture and shape features which are effective for crack re-cognition.Then,the sparse representation classification method is adopted to realize sub-block re-cognition under each feature matrix separately,and a comprehensive recognition classifier for sub-block detection is designed by fusing the recognition results under different features.Finally,on the detected sub-block,a pixel-level detection method based on visual saliency is used to extract crack details accurately.The experiment results on highway pavement datasets show that the proposed algorithm can effectively improve the accuracy of pavement crack detection and has good robustness.

Key words: Crack detection, Multi-feature fusion, Pixel-level detection, Sparse representation, Visual saliency

中图分类号: 

  • TP391
[1]CHENG H D,MIYOJIM M.Automatic pavement distress detection system [J].Journal of Information Sciences,1998,108(1):219-240.
[2]ZHANG D J,LI Q Q,CHEN Y,et al.Asphalt Pavement Crack Detection Based on Spatial Clustering Feature [J].Acta Automatica Sinica,2016,42(3):443-454.(in Chinese)
张德津,李清泉,陈颖,等.基于空间聚集特征的沥青路面裂缝检测方法[J].自动化学报,2016,42(3):443-454.
[3]QIAN B,TANG Z M,SHEN X B,et al.Pavement crack detection based on multi-feature manifold learning and matrix factorization [J].Chinese Journal of Scientific Instrument,2016,37(7):1639-1646.(in Chinese)
钱彬,唐振民,沈肖波,等.基于多特征流形学习和矩阵分解的路面裂缝检测[J].仪器仪表学报,2016,37(7):1639-1646.
[4]GAO J Z,REN M W,TANG Z M,et al.Automatic road crack detection and identification[J].Computer Engineering,2003,29(2):149-150.(in Chinese)
高建贞,任明武,唐振民,等.路面裂缝的自动检测与识别[J].计算机工程,2003,29(2):149-150.
[5]LI Q,LIU X.Novel Approach to Pavement Image Segmentation Based on Neighboring Difference Histogram Method[C]∥Congress on Image and Signal Processing.New York:IEEE Press,2008:792-796.
[6]LIU F,XU G,YANG Y,et al.Novel approach to pavementcracking automatic detection based on segment extending[C]∥International Symposium on Knowledge Acquisition and Mode-ling.New York:IEEE Press,2008:610-614.
[7]YAN M D,BO S B,HE Y Y.A method of image detection and analysis for pavement crack based on morphology[J].Journal of Engineering Graphics,2008,29(2):142-147.(in Chinese)
闫茂德,伯绍波,贺昱曜.一种基于形态学的路面裂缝图像检测与分析方法[J].工程图学学报,2008,29(2):142-147.
[8]NEJAD F M,ZAKERI H.An optimum feature extraction me-thod based on Wavelet-Radon Transform and Dynamic Neural Network for pavement distress classification[J].Expert Systems with Applications,2011,38(8):9442-9460.
[9]MA C X,ZHAO C X,HU Y,et al.Road crack detection based on NSCT and morphology[J].Journal of Computer-Aided Design & Computer Graphics,2009,21(12):1761-1767.(in Chinese)
马常霞,赵春霞,胡勇,等.结合NSCT和图像形态学的路面裂缝检测[J].计算机辅助设计与图形学学报,2009,21(12):1761-1767.
[10]XU W,TANG Z M,LV J Y.Pavement crack detection based on image saliency [J].Journal of Image and Graphics,2013,18(1):69-77.(in Chinese)
徐威,唐振民,吕建勇.基于图像显著性的路面裂缝检测[J].中国图象图形学报,2013,18(1):69-77.
[11]OLIVEIRA H,CORREIA P L.Automatic road crack detection and characterization[J].IEEE Transactions on Intelligent Transportation Systems,2013,14(1):155-168.
[12]HU Y,ZHAO C,WANG H.Automatic pavement crack detection using texture and shape descriptors[J].Iete Technical Review,2014,27(5):398-405.
[13]QIAN B,TANG Z M,XU W,et al.Pavement crack detection algorithm based on sub-patch discriminant analysis[J].Journal of Image and Graphics,2015,20(12):1652-1663.(in Chinese)
钱彬,唐振民,徐威,等.子块鉴别分析的路面裂缝检测[J].中国图象图形学报,2015,20(12):1652-1663.
[14]ZHANG L,YANG F,ZHANG Y D,et al.Road crack detection using deep convolutional neural network[C]∥IEEE International Conference on Image Processing.New York:IEEE Press,2016.
[15]WRIGHT J,YANG A Y,GANESH A,et al.Robust face recognition via sparse representation[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2009,31(2):210-227.
[16]YIN H F,WU X J,CHEN S G.Improved LSRC and its application in face recognition[J].Computer Science,2015,42(8):48-51.(in Chinese)
尹贺峰,吴小俊,陈素根.改进的局部稀疏表示分类算法及其在人脸识别中的应用[J].计算机科学,2015,42(8):48-51.
[17]QIAN B,TANG Z,XU W.Pavement crack detection based on improved tensor voting[C]∥International Conference on Computer Science & Education.2014:397-402.
[18]PERONA P,MALIK J.Scale-space and edge detection using ani-sotropic diffusion [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2002,12(7):629-639.
[19]HARALICK R M.Texture features for image classification[J].IEEE Transactions on Systems Man & Cybernetics,1975,3(6):610-621.
[20]ZHANG Z,XU Y,YANG J,et al.A Survey of Sparse Representation:Algorithms and Applications[J].IEEE Access,2015,3:490-530.
[21]LEE D D,SEUNG H S.Learning the parts of objects by non-negative matrix factorization[J].Nature,1999,401(6755):788-791.
[22]CAI D,HE X,HAN J,et al.Graph Regularized Nonnegative Matrix Factorization for Data Representation[J].IEEE Tran-sactions on Pattern Analysis & Machine Intelligence,2011,33(8):1548-1560.
[23]ACHANTA R,HEMAMI S,ESTRADA F,et al.Frequency-tuned salient region detection[C]∥IEEE Conference on Computer Vision and Pattern Recognition.2009:1597-1604.
[24]CHU X M,WANG R B.Asphalt Pavement Surface Distress Ima-ge Recognition Based on Neural Network[J].Journal of Wuhan University of Technology,2004,28(3):373-376.(in Chinese)
初秀民,王荣本.基于神经网络的沥青路面破损图像识别研究[J].武汉理工大学学报,2004,28(3):373-376.
[25]DOYCHEVA K,KOCH C,K NIG M.GPU-Enabled Pavement Distress Image Classification in Real Time[J].Journal of Computing in Civil Engineering,2016,31(3):1943-1952.
[1] 郁舒昊, 周辉, 叶春杨, 王太正.
SDFA:基于多特征融合的船舶轨迹聚类方法研究
SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion
计算机科学, 2022, 49(6A): 256-260. https://doi.org/10.11896/jsjkx.211100253
[2] 王君锋, 刘凡, 杨赛, 吕坦悦, 陈峙宇, 许峰.
基于多源迁移学习的大坝裂缝检测
Dam Crack Detection Based on Multi-source Transfer Learning
计算机科学, 2022, 49(6A): 319-324. https://doi.org/10.11896/jsjkx.210500124
[3] 李鹏祖, 李瑶, Ibegbu Nnamdi JULIAN, 孙超, 郭浩, 陈俊杰.
基于多特征融合的重叠组套索脑功能超网络构建及分类
Construction and Classification of Brain Function Hypernetwork Based on Overlapping Group Lasso with Multi-feature Fusion
计算机科学, 2022, 49(5): 206-211. https://doi.org/10.11896/jsjkx.210300049
[4] 瞿中, 陈雯.
基于空洞卷积和多特征融合的混凝土路面裂缝检测
Concrete Pavement Crack Detection Based on Dilated Convolution and Multi-features Fusion
计算机科学, 2022, 49(3): 192-196. https://doi.org/10.11896/jsjkx.210100164
[5] 祝一帆, 王海涛, 李可, 吴贺俊.
一种高精度路面裂缝检测网络结构:Crack U-Net
Crack U-Net:Towards High Quality Pavement Crack Detection
计算机科学, 2022, 49(1): 204-211. https://doi.org/10.11896/jsjkx.210100128
[6] 牛富生, 郭延哺, 李维华, 刘文洋.
基于序列特征融合的蛋白质可溶性预测
Protein Solubility Prediction Based on Sequence Feature Fusion
计算机科学, 2022, 49(1): 285-291. https://doi.org/10.11896/jsjkx.201100117
[7] 吕金娜, 邢春玉, 李莉.
基于多特征融合的细粒度视频人物关系抽取
Video Character Relation Extraction Based on Multi-feature Fusion and Fine-granularity Analysis
计算机科学, 2021, 48(4): 117-122. https://doi.org/10.11896/jsjkx.200800160
[8] 瞿中, 谢钇.
基于全U网络的混凝土路面裂缝检测算法
Concrete Pavement Crack Detection Algorithm Based on Full U-net
计算机科学, 2021, 48(4): 187-191. https://doi.org/10.11896/jsjkx.200100113
[9] 李培冠, 於志勇, 黄昉菀.
基于稀疏表示的电力负荷数据补全
Power Load Data Completion Based on Sparse Representation
计算机科学, 2021, 48(2): 128-133. https://doi.org/10.11896/jsjkx.191200152
[10] 栾晓, 李晓双.
基于多特征融合的人脸活体检测算法
Face Anti-spoofing Algorithm Based on Multi-feature Fusion
计算机科学, 2021, 48(11A): 409-415. https://doi.org/10.11896/jsjkx.210100181
[11] 原晓佩, 陈小锋, 廉明.
基于Haar-like和LBP的多特征融合目标检测算法
Improved Multi-feature Fusion Algorithm for Target Detection Based on Haar-like and LBP
计算机科学, 2021, 48(11): 219-225. https://doi.org/10.11896/jsjkx.201100174
[12] 田旭, 常侃, 黄升, 覃团发.
基于残差字典及协作表达的单图像超分辨率算法
Single Image Super-resolution Algorithm Using Residual Dictionary and Collaborative Representation
计算机科学, 2020, 47(9): 135-141. https://doi.org/10.11896/jsjkx.190600146
[13] 袁野, 和晓歌, 朱定坤, 王富利, 谢浩然, 汪俊, 魏明强, 郭延文.
视觉图像显著性检测综述
Survey of Visual Image Saliency Detection
计算机科学, 2020, 47(7): 84-91. https://doi.org/10.11896/jsjkx.190900006
[14] 程中建, 周双娥, 李康.
基于多尺度自适应权重的稀疏表示目标跟踪算法
Sparse Representation Target Tracking Algorithm Based on Multi-scale Adaptive Weight
计算机科学, 2020, 47(6A): 181-186. https://doi.org/10.11896/JsJkx.190500093
[15] 吴宏涛, 刘力源, 孟颖, 荣亚鹏, 李路凯.
动态多特征融合的道路遗洒物威胁度分析方法
Novel Threat Degree Analysis Method for Scattered ObJects in Road Traffic Based on Dynamic Multi-feature Fusion
计算机科学, 2020, 47(6A): 196-205. https://doi.org/10.11896/JsJkx.190900066
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!