Computer Science ›› 2019, Vol. 46 ›› Issue (11A): 584-589.

• Interdiscipline & Application • Previous Articles     Next Articles

Crack Detection of Concrete Pavement Based on Convolutional Neural Network

WANG Li-ping1, GAO Rui-zhen2, ZHANG Jing-jun2, WANG Er-cheng1   

  1. (College of Civil Engineering,Hebei University of Engineering,Handan,Hebei 056038,China)1;
    (School of Mechanical and Equipment Engineering,Hebei University of Engineering,Handan,Hebei 056038,China)2
  • Online:2019-11-10 Published:2019-11-20

Abstract: In concrete road pavements,the presence of cracks often leads to major engineering and economic problems.At present,when computer vision technology is used to conduct crack detection,artificial predesigned feature extractor is needed to extract image features for classification,resulting in poor generalization ability and classification perfor-mance.In this paper,a crack detection method based on convolutional neural network was proposed to realize the automatic detection and classification of pavement defects and improve the efficiency and accuracy of pavement crack detection.Firstly,the crack convolutional neural network of concrete pavement is designed.The model is based on AlexNet network architecture,and the model is optimized from two aspects:network structure level and hyperparameter.Secondly,the camera collects the concrete pavement image to obtain the learning data.According to the data set size and the image color factor,10000 and 20000 gray maps and four data sets of the color RGB map are respectively created.Then,the created four datasets are used.The data set trains the designed concrete crack convolutional neural network to create a crack detection model and compare it to the original AlexNet model.Finally,the two models are compared by factors such as dataset size,image color factor,network structure and hyperparameters.The experimental results show that by increasing the data set,using the color RGB map,adjusting the network structure and hyperparameters,the proposed model is helpful to improve the classification detection accuracy.Compared with the original AlexNet network model,the network model identification accuracy is high,and the recognition accuracy of color image samples is up to 98.5%.At the same time,the image gray level preprocessing is avoided and the efficiency of crack detection is improved.

Key words: Convolutional neural network, Crack detection, Deep learning, Image classification, Rroad pavement

CLC Number: 

  • TP391
[1]OLIVERA H,CORREIA P L.Supervised crack detection andclassification in images of road pavement flexible surfaces[M].Recent Advances in Signal Processing.InTech,2009.<br /> [2]JAHANSHAHI M R,JAZIZADEH F,MASRI S F,et al.Anunsupervised approach for autonomous pavement defect detection and quantification using an inexpensive depth sensor[J].Journal of Computing in Civil Engineering,2013,27(6):743-754.<br /> [3]ZHANG D,QU S,HE H,et al.Automatic ridgelet image enhancement algorithm for road crack image based on fuzzy entropy and fuzzy divergence[J].Opt.Lasers Eng.,2009,47 (11):1216-1225.<br /> [4]ZHANG Y.The design of glass crack detection system based on image pre-processing technology[C]∥Proceedings of IEEE 7th Joint International Information Technology and Artificial Intelligence Conference.Chongqing,China,2014:39-42.<br /> [5]彭博,蒋阳升,蒲云.基于数字图像处理的路面裂缝自动分类算法[J].中国公路学报,2014,27(9):10-18,24.<br /> [6]宋宏勋,马建,王建锋,等.基于双相机立体摄影测量的路面裂缝识别方法[J].中国公路学报,2015,28(10):18-25,40.<br /> [7]ZOU Q,CAO Y,LI Q,et al.CrackTree:automatic crack detection from pavement images[J].Pattern Recogn.Lett.,2012,33(3):227-238.<br /> [8]TALAB A M A,HUANG Z,XI F,et al.Detection crack in image using Otsu method and multiple filtering in image processing techniques [J].Optik,2016,127(3):1030-1033.<br /> [9]CHEN J H,SU M C,CAO R,et al.A self organizing map optimization based image recognition and processing model for bridge crack inspection[J].Automation in Construction,2017,73:58-66.<br /> [10]LIU Z,SHAHREL A,OHASHI T,et al.Tunnel crack detection and classification system based on image processing[C]∥Proc.SPIE.San Jose,California,USA,2002:145-152.<br /> [11]SAAR T,TALVIK O.Automatic asphalt pavement crack detection and classification using neural networks[C]∥Proceedings of the 12th Biennial Baltic Electronics Conference.Tallinn,Estonia,2010:345-348.<br /> [12]MOKHTATI S,WU L,YUN H B.Comparison of supervisedclassification techniques for vision based pavement crack detection[J].Transportation Research Record:Journal of the Transportation Research Board,2016,2595:119-127.<br /> [13]王睿,漆泰岳.基于机器视觉检测的裂缝特征研究[J].土木工程学报,2016,49(7):123-128.<br /> [14]LINS R G,GIVIGI S N.Automatic crack detection and measurement based on image analysis[J].IEEE Trans.Instrum.Meas.,2016,65 (3):583-590.<br /> [15]BRAY J,VERMA B,LI X,et al.A neural network based technique for automatic classification of road cracks[C]∥Proceedings of IEEE International Joint Conference on Neural Network.Vancouver,BC,Canada,2006:907-912.<br /> [16]ZHANG L,YANG F,ZHANG Y,et al.Road crack detection using deep convolutional neural network[C]∥Proceedings of IEEE International Conference on Image Processing.Phoenix,AZ,USA,2016:3708-3712.<br /> [17]CHA Y J,CHOI W,BUYUKOZTURK O.Deep learning-based crack damage detection using convolutional neural networks[J].Comput.Aided Civ.Inf.Eng.,2017,32 (5):361-378.<br /> [18]赵雪峰,李生元,欧进萍.基于人工智能与智能手机的混凝土裂纹检测[J].物联网技术,2017,7(8):15-18.<br /> [19]XIE D,ZHANG L,BAI L.Deep learning in visual computing and signal processing[J].Applied Computational Intelligence and Soft Computing,2017(10):1-13.<br /> [20]FENG C,LIU M Y,KAO C C,et al.Deep active learning forcivil infrastructure defect detection and classification[C]∥International Workshop on Computing in Civil Engineering.Seattle,Washington,USA,2017:298-306.<br /> [21]NAIR V,HINTON G E.Rectified linear units improve restricted boltzmann machines[C]∥Proceedings of the 27th International Conference on Machine Learning.Haifa,Israel,2010:807-814.<br /> [22]BOUREAU Y L,PONCE J,LECUN Y.A theoretical analysis of feature pooling in visual recognition[C]∥Proceedings of the 27th International Conference on Machine Learning.Haifa,Israel,2010:111-118.<br /> [23]SCHERER D,MÜLLER A,BEHNKE S.Evaluation of pooling operations in convolutional architectures for object recognition [C] //Proceedings of the ICANN.Thessaloniki,Greece,2010:92-101.<br /> [24]SRIVASTAVA N,HINTON G,KRIZHEVSKY A,et al.Dropout:a simple way to prevent neural networks from overfitting [J].The Journal of Machine Learning Research,2014,15(1):1929-1958.<br /> [25]WANG Y,HUANG M,ZHAO L.Attention-based lstmfor aspect-level sentiment classification[C]∥Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016:606-615.<br /> [26]BOUREAU Y L,PONCE J,LECUN Y.A theoretical analysis of feature pooling in visual recognition[C]∥Proceedings of the 27th International Conference on Machine Learning (ICML-10).2010:111-118.<br /> [27]SCHERER D,MüLLER A,BEHNKE S.Evaluation of pooling operations in convolutional architectures for object recognition[M]∥Artificial Neural Networks-ICANN 2010.Springer,Berlin,Heidelberg,2010:92-101<br /> [28]BETTAHAR S,STAMBOULI A B,LAMBERT P,et al.PDE-based enhancement of color images in RGB space [J].IEEE Transactions on Image Processing,2012,21(5):2500-2512.<br /> [29]JIA Y,SHELHAMER E,DONAHUE J,et al.Caffe:convolutional architecture for fast feature embedding[C]∥Proceedings of the 22nd ACM International Conference on Multimedia.New York,USA,2014:675-678.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[3] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[4] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[5] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[6] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[7] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[8] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[9] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[10] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[11] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[12] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[13] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[14] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[15] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!