Computer Science ›› 2022, Vol. 49 ›› Issue (1): 204-211.doi: 10.11896/jsjkx.210100128

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Crack U-Net:Towards High Quality Pavement Crack Detection

ZHU Yi-fan, WANG Hai-tao, LI Ke, WU He-jun   

  1. School of Computer Science and Engineering,SunYet-San University,Guangzhou 510006,China
  • Received:2021-01-18 Revised:2021-05-10 Online:2022-01-15 Published:2022-01-18
  • About author:ZHU Yi-fan,born in 1997,postgra-duate.Her main research interests include computer vision and crack detection.
    WU He-jun,born in 1974,Ph.D,asso-ciate professor.His main research in-terests include intelligent perception computing,new mobile Internet of things,autonomous robot clusters.
  • Supported by:
    Shanghai Science and Technology Program(20511100600) and National Natural Science Foundation of China (62076094).

Abstract: Pavement cracks constitute a major potential threat to driving safety.Previous manual detection methods are highly subjective and inefficient.Current computer vision methods have limited applications in crack detection.Existing models have poor generalization capabilities and limited detection effects.To address this problem,a dense network structure of pavement crack detection,called Crack U-Net,is proposed to improve the model generalization capabilities and detection accuracy.Firstly,the dense connection structure of Crack U-Net adopts the network design from the encoder-decoder backbone network U-Net.Similar to the encoder-decoder backbone network,this structure of Crack U-Net is able to improve the utilization of feature information and to enhance the robustness of the model,as well.Secondly,the Crack U-block composed of residual blocks and mini-U is proposed as the basic convolution module of the network,which can extract more abundant crack features compared with the traditional dou-ble-layer convolution layer.Finally,dilated convolution is used in the middle layer of up sampling and down sampling in the network to fully capture the crack features,which is at the edge if the image.Crack U-Net runs on public fracture dataset and produces a series of experimental results.The experimental results show that the AIU value of this method on the dataset is 2.2% higher than the previous method,and it is better than the existing fracture segmentation accuracy and generalization.The experimental results also show that Crack U-Net model can be pruned,and the pruned model is suitable for loading to mobile devices for road crack detection.

Key words: Crack detection, Deep learning, Image segmentation, Road pavement

CLC Number: 

  • TP391
[1]LI H F,WU Z L,NIE J J,et al.Automatic crack detection algorithm for airport pavement based on depth image[J].Journal of Traffic and Transportation Engineering,2021,20(6):1-12.
[2]TIAN W,SHEN H,LI X,et al.Research on corridor surface crack detection technology based on image processing[J].Electronic Design Engineering,2020,28(5):148-151,156.
[3]MARQUES A,CORREIA P L.Automatic road pavement crack detection using SVM[J].Lisbon,Portugal:Dissertation for the Master of Science Degree in Electrical and Computer Enginee-ring at Instituto Superior Técnico,2012,31(4):157-170.
[4]RONNEBERGER O,FISCHER P,BROX T.U-net:Convolu-tional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Compu-ter-assisted Intervention.Cham:Springer,2015:234-241.
[5]ZHOU Z,SIDDIQUEE M M R,TAJBAKHSH N,et al.Unet++:Redesigning skip connections to exploit multiscale features in image segmentation[J].IEEE Transactions on Medical Imaging,2019,39(6):1856-1867.
[6]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[7]YU F,KOLTUN V.Multi-scale context aggregation by dilated convolutions[J].arXiv:1511.07122.
[8]CHA Y J,CHOI W,BÜYÜKÖZTÜRK O.Deep learning-based crack damage detection using convolutional neural networks[J].Computer-Aided Civil and Infrastructure Engineering,2017,32(5):361-378.
[9]PAULY L,PEEL H,LUO S,et al.Deeper Networks for Pavement Crack Detection[C]//34th International Symposium in Automation and Robotics in Construction.2017:479-485.
[10]TANG J,MAO Y,WANG J,et al.Multi-task enhanced damcrack image detection based on faster R-CNN[C]//2019 IEEE 4th International Conference on Image,Vision and Computing (ICIVC).IEEE,2019:336-340.
[11]SUH G,CHA Y J.Deep faster R-CNN-based automated detection and localization of multiple types of damage[C]//Sensors and Smart Structures Technologies for Civil,Mechanical and Aerospace Systems 2018.International Society for Optics and Photonics,2018,10598:105980T.
[12]CHA Y J,CHOI W,SUH G,et al.Autonomous structural vi-sual inspection using region-based deep learning for detecting multiple damage types[J].Computer-Aided Civil and Infrastructure Engineering,2018,33(9):731-747.
[13]ZEILER M D,FERGUS R.Visualizing and understanding con-volutional networks[C]//European Conference on Computer Vision.Cham:Springer,2014:818-833.
[14]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.Imagenetclassification with deep convolutional neural networks[J].Communications of the ACM,2017,60(6):84-90.
[15]LONG J,SHELHAMER E,DARRELL T.Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3431-3440.
[16]BADRINARAYANAN V,KENDALL A,CIPOLLA R.Segnet:A deep convolutional encoder-decoder architecture for image segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(12):2481-2495.
[17]YANG F,ZHANG L,YU S,et al.Feature pyramid and hierarchical boosting network for pavement crack detection[J].IEEE Transactions on Intelligent Transportation Systems,2019,21(4):1525-1535.
[18]XIE S,TU Z.Holistically-nested edge detection[C]//Procee-dings of the IEEE International Conference on Computer Vision.2015:1395-1403.
[19]REN Y,HUANG J,HONG Z,et al.Image-based concrete crack detection in tunnels using deep fully convolutional networks[J].Construction and Building Materials,2020,234:117367.
[20]LIU Z,CAO Y,WANG Y,et al.Computer vision-based concrete crack detection using U-net fully convolutional networks[J].Automation in Construction.2019,104:129-139.
[21]QU Z,XIE Y.Concrete Pavement Crack Detection Algorithm Based on Full U-net[J].Computer Science,2021,48(4):187-191.
[22]HUANG G,LIU Z,VAN DER MAATEN L,et al.Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4700-4708.
[23]LEE C Y,XIE S,GALLAGHER P,et al.Deeply-supervised nets[C]//Artificial Intelligence and Statistics.2015:562-570.
[24]LIN T Y,GOYAL P,GIRSHICK R,et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2980-2988.
[25]SHI Y,CUI L,QI Z,et al.Automatic road crack detection using random structured forests[J].IEEE Transactions on Intelligent Transportation Systems,2016,17(12):3434-3445.
[26]LIU Y,CHENG M M,HU X,et al.Richer convolutional features for edge detection[C]//Proceedings of the IEEE Confe-rence on Computer Vision and Pattern Recognition.2017:3000-3009.
[1] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[2] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[4] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[5] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[6] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[7] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[8] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[9] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[10] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[11] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[12] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[13] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
[14] CHU Yu-chun, GONG Hang, Wang Xue-fang, LIU Pei-shun. Study on Knowledge Distillation of Target Detection Algorithm Based on YOLOv4 [J]. Computer Science, 2022, 49(6A): 337-344.
[15] ZHU Wen-tao, LAN Xian-chao, LUO Huan-lin, YUE Bing, WANG Yang. Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN [J]. Computer Science, 2022, 49(6A): 378-383.
Full text



No Suggested Reading articles found!