Computer Science ›› 2024, Vol. 51 ›› Issue (11A): 240100141-9.doi: 10.11896/jsjkx.240100141

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Road Crack Detection Based on Separable Convolution and Wave Transform Fusion

LIU Yunqing1,2, WU Yue1, ZHANG Qiong1,2, YAN Fei1,2, CHEN Shanshan1   

  1. 1 School of Electronics Information,Changchun University of Science and Technology,Changchun 130000,China
    2 Jilin Provincial Science and Technology Innovation Center of Intelligent Perception and Information Processing,Changchun 130000,China
  • Online:2024-11-16 Published:2024-11-13
  • About author:LIU Yunqing,born in 1970,professor,Ph.D supervisor.His main research interests include computer vision and radar signal processing and laser communication.
  • Supported by:
    Young Scientists Fund of the National Natural Science Foundation of China(42204144) and Natural Science Foundation of Jilin Province,China(YDZJ202101ZYTS064).

Abstract: Aiming at the current problems of weak detection ability and low segmentation accuracy for small cracks,an improved U-Net model is proposed to detect road cracks and improve detection ability and segmentation accuracy.This paper designs a new module,multi scale depth separated convolutional block(MSDWBlock),which is applied in the encoder and decoder sections.Through its depthwise separable convolution,the model's ability is enhanced,the model's receptive field is expanded,and a C2G attention mechanism module is introduced in the skip connection section to enhance the model's perception of crack features.And atrous spatial pyramid pooling(ASPP) and discrete wavelet transformation(DWT) are introduced.ASPP helps to capture the characteristics of cracks by operating at multiple scales,while DWT can reduce the loss of crack spatial information during convolutional pooling and preserve crack edge information.This structural design makes the network more focused on the characteristics of cracks,thereby improving the accuracy of crack detection.It has been demonstrated through experiments that the accuracy of the proposed model is better than that of advanced models such as U-Net,Segnet,and U2net.On the CFD dataset,mIoU and F1 reaches 78.51% and 0.868 respectively.These results indicate that the proposed method can effectively improve the perfor-mance of road crack detection.

Key words: Crack detection, U-net neural network, Depthwise separable convolutional, Attention mechanism, Spatial pyramid, Wavelet transform

CLC Number: 

  • TP391
[1]2020 Statistical Bulletin on the Development of the Transportation Industry [J].Communications Finance and Accounting,2021(6):92-97.
[2]MA L,LI J.SD-GCN:Saliency-based dilated graph convolutionnetwork for pavement crack extraction from 3D point clouds[J].International Journal of Applied Earth Observation and Geoinformation,2022,111:102836.
[3]GUPTA P,DIXIT M.Image-based crack detection approaches:a comprehensive survey[J].Multimedia Tools and Applications,2022,81(28):40181-40229.
[4]SHI Y,CUI L,QI Z,et al.Automatic road crack detec-tion using random structured forests[J].IEEE Transactions on Intelligent Transportation Systems,2016,17(12):3434-3445.
[5]ZOU Q,CAO Y,LI Q,et al.CrackTree:Automatic crack detection from pavement images[J].Pattern Recognition Letters,2012,33(3):227-238.
[6]LI Q,ZOU Q,ZHANG D,et al.FoSA:F*seed-growing ap-proach for crack-line detection from pavement images[J].Image and Vision Computing,2011,29(12):861-872.
[7]DORAFSHAN S,THOMAS R J,MAGUIREM.Comparison ofdeep convolutional neural networks and edge detectors for image-based crack detection in concrete[J].Construction and Building Materials,2018,186:1031-1045.
[8]KAMALIARDAKANI M,SUN L,ARDAKANI M K.Sealed-crack detection algorithm using heuristic thresholding approach[J].Journal of Computing in Civil Engineering,2016,30(1):04014110.
[9]WANG J,LIU F,YANG W,et al.Pavement crack detectionusing attention u-net with multiple sources[C]//Pattern Recognition and Computer Vision:Third Chinese Conference(PRCV 2020).Nanjing,China,Part II 3.Springer International Publishing,2020:664-672.
[10]ZHANG L,YANG F,ZHANG Y D,et al.Road crack detection using deep convolutional neural network[C]//2016 IEEE International Conference on Image Processing(ICIP).IEEE,2016:3708-3712.
[11]ZHANG A,WANG K C P,LI B,et al.Automated pixel-levelpavement crack detection on 3D asphalt surfaces using a deep-learning network[J].Computer-Aided Civil and Infrastructure Engineering,2017,32(10):805-819.
[12]LI G,MA B,HE S,et al.Automatic tunnel crack detection based on u-net and a convolutional neural network with alternately updated clique[J].Sensors,2020,20(3):717.
[13]ZHU S,DU J,LI Y,et al.Method for bridge crack detectionbased on the U-Net convolutional networks[J].Journal of Xi-dian University,2019,46(4):35-42.
[14]LIU Z,CAO Y,WANG Y,et al.Computer vision-based concretecrack detection using U-net fully convolutional networks[J].Automation in Construction,2019,104:129-139.
[15]HUYAN J,LI W,TIGHE S,et al.CrackU-net:A novel deepconvolutional neural network for pixelwise pavement crack detection[J].Structural Control and Health Monitoring,2020,27(8):e2551.
[16]HOWARD A G,ZHU M,CHEN B,et al.Mobilenets:Efficient convolutional neural networks for mobile vision applications[J].arXiv:1704.04861,2017.
[17]GUO T,MOUSAVI H S,VU T H,et al.Deep wavelet prediction for image super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.2017:104-113.
[18]BAE W,YOO J,CHULYE J.Beyond deep residual learning for image restoration:Persistent homology-guided manifold simplification[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.2017:145-153.
[19]LI Q,SHEN L,GUO S,et al.Wavelet integrated CNNs fornoise-robust image classification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:7245-7254.
[20]MNIH V,BADIA A P,MIRZA M,et al.Asynchronous methods for deep reinforcement learning[C]//International Conference on Machine Learning.PMLR,2016:1928-1937.
[1] LI Yunchen, ZHANG Rui, WANG Jiabao, LI Yang, WANG Ziqi, CHEN Yao. Re-parameterization Enhanced Dual-modal Realtime Object Detection Model [J]. Computer Science, 2024, 51(9): 162-172.
[2] HU Pengfei, WANG Youguo, ZHAI Qiqing, YAN Jun, BAI Quan. Night Vehicle Detection Algorithm Based on YOLOv5s and Bistable Stochastic Resonance [J]. Computer Science, 2024, 51(9): 173-181.
[3] LIU Qian, BAI Zhihao, CHENG Chunling, GUI Yaocheng. Image-Text Sentiment Classification Model Based on Multi-scale Cross-modal Feature Fusion [J]. Computer Science, 2024, 51(9): 258-264.
[4] LI Zhe, LIU Yiyang, WANG Ke, YANG Jie, LI Yafei, XU Mingliang. Real-time Prediction Model of Carrier Aircraft Landing Trajectory Based on Stagewise Autoencoders and Attention Mechanism [J]. Computer Science, 2024, 51(9): 273-282.
[5] LIU Qilong, LI Bicheng, HUANG Zhiyong. CCSD:Topic-oriented Sarcasm Detection [J]. Computer Science, 2024, 51(9): 310-318.
[6] YAO Yao, YANG Jibin, ZHANG Xiongwei, LI Yihao, SONG Gongkunkun. CLU-Net Speech Enhancement Network for Radio Communication [J]. Computer Science, 2024, 51(9): 338-345.
[7] LIU Sichun, WANG Xiaoping, PEI Xilong, LUO Hangyu. Scene Segmentation Model Based on Dual Learning [J]. Computer Science, 2024, 51(8): 133-142.
[8] ZHANG Rui, WANG Ziqi, LI Yang, WANG Jiabao, CHEN Yao. Task-aware Few-shot SAR Image Classification Method Based on Multi-scale Attention Mechanism [J]. Computer Science, 2024, 51(8): 160-167.
[9] WANG Qian, HE Lang, WANG Zhanqing, HUANG Kun. Road Extraction Algorithm for Remote Sensing Images Based on Improved DeepLabv3+ [J]. Computer Science, 2024, 51(8): 168-175.
[10] XIAO Xiao, BAI Zhengyao, LI Zekai, LIU Xuheng, DU Jiajin. Parallel Multi-scale with Attention Mechanism for Point Cloud Upsampling [J]. Computer Science, 2024, 51(8): 183-191.
[11] PU Bin, LIANG Zhengyou, SUN Yu. Monocular 3D Object Detection Based on Height-Depth Constraint and Edge Fusion [J]. Computer Science, 2024, 51(8): 192-199.
[12] ZHANG Junsan, CHENG Ming, SHEN Xiuxuan, LIU Yuxue, WANG Leiquan. Diversified Label Matrix Based Medical Image Report Generation [J]. Computer Science, 2024, 51(8): 200-208.
[13] WANG Chao, TANG Chao, WANG Wenjian, ZHANG Jing. Infrared Human Action Recognition Method Based on Multimodal Attention Network [J]. Computer Science, 2024, 51(8): 232-241.
[14] ZHANG Lu, DUAN Youxiang, LIU Juan, LU Yuxi. Chinese Geological Entity Relation Extraction Based on RoBERTa and Weighted Graph Convolutional Networks [J]. Computer Science, 2024, 51(8): 297-303.
[15] CHEN Shanshan, YAO Subin. Study on Recommendation Algorithms Based on Knowledge Graph and Neighbor PerceptionAttention Mechanism [J]. Computer Science, 2024, 51(8): 313-323.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!