Computer Science ›› 2023, Vol. 50 ›› Issue (2): 231-236.doi: 10.11896/jsjkx.211200290

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Crack Detection of Concrete Pavement Based on Attention Mechanism and Lightweight DilatedConvolution

QU Zhong, WANG Caiyun   

  1. College of Computer Science and Technology,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2021-12-27 Revised:2022-07-02 Online:2023-02-15 Published:2023-02-22
  • Supported by:
    National Natural Science Foundation of China(62176034)

Abstract: Cracks in the concrete pavement will affect the safety,applicability,and durability of the structure,and crack detection is a challenging research hotspot.This paper proposes a crack detection model composed of an improved full convolutional network and a deep supervision network,which uses the improved VGG-16 as the backbone network.Firstly,the low-level convolutional feature aggregation is fused to the backbone network again through the spatial attention mechanism.Secondly,the middle and high-level convolutional features are fused through the lightweight dilated convolution fusion module for multi-feature fusion to get the clear edge and high-resolution feature maps,all side feature maps are added to produce the final prediction map.Finally,the deep supervision network provides direct supervision for the detection results of each stage.In this paper,the focus loss function is selected as the evaluation function,and the trained network model can efficiently identify the crack location from the input original image under various conditions such as uneven illumination and complex background.To verify the effectiveness and robustness of the proposed method,it is compared with six methods on three datasets,DeepCrack,CFD,and Crack500,and the results show that it has excellent performance,and the F-score value reaches 87.12%.

Key words: Crack detection, Attention mechanism, Dilated convolution, Multiscale fusion, Fully convolutional network, Deep supervision network

CLC Number: 

  • TP391.41
[1]CHENG H,SHI X,GLAZIER C.Real-Time Image Thresholding Based on Sample Space Reduction and Interpolation Approach [J].Journal of Computing in Civil Engineering,2003,17(4):264-272.
[2]NEJAD F M,ZAKERI H.An Optimum Feature ExtractionMethod based on Wavelet-Radon Transform and Dynamic Neural Network for Pavement Distress Classification [J].Expert Systems with Applications,2011,38(8):9442-9460.
[3]AMHAZ R,CHAMBON S,IDIER J,et al.Automatic Crack Detection on Two-Dimensional Pavement Images:An Algorithm Based on Minimal Path Selection [J].IEEE Transactions on Intelligence Transport System,2016,17(10):2718-2729.
[4]YAMAGUCHI T,HASHIMOTO S.Fast crack detection me-thod for large-size concrete surface images using percolation-based image processing[J].Machine Vision and Applications,2010,21(5):797-809.
[5]FAN Z,LI C,CHEN Y,et al.Automatic Crack Detection on Road Pavements Using Encoder-Decoder Architecture [J].Materials,2020,13(13):2960.
[6]QU Z,CAO C,LIU L,et al.A Deeply Supervised Convolutional Neural Network for Pavement Crack Detection with Multiscale Feature Fusion[J].IEEE Transactions on Neural Networks and Learning Systems,2021,33(9):4890-4899.
[7]XU G Z,LIAO C G,C J J,et al.Extraction of Apparent Crack Information of Concrete Based on HU-ResNet[J].Computer Engineering,2020,46(11):279-285.
[8]HU J,LI S,GANG S,et al.Squeeze-and-Excitation Networks [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,42(8):2011 -2023.
[9]WOO S,PARK J,LEE J Y,et al.CBAM:Convolutional Block Attention Module [C]//European Conference on Computer Vision.Berlin:Springer,2018:3-19.
[10]CHEN Y,DAI X,LIU M,et al.Dynamic Convolution:Attention over convolution kernels [C]//IEEE Computer Vision and Pattern Recognition.2020:11030-11039.
[11]ZHAO T,WU X Q.Pyramid Feature Attention Network for Saliency detection [C]//IEEE Computer Vision and Pattern Re-cognition.2019:3080-3089.
[12]CHEN L C,PAPANDREOU G,SCHROFF F,et al.Rethinking Atrous Convolution for Semantic Image Segmentation [J].ar-Xiv:1706.05587,2017.
[13]CHOLLET F.Xception:Deep Learning with Depthwise Separable Convolutions [C]//IEEE Computer Vision and Pattern Re-cognition.IEEE,2017:1063-6919.
[14]LIU Y H,YAO J,LU X H,et al.DeepCrack:A Deep Hierarchical Feature Learning Architecture for Crack Segmentation [J].Neurocomputing,2019,338:139-153.
[15]SHI Y,CUI L,QI Z,et al.Automatic Road Crack Detectionusing Random Structured Forests [J].IEEE Transactions Intelligence Transport System,2016,17(12):3434-3445.
[16]YANG F,ZHANG L,YU S J,et al.Feature Pyramid and Hie-rarchical Boosting Network for Pavement Crack Detection [J].IEEE Transactions on Intelligent Transportation Systems,2020,21(4):1525-1535.
[17]REN Y P,HUANG J S,HONG Z Y,et al.Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolu-tional Networks [J].Construction and Building Materials,2020,234(20):117367.
[18]GU Z W,CHENG J,FU H Z,et al.CE-Net:Context Encoder Network for 2D Medical Image Segmentation [J].IEEE Transac-tions on Medical Imaging.2019(10):2281-2292.
[1] LI Shuai, XU Bin, HAN Yike, LIAO Tongxin. SS-GCN:Aspect-based Sentiment Analysis Model with Affective Enhancement and Syntactic Enhancement [J]. Computer Science, 2023, 50(3): 3-11.
[2] CHEN Fuqiang, KOU Jiamin, SU Limin, LI Ke. Multi-information Optimized Entity Alignment Model Based on Graph Neural Network [J]. Computer Science, 2023, 50(3): 34-41.
[3] ZHOU Mingqiang, DAI Kailang, WU Quanwang, ZHU Qingsheng. Attention-aware Multi-channel Graph Convolutional Rating Prediction Model for Heterogeneous Information Networks [J]. Computer Science, 2023, 50(3): 129-138.
[4] ZOU Yunzhu, DU Shengdong, TENG Fei, LI Tianrui. Visual Question Answering Model Based on Multi-modal Deep Feature Fusion [J]. Computer Science, 2023, 50(2): 123-129.
[5] LIU Luping, ZHOU Xin, CHEN Junjun, He Xiaohai, QING Linbo, WANG Meiling. Event Extraction Method Based on Conversational Machine Reading Comprehension Model [J]. Computer Science, 2023, 50(2): 275-284.
[6] LI Xuehui, ZHANG Yongjun, SHI Dianxi, XU Huachi, SHI Yanyan. AFTM:Anchor-free Object Tracking Method with Attention Features [J]. Computer Science, 2023, 50(1): 138-146.
[7] ZHAO Qian, ZHOU Dongming, YANG Hao, WANG Changchen. Image Deblurring Based on Residual Attention and Multi-feature Fusion [J]. Computer Science, 2023, 50(1): 147-155.
[8] ZHENG Cheng, MEI Liang, ZHAO Yiyan, ZHANG Suhang. Text Classification Method Based on Bidirectional Attention and Gated Graph Convolutional Networks [J]. Computer Science, 2023, 50(1): 221-228.
[9] CAI Xiao, CEHN Zhihua, SHENG Bin. SPT:Swin Pyramid Transformer for Object Detection of Remote Sensing [J]. Computer Science, 2023, 50(1): 105-113.
[10] ZHANG Jingyuan, WANG Hongxia, HE Peisong. Multitask Transformer-based Network for Image Splicing Manipulation Detection [J]. Computer Science, 2023, 50(1): 114-122.
[11] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[12] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[13] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[14] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[15] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!