Computer Science ›› 2024, Vol. 51 ›› Issue (11): 198-204.doi: 10.11896/jsjkx.240100082

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Crack Detection of Concrete Pavement Based on Attention Mechanism and Deep Feature Optimization

XIA Shufang, YUAN Bin, QU Zhong   

  1. School of Software Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2024-01-08 Revised:2024-05-27 Online:2024-11-15 Published:2024-11-06
  • About author:XIA Shufang,born in 1980,Ph.D.Her main research interests include compu-ter vision,machine learning and artificial intelligence.
    QU Zhong,born in 1972,Ph.D,professor.His main research interests include computer vision,machine learning and artificial intelligence.
  • Supported by:
    National Natural Science Foundation of China(62176034).

Abstract: Automatic crack detection is the key to ensure the quality of concrete pavement and improve the efficiency of road maintenance.Aiming at the shortcomings of existing methods in paying attention to crack features and the problem of easy loss of crack detail information in deep feature maps,this paper proposes a network model that integrates attention mechanism and deep feature optimization strategy,using VGG-16 as the backbone network.Firstly,a lightweight shuffle attention mechanism is introduced after the middle and high level convolutions of the backbone network,aiming to improve the sensitivity of the network to crack features.Secondly,in order to further enhance the capture ability of crack features,the corresponding attention module is embedded in the side output of each stage.Finally,a spatial separable pyramid module is proposed and an attention fusion module is designed to optimize the deep feature map and restore more crack details.The side network assisted in generating the final prediction image by fusing the low-level and high-level features at multiple levels.The network uses the binary cross-entropy loss function as the evaluation function,and the trained network model can accurately identify the crack position from the input original image under complex background.To verify the effectiveness of the proposed method,it is compared with six methods on three datasets,DeepCrack,CFD,and Crack500.The proposed algorithm shows excellent performance,and the F-score value reaches 87.19%.

Key words: Crack detection, Attention mechanism, Deep feature optimization, Multi-feature fusion, Shuffle attention, Spatial separable pyramid

CLC Number: 

  • TP391.41
[1] ZHANG Q L,YANG Y B.SA-Net:Shuffle Attention for Deep Convolutional Neural Networks[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.Toronto:IEEE,2021:2235-2239.
[2] WU Y,YANG W,PAN J,et al.Asphalt Pavement Crack Detection Based on Multi-scale Full Convolutional Network[J].Journal of Intelligent & Fuzzy Systems,2021,40(1):1495-1508.
[3] MA D,FANG H,WANG N,et al.A Real-time Crack Detection Algorithm for Pavement Based on CNN with Multiple Feature Layers[J].Road Materials and Pavement Design,2022,23(9):2115-2131.
[4] ZHOU Q,QU Z,WANG S Y,et al.A Method of PotentiallyPromising Network for Crack Detection with Enhanced Convolution and Dynamic Feature Fusion[J].IEEE Transactions on Intelligent Transportation Systems,2022,23(10):18736-18745.
[5] XU C,ZHANG Q,MEI L,et al.Dense Multiscale FeatureLearning Transformer Embedding Cross-Shaped Attention for Road Damage Detection[J].Electronics,2023,12(4):898.
[6] ZHOU Q,QU Z,LI Y X,et al.Tunnel Crack Detection with Linear Seam Based on Mixed Attention and Multiscale Feature Fusion[J].IEEE Transactionson Instrumentation and Measurement,2022,71(1):1-11.
[7] SU H,WANG X,HAN T,et al.Research on a U-Net BridgeCrack Identification and Feature-Calculation Methods Based on a CBAM Attention Mechanism[J].Buildings,2022,12(10):1561-1572.
[8] SUN X,XIE Y,JIANG L,et al.Dma-net:Deeplab with Multi-scale Attention for Pavement Crack Segmentation[J].IEEE Transactions on Intelligent Transportation Systems,2022,23(10):18392-18403.
[9] HANG J,WU Y,LI Y,et al.A Deep Learning Semantic Seg-mentation Network with Attention Mechanism for Concrete Crack Detection[J].Structural Health Monitoring,2023,22(5):3006-3026.
[10] YANG L,BAI S,LIU Y,et al.Multi-scale Triple-attention Network for Pixelwise Crack Segmentation[J].Automation in Construction,2023,150:104853.
[11] ZOU Q,ZHANG Z,LI Q,et al.Deepcrack:Learning Hierarchical Convolutional Features for Crack Detection[J].IEEE Transactions on Image Processing,2019,28(3):1498-1512.
[12] LIU Y,YAO J,LU X,et al.DeepCrack:A Deep Hierarchical Feature Learning Architecture for Crack Segmentation[J].Neurocomputing,2019,338(21):139-153.
[13] QU Z,WANG C Y,WANG S Y,et al.A Method of HierarchicalFeature Fusion and Connected Attention Architecture for Pavement Crack Detection[J].IEEE Transactions on Intelligent Transportation Systems,2022,23(9):16038-16047.
[14] XU S,HAO M,LIU G,et al.Concrete Crack SegmentationBased on Convolution-deconvolution Feature Fusion with Holistically Nested Networks[J].Structural Control and Health Monitoring,2022,29(8):2965-2976.
[15] FU J,LIU J,TIAN H,et al.Dual Attention Network for Scene Segmentation[C]//IEEE Computer Vision and Pattern Recognition.Long Beach:IEEE,2019:3146-3154.
[16] SHI Y,CUI L,QI Z,et al.Automatic Road Crack Detection using Random Structured Forests[J].IEEE Transactions Intelligence Transport System,2016,17(12):3434-3445.
[17] YANG F,ZHANG L,YU S J,et al.Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection[J].IEEE Transactions on Intelligent Transportation Systems,2020,21(4):1525-1535.
[18] CHEN J,LU Y,YU Q,et al.Transunet:Transformers Make Strong Encoders for Medical Image Segmentation[J].arXiv:2102.04306,2021.
[19] LIU H,MIAO X,MERTZ C,et al.CrackFormer:Transformer Network for Fine-Grained Crack Detection[C]//IEEE International Conference on Computer Vision.IEEE,2021:3783-3792.
[20] HAN C,MA T,HUYAN J,et al.CrackW-Net:A Novel Pavement Crack Image Segmentation Convolutional Neural Network[J].IEEE Transactions on Intelligent Transportation Systems,2021,23(11):22135-22144.
[21] CHEN H,LIN H.An Effective Hybrid Atrous ConvolutionalNetwork for Pixel-level Crack Detection[J].IEEE Transactions on Instrumentation and Measurement,2021,70:1-12.
[1] LI Yunchen, ZHANG Rui, WANG Jiabao, LI Yang, WANG Ziqi, CHEN Yao. Re-parameterization Enhanced Dual-modal Realtime Object Detection Model [J]. Computer Science, 2024, 51(9): 162-172.
[2] HU Pengfei, WANG Youguo, ZHAI Qiqing, YAN Jun, BAI Quan. Night Vehicle Detection Algorithm Based on YOLOv5s and Bistable Stochastic Resonance [J]. Computer Science, 2024, 51(9): 173-181.
[3] LIU Qian, BAI Zhihao, CHENG Chunling, GUI Yaocheng. Image-Text Sentiment Classification Model Based on Multi-scale Cross-modal Feature Fusion [J]. Computer Science, 2024, 51(9): 258-264.
[4] LI Zhe, LIU Yiyang, WANG Ke, YANG Jie, LI Yafei, XU Mingliang. Real-time Prediction Model of Carrier Aircraft Landing Trajectory Based on Stagewise Autoencoders and Attention Mechanism [J]. Computer Science, 2024, 51(9): 273-282.
[5] LIU Qilong, LI Bicheng, HUANG Zhiyong. CCSD:Topic-oriented Sarcasm Detection [J]. Computer Science, 2024, 51(9): 310-318.
[6] YAO Yao, YANG Jibin, ZHANG Xiongwei, LI Yihao, SONG Gongkunkun. CLU-Net Speech Enhancement Network for Radio Communication [J]. Computer Science, 2024, 51(9): 338-345.
[7] ZHANG Lu, DUAN Youxiang, LIU Juan, LU Yuxi. Chinese Geological Entity Relation Extraction Based on RoBERTa and Weighted Graph Convolutional Networks [J]. Computer Science, 2024, 51(8): 297-303.
[8] CHEN Shanshan, YAO Subin. Study on Recommendation Algorithms Based on Knowledge Graph and Neighbor PerceptionAttention Mechanism [J]. Computer Science, 2024, 51(8): 313-323.
[9] LIU Sichun, WANG Xiaoping, PEI Xilong, LUO Hangyu. Scene Segmentation Model Based on Dual Learning [J]. Computer Science, 2024, 51(8): 133-142.
[10] ZHANG Rui, WANG Ziqi, LI Yang, WANG Jiabao, CHEN Yao. Task-aware Few-shot SAR Image Classification Method Based on Multi-scale Attention Mechanism [J]. Computer Science, 2024, 51(8): 160-167.
[11] WANG Qian, HE Lang, WANG Zhanqing, HUANG Kun. Road Extraction Algorithm for Remote Sensing Images Based on Improved DeepLabv3+ [J]. Computer Science, 2024, 51(8): 168-175.
[12] XIAO Xiao, BAI Zhengyao, LI Zekai, LIU Xuheng, DU Jiajin. Parallel Multi-scale with Attention Mechanism for Point Cloud Upsampling [J]. Computer Science, 2024, 51(8): 183-191.
[13] PU Bin, LIANG Zhengyou, SUN Yu. Monocular 3D Object Detection Based on Height-Depth Constraint and Edge Fusion [J]. Computer Science, 2024, 51(8): 192-199.
[14] ZHANG Junsan, CHENG Ming, SHEN Xiuxuan, LIU Yuxue, WANG Leiquan. Diversified Label Matrix Based Medical Image Report Generation [J]. Computer Science, 2024, 51(8): 200-208.
[15] WANG Chao, TANG Chao, WANG Wenjian, ZHANG Jing. Infrared Human Action Recognition Method Based on Multimodal Attention Network [J]. Computer Science, 2024, 51(8): 232-241.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!