Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 230900113-7.doi: 10.11896/jsjkx.230900113

• Image Processing & Multimedia Technology • Previous Articles    

Improved YOLOv5s Lightweight Steel Surface Defect Detection Model

JIANG Bo1, WAN Yi1, XIE Xianzhong2   

  1. 1 School of Communication and Information Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    2 Graduate School,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Published:2023-11-09
  • About author:JIANG Bo,born in 1998,postgraduate.His main research interests include machine learning and image processing.

Abstract: Aiming at the problems of complex structure,large number of parameters,poor detection accuracy and real-time performance of existing steel surface defect detection models,this paper proposes an improved YOLOv5s lightweight steel surface defect detection model.Firstly,the MobileNetv3-Small is used to replace the YOLOv5s backbone extraction network,achieving model lightweight and improving detection speed.Secondly,in the feature fusion stage,a weighted bidirectional feature pyramid network (BiFPN) is used to enhance feature extraction.By fusing features of different scales,the accuracy and robustness of detection are improved.Simultaneously,the convolutional block attention module(CBAM) attention mechanism is introduced to enhance the model's ability to detect small scale targets.Finally,the K-means++ algorithm is proposed to cluster prior boxes,improve the accuracy and convergence speed of prior box clustering.The average accuracy of the improved YOLOv5s on the NEU-DET dataset (mAP@0.5) reaches 77.2%,with a detection speed of 102 FPS on NVIDIA 1080Ti.Compared to the original YOLOv5s,the mAP is increased by 3.90%,the parameter quantity is decreased by 58.6%,the volume is decreased by 34%,and the detection speed is increased by 29.7%.Experimental results demonstrate that the improved lightweight YOLOv5s effectively improves both the accuracy and speed of steel surface defect detection.Moreover,it is easy to deploy and meet the requirements of actual production in the steel strip industry.

Key words: Defect detection, YOLOv5s, lightweight, MobileNetv3-Small, BiFPN, CBAM, K-means++

CLC Number: 

  • TP391
[1]ZHANG R,WANG Y Y,DUAN Y Q,et al.Real time object detection and localization algorithm for flight robotic arms[J].Journal of Nanjing University of Aeronautics and Astronautics,2022,54 (1):27-33.
[2]GIRSHICK R.Fast r-cnn[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:1440-1448.
[3]DAI J,LI Y,HE K,et al.R-fcn:Object detection via region-based fully convolutional networks[J].Advances in Neural Information Processing Systems,2016,29:379-387.
[4]HE K,GKIOXARI G,DOLLÁR P,et al.Mask r-cnn[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2961-2969.
[5]LIU W,ANGUELOV D,ERHAN D,et al.Ssd:Single shotmultibox detector[C]//Computer Vision-ECCV 2016:14th European Conference,Amsterdam,The Netherlands(Part I 14).Springer International Publishing,2016:21-37.
[6]REDMON J,DIVVALA S,GIRSHICKR,et al.You only lookonce:Unified,real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:779-788.
[7]REDMON J,FARHADI A.Yolov3:An incremental improve-ment[J].arXiv:1804.02767,2018.
[8]BOCHKOVSKIY A,WANG C Y,LIAO H Y M.Yolov4:Optimal speed and accuracy of object detection[J].arXiv:2004.10934,2020.
[9]GE Z,LIU S,WANG F,et al.Yolox:Exceeding yolo series in 2021[J].arXiv:2107.08430,2021.
[10]WANG C Y,BOCHKOVSKIY A,LIAO H Y M.YOLOv7:Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:7464-7475.
[11]YANG J H,LI H,DU Y Y,et al.Lightweight object detection algorithm based on improved YOLOv5s[J].Electro Optics and Control,2023,30 (2):24-30.
[12]CAO Y Q,WU M L,XU L.Steel surface defect detection based on improved YOLOv5 algorithm[J].Journal of Graphics,2023,44 (2):335
[13]LI X,WANG C,LI B,et al.Improvement of YOLOv5 steel surface defect detection algorithm [J].Journal of Air Force Engineering University(Natural Science Edition),2022,23(2):26-33.
[14]WU D,LI M H,MA W K,et al.Steel surface defect detection based on improved YOLOv5[J].Journal of Shanxi University of Science&Technology,2023,41 (2):162-169.
[15]HOWARD A,SANDLER M,CHU G,et al.Searching for MobileNetv3[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:1314-1324.
[16]HOWARD A G,ZHU M,CHEN B,et al.Mobilenets:Efficient convolutional neural networks for mobile vision applications[J].arXiv:1704.04861,2017.
[17]SANDLER M,HOWARD A,ZHU M,et al.Mobilenetv2:Inverted residuals and linear bottlenecks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:4510-4520.
[18]TAN M,PANG R,LE Q V.Efficientdet:Scalable and efficient object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:10781-10790.
[19]WOO S,PARK J,LEE J Y,et al.Cbam:Convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision(ECCV).2018:3-19.
[20]MODHA D S,SPANGLER W S.Feature weighting in k-means clustering[J].Machine learning,2003,52:217-237.
[21]ARTHUR D,VASSILVITSKII S.K-means++ the advantages of careful seeding[C]//Proceedings of the Eighteenth Aannual ACM-SIAM Symposium on Discrete Algorithms.2007:1027-1035.
[22]HE Y,SONG K,MENG Q,et al.An end-to-end steel surfacedefect detection approach via fusing multiple hierarchical features[J].IEEE Transactions on Instrumentation and Measurement,2019,69(4):1493-1504.
[23]ZHANG X,ZHOU X,LIN M,et al.Shufflenet:An extremelyefficient convolutional neural network for mobile devices[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:6848-6856.
[24]HAN K,WANG Y,TIAN Q,et al.Ghostnet:More featuresfrom cheap operations[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:1580-1589.
[1] LIU Yubo, GUO Bin, MA Ke, QIU Chen, LIU Sicong. Design of Visual Context-driven Interactive Bot System [J]. Computer Science, 2023, 50(9): 260-268.
[2] ZHONG Yue, GU Jieming, CAO Honglin. Survey of Lightweight Block Cipher [J]. Computer Science, 2023, 50(9): 3-15.
[3] ZHANG Xiao, DONG Hongbin. Lightweight Multi-view Stereo Integrating Coarse Cost Volume and Bilateral Grid [J]. Computer Science, 2023, 50(8): 125-132.
[4] BAI Mingli, WANG Mingwen. Fabric Defect Detection Algorithm Based on Improved Cascade R-CNN [J]. Computer Science, 2023, 50(6A): 220300224-6.
[5] DOU Zhi, HU Chenguang, LIANG Jingyi, ZHENG Liming, LIU Guoqi. Lightweight Target Detection Algorithm Based on Improved Yolov4-tiny [J]. Computer Science, 2023, 50(6A): 220700006-7.
[6] LEI Ying, LIU Feng. LDM-EEG:A Lightweight EEG Emotion Recognition Method Based on Dual-stream Structure Scaling and Multiple Attention Mechanisms [J]. Computer Science, 2023, 50(6A): 220300262-9.
[7] LIANG Weiliang, LI Yue, WANG Pengfei. Lightweight Face Generation Method Based on TransEditor and Its Application Specification [J]. Computer Science, 2023, 50(2): 221-230.
[8] WU Jiaojiao, LIU Zheng. Electrolyzer Equipment and Sample Detection Method Based on Multi-scale Improved YOLOv5 [J]. Computer Science, 2023, 50(11A): 230200163-6.
[9] JIANG Ke, SHI Jianqiang, CHEN Guangwu. Railway Track Detection Method Based on Improved YOLOv5s [J]. Computer Science, 2023, 50(11A): 230200101-6.
[10] LUO Yuetong, LI Chao, DUAN Chang, ZHOU Bo. Hue Augmentation Method for Industrial Product Surface Defect Images [J]. Computer Science, 2023, 50(11A): 230200089-6.
[11] LI Hua, ZHAO Lingdi, CHEN Yujie, YANG Yang, DU Xinzhao. Lightweight Graph Convolution Action Recognition Algorithm Based on Multi-streamFusion [J]. Computer Science, 2023, 50(11A): 220800147-6.
[12] ZOU Chenwei, YAO Rao. Study on Ultrasonic Phased Array Defect Detection Based on Machine Vision [J]. Computer Science, 2023, 50(11A): 230200150-6.
[13] ZHANG Xiaoxiao, DENG Chengzhi, WU Zhaoming, CAO Chunyang, HU Cheng. Magnetic Tile Defect Detection Algorithm Based on Improved YOLOv4 [J]. Computer Science, 2023, 50(11A): 230100100-7.
[14] YU Yunjun, ZHANG Pengfei, GONG Hancheng, CHEN Min. Lightweight Network Hardware Acceleration Design for Edge Computing [J]. Computer Science, 2023, 50(11A): 220800045-7.
[15] HAO Qiang, LI Jie, ZHANG Man, WANG Lu. Spatial Non-cooperative Target Components Recognition Algorithm Based on Improved YOLOv3 [J]. Computer Science, 2022, 49(6A): 358-362.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!