Computer Science ›› 2024, Vol. 51 ›› Issue (6A): 220200162-7.doi: 10.11896/jsjkx.220200162

• Image Processing & Multimedia Technolog • Previous Articles     Next Articles

Complex Environment License Plate Recognition Algorithm Based on Improved Image Enhancement and CNN

YANG Xiuzhang1, WU Shuai1, REN Tianshu1, LIAO Wenjing1, XIANG Meiyu2, YU Xiaomin3, LIU Jianyi1, CHEN Dengjian1   

  1. 1 School of Information,Guizhou University of Finance and Economics, Guiyang 550025,China
    2 Guiyang School of Big Data and Finance,School of Big Data Application and Economics,Guizhou University of Finance and Economics, Guiyang 550025,China
    3 Guizhou Key Laboratory of Economics System Simulation,Guizhou University of Finance and Economics, Guiyang 550025,China
  • Published:2024-06-06
  • About author:YANG Xiuzhang,born in 1991,Ph.D.His main research interests include artificial intelligence,image identification and natural language processing.
    WU Shuai,born in 1994,Ph.D candidate.His main research interests include information service and computer application.
  • Supported by:
    Guizhou Science and Technology Plan Project(QiankeheFoundation[2020]1Y279) and Guizhou University of Finance and Economics Scientific Research Fund Project(2021KYQN03).

Abstract: Traditional image recognition and deep learning models are difficult to detect license plates in complex environments.Their scene applicability and accuracy are low,which seriously threatens traffic safety and affects the development of intelligent transportation.This paper proposes a complex environment license plate recognition algorithm based on improved image enhancement and CNN.First,after calculating the average gray value of the target image,we use the ACE algorithm and the dark channel prior dehazing algorithm to perform image enhancement on the license plate dataset in complex environments.Then,a license plate area localization algorithm that combines the key features of color and the peak is proposed,effectively locating the license plate area by eight-core steps in a complex environment.Finally,a five-layer convolutional neural network model is constructed to recognize the license plate character.Experimental results show that the proposed algorithm can effectively identify the license plates of vehicles in complex environments.The precision of the algorithm’s license plate area location in complex environments is 86.04%,the recall is 82.60%,and the F1-score is 84.29%.Among them,the F1-score of the proposed algorithm is 47.29% higher than the traditional image processing algorithm,24.73% higher than the SSD algorithm,26.37% higher than the YOLO algorithm and 17.15% higher than the YOLOv3 algorithm.At the same time,the time complexity of the proposed method is low,and it belongs to a lightweight license plate recognition method.Also,it can eliminate noise and realize license plate character re-cognition.Therefore,it has specific application prospects and practical value and provides a theoretical basis for intelligent transportation research.

Key words: License plate recognition, Image enhancement, Deep learning, Complex environment, Intelligent transportation

CLC Number: 

  • TP391
[1]ZHANG B,PANG J M,ZHANG W S,et al.Application of big data technology in the development of intelligent transportation[J].Science & Technology Review,2020,38(9):47-54.
[2]CHEN J Y,SHEN S J,SU M M,et al.Black-box AdversarialAttack on License Plate Recognition System[J].Acta Automatica Sinica,2021,47(1):121-135.
[3]PEI Y L,ZHANG T.Vehicle Numb:er Plate and Vehicle Identification System based on Artificial Intelligence[J].Highway,2019,64(8):277-281.
[4]BAI R,XU Y C,LI Y L,et al.Digital Character Recognition Technique for Intelligent Vehicles in Road Scenes[J].Laser & Optoelectronics Progress,2019,56(19):211-219.
[5]ZHANG Y,LUO X Y,WANG J W,et al.Research progress on digital image robust steganography[J].Journal of Image and Graphics,2022,27(1):3-26.
[6]WANG K,YANG F,JIANG S.Review of optical character recognition[J].Application Research of Computers,2020,37(S2):22-24.
[7]WANG X Y,LIU S J.Simulation of Super-Resolution ImageNoise Recognition Based on Multi-Directional Threshol[J].Computer Simulation,2021,38(12):132-135,181.
[8]ZHOU Q ,ZHOU H,XU L J,et al.Method for image Locating based on SURF algorithm and SLSH algorithm[J].Instrument Technique and Sensor,2020(10):103-107.
[9]XU J D,ZHAO T Y,FENG G Z,et al.Image Segmentation Algorithm Based on Context Fuzzy C-Means Clustering[J].Journal of Electronics & Information Technology,2021,43(7):2079-2086.
[10]GE Y Z,LIU H,WANG Y,et al.Survey on Deep Learning Image Recognition in Dilemma of Small Samples[J].Journal of Software,2022,33(1):193-210.
[11]LI N,ZHOU L H,YANG G,et al.An Improved YOLOv3 Anomaly Detection Method for Deck Lights[J].Ship Engineering,2021,43(S2):52-58,61.
[12]YANG X Z,XIA H,YU X M.Image Enhancement and Recognition Method Based on Shui-characters[J].Computer Science,2019,46(S2):324-328.
[13]GIRSHICK R.Fast r-cnn[C]//Proceedings of the IEEE international conference on computer vision.2015:1440-1448.
[14]BRUNELLI R.Template matching techniques in computer vision:theory and practice[M].John Wiley & Sons,2009.
[15]TYLER L K,CHIU S,ZHUANG J,et al.Objects and categories:feature statistics and object processing in the ventral stream[J].Journal of Cognitive Neuroscience,2013,25(10):1723-1735.
[16]ALPAYDIN E.Machine learning[M].MIT Press,2021.
[17]ALBAWI S,MOHAMMED T A,AL-ZAWI S.Understandingof a convolutional neural network[C]//2017 International Conference on Engineering Tnd technology(ICET).IEEE,2017:1-6.
[18]FU J Q,FENG R.Segmenting characters on license plate with low image quality based on conditional random fields[J].Computer Applications and Software,2014,31(10):157-160.
[19]XU J M,WEI X,LIN Y J,et al.Urban Vehicle Trip Chain Reconstruction based on Gradient Boosting Decision Tree[J].Journal of South China University of Technology(Natural Science Edition),2020,48(7):55-64.
[20]LI M K,KE Z X,YU D R,et al.Vehicle license plate number recognition algorithm based on mobile edge calculation[J].Computer Engineering and Design,2021,42(11):3151-3157.
[21]SU Y T,YU H Y,CHI J Z.Reseach on license plate recognition system based on LSTM algorithm[J].Electronic Measurement Technology,2021,44(18):67-71.
[22]ZHANG C Z,LI Y,KANG B L,et al.Blurred license PlateCharacter Recognition algorithm based on deep learning[J].Laser & Optoelectronics Progress,2021,58(16):259-266.
[23]LI Y,WANG X L,LEI L,et al.Research of license plate recognition method based on polarity detection and improved CNN framework[J].Electronic Measurement Technology,2021,44(14):26-32.
[24]REDMON J,FARHADI A.Yolov3:An incremental improve-ment[J].arXiv:1804.02767,2018.
[25]RAO W J,GU Y H,ZHU T T,et al.Intelligent License Plate Recognition Method in Complex Environment[J].Journal of Chongqing University of Technology(Natural Science),2021,35(3):119-127.
[26]RIZZI A,GATTA C,MARINI D.A new algorithm for unsupervised global and local colorcor-rection[C]//Pattern Recognition Letters.2003:1663-1677.
[27]HE K M,SUN J,TANGX O.Single image haze removal using dark channel prior[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(12):2341-2353.
[28]HE T,ZHAO T,XU H.Novel Algorithm of Single Image Dehazing Based on Dark Channel Prior[J].Computer Science,2021,48(7):219-224.
[1] HUANG Haixin, CAI Mingqi, WANG Yuyao. Review of Point Cloud Semantic Segmentation Based on Graph Convolutional Neural Networks [J]. Computer Science, 2024, 51(6A): 230400196-7.
[2] WANG Li, CHEN Gang, XIA Mingshan, HU Hao. DUWe:Dynamic Unknown Word Embedding Approach for Web Anomaly Detection [J]. Computer Science, 2024, 51(6A): 230300191-5.
[3] ZHANG Le, YU Ying, GE Hao. Mural Inpainting Based on Fast Fourier Convolution and Feature Pruning Coordinate Attention [J]. Computer Science, 2024, 51(6A): 230400083-9.
[4] WU Yibo, HAO Yingguang, WANG Hongyu. Rice Defect Segmentation Based on Dual-stream Convolutional Neural Networks [J]. Computer Science, 2024, 51(6A): 230600107-8.
[5] HOU Linhao, LIU Fan. Remote Sensing Image Fusion Combining Multi-scale Convolution Blocks and Dense Convolution Blocks [J]. Computer Science, 2024, 51(6A): 230400110-6.
[6] HUANG Yuanhang, BIAN Shan, WANG Chuntao. Gaussian Enhancement Module for Reinforcing High-frequency Details in Camera ModelIdentification [J]. Computer Science, 2024, 51(6A): 230700125-5.
[7] SUN Yang, DING Jianwei, ZHANG Qi, WEI Huiwen, TIAN Bowen. Study on Super-resolution Image Reconstruction Using Residual Feature Aggregation NetworkBased on Attention Mechanism [J]. Computer Science, 2024, 51(6A): 230600039-6.
[8] SHI Songhao, WANG Xiaodan, YANG Chunxiao, WANG Yifei. SAR Image Target Recognition Based on Cross Domain Few Shot Learning [J]. Computer Science, 2024, 51(6A): 230800136-7.
[9] WU Jing, FAN Shaosheng, HU Chengyang. Mark Line Image Enhancement Method in Complex Illumination Environment [J]. Computer Science, 2024, 51(6A): 230300187-5.
[10] LI Yuanxin, GUO Zhongfeng, YANG Junlin. Container Lock Hole Recognition Algorithm Based on Lightweight YOLOv5s [J]. Computer Science, 2024, 51(6A): 230900021-6.
[11] HUANG Haixin, WU Di. Steel Defect Detection Based on Improved YOLOv7 [J]. Computer Science, 2024, 51(6A): 230800018-5.
[12] WANG Yingjie, ZHANG Chengye, BAI Fengbo, WANG Zumin. Named Entity Recognition Approach of Judicial Documents Based on Transformer [J]. Computer Science, 2024, 51(6A): 230500164-9.
[13] LIANG Fang, XU Xuyao, ZHAO Kailong, ZHAO Xuanfeng, ZHANG Guijun. Remote Template Detection Algorithm and Its Application in Protein Structure Prediction [J]. Computer Science, 2024, 51(6A): 230600225-7.
[14] PENG Bo, LI Yaodong, GONG Xianfu, LI Hao. Method for Entity Relation Extraction Based on Heterogeneous Graph Neural Networks and TextSemantic Enhancement [J]. Computer Science, 2024, 51(6A): 230700071-5.
[15] ZHANG Tianchi, LIU Yuxuan. Research Progress of Underwater Image Processing Based on Deep Learning [J]. Computer Science, 2024, 51(6A): 230400107-12.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!