Computer Science ›› 2024, Vol. 51 ›› Issue (11A): 231200046-9.doi: 10.11896/jsjkx.231200046

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Optimization of License Plate Image Restoration and Recognition in Video with Motion BlurBased on Frequency Domain Point Spread Function

ZHU Peiwu, GAO Shuhui, XIE Zhaoyu, FU Yu   

  1. School of Investigation,People's Public Security University of China,Beijing 100038,China
  • Online:2024-11-16 Published:2024-11-13
  • About author:ZHU Peiwu,born in 2000,postgra-duate.His main research interest is forensic science of image.
    GAO Shuhui,born in 1971,Ph.D,professor,Ph.D supervisor.Her main research interest is forensic science of image.
  • Supported by:
    Double First-class Innovation Research Project of Forensic Science,People's Public Security University of China(2023SYL06).

Abstract: Vehicles are commonly used tools in criminal cases,and license plate recognition is one of the crucial criteria for identi-fying involved vehicles.The restoration of license plate images degraded by motion blur is an important research direction in digi-tal image processing.This paper proposes a license plate image restoration algorithm based on the estimation of frequency domain point spread function parameters.It utilizes two-dimensional discrete Fourier transformation,Radon transformation,and the Wiener filtering algorithm to address the problem of restoring license plates affected by motion blur in surveillance video angles.The process starts with preprocessing the motion-blurred image by converting it to grayscale and reducing noise.A Hanning window is applied to the image,followed by two-dimensional discrete Fourier transformation and logarithmic operations.This computes the power spectrum of the image.Radon transformation is used to detect the spectrum and estimate the blur direction.The minimum value computation on the spectrum determines the blur length,which completes the estimation of the two parameters of the point spread function.The image is then deconvolved using the Wiener filtering algorithm,resulting in the restoration of the image.To address the issue of traditional spectrum estimation being susceptible to interference from central bright lines,a window function is added before the discrete Fourier transformation.To validate the algorithm's restoration effect,experiments are conducted with motion-blurred images captured by road surveillance.These experiments are compared with the non-windowed me-thod,establishing a method for restoring motion-blurred license plate images.Experimental results demonstrate that the proposed algorithm has an advantage in preserving the semantic information of license plate images and can complement the field of criminal image technology in the restoration of blurred license plates.

Key words: Point spread function, PSF, Image restoration, Motion video, Blurred license plate, Image processing

CLC Number: 

  • TP309
[1]ZHANG J H,DU J,ZHU Y D,et al.A Fast Point Spread Function Parameter Extraction Algorithm Based on Linear Regression [J].Optical Technique,2023,49(5):534-539.
[2]HOU W H,WU Y J.Evaluating the resolution of conventional optical microscopes through point spread function measurement[J].iScience,2023,26(10):107976.
[3]CANNON M.Blind deconvolution of spatially invariant image blurs with phase[J].Acoustics Speech & Signal Processing IEEE Transactions on,1976(1):58-63.
[4]LU Q B,ZHOU W G,FANG L,et al.Robust Blur Kernel Estimation for License Plate Images From Fast Moving Vehicles[J].IEEE Transactions on Image Processing:a Publication of the IEEE Signal Processing Society,2016,25(5):2311-2323.
[5]MAMTA R,DUTTA M.GA based Blind Deconvolution Technique of Image Restoration using Cepstrum Domain of Motion Blur[J].Indian Journal of Science and Technology,2017,10(16):1-8.
[6]KANG X,PENG Q,THOMAS G,et al.Blind Image Restoration using the Cepstrum Method[C]//Canadian Conference on Electrical and Computer Engineering,2006(CCECE 06).IEEE,2007.
[7]XU X Y,PAN J S,ZHANG Y J,et al.Motion blur kernel estimation via deep learning[J].IEEE Transactions on Image Processing,2018,27(1):194-205.
[8]SCHULERC J,HIRSCH M,HARMELING S,et al.Learning to Deblur[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,38(7):1439-1451.
[9]WANG X H,ZHAO R C.Elimination of motion blur in any direction [J].Journal of Image and Graphics,2000,5(6):525-529.
[10]WANG X H,ZHAO R C.Estimation of PSF for Uniform Linear Motion Blurring [J].Journal of Computer Applications,2001,21(9):40-41.
[11]CHEN J,ZHANG X,CHEN Z R.Improved PSF parameter estimation algorithm for motion blurred images based on Radon transform [J].Computer Engineering & Software,2020,41(6):1-6.
[12]TANG C J.Parameter detection of motion blurred images based on spectral analysis [J].Information and Electronic Engineering,2015,13(1):148-153.
[13]ZHANG G Y.Research on Global Uniform Linear MotionBlurred Image Restoration Algorithm [D].Wuahan:Hubei University of Technology,2021.
[14]SUN P,LANG Y B,MUBALAK A,et al.Motion Blurred Li-cense Plate Image Restoration Method Based on PSF Parameter Estimation [J].Journal of Criminal Investigation Police University of China,2017(4):121-124.
[15]XU H S.Parameter estimation and restoration of motion blurred license plate images in surveillance videos [J].Journal of Hebei Vocational College of Public Security Police,2021,21(2):28-32.
[16]LE X,CHENG J,LI M.An improved motion blur image parameter estimation method based on Radon transform [J].Infrared and Laser Engineering,2011,40(5):963-969.
[17]JU S Y,GAO S H.A method for improving the accuracy of PSF parameters in motion blurred images using window functions [J/OL].Laser & Optoelectronics Progress:1-13.[2022-10-12].http://kns.cnki.net/kcms/detail/31.1690.TN.20230207.1646.076.html.
[18]BUCKER A S,STEVEN S,DAVID V,et al.Deep learning estimation of modified Zernike coefficients and recovery of point spread functions in turbulence[J].Optics Express,2023,31(14):22903-22913.
[19]YOGESH K,SHEFALI S,MAYANK S,et al.Characterization of instrumental PSF in neutron imaging experiments using logarithmic power spectral plot method[J].NDT and E Interna-tional,2023,139:102922.
[20]MING W H.Research on Motion Blurred Image Restoration Algorithm [D].Hefei:Anhui University,2004.
[21]JIA H T,ZHU Y C,WANG J H.Principle and Implementation of Extended Adaptive Median Filter [J].Journal of Image and Graphics,2004(8):55-58.
[22]CHEN Q L,YIN Y Y,JIANG Q,et al.High resolution hyper lens imaging based on SRResNet and point spread function design [J].Optical Technique,2023,49(4):385-389,411.
[23]FENG R.Research on Key Algorithms for Image Clarity in Surveillance Video [D].Shenyang:Northeastern University,2016.
[24]FU J Q.Research and Application of License Plate Recognition Algorithm in Complex Background [D].Shanghai:Fudan University,2015.
[25]XU K.Motion Blurred Image Restoration in Low Light Scenarios [D].Wuhan:Central China Normal University,2019.
[26]ZHANG M.Super resolution motion blurred image restoration based on Radon transform [D].Chengdu:Southwest Jiaotong University,2012.
[1] LU Dongsheng, LONG Hua. Method for Homologous Spectrum Monitoring Data Identification Based on Spectrum SIFT [J]. Computer Science, 2024, 51(6A): 230300177-7.
[2] ZHANG Tianchi, LIU Yuxuan. Research Progress of Underwater Image Processing Based on Deep Learning [J]. Computer Science, 2024, 51(6A): 230400107-12.
[3] TAN Peng, OU Bo. Medical Image Reversible Contrast Enhancement Based on Adaptive Histogram Equalization [J]. Computer Science, 2024, 51(6A): 230700124-7.
[4] LIU Jiasen, HUANG Jun. Center Point Target Detection Algorithm Based on Improved Swin Transformer [J]. Computer Science, 2024, 51(6): 264-271.
[5] XUE Jinqiang, WU Qin. Progressive Multi-stage Image Denoising Algorithm Combining Convolutional Neural Network and
Multi-layer Perceptron
[J]. Computer Science, 2024, 51(4): 243-253.
[6] LIU Haowei, YAO Jingchi, LIU Bo, BI Xiuli, XIAO Bin. Two-stage Method for Restoration of Heritage Images Based on Muti-scale Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220600129-8.
[7] YU Jiuyang, ZHANG Dean, DAI Yaonan, HU Tianhao, XIA Wenfeng. Image Super-resolution Reconstruction Based on Structured Fusion Attention Network [J]. Computer Science, 2023, 50(6A): 220600240-5.
[8] DAI Tianhong, SONG Jieqi. Multimodal MRI Brain Tumor Segmentation Based on Multi-encoder Architecture [J]. Computer Science, 2023, 50(6A): 220200108-6.
[9] ZHANG Xinfeng, BIAN Haonan, ZHANG Bo, ZHANG Jiaming, LIANG Yuqing. Rail Light Band Detection Algorithm Based on Deep Learning [J]. Computer Science, 2023, 50(11A): 230200146-6.
[10] JIANG Ke, SHI Jianqiang, CHEN Guangwu. Railway Track Detection Method Based on Improved YOLOv5s [J]. Computer Science, 2023, 50(11A): 230200101-6.
[11] CHEN Meiying, BI Xiuli, LIU Bo. Image Retargeting Method Based on Grids and Superpixels [J]. Computer Science, 2023, 50(11A): 221100153-8.
[12] LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing [J]. Computer Science, 2022, 49(6A): 314-318.
[13] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
[14] PAN Ze-min, QIN Ya-li, ZHENG Huan, WANG Rong-fang, REN Hong-liang. Block-based Compressed Sensing of Image Reconstruction Based on Deep Neural Network [J]. Computer Science, 2022, 49(11A): 210900118-9.
[15] HE Huang-xing, CHEN Ai-guo, WANG Jiao-long. Handwritten Image Binarization Based on Background Estimation and Local Adaptive Integration [J]. Computer Science, 2022, 49(11): 163-169.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!