Computer Science ›› 2022, Vol. 49 ›› Issue (11A): 210900118-9.doi: 10.11896/jsjkx.210900118

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Block-based Compressed Sensing of Image Reconstruction Based on Deep Neural Network

PAN Ze-min, QIN Ya-li, ZHENG Huan, WANG Rong-fang, REN Hong-liang   

  1. College of Information Engineering,Zhejiang University of Technology,Hangzhou 310023,China
  • Online:2022-11-10 Published:2022-11-21
  • About author:PAN Ze-min,born in 1995,postgra-duate.His main research interests include compressed sensing,image processing,and deep learning.
    QIN Ya-li,born in 1963,Ph.D,professor.Her main research interests include nonlinear optics,optical fiber communications and sensing,single pixel imaging,optical field imaging,signal processing for optical communications,image processing,and photonic devices.
  • Supported by:
    National Natural Science Foundation of China(61675184,61275124).

Abstract: Compressed sensing(CS) is a signal processing framework for effectively reconstructing signal from a small number of measurements obtained by linear projections of the signal.It’s an ongoing challenge for the practicality of computational imaging based on CS.The improvement of image reconstruction model is to incorporate more prior constraints under the signal sparse constraint,and the iterative optimization process is complex and time-consuming.Neural networks,as the application models of deep learning,can realize the approximation of any complex function,which provides a new technical route for high-quality and real-time image reconstruction.In this paper,deep neural network(DNN) is used for reconstruction and the block processing is used to reduce the reconstruction time and the number of network nodes,which avoids the complicated algorithm solving process of CS.The DNN model is obtained by training a large number of different types of images,and then the block CS measurement and DNN nonlinear solution are combined jointly to achieve efficient reconstruction.Experimental results show that,compared with six different reconstruction algorithms,the peak signal-to-noise ratio(PSNR) and structure similarity(SSIM) of images are improved in different degrees.Compared with the advanced CS algorithm,not only the reconstruction quality is comparable,but also the time complexity of DNN is greatly reduced and the reconstruction time is less than 3s.When sampling rate is as low as 0.01,the proposed approach can still reconstruct the image clearly while other algorithms fail.When sampling rate is 0.1,compared with the recent residual network method,the maximum(minimum) gain of PSNR is 6.7(1.97) dB,and the maximum(minimum) gain of SSIM is 0.354(0.122).

Key words: Image processing, Block-based compressed sensing, Reconstruction algorithm, Deep learning, Neural network

CLC Number: 

  • TP391
[1]DONOHO D L.Compressed sensing[J].IEEE Transactions on Information Theory,2006,52(4):1289-1306.
[2]CANDES E J,WAKIN M B.An introduction to compressivesampling[J].IEEE Signal Processing Magazine,2008,25(2):21-30.
[3]ROMBERG J.Imaging via compressive sampling[J].IEEE Signal Processing Magazine,2008,25(2):14-20.
[4]DUARTE M F,DAVENPORT M A,TAKHAR D,et al.Single-pixel imaging via compressive sampling[J].IEEE Signal Processing Magazine,2008,25(2):83-91.
[5]POTTER L C,ERTIN E,PARKER J T,et al.Sparsity andcompressed sensing in radar imaging[J].Proceedings of the IEEE,2010,98(6):1006-1020.
[6]SCHIFFNER M F,SCHMITZ G.Fast image acquisition inpulse-echo ultrasound imaging using compressed sensing[C]//Proc of the IEEE Int Ultrasonics Symp(IUS).Dresden,Germany,2012:1944-1947.
[7]WU L B,WANG Y.Compressive sensing based indoor occupancy positioning using a single thermopile point detector with a coded binary mask[J].IEEE Sensors Letters,2019,3(12):1-4.
[8]LIU J,HUANG K Y,YAO X H.Common-innovation subspace pursuit for distributed compressed sensing in wireless sensor networks[J].IEEE Sensors Journal,2019,19(3):1091-1103.
[9]HUGGINS P S,ZUCKER S W.Greedy basis pursuit[J].IEEE Transactions on Signal Processing,2007,55(7):3760-3772.
[10]CHARTRAND R,YIN W T.Iteratively reweighted algorithms for compressed sensing[C]//2008 IEEE International Confe-rence on Acoustics,Speech and Signal Processing.Las Vegas,NV,USA,2008.
[11]TROPP J A,GILBERT A C.Signal recovery from randommeasurements via orthogonal matching pursuit[J].IEEE Transactions on Information Theory,2007,53(12):1-17.
[12]GAN L.Block compressed sensing of natural images[C]//2007 15th International Conference on Digital Signal Processing.Cardiff,UK,2007:403-406.
[13]MUN S,FOWLER J E,TRAMEL E W.Block-based com-pressed sensing of images and video[J].Foundations and Trends in Machine Learning,2012,4(4):297-416.
[14]MUN S,FOWLER J E.Block compressed sensing of imagesusing directional transforms[C]//2009 16th IEEE International Conference on Image Processing(ICIP).Cairo,Egypt,2009:3021-3024.
[15]FOWLER J E,MUN S,TRAMEL E W.Multiscale block compressed sensing with smoothed projected Landweber reconstruction[C]//Proceedings of the European Signal Processing Conference.Barcelona,Spain,2011:564-568.
[16]MARIO A T F,ROBERT D N,STEPHEN J W.Gradient Projection for Sparse Reconstruction:Application to Compressed Sensing and Other Inverse Problems[J].IEEE Journal of Selec-ted Topics in Signal Processing,2007,1(4):586-597.
[17]SHI W Z,JIANG F,LIU S H,et al.Multi-scale deep networks for image compressed Sensing[C]//2018 25th IEEE International Conference on Image Processing(ICIP).Athens,Greece,2018.
[18]MUDULI P R,GUNUKULA R R,MUKHERJEE A.A deep learning approach to fetal-ECG signal reconstruction[C]//2016 Twenty Second National Conf on Communication(NCC).Guwahati,India,2016.
[19]XIA Q,LI S,HAO A M,et al.Deep Learning for Digital Geo-metry Processing and Analysis:A Review[J].Journal of Compu-ter Research and Development,2019,56(1):155-182.
[20]TIAN X,WANG L,DING Q.Review of image semantic segmentation based on deep learning[J].Journal of Software,2019,30(2):440-468
[21]TOMOYOSHI S,YUTAKA E,TAKASHI N,et al.Computa-tional ghost imaging using deep learning[J].Optics Communications,2018,413:147-151.
[22]CAO Y,LI H,WANG T B.A survey of research on target detection algorithms based on deep learning[J].Computer and Modernization,2020(5):63-69
[23]ZHAO F,LI J,ZHANG L,et al.Muli-view face recognitionusing deep neural networks[J].Future Generation Computer Systems,2020,111:375-380.
[24]CUI L,ZHANG P,CHE J.Overview of deep neural based classification algorithms for remote images[J].Computer Science,2018,45(z1):50-53
[25]MOUSAVI A,PATEL A B,BARANIUK R G.A deep learning approach to structured signal recovery[C]//2015 53rd Annual Allerton Conf on Communication,Control,and Computing(Allerton).Monticello,IL,USA,2015:1336-1343.
[26]LIU Y H,LIU S Y,FU F X.Optimization of Compressed Sen-sing Reconstruction Algorithms Based on Convolutional Neural Network[J].Computer Science,2020,47(3):143-148.
[27]KULKARNI K,LOHIT S,TURAGA P,et al.ReconNet:Non-iterative reconstruction of images from compressively sensed random measurements[C]//2016 IEEE Conf on Computer Vision and Pattern Recognition(CVPR).Las Vegas,NV,USA,2016:449-458.
[28]XIE X M,WANG Y X,SHI G M,et al.Adaptive measurement network for CS image reconstruction[C]//Proc of the China Conf on Computer Vision.2017.
[29]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2016:770-778.
[30]YAO H T,DAI F,ZHANG S L,et al.DR2-Net:Deep residual reconstruction network for image compressive sensing[J].Neurocomputing,2019,359:483-493.
[31]ADLER A,BOUBLIL D,ZIBULEVSKY M.Block-based com-pressed sensing of images via deep learning[C]//2017 IEEE 19th Int Workshop on Multimedia Signal Processing(MMSP).Luton,UK,2017.
[32]ZENG C Y,YE J X,WANG Z F,et al.Survey of compressed sensing reconstruction algorithms in deep learning framework[J].Computer Engineering and Applications,2019,55(17):1-8.
[33]RUMELHART D E,HINTON G E,WILLIAMS R J.Learning representations by back-propagating errors[J].Nature,1986,323:533-536.
[34]NAIR V,HINTON G E.Rectified linear units improve restric-ted boltzmann machines[C]//Proc of the 27th International Conference on Machine Learning(ICML-10).Haifa,Israel,2010:807-814.
[35]CUI J F,LI Y P,WANG S X,et al.Directional preparation of anticoagulantactive sulfated polysaccharides from Enteromorpha prolifera using artificial neural networks[J].Scientific Reports,2018,8(3062).
[36]GUI W X,LU Q,SU M L.A firewoks algorithm-back propagation fault diagnosis algorithm for system-level fault diagnosis[J].Journal of Electronics and Information Technology,2020,42(5):1102-1109.
[37]RUSSELL B C,TORRALBA A,Murphy K P,et al.Labelme:a database and web-based tool for image annotation[J].International Journal of Computer Vision,2008,77(1/2/3):157-173.
[38]DUCHI J,HAZAN E,SINGER Y.Adaptive subgradient me-thods for online learning and stochastic optimization[J].Journal of Machine Learning Research,2011,12:2121-2159.
[39]CHEN H,QIN Y L,REN H L,et al.Adaptive weighted high frequency iterative algorithm for fractional-order total variation with nonlocal regularization for image reconstruction[J].Electronics,2020,9(7).
[1] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[2] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[3] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[4] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[5] NING Han-yang, MA Miao, YANG Bo, LIU Shi-chang. Research Progress and Analysis on Intelligent Cryptology [J]. Computer Science, 2022, 49(9): 288-296.
[6] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[7] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[8] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[9] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[10] WANG Run-an, ZOU Zhao-nian. Query Performance Prediction Based on Physical Operation-level Models [J]. Computer Science, 2022, 49(8): 49-55.
[11] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[12] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[13] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[14] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[15] QI Xiu-xiu, WANG Jia-hao, LI Wen-xiong, ZHOU Fan. Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning [J]. Computer Science, 2022, 49(7): 18-24.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!