Computer Science ›› 2023, Vol. 50 ›› Issue (4): 117-124.doi: 10.11896/jsjkx.211200215

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Image Compressed Sensing Attention Neural Network Based on Residual Feature Aggregation

WANG Zhenbiao, QIN Yali, WANG Rongfang, ZHENG Huan   

  1. College of Information Engineering,Zhejiang University of Technology,Hangzhou 310000,China
  • Received:2021-12-20 Revised:2022-04-20 Online:2023-04-15 Published:2023-04-06
  • About author:WANG Zhenbiao,born in 1995,postgraduate.His main research interests include compressed sensing,image processing,and deep learning.
    QIN Yali,born in 1963,Ph.D,professor.Her main research interests include nonlinear optics,single-pixel imaging,image processing and photonic devices.
  • Supported by:
    National Natural Science Foundation of China(61275124).

Abstract: Deep learning-based image compressive sensing has received extensive attention due to its powerful learning ability and fast processing speed.With the increase in the depth of convolutional neural networks,the existing image reconstruction methods using neural networks do not fully utilize the residual features in the network.In order to solve this problem,this paper proposes a compressed sensing attention neural network framework based on residual feature aggregation(RFA2CSNet)by jointly optimizing the sampling and inverse reconstruction processes.First,the block compressed sensing sampling sub-network and the initial reconstruction sub-network are constructed to adaptively learn the measurement matrix and generate the initial reconstruction image.Then the residual learning and spatial attention mechanisms are introduced to construct the residual feature aggregation attention reconstruction sub-network to make the residual feature more focused on the key spatial content,so as to further improve the reconstructed image quality.Experimental results show that the proposed network is superior to the existing image compressed sensing reconstruction algorithm in the case of comparable reconstruction time,and obtains better image compressive sensing reconstruction quality.Specifically,using 11 images for testing with a sampling rate of 0.10,the average peak signal-to-noise ratio increases by 0.34~6.18 dB compared with other deep learning-based methods.

Key words: Image compressed sensing, Convolution neural network, Feature aggregation, Attention

CLC Number: 

  • TP391
[1]DONOHO D L.Compressed sensing[J].IEEE Transactions on Information Theory.2006,52(4):1289-1306.
[2]CANDES E J,JUSTIN R J,TAO T.Robust uncertainty principles:exact signal reconstruction from highly incomplete frequency information[J].IEEE Transactions on Information Theory,2006,52(2):489-509.
[3]CANDES E J,WAKIN M B.An introduction to compressivesampling[J].IEEE Signal Processing Magazine,2008,25(2):21-30.
[4]ROMBERG J.Imaging via compressive sampling[J].IEEE Signal Processing Magazine,2008,25(2):14-20.
[5]DUARTE M F,DAVENPORT M A,TAKHAR D,et al.Single-pixel imaging via compressive sampling[J].IEEE Signal Proces-sing Magazine,2008,25(2):83-91.
[6]EDGAR M P,SUN M J,GIBSON G M,et al.Real-time 3D videoutilizing a compressed sensing time-of-flight single-pixel camera[C]//Optical Trapping and Optical Micromanipulation XIII.2016:9921-9922.
[7]YAN Y,HUIBIN L,ZONGBEN X,et al.Deep ADMM-Net for compressive sensing MRI[C]//Advances in Neural Information Processing Systems(NIPS).2016:10-18.
[8]LIU Y X,YUAN X,SUO J L,et al.Rank minimization forsnapshot compressive imaging[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(12):2990-3006.
[9]YIN W,OSHER S,GOLDFARB D,et al.Bregman iterative algorithms forl1-minimization with applications to compressed sensing[J].Siam Journal On Imaging Sciences,2008,1(1):143-168.
[10]LI Y,DAI W,ZOU J,et al.Structured sparse representation with union of data-driven linear and multilinear subspaces model for compressive video sampling[J].IEEE Transactions on Signal Processing,2017,65(19):5062-5077.
[11]LIAN Q S,CHEN S Z.Image reconstruction for compressedsensing based on the combined sparse image representation[J].Acta Automatica Sinica,2010,36(3):385-391.
[12]SHEN Y F,LI J T,ZHU Z M,et al.Image reconstruction algorithm of compressed sensing based on nonlocal similarity model[J].Acta Automatica Sinica,2015,41(2):261-272.
[13]GAN L.Block compressed sensing of natural images[C]//International Conference on Digital Signal Processing.2007:403-406.
[14]MUN S,FOWLER J E.Block compressed sensing of imagesusing directional transforms[C]//IEEE International Confe-rence on Image Processing(ICIP).2009:3021-3024.
[15]FOWLER J E,MUN S,TRAMEL E W.Block-based com-pressed sensing of images and video[J].Foundations and Trends in Signal Processing,2012,4(4):297-416.
[16]YING Y,WANG B,ZHANG L.Saliency-based compressivesampling for image signals[J].IEEE Signal Processing Letters,2010,17(11):973-976.
[17]PAN Z M,QIN Y L,ZHENG H,et al.Block compressed sen-sing image reconstruction via deep learning with smoothed projected Landweber[J].Journal of Electronic Imaging,2021,30(4):041402.
[18]ZHOU S,HE Y,LIU Y,et al.Multi-channel deep networks for block-based image compressive sensing[J].IEEE Transactions on Multimedia,2020,23:2627-2640.
[19]ZHANG X,LIAN Q,YANG Y,et al.A deep unrolling network inspired by total variation for compressed sensing MRI[J/OL].https://doi.org/10.1016/j.dsp.2020.102856.
[20]KULKARNI K,LOHIT S,TURAGA P,et al.ReconNet:no-n-iterative reconstruction of images from compressively sensed measurements[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition.2016:449-458.
[21]YAO H T,DAI F,ZHANG S L,et al.DR2-Net:deep residual reconstruction network for image compressive sensing[J].Neurocomputing,2019,359:483-493.
[22]HE K,ZHANG X Y,REN S Q,et al.Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2016:770-778.
[23]ZHANG J,GHANEM B.ISTA-Net:Interpretable optimization-inspired deep network for image compressive sensing[C]//2018 IEEE Conference on Computer Vision and Pattern Recognition.2018:828-1837.
[24]LI N Y,ZHOU C C.AMPA-Net:Optimization-Inspired Attention Neural Network for Deep Compressed Sensing[C]//2020 IEEE 20th International Conference on Communication Technology.2020:1338-1344.
[25]SHI W Z,JIANG F,ZHANG S P,et al.Deep networks for compressed image sensing[C]//IEEE International Conference on Computer Vision and Pattern Recognition.2016.
[26]SHI W Z,JIANG F,LIU S H,et al.Scalable convolutional neural network for image compressed sensing[C]//2019 IEEE Conference on Computer Vision and Pattern Recognition.2019:12290-12299.
[27]SHI W Z,JIANG F,LIU S H,et al.Image compressed sensing using convolutional neural network[J].IEEE Transactions on Image Processing,2020,29:375-388.
[28]SUN Y J,CHEN J,LIU Q,et al.Dual-Path Attention Network for Compressed Sensing Image Reconstruction[J].IEEE Transac-tions on Image Processing,2020,29:9482-9495.
[29]CHEN S S,SAUNDERSD.Atomic decomposition by basis pursuit[J].SIAM review,2001,43(1):129-159.
[30]YANG M,HOOG F D.Orthogonal matching pursuit withthresholding and its application in compressive sensing[J].IEEE Transactions on Signal Processing,2015,63(20):5479-5486.
[31]METZLER C A,MALEKI A,BARANIUK R G.From denoising to compressed sensing[J].IEEE Transactions on Information Theory,2016,62(9):5117-5144.
[32]LIU J,ZHANG W,TANG Y,et al.Residual feature aggregation network for image super-resolution[C]//2020 IEEE Conference on Computer Vision and Pattern Recognition.2020:2356-2365.
[33]ZHU X,CHENG D Z,ZHANG Z,et al.An Empirical Study of Spatial Attention Mechanisms in Deep Networks[C]//IEEE International Conference on Computer Vision and Pattern Recognition.2019.
[34]ARBELAEZP,MAIRE M,FOWLKES C,et al.Contour detection and hierarchical image segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(5):898-916.
[35]KINGMA D,BA J.Adam:A method for stochastic optimization[C]//International Conference for Learning Representations.2015.
[36]LIAN Q S,FU L P,CHEN S Z,et al.A compressed sensing algorithm based on multiscale residual reconstruction network[J].Acta Automatica Sinica,2019,45(11):2082-2091.
[37]LIN T Y,MAIRE M,BELONGIE S,et al.Microsoft COCO:common objects in context[C]//Computer Vision-ECCV 2014 Lecture Notes in Computer Science.2014:740-755.
[1] HAN Xueming, JIA Caiyan, LI Xuanya, ZHANG Pengfei. Dual-attention Network Model on Propagation Tree Structures for Rumor Detection [J]. Computer Science, 2023, 50(4): 22-31.
[2] YIN Heng, ZHANG Fan, LI Tianrui. Short-time Traffic Flow Forecasting Based on Multi-adjacent Graph and Multi-head Attention Mechanism [J]. Computer Science, 2023, 50(4): 40-46.
[3] LUO Xiaohui, WU Yun, WANG Chenxing, YU Wenting. Sequential Recommendation Model Based on User’s Long and Short Term Preference [J]. Computer Science, 2023, 50(4): 47-55.
[4] BAI Xuefei, JIN Zhichao, WANG Wenjian, MA Yanan. Skin Lesion Segmentation Combining Boundary Enhancement and Multi-scale Attention [J]. Computer Science, 2023, 50(4): 96-102.
[5] YANG Xiaoyu, LI Chao, CHEN Shunyao, LI Haoliang, YIN Guangqiang. Text-Image Cross-modal Retrieval Based on Transformer [J]. Computer Science, 2023, 50(4): 141-148.
[6] WANG Yali, ZHANG Fan, YU Zeng, LI Tianrui. Aspect-level Sentiment Classification Based on Interactive Attention and Graph Convolutional Network [J]. Computer Science, 2023, 50(4): 196-203.
[7] HE Chao, CHEN Jinjie, JIN Zhao, LEI Yinjie. Automatic Modulation Recognition Method Based on Multimodal Time-Frequency Feature Fusion [J]. Computer Science, 2023, 50(4): 226-232.
[8] YU Xingzhan, LU Tianliang, DU Yanhui, WANG Xirui, YANG Cheng. Android Malware Family Classification Method Based on Synthetic Image and Xception Improved Model [J]. Computer Science, 2023, 50(4): 351-358.
[9] LI Shuai, XU Bin, HAN Yike, LIAO Tongxin. SS-GCN:Aspect-based Sentiment Analysis Model with Affective Enhancement and Syntactic Enhancement [J]. Computer Science, 2023, 50(3): 3-11.
[10] CHEN Fuqiang, KOU Jiamin, SU Limin, LI Ke. Multi-information Optimized Entity Alignment Model Based on Graph Neural Network [J]. Computer Science, 2023, 50(3): 34-41.
[11] ZHOU Mingqiang, DAI Kailang, WU Quanwang, ZHU Qingsheng. Attention-aware Multi-channel Graph Convolutional Rating Prediction Model for Heterogeneous Information Networks [J]. Computer Science, 2023, 50(3): 129-138.
[12] DONG Yongfeng, HUANG Gang, XUE Wanruo, LI Linhao. Graph Attention Deep Knowledge Tracing Model Integrated with IRT [J]. Computer Science, 2023, 50(3): 173-180.
[13] LIU Hang, PU Yuanyuan, LYU Dahua, ZHAO Zhengpeng, XU Dan, QIAN Wenhua. Polarized Self-attention Constrains Color Overflow in Automatic Coloring of Image [J]. Computer Science, 2023, 50(3): 208-215.
[14] LIU Songyue, WANG Huan. Leaf Classification and Ranking Method Based on Multi-granularity Feature Fusion [J]. Computer Science, 2023, 50(3): 216-222.
[15] FENG Chengcheng, LIU Pai, JIANG Linying, MEI Xiaohan, GUO Guibing. Document-enhanced Question Answering over Knowledge-Bases [J]. Computer Science, 2023, 50(3): 266-275.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!