Computer Science ›› 2022, Vol. 49 ›› Issue (2): 123-133.doi: 10.11896/jsjkx.211000007
• Computer Vision: Theory and Application • Previous Articles Next Articles
LENG Jia-xu1,2, WANG Jia1, MO Meng-jing-cheng1, CHEN Tai-yue1, GAO Xin-bo1
CLC Number:
[1]HARRIS J L.Diffraction and resolving power[J].JOSA,1964,54(7):931-936. [2]CAPEL D,ZISSERMAN A.Super-resolution enhancement oftext image sequences[C]//Proceedings 15th International Conference on Pattern Recognition.2000:600-605. [3]SCHULTZ R R,STEVENSON R L.Extraction of high-resolution frames from video sequences[J].IEEE Transactions on Image Processing,1996,5(6):996-1011. [4]BORMAN S,STEVENSON R L.Simultaneous multi-frameMAP super-resolution video enhancement using spatio-temporal priors[C]//Proceedings 1999 International Conference on Image Processing (Cat.99CH36348).1999:469-473. [5]GUNTURK B K,ALTUNBASAK Y,MERSEREAU R.Baye-sian resolution-enhancement framework for transform-coded video[C]//Proceedings 2001 International Conference on Image Processing (Cat.No.01CH37205).2001:41-44. [6]PATTI A J,SEZAN M I,TEKALP A M.Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time[J].IEEE Transactions on Image Processing,1997,6(8):1064-1076. [7]KAPPELER A,YOO S,DAI Q,et al.Video super-resolutionwith convolutional neural networks[J].IEEE Transactions on Computational Imaging,2016,2(2):109-122. [8]XUE T,CHEN B,WU J,et al.Video enhancement with task-oriented flow[J].International Journal of Computer Vision,2019,127(8):1106-1125. [9]HARIS M,SHAKHNAROVICH G,UKITA N.Recurrentback-projection network for video super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:3897-3906. [10]LI F,BAI H,ZHAO Y.Learning a deep dual attention network for video super-resolution[J].IEEE Transactions on Image Processing,2020,29:4474-4488. [11]WANG Z,CHEN J,HOI S C H.Deep learning for image super-resolution:A survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020:3365-3387. [12]SINGH A,SINGH J.Survey on single image based super-resolution—implementation challenges and solutions[J].Multimedia Tools and Applications,2020,79(3):1641-1672. [13]YANG W,ZHANG X,TIAN Y,et al.Deep learning for single image super-resolution:A brief review[J].IEEE Transactions on Multimedia,2019,21(12):3106-3121. [14]DAITHANKAR M V,RUIKAR S D.Video Super Resolution:A Review[C]//ICDSMLA.2020:488-495. [15]WU Y,FAN G H.Survey of Super-Resolution ReconstructionTechniques for Video Sequences[J].Computer Engineering & Software,2017,38(4):154-160. [16]LIU H,RUAN Z,ZHAO P,et al.Video super resolution based on deep learning:A comprehensive survey[J].arXiv:2007.12928,2020. [17]DONG C,LOY C C,HE K,et al.Image super-resolution using deep convolutional networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,38(2):295-307. [18]DONG C,LOY C C,TANG X.Accelerating the super-resolution convolutional neural network[C]//European Conference on Computer Vision.2016:391-407. [19]KIM J,LEE J K,LEE K M.Accurate image super-resolutionusing very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1646-1654. [20]SHI W,CABALLERO J,HUSZAR F,et al.Real-time singleimage and video super-resolution using an efficient sub-pixel convolutional neural network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1874-1883. [21]ZHANG Y,LI K,LI K,et al.Image super-resolution using very deep residual channel attention networks[C]//Proceedings of the European Conference on Computer Vision (ECCV).2018:286-301. [22]BAO W,LAI W S,ZHANG X,et al.Memc-net:Motion estimation and motion compensation driven neural network for video interpolation and enhancement[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019:933-948. [23]JO Y,OH S W,KANG J,et al.Deep video super-resolution network using dynamic upsampling filters without explicit motion compensation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:3224-3232. [24]TIAN Y,ZHANG Y,FU Y,et al.Tdan:Temporally-deformablealignment network for video super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:3360-3369. [25]CABALLERO J,LEDIG C,AITKEN A,et al.Real-time videosuper-resolution with spatio-temporal networks and motion compensation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4778-4787. [26]GUO J,CHAO H.Building an end-to-end spatial-temporal con-volutional network for video super-resolution[C]//Thirty-First AAAI Conference on Artificial Intelligence.2017:4053-4060. [27]YI P,WANG Z,JIANG K,et al.Omniscient Video Super-Resolution[J].arXiv:2103.15683,2021. [28]CHAN K C K,WANG X,YU K,et al.BasicVSR:The searchfor essential components in video super-resolution and beyond[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:4947-4956. [29]LUCAS B.An Iterative Image Registration Technique with an Application to Stereo Vision (DARPA)[J].Proc. IJCAI,1981,81(3):674-679. [30]DRULEA M,NEDEVSCHI S.Total variation regularization of local-global optical flow[C]//2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).2011:318-323. [31]DOSOVITSKIY A,FISCHER P,ILG E,et al.Flownet:Lear-ning optical flow with convolutional networks[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:2758-2766. [32]ILG E,MAYER N,SAIKIA T,et al.Flownet 2.0:Evolution of optical flow estimation with deep networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2462-2470. [33]RANJAN A,BLACK M J.Optical flow estimation using a spatial pyramid network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4161-4170. [34]TAO X,GAO H,LIAO R,et al.Detail-revealing deep video super-resolution[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:4472-4480. [35]WANG L,GUO Y,LIN Z,et al.Learning for video super-resolution through HR optical flow estimation[C]//Asian Confe-rence on Computer Vision.2018:514-529. [36]BARE B,YAN B,MA C,et al.Real-time video super-resolution via motion convolution kernel estimation[J].Neurocomputing,2019,367:236-245. [37]WANG Z,YI P,JIANG K,et al.Multi-memory convolutionalneural network for video super-resolution[J].IEEE Transactions on Image Processing,2018,28(5):2530-2544. [38]KALAROT R,PORIKLI F.Multiboot vsr:Multi-stage multi-reference bootstrapping for video super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2019:2060-2069. [39]SHI X J,CHEN Z,WANG H,et al.Convolutional LSTM network:A machine learning approach for precipitation nowcasting[C]//Advances in Neural Information Processing Systems.2015:802-810. [40]IRANI M,PELEG S.Improving resolution by image registration[J].CVGIP:Graphical Models and Image Processing,1991,53(3):231-239. [41]LIU D,WANG Z,FAN Y,et al.Robust video super-resolution with learned temporal dynamics[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2507-2515. [42]KIM T H,SAJJADI M S M,HIRSCH M,et al.Spatio-temporal transformer network for video restoration[C]//Proceedings of the European Conference on Computer Vision (ECCV).2018:106-122. [43]LIU H,ZHAO P,RUAN Z,et al.Large motion video super-re-solution with dual subnet and multi-stage communicated upsampling[J].arXiv:2103.11744,2021. [44]DAI J,QI H,XIONG Y,et al.Deformable convolutional net-works[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:764-773. [45]ZHU X,HU H,LIN S,et al.Deformable convnets v2:More deformable,better results[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:9308-9316. [46]WANG X,CHAN K C K,YU K,et al.Edvr:Video restoration with enhanced deformable convolutional networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2019:1954-1963. [47]WANG H,SU D,LIU C,et al.Deformable non-local networkfor video super-resolution[J].IEEE Access,2019,7:177734-177744. [48]SONG H,XU W,LIU D,et al.Multi-Stage Feature Fusion Network for Video Super-Resolution[J].IEEE Transactions on Image Processing,2021,30:2923-2934. [49]LUCAS A,LOPEZ-TAPIA S,MOLINA R,et al.Generative adversarial networks and perceptual losses for video super-resolution[J].IEEE Transactions on Image Processing,2019,28(7):3312-3327. [50]YI P,WANG Z,JIANG K,et al.Progressive fusion video super-resolution network via exploiting non-local spatio-temporal correlations[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:3106-3115. [51]ISOBE T,LI S,JIA X,et al.Video super-resolution with temporal group attention[C]//Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.2020:8008-8017. [52]LI W,TAO X,GUO T,et al.Mucan:Multi-correspondence aggregation network for video super-resolution[C]//European Conference on Computer Vision.2020:335-351. [53]SAJJADI M S M,VEMULAPALLI R,BROWN M.Frame-recurrent video super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:6626-6634. [54]YIN B,LIN C,TAN W.Frame and feature-context video super-resolution[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019,33(1):5597-5604. [55]ZHU X,LI Z,ZHANG X Y,et al.Residual invertible spatio-temporal network for video super-resolution[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019:5981-5988. [56]JACOBSEN J H,SMEULDERS A,OYALLON E.i-revnet:Deep invertible networks[J].arXiv:1802.07088,2018. [57]ISOBE T,JIA X,GU S,et al.Video super-resolution with recurrent structure-detail network[C]//European Conference on Computer Vision.2020:645-660. [58]HUANG Y,WANG W,WANG L.Bidirectional recurrent con-volutional networks for multi-frame super-resolution[J].Advances in Neural Information Processing Systems,2015,28:235-243. [59]GUO J,CHAO H.Building an end-to-end spatial-temporal con-volutional network for video super-resolution[C]//Thirty-First AAAI Conference on Artificial Intelligence.2017:4053-4060. [60]LI D,LIU Y,WANG Z.Video super-resolution using non-simultaneous fully recurrent convolutional network[J].IEEE Tran-sactions on Image Processing,2018,28(3):1342-1355. [61]FUOLI D,GU S,TIMOFTE R.Efficient video super-resolution through recurrent latent space propagation[C]//2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).IEEE,2019:3476-3485. [62]LIAO R,TAO X,LI R,et al.Video super-resolution via deep draft-ensemble learning[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:531-539. [63]NAH S,BAIK S,HONG S,et al.Ntire 2019 challenge on video deblurring and super-resolution:Dataset and study[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2019:1996-2005. [64]LIU C,SUN D.On Bayesian Adaptive Video Super Resolution[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2014,36(2):346-360. [65]ZENG H,ZHANG X,YU Z,et al.SR-ITM-GAN:Learning 4K UHD HDR With a Generative Adversarial Network[J].IEEE Access,2020,8:182815-182827. [66]HE Z,HUANG H,JIANG M,et al.FPGA-based real-time super-resolution system for ultra high definition videos[C]//2018 IEEE 26th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM).IEEE,2018:181-188. [67]LIU Z,CUI C.A New Low Bit-Rate Coding Scheme for Ultra High Definition Video Based on Super-Resolution Reconstruction[C]//2018 IEEE International Conference on Computer and Communication Engineering Technology (CCET).IEEE,2018:325-329. [68]KIM Y,CHOI J S,KIM M.A real-time convolutional neuralnetwork for super-resolution on FPGA with applications to 4K UHD 60 fps video services[J].IEEE Transactions on Circuits and Systems for Video Technology,2018,29(8):2521-2534. [69]YANG Y,BI P,LIU Y.License plate image super-resolutionbased on convolutional neural network[C]//2018 IEEE 3rd International Conference on Image,Vision and Computing (ICIVC).IEEE,2018:723-727. [70]GHONEIM M,REHAN M,OTHMAN H.Using super resolution to enhance license plates recognition accuracy[C]//2017 12th International Conference on Computer Engineering and Systems (ICCES).2017:515-518. [71]MEHREGAN K,AHMADYFARD A,KHOSRAVI H.Super-resolution of license-plates using frames of low-resolution video[C]//2019 5th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS).2019:1-6. [72]NISHIBORI K,TAKAHASHI T,DEGUCHI D,et al.Exem-plar-based human body super-resolution for surveillance camera systems[C]//2014 International Conference on Computer Vision Theory and Applications (VISAPP).IEEE,2014:115-121. [73]LEE Y,YUN J W,HONG Y,et al.Accurate license plate recognition and super-resolution using a generative adversarial networks on traffic surveillance video[C]//2018 IEEE InternationalConference on Consumer Electronics-Asia (ICCE-Asia).IEEE,2018:1-4. [74]REN S,LI J,GUO K,et al.Medical video super-resolution based on asymmetric back-projection network with multilevel error feedback[J].IEEE Access,2021,9:17909-17920. [75]BONANNO D,DEBONO C J.A Medical Video Coding Scheme with Preserved Diagnostic Quality[C]//2019 IEEE Global Communications Conference (GLOBECOM).IEEE,2019:1-6. [76]XIAO A,WANG Z,WANG L,et al.Super-resolution for “Jilin-1” satellite video imagery via a convolutional network[J].Sensors,2018,18(4):1194. [77]GARCIA D C,FONSECA T A,QUEIROZ R L D.Example-based super-resolution for point-cloud video[C]//2018 25th IEEE International Conference on Image Processing (ICIP).IEEE,2018:2959-2963. [78]MATSUSHITA Y,KAWASAKI H,ONO S,et al.Simultaneous deblur and super-resolution technique for video sequence captured by hand-held video camera[C]//2014 IEEE International Conference on Image Processing (ICIP).IEEE,2014:4562-4566. |
[1] | ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161. |
[2] | XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171. |
[3] | RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207. |
[4] | TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305. |
[5] | WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293. |
[6] | HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329. |
[7] | JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335. |
[8] | CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85. |
[9] | ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119. |
[10] | SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177. |
[11] | HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78. |
[12] | DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119. |
[13] | CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126. |
[14] | LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131. |
[15] | XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141. |
|