超分辨率重构遥感图像分类研究

doi:10.11896/jsjkx.210300132

摘要/Abstract

摘要： 通常情况下,超分辨率技术能够使图像获得更好的视觉质量,从而有利于图像的目视解译。然而,超分辨率技术能否提升图像在应用于分类、识别等其他更高级计算机视觉任务时的效果呢？结合计算机视觉技术的发展现状,首先训练一个具有良好性能的图像分类模型,用于对经过不同超分辨率方法处理后的图像进行分类。利用分类准确率来衡量超分辨率重构处理对图像分类任务的影响。在遥感分类数据集上的实验显示,相比插值方法,经过超分辨率处理的图像在分类模型中取得了更高的分类准确率。这一结果说明,经过良好设计的超分辨率模型不仅能使低质图像获得更好的视觉质量,在分类模型中也能够被更准确地归入所属类别。证实了经过良好设计的超分辨率模型对于图像分类任务具有促进作用,并且还能有效提升低质图像在计算机视觉中的感知效果。

关键词: 超分辨率重构, 计算机视觉, 深度学习, 图像处理, 图像分类

Abstract: Usually,super-resolution technology makes the image get better visual quality,which is conducive to the visual interpretation of the image.However,will super-resolution technology improve the effect of image in the application of classification,recognition and other more advanced computer vision tasks? Combined with the development of computer vision technology,a new image classification model is trained to classify the images processed by different super-resolution methods.By measuring the classification accuracy of different types of images,the promotion effect of different super-resolution methods on image classification task is measured.Experimental results on remote sensing classification data set show that the well-designed super-resolution model has obvious effect on enhancing low-quality images.Compared with the interpolation method,the image processed by super-resolution achieves higher classification accuracy in the classification model,which proves that the well-designed super-resolution model can promote the image classification task.It is confirmed that super-resolution can effectively improve the perception effect of image in computer vision.

Key words: Computer vision, Deep learning, Image classification, Image processing, Super resolution reconstruction

中图分类号:

TP751

谢海平, 李高源, 杨海涛, 赵洪利. 超分辨率重构遥感图像分类研究[J]. 计算机科学, 2021, 48(11A): 424-428. https://doi.org/10.11896/jsjkx.210300132

XIE Hai-ping, LI Gao-yuan, YANG Hai-tao, ZHAO Hong-li. Classification Research of Remote Sensing Image Based on Super Resolution Reconstruction[J]. Computer Science, 2021, 48(11A): 424-428. https://doi.org/10.11896/jsjkx.210300132

参考文献

[1]CHENG G,HAN J,LU X.Remote Sensing Image Scene Classification:Benchmark and State of the Art[J].Proceedings of the IEEE,2017,105(10):1865-1883.
[2]MA L,LIU Y,ZHANG X,et al.Deep learning in remote sensing applications:A meta-analysis and review[J].ISPRS Journal of Photogrammetry and Remote Sensing,2019,152:166-177.
[3]VAN OUWERKERK J D.Image super-resolution survey[J].Image and Vision Computing,2006,24(10):1039-1052.
[4]SMORENBURG A,LEDEBT A,FELTHAM M G,et al.The positive effect of mirror visual feedback on arm control in children with Spastic Hemiparetic Cerebral Palsy is dependent on which arm is viewed[J].Experimental Brain Research.Experimentelle Hirnforschung.Experimentation Cerebrale,2011,213(4):393-402.
[5]NASROLLAHI K,MOESLUND T B.Super-resolution:a comprehensive survey[J].Machine Vision and Applications,2014,25(6):1423-1468.
[6]DONG C,LOY C C,TANG X.Accelerating the super-resolution convolutional neural network[C]//European Conference on Computer Vision.Springer,Cham,2016:391-407.
[7]KRIZHEVSKY A,SUTSKEVER I,Hinton G.ImageNet Classification with Deep Convolutional Neural Networks[J].Advances in Neural Information Processing Systems,2012,25(2):1106-1114.
[8]JING L,YANG X,TIAN Y.Video You Only Look Once:Overall Temporal Convolutions for Action Recognition[J].Journal of Visual Communication and Image Representation,2018,52(APR.):58-65.
[9]HE K,ZHANG X,REN S,et al.Deep Residual Learning for Ima-ge Recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).2016:770-778.
[10]YANG J,WRIGHT J,HUANG T,et al.Image Super-Resolution Via Sparse Representation[J].IEEE Transactions on Image Processing,2010,19(11):2861-2873.
[11]KIM J,LEE K J,LEE M K.Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1646-1654.
[12]LIM B,SON S,KIM H,et al.Enhanced deep residual networks for single image super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR).2017:136-144.
[13]MAO X J,SHEN C,YANG Y B.Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections[C]//Proceedings of the 30th International Conference on Neural Information Processing Systems.2016:2810-2818.
[14]HORE A,ZIOU D.Image quality metrics:PSNR vs.SSIM[C]//2010 20th International Conference on Pattern Recognition.IEEE,2010:2366-2369.

相关文章 15

[1]	徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[2]	饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[3]	汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[4]	武红鑫, 韩萌, 陈志强, 张喜龙, 李慕航. 监督和半监督学习下的多标签分类综述 Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning 计算机科学, 2022, 49(8): 12-25. https://doi.org/10.11896/jsjkx.210700111
[5]	王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[6]	郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[7]	姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[8]	孙奇, 吉根林, 张杰. 基于非局部注意力生成对抗网络的视频异常事件检测方法 Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection 计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[9]	郭拯危, 付泽文, 李宁, 白澜. 高分辨率斜视聚束SAR回波仿真加速算法研究 Study on Acceleration Algorithm for Raw Data Simulation of High Resolution Squint Spotlight SAR 计算机科学, 2022, 49(8): 178-183. https://doi.org/10.11896/jsjkx.210600066
[10]	侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木. 中文预训练模型研究进展 Advances in Chinese Pre-training Models 计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11]	周慧, 施皓晨, 屠要峰, 黄圣君. 基于主动采样的深度鲁棒神经网络学习 Robust Deep Neural Network Learning Based on Active Sampling 计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12]	苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫. 小样本雷达辐射源识别的深度学习方法综述 Survey of Deep Learning for Radar Emitter Identification Based on Small Sample 计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13]	胡艳羽, 赵龙, 董祥军. 一种用于癌症分类的两阶段深度特征选择提取算法 Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification 计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[14]	程成, 降爱莲. 基于多路径特征提取的实时语义分割方法 Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction 计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[15]	来腾飞, 周海洋, 余飞鸿. 视频流的实时景深延拓算法 Real-time Extend Depth of Field Algorithm for Video Processing 计算机科学, 2022, 49(6A): 314-318. https://doi.org/10.11896/jsjkx.201100187

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed