计算机科学 ›› 2020, Vol. 47 ›› Issue (6A): 500-504.doi: 10.11896/JsJkx.200100084

• 数据库 & 大数据 & 数据科学 • 上一篇    下一篇

基于改进残差网络的水下图像重建方法

宋娅菲, 谌雨章, 沈君凤, 曾张帆   

  1. 湖北大学计算机与信息工程学院 武汉 430062
  • 发布日期:2020-07-07
  • 通讯作者: 谌雨章(hubucyz@foxmail.com)
  • 作者简介:1012677264@qq.com
  • 基金资助:
    湖北省自然科学基金面上项目(2019CFB733);湖北省大学生创业训练计划基金资助项目(S201910512024,201710512051)

Underwater Image Reconstruction Based on Improved Residual Network

SONG Ya-fei, CHEN Yu-zhang, SHEN Jun-feng and ZENG Zhang-fan   

  1. School of Computer Science and Information Engineering,Hubei University,Wuhan 430062,China
  • Published:2020-07-07
  • About author:SONG Ya-fei, born in 1999, postgraduate.Her main research interests include image processing and deeparning.
    CHEN Yu-zhang, born in 1984, Ph.D, associate professor.His main researchinterest include laser and LED in water, night vision or underwater scattering medium radiation transmission theory and computer simulation, image acquisition and restoration and reconstruction algorithms, image processing algorithms embedded including the research of Android development.
  • Supported by:
    This work was supported by General program of Natural Science Foundation of Hubei Province(2019CFB733) and Student’s Platform for Innovation and Entrepreneurship Training Program of Hubei Province (S201910512024,201710512051).

摘要: 自然水体成像中湍流及悬浮颗粒等环境因素会造成水下采集的图像存在扭曲失真、分辨率低、背景模糊等问题,为了解决上述问题并进一步提高图像重建和复原的质量,提出了一种改进的基于残差网络的图像超分辨率重建方法,该方法将网络中的残差密集块和自适应机制进行融合,有效解决深度学习网络中经常遇到的梯度爆炸问题,同时能够抑制无用信息的学习,充分利用重要特征信息。为了使网络适应水下噪声环境,通过自建水下系统对目标板分别在清水中和浑浊微湍流水域中进行采集并对其进行图像配对生成训练对,并在河流和海洋水域下采集图像生成测试集。实验结果表明,在微湍流的海洋水域和河流水域中,较传统的水下图像处理和神经网络算法,使用改进的残差网络算法能够很好地对水下图像进行重建,重建图像的边缘信息得到了极大的保留,图像的重建效果更好。

关键词: 残差网络, 超分辨率重建, 深度学习, 水下图像处理, 自适应机制

Abstract: Natural environment factors such as turbulence and suspended particles in water imaging can causeimage distortion,low resolution,and fuzzy background of underwater acquisition.In order to solve the above problems and further improve the quality of image reconstruction and rehabilitation,this paper puts forward an improved image super-resolution reconstruction based on residual network method.This method will in residual dense network of fusion and adaptive mechanism,effectively solve the deep learning gradient explosion problems often encountered in network,also can inhibit learning of useless information,make full use of the important feature information.In order to adapt the network to the underwater noise environment,a self-built underwater system is used to collect the target plate in clear water and turbid micro-turbulent waters respectively,and the training pair of image generation is performed on the target plate,and the test set of image generation is collected under rivers and ocean waters.The experimental results show that in the micro-turbulent ocean and river waters,compared with the traditional underwater image processing and neural network algorithm,the improved residual network algorithm can reconstruct the underwater ima-ge very well.

Key words: Adaptive mechanism, Deep learning, Residual network, Superresolution reconstruction, Underwater image processing

中图分类号: 

  • TN911.73
[1] CHEN Y,YANG W,TAN H,et al.Image enhancement for LD based imaging in turbid water.Optik - International Journal for Light and Electron Optics,2016,127(2):517-521.
[2] CHEN Y Z,YE T,CHENG C J,et al.Degradation and optimal recovery of underwater turbulent imaging.Optoelectronic Engineering,2018,45(12):55-65.
[3] YANG A P,ZHENG J,WANG J,et al.Underwater image restoration based on color distortion removal and dark channel prio-ri.Journal of Electronics and Information Technology,2015,37(11):2541-2547.
[4] HUO G Y,YAN S Y,WU W L,et al.Underwater image processing based on dark channel priors and adaptive color correction.Electrooptic & Control,2019,26(11):70-74.
[5] SERIKAWA S,LU H.Underwater image dehazing using Joint trilateral filter.Computers & Electrical Engineering,2014,40(1):41-50.
[6] LU H,LI Y,NAKASHIMA S,et al.Underwater image super-resolution by descattering and fusion.IEEE Access,2017,5:670-679.
[7] NAKAGAWA Y,KIHARA K,TADOH R,et al.Super resolving of the depth map for 3D reconstruction of underwater terrain using Kinect//2016 IEEE 22nd International Confe-rence on Parallel and Distributed Systems (ICPADS).IEEE,2016:1237-1240.
[8] ZHANG Q B,ZHANG X H,HAN H W.An underwater photoelectric image quality optimization method based on deep convolutional neural network .Acta Optica Sinica,2008,38(11):96-104.
[9] XU Y,SUN M S.Underwater image enhancement method based on convolutional neural network .Journal of Jilin University (Engineering Ddition),2018,48(6):1895-1903.
[10] DONG C,LOY C C,HE K,et al.Learning a deep convolutional network for image super-resolution//European cCnference on Computer Vision.Springer,Cham,2014:184-199.
[11] SCHMIDHUBER J.Gradient Flow in Recurrent Nets:the Difficulty of Learning Long-Term Dependencies//Gradient Flow in Recurrent Nets:The Difficulty of Learning LongTerm Dependencies.Wiley-IEEE Press,2001.
[12] HE K,ZHANG X,REN S,et al.Deep residual learning for ima-ge recognition//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[13] KIM J,KWON LEE J,MU L K.Accurate image super-resolution using very deep convolutional networks//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1646-1654.
[14] LIM B,SON S,KIM H,et al.Enhanced deep residual networks for single image super-resolution//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.2017:136-144.
[15] ZHANG Y,TIAN Y,KONG Y,et al.Residual dense network for image super-resolution//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:2472-2481.
[16] HU J,SHEN L,SUN G.Squeeze-and-excitation networks//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:7132-7141.
[17] SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1-9.
[18] WANG Z,BOVIK A C,SHEIKH H R,et al.Image quality assessment:from error visibility to structural similarity.IEEE Transactions on Image Processing,2004,13(4):600-612.
[19] CHEN Y Z,YANG W L,TAN H Y,et al.Image enhancement for LD based imaging in turbid water.Optik - International
[20] Journal for Light and Electron Optics,2016,127(2):517-521.
[21] CHEN Y,YANG K.MAP-regularized robust reconstruction for underwater imaging detection.Optik-International Journal for Light and Electron Optics,2013,124(20):4514-4518.
[22] ZHANG M,CHEN Y,PAN Y,et al.A Fast Image Deformity Correction Algorithm for Underwater Turbulent Image Distortion.Sensors,2019,19(18):3818.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 王馨彤, 王璇, 孙知信.
基于多尺度记忆残差网络的网络流量异常检测模型
Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network
计算机科学, 2022, 49(8): 314-322. https://doi.org/10.11896/jsjkx.220200011
[6] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[7] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[8] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[9] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[10] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[11] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[12] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[13] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[14] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[15] 高荣华, 白强, 王荣, 吴华瑞, 孙想.
改进注意力机制的多叉树网络多作物早期病害识别方法
Multi-tree Network Multi-crop Early Disease Recognition Method Based on Improved Attention Mechanism
计算机科学, 2022, 49(6A): 363-369. https://doi.org/10.11896/jsjkx.210500044
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!