计算机科学 ›› 2021, Vol. 48 ›› Issue (6A): 101-106.doi: 10.11896/jsjkx.200600144

• 图像处理&多媒体技术 • 上一篇    下一篇

基于信道注意结构的生成对抗网络医学图像去模糊

王建明1, 黎向锋1, 叶磊1, 左敦稳1, 张丽萍2   

  1. 1 南京航空航天大学机电学院 南京210016
    2 南京航空航天大学理学院 南京210016
  • 出版日期:2021-06-10 发布日期:2021-06-17
  • 通讯作者: 黎向锋(fxli@nuaa.edu.cn)
  • 作者简介:ahwjming@163.com
  • 基金资助:
    国家自然科学基金联合基金项目(U20A20293)

Medical Image Deblur Using Generative Adversarial Networks with Channel Attention

WANG Jian-ming1, LI Xiang-feng1, YE Lei1, ZUO Dun-wen1, ZHANG Li-ping2   

  1. 1 College of Mechanical and Electrical Engineering,Nanjing University of Aeronautic and Astronautics,Nanjing 210016,China
    2 College of Science,Nanjing University of Aeronautic and Astronautics,Nanjing 210016,China
  • Online:2021-06-10 Published:2021-06-17
  • About author:WANG Jian-ming,born in 1995,postgraduate.His main research intrests include deep learning and image proces-sing.
    LI Xiang-feng,born in 1971,professor,Ph.D supervisor.Her main research intrests include computer intelligent processing and antifatigue manufacture.
  • Supported by:
    Joint Funds of the National Natural Science Foundation of China(U20A20293).

摘要: 清晰的医学图像可以有效地帮助医生进行病理分析和病情诊断。针对医学图像中的显微图像在采集过程中因失焦产生的图像模糊问题,文中以生成对抗网络去模糊模型DeblurGAN作为基本框架,提出了一种新的图像去模糊网络。该网络在生成器结构中引入信道注意结构(Channel Attention,CA),有效地提取了图像的细节特征。图像上采样过程中使用双线性插值+卷积的结构代替反卷积(转置卷积)过程,消除了棋盘效果。使用对抗损失、内容损失相结合的方式训练模型来获得清晰的图像。实验结果表明,该网络较DeblurGAN生成的去模糊图像,在PSNR和SSIM指标上都获得了较大的提升。

关键词: 残差网络, 卷积神经网络, 生成对抗网络, 图像去模糊, 信道注意结构, 医学图像

Abstract: Clear medical images can effectively help doctors to make pathological analysis and diagnosis.Aiming at the problem of image blur caused by camera unfocused during the process of medical image acquisition,this paper proposes a new image deblurring network based on the deblur generative adversarial networks(DeblurGAN).The network uses channel attention structure in Generator and extracts details effectively.During the process of image up-sampling,we use the method of bilinear interpolation with a convolution layer instead of transpose convolution,which removes the checkerboard effects.The model is trained by the combination of adversarial loss and content loss to obtain clear image.The experimental results show that the network achieves better performance in both PSNR and SSIM compared with DeblurGAN.

Key words: Channel attention structure, Convolutional neural network, Generative adversarial networks, Image deblur, Medical images, Residual network

中图分类号: 

  • TP391
[1] PAN D,JIA L F,ZENG A,et al.Applications of generative adversarial networks in medical image processing[J].Journal of Biomedical Engineering,2018,35(6):148-154.
[2] ROTH S,BLACK M J.Fields of Experts:A framework forleaning imagepriors[J].International Journal of Computer Vision,2009,82(2):205-229.
[3] LEVIN A.Blind Motion Deblurring Using Image Statistics[C]//Conference on Advances in Neural Information Processing Systems.MIT Press,2006.
[4] SHAN Q,XIONG W,JIA J.Rotational Motion Deblurring of a Rigid Object from a Single Image[C]//IEEE International Conference on Computer Vision.2007:1-8.
[5] DAI S,WU Y.Motion from blur[J].Computer Vision and Pattern Recognition,IEEE,2008.
[6] JOSHI N,SZELISKI R,KRIEGMAN D J.PSF Estimation using Sharp Edge Prediction[C]//2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2008).Anchorage,Alaska,USA,IEEE,2008:24-26.
[7] SUN J,CAO W,XU Z,et al.Learning a convolutional neuralnetwork for non-unifonn motion blur removal[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:769-777.
[8] CHAKRABARTI A.A neural approach to blind motion deblurring[C]//European Conference onComputer) Vision.Cham:Springer,2016:221-235.
[9] NAH S,KIM T H,LEE K M,et al.Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2017.
[10] KUPYN O,BUDZAN V,MYKHAILYCH M,et al.Deblurgan:Blind motion deblurring using conditio-nal adversarial networks [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:8183-8192.
[11] SUN J F,ZHU Y T,WANG K.Motion Deblurring Based in DeblurGAN and Low Rank Decomposition[J].Journal of South China University of Technology(Natural Science Edition),2020,48(1):32-41,50.
[12] GOODFELLOW I J,POUGET-ABADIE J,MIRZA M,et al.Generative Adversarial nets[C]//International Conference on Neural Information Processing Systems.2014.
[13] ZHANG Y,LI K,LI K,et al.Image super-resolution using very deep residual channel attention networks[C]//ECCV.2018:86-301.
[14] SHAO W Z,LIU Y Y,YE L Y,et al.DeblurGAN+:Revisiting Blind Motion Deblurring Using Conditional Adversarial Networks[J].Signal Processing,2019,168:107-338.
[15] ODENA A,DUMOULIN V,OLAH C.Deconvolution andCheckerboard Artifacts[J/OL].https://distiw.pub/2016/deconv-checkerboard/.
[16] ISOLA P,ZHU J Y,ZHOU T,et al.Image-to-image translation with conditional adversarial networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017.
[17] ARJOVSKY M,CHINTALA S,BOTTOU L.Wasserstein GAN[J].arXiv:1701.07875
[18] LEDIG C,THEIS L,HUSZAR F,et al.Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network[C]//IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2017:105-114.
[19] KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[1] 张佳, 董守斌.
基于评论方面级用户偏好迁移的跨领域推荐算法
Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer
计算机科学, 2022, 49(9): 41-47. https://doi.org/10.11896/jsjkx.220200131
[2] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[3] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[4] 王馨彤, 王璇, 孙知信.
基于多尺度记忆残差网络的网络流量异常检测模型
Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network
计算机科学, 2022, 49(8): 314-322. https://doi.org/10.11896/jsjkx.220200011
[5] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[6] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[9] 金方焱, 王秀利.
融合RACNN和BiLSTM的金融领域事件隐式因果关系抽取
Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM
计算机科学, 2022, 49(7): 179-186. https://doi.org/10.11896/jsjkx.210500190
[10] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[11] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[12] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[13] 徐鸣珂, 张帆.
Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法
Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition
计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085
[14] 杨玥, 冯涛, 梁虹, 杨扬.
融合交叉注意力机制的图像任意风格迁移
Image Arbitrary Style Transfer via Criss-cross Attention
计算机科学, 2022, 49(6A): 345-352. https://doi.org/10.11896/jsjkx.210700236
[15] 杨健楠, 张帆.
一种结合双注意力机制和层次网络结构的细碎农作物分类方法
Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure
计算机科学, 2022, 49(6A): 353-357. https://doi.org/10.11896/jsjkx.210200169
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!