Computer Science ›› 2021, Vol. 48 ›› Issue (6A): 101-106.doi: 10.11896/jsjkx.200600144

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Medical Image Deblur Using Generative Adversarial Networks with Channel Attention

WANG Jian-ming1, LI Xiang-feng1, YE Lei1, ZUO Dun-wen1, ZHANG Li-ping2   

  1. 1 College of Mechanical and Electrical Engineering,Nanjing University of Aeronautic and Astronautics,Nanjing 210016,China
    2 College of Science,Nanjing University of Aeronautic and Astronautics,Nanjing 210016,China
  • Online:2021-06-10 Published:2021-06-17
  • About author:WANG Jian-ming,born in 1995,postgraduate.His main research intrests include deep learning and image proces-sing.
    LI Xiang-feng,born in 1971,professor,Ph.D supervisor.Her main research intrests include computer intelligent processing and antifatigue manufacture.
  • Supported by:
    Joint Funds of the National Natural Science Foundation of China(U20A20293).

Abstract: Clear medical images can effectively help doctors to make pathological analysis and diagnosis.Aiming at the problem of image blur caused by camera unfocused during the process of medical image acquisition,this paper proposes a new image deblurring network based on the deblur generative adversarial networks(DeblurGAN).The network uses channel attention structure in Generator and extracts details effectively.During the process of image up-sampling,we use the method of bilinear interpolation with a convolution layer instead of transpose convolution,which removes the checkerboard effects.The model is trained by the combination of adversarial loss and content loss to obtain clear image.The experimental results show that the network achieves better performance in both PSNR and SSIM compared with DeblurGAN.

Key words: Channel attention structure, Convolutional neural network, Generative adversarial networks, Image deblur, Medical images, Residual network

CLC Number: 

  • TP391
[1] PAN D,JIA L F,ZENG A,et al.Applications of generative adversarial networks in medical image processing[J].Journal of Biomedical Engineering,2018,35(6):148-154.
[2] ROTH S,BLACK M J.Fields of Experts:A framework forleaning imagepriors[J].International Journal of Computer Vision,2009,82(2):205-229.
[3] LEVIN A.Blind Motion Deblurring Using Image Statistics[C]//Conference on Advances in Neural Information Processing Systems.MIT Press,2006.
[4] SHAN Q,XIONG W,JIA J.Rotational Motion Deblurring of a Rigid Object from a Single Image[C]//IEEE International Conference on Computer Vision.2007:1-8.
[5] DAI S,WU Y.Motion from blur[J].Computer Vision and Pattern Recognition,IEEE,2008.
[6] JOSHI N,SZELISKI R,KRIEGMAN D J.PSF Estimation using Sharp Edge Prediction[C]//2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2008).Anchorage,Alaska,USA,IEEE,2008:24-26.
[7] SUN J,CAO W,XU Z,et al.Learning a convolutional neuralnetwork for non-unifonn motion blur removal[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:769-777.
[8] CHAKRABARTI A.A neural approach to blind motion deblurring[C]//European Conference onComputer) Vision.Cham:Springer,2016:221-235.
[9] NAH S,KIM T H,LEE K M,et al.Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2017.
[10] KUPYN O,BUDZAN V,MYKHAILYCH M,et al.Deblurgan:Blind motion deblurring using conditio-nal adversarial networks [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:8183-8192.
[11] SUN J F,ZHU Y T,WANG K.Motion Deblurring Based in DeblurGAN and Low Rank Decomposition[J].Journal of South China University of Technology(Natural Science Edition),2020,48(1):32-41,50.
[12] GOODFELLOW I J,POUGET-ABADIE J,MIRZA M,et al.Generative Adversarial nets[C]//International Conference on Neural Information Processing Systems.2014.
[13] ZHANG Y,LI K,LI K,et al.Image super-resolution using very deep residual channel attention networks[C]//ECCV.2018:86-301.
[14] SHAO W Z,LIU Y Y,YE L Y,et al.DeblurGAN+:Revisiting Blind Motion Deblurring Using Conditional Adversarial Networks[J].Signal Processing,2019,168:107-338.
[15] ODENA A,DUMOULIN V,OLAH C.Deconvolution andCheckerboard Artifacts[J/OL].https://distiw.pub/2016/deconv-checkerboard/.
[16] ISOLA P,ZHU J Y,ZHOU T,et al.Image-to-image translation with conditional adversarial networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017.
[17] ARJOVSKY M,CHINTALA S,BOTTOU L.Wasserstein GAN[J].arXiv:1701.07875
[18] LEDIG C,THEIS L,HUSZAR F,et al.Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network[C]//IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2017:105-114.
[19] KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] WANG Xin-tong, WANG Xuan, SUN Zhi-xin. Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network [J]. Computer Science, 2022, 49(8): 314-322.
[3] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[4] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[5] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[6] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[7] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[8] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[9] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[10] WU Zi-bin, YAN Qiao. Projected Gradient Descent Algorithm with Momentum [J]. Computer Science, 2022, 49(6A): 178-183.
[11] XU Guo-ning, CHEN Yi-peng, CHEN Yi-ming, CHEN Jin-yin, WEN Hao. Data Debiasing Method Based on Constrained Optimized Generative Adversarial Networks [J]. Computer Science, 2022, 49(6A): 184-190.
[12] GAO Rong-hua, BAI Qiang, WANG Rong, WU Hua-rui, SUN Xiang. Multi-tree Network Multi-crop Early Disease Recognition Method Based on Improved Attention Mechanism [J]. Computer Science, 2022, 49(6A): 363-369.
[13] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[14] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[15] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!