Computer Science ›› 2021, Vol. 48 ›› Issue (4): 164-168.doi: 10.11896/jsjkx.200100099

Special Issue: Medical Imaging

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Study on Super-resolution Image Reconstruction of Leukocytes

WANG Wei, HU Tao, LI Xin-wei, SHEN Si-wan, JIANG Xiao-ming, LIU Jun-yuan   

  1. Research Center of Biomedical Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    Chongqing Engineering Research Center of Medical Electronics and Information Technology,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2020-06-24 Revised:2020-05-20 Online:2021-04-15 Published:2021-04-09
  • About author:WANG Wei,born in 1977,associate professor.His main research interests include digital medical instruments and medical image processing.(wangw@cqupt.edu.cn)
    LI Xin-wei,born in 1990,lecturer.Her main research interests include biome-dical image processing and brain and cognitive science.
  • Supported by:
    National Natural Science Foundation of China(61801069) and Chongqing Education Commission Science and Technology Research Project(KJQN201800622).

Abstract: In recent years,computer vision has become the focus of research in various disciplines and has been gradually applied to numerous scientific research scenarios.Medical workers often use blood cell image analysis systems to automatically count and classify white blood cell images when performing blood routine tests in the clinic.Among them,the white blood cell image quality affects the counting classification effect of the blood cell analysis system.This paper focuses on the problem of blurred details of white blood cell images under the microscope and attempts to introduce a super-resolution method to solve the problem.This method introduces a Residual-in-Residual Dense Block(RRDB) based on the Super-Resolution Generative Adversarial Network(SRGAN) to improve the network structure and remove the batch normalization layer in the standard residual block.The network performance is improved and the loss function of the discriminator is improved.Experimental results show that,compared with 3 interpolation methods and 4 learning-based super-resolution methods,the proposed method(SRGAN+) improves the reso-lution while obtaining images with richer textures and more realistic visuals.Compared with the SRGAN method,the proposed algorithm has a 1.008 dB improvement in peak signal-to-noise ratio(PSNR) and 1.07% improvement in Structural SIMilarity(SSIM).

Key words: Generative adversarial network, Leukocyte image, Residual-in-Residual dense block, Super-resolution

CLC Number: 

  • TP391
[1]WANG P,DALLA M M,CHANUSSOT J,et al.Soft-Then-Hard Super-Resolution Mapping Based on Pansharpening Technique for Remote Sensing Image[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2018,12(1):334-344.
[2]WANG R,ZHANG Y,ZHANG J,et al.Face super-resolution reconstruction based on convolutional neural network[J].Computer Engineering and Design,2019,40(9):2614-2619.
[3]ISAAC J S,KULKARNI R.Super resolution techniques formedical image processing[C]//2015 International Conference on Technologies for Sustainable Development(ICTSD).IEEE,2015:1-6.
[4]SU H,ZHOU J,ZHANG Z H.Survey of super-resolution imagereconstruction methods[J].Acta Automatica Sinica,2013,39(8):1202-1213.
[5]GAO Y,LIU Z,QIN P L,et al.Medical image super-resolution algorithm based on deep residual generative adversarial network[J].Journal of Computer Applications,2018,38(9):2689-2695.
[6]XIE T.Super-resolution image restoration via improved POCS algorithm[J].Electronic Design Engineering,2013,21(18):142-144.
[7]TAO Z Q,LI H L,ZHANG H B.Iterative Back Projection Super Resolution Reconstruction Algorithm Based on New Edge Directed Interpolation[J].Computer Engineering,2016,42(6):255-260.
[8]ZENG K,DING S F.Advances in image super-resolution reconstruction[J].Computer Engineering and Applications,2017,53(16):29-35.
[9]DONG C,LOY C C,HE K,et al.Learning a Deep Convolutional Network for Image Super-Resolution[C]//European Conference on Computer Vision.2014:184-199.
[10]DONG C,LOY C C,TANG X.Accelerating the Super-Resolution Convolutional Neural Network[C]//European Conference on Computer Vision.2016:391-407.
[11]KIM J,KWON L J,MU L K.Deeply-recursive convolutionalnetwork for image super resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1637-1645.
[12]LEDIG C,THEIS L,HUSZÁR F,et al.Photo-realistic singleimage super-resolution using a generative adversarial network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4681-4690.
[13]GOODFELLOW I J,POUGET-ABADIE J,MIRZA M,et al.Generative adversarial nets[C]//Advances in Neural Information Processing Systems.2014:2672-2680.
[14]ZHANG H,XU T,LI H S.Stackgan:Text to photo-realisticimage synthesis with stacked generative adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:5907-5915.
[15]ZHU J Y,PARK T,ISOLA P,et al.Unpaired image-to-image translation using cycle-consistent adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2223-2232.
[16]MA L,JIA X,SUN Q,et al.Pose guided person image generation[C]//Advances in Neural Information Processing Systems.2017:406-416.
[17]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[18]WANG X,YU K,WU S,et al.Esrgan:Enhanced super-resolution generative adversarial networks[C]//Proceedings of the European Conference on Computer Vision(ECCV).2018.
[19]NAH S,KIM T H,LEE K M.Deep multi-scale convolutionalneural network for dynamic scene deblurring[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:3883-3891.
[20]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv:1409.1556,2014.
[21]JOLICOEUR-MARTINEAU A.The relativistic discriminator:a key element missing from standard GAN[J].arXiv:1807.00734,2018.
[22]SHI W,CABALLERO J,FERENC H,et al.Real-time singleimage and video super-resolution using an efficient sub-pixel convolutional neural network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1874-1883.
[23]TONG Y B,ZHANG Q S,QI Y P.Image quality assessing by combining PSNR with SSIM[J].Journal of Image and Graphics,2006,12:1758-1763.
[1] ZHANG Jia, DONG Shou-bin. Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer [J]. Computer Science, 2022, 49(9): 41-47.
[2] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[3] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[4] XU Guo-ning, CHEN Yi-peng, CHEN Yi-ming, CHEN Jin-yin, WEN Hao. Data Debiasing Method Based on Constrained Optimized Generative Adversarial Networks [J]. Computer Science, 2022, 49(6A): 184-190.
[5] YIN Wen-bing, GAO Ge, ZENG Bang, WANG Xiao, CHEN Yi. Speech Enhancement Based on Time-Frequency Domain GAN [J]. Computer Science, 2022, 49(6): 187-192.
[6] XU Hui, KANG Jin-meng, ZHANG Jia-wan. Digital Mural Inpainting Method Based on Feature Perception [J]. Computer Science, 2022, 49(6): 217-223.
[7] GAO Zhi-yu, WANG Tian-jing, WANG Yue, SHEN Hang, BAI Guang-wei. Traffic Prediction Method for 5G Network Based on Generative Adversarial Network [J]. Computer Science, 2022, 49(4): 321-328.
[8] DOU Zhi, WANG Ning, WANG Shi-jie, WANG Zhi-hui, LI Hao-jie. Sketch Colorization Method with Drawing Prior [J]. Computer Science, 2022, 49(4): 195-202.
[9] LI Si-quan, WAN Yong-jing, JIANG Cui-ling. Multiple Fundamental Frequency Estimation Algorithm Based on Generative Adversarial Networks for Image Removal [J]. Computer Science, 2022, 49(3): 179-184.
[10] ZHOU Ying, CHANG Ming-xin, YE Hong, ZHANG Yan. Super Resolution Reconstruction Method of Solar Panel Defect Images Based on Meta-transfer [J]. Computer Science, 2022, 49(3): 185-191.
[11] SHI Da, LU Tian-liang, DU Yan-hui, ZHANG Jian-ling, BAO Yu-xuan. Generation Model of Gender-forged Face Image Based on Improved CycleGAN [J]. Computer Science, 2022, 49(2): 31-39.
[12] LI Jian, GUO Yan-ming, YU Tian-yuan, WU Yu-lun, WANG Xiang-han, LAO Song-yang. Multi-target Category Adversarial Example Generating Algorithm Based on GAN [J]. Computer Science, 2022, 49(2): 83-91.
[13] TAN Xin-yue, HE Xiao-hai, WANG Zheng-yong, LUO Xiao-dong, QING Lin-bo. Text-to-Image Generation Technology Based on Transformer Cross Attention [J]. Computer Science, 2022, 49(2): 107-115.
[14] CHEN Gui-qiang, HE Jun. Study on Super-resolution Reconstruction Algorithm of Remote Sensing Images in Natural Scene [J]. Computer Science, 2022, 49(2): 116-122.
[15] LENG Jia-xu, WANG Jia, MO Meng-jing-cheng, CHEN Tai-yue, GAO Xin-bo. Survey on Video Super-resolution Based on Deep Learning [J]. Computer Science, 2022, 49(2): 123-133.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!