计算机科学 ›› 2021, Vol. 48 ›› Issue (4): 164-168.doi: 10.11896/jsjkx.200100099

所属专题: 医学图像

• 计算机图形学&多媒体 • 上一篇    下一篇

白细胞图像超分辨率重建研究

王伟, 胡涛, 李欣蔚, 沈思婉, 姜小明, 刘峻源   

  1. 重庆邮电大学生物医学工程研究中心 重庆400065;
    重庆邮电大学重庆市医用电子与信息技术工程研究中心 重庆400065
  • 收稿日期:2020-06-24 修回日期:2020-05-20 出版日期:2021-04-15 发布日期:2021-04-09
  • 通讯作者: 李欣蔚(lixinwei@cqupt.edu.cn)
  • 基金资助:
    国家自然科学基金(61801069);重庆市教育委员会科学技术研究项目(KJQN201800622)

Study on Super-resolution Image Reconstruction of Leukocytes

WANG Wei, HU Tao, LI Xin-wei, SHEN Si-wan, JIANG Xiao-ming, LIU Jun-yuan   

  1. Research Center of Biomedical Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    Chongqing Engineering Research Center of Medical Electronics and Information Technology,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2020-06-24 Revised:2020-05-20 Online:2021-04-15 Published:2021-04-09
  • About author:WANG Wei,born in 1977,associate professor.His main research interests include digital medical instruments and medical image processing.(wangw@cqupt.edu.cn)
    LI Xin-wei,born in 1990,lecturer.Her main research interests include biome-dical image processing and brain and cognitive science.
  • Supported by:
    National Natural Science Foundation of China(61801069) and Chongqing Education Commission Science and Technology Research Project(KJQN201800622).

摘要: 近年来,计算机视觉已成为各类学科领域研究的重点,逐渐被应用于各类科研场景。医务工作者在临床上做血常规检验时,经常会采用血细胞图像分析系统对镜下白细胞图像进行自动计数与分类。其中,白细胞图像质量影响着血细胞分析系统计数分类的效果。针对镜下白细胞图像细节模糊的问题,文中尝试引入超分辨率方法对图片进行优化,以达到使白细胞图像更清晰的目的。所提出的方法在现有生成对抗网络的超分辨率方法(Super-Resolution Generative Adversarial Network,SRGAN) 的基础上,设计引入嵌套型残差密集块(Residual-in-Residual Dense Block,RRDB)来改进网络结构,并对原有标准残差块中的批量规范化层进行删减,以提升网络性能,另外还对判别器的损失函数进行了改进。实验结果表明,该方法(SRGAN+)与3种插值法以及4种基于学习的超分辨率方法相比,在提高分辨率的同时,获得了图片细节更丰富、人眼视觉更优的图像。与SRGAN方法相比,改进算法在峰值信噪比(Peak Signal-to-noise Ratio,PSNR)和结构相似度(Structural SIMilarity,SSIM)上分别有1.008 dB和1.07%的提高。

关键词: 白细胞图像, 超分辨率, 嵌套型残差密集块, 生成对抗网络

Abstract: In recent years,computer vision has become the focus of research in various disciplines and has been gradually applied to numerous scientific research scenarios.Medical workers often use blood cell image analysis systems to automatically count and classify white blood cell images when performing blood routine tests in the clinic.Among them,the white blood cell image quality affects the counting classification effect of the blood cell analysis system.This paper focuses on the problem of blurred details of white blood cell images under the microscope and attempts to introduce a super-resolution method to solve the problem.This method introduces a Residual-in-Residual Dense Block(RRDB) based on the Super-Resolution Generative Adversarial Network(SRGAN) to improve the network structure and remove the batch normalization layer in the standard residual block.The network performance is improved and the loss function of the discriminator is improved.Experimental results show that,compared with 3 interpolation methods and 4 learning-based super-resolution methods,the proposed method(SRGAN+) improves the reso-lution while obtaining images with richer textures and more realistic visuals.Compared with the SRGAN method,the proposed algorithm has a 1.008 dB improvement in peak signal-to-noise ratio(PSNR) and 1.07% improvement in Structural SIMilarity(SSIM).

Key words: Generative adversarial network, Leukocyte image, Residual-in-Residual dense block, Super-resolution

中图分类号: 

  • TP391
[1]WANG P,DALLA M M,CHANUSSOT J,et al.Soft-Then-Hard Super-Resolution Mapping Based on Pansharpening Technique for Remote Sensing Image[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2018,12(1):334-344.
[2]WANG R,ZHANG Y,ZHANG J,et al.Face super-resolution reconstruction based on convolutional neural network[J].Computer Engineering and Design,2019,40(9):2614-2619.
[3]ISAAC J S,KULKARNI R.Super resolution techniques formedical image processing[C]//2015 International Conference on Technologies for Sustainable Development(ICTSD).IEEE,2015:1-6.
[4]SU H,ZHOU J,ZHANG Z H.Survey of super-resolution imagereconstruction methods[J].Acta Automatica Sinica,2013,39(8):1202-1213.
[5]GAO Y,LIU Z,QIN P L,et al.Medical image super-resolution algorithm based on deep residual generative adversarial network[J].Journal of Computer Applications,2018,38(9):2689-2695.
[6]XIE T.Super-resolution image restoration via improved POCS algorithm[J].Electronic Design Engineering,2013,21(18):142-144.
[7]TAO Z Q,LI H L,ZHANG H B.Iterative Back Projection Super Resolution Reconstruction Algorithm Based on New Edge Directed Interpolation[J].Computer Engineering,2016,42(6):255-260.
[8]ZENG K,DING S F.Advances in image super-resolution reconstruction[J].Computer Engineering and Applications,2017,53(16):29-35.
[9]DONG C,LOY C C,HE K,et al.Learning a Deep Convolutional Network for Image Super-Resolution[C]//European Conference on Computer Vision.2014:184-199.
[10]DONG C,LOY C C,TANG X.Accelerating the Super-Resolution Convolutional Neural Network[C]//European Conference on Computer Vision.2016:391-407.
[11]KIM J,KWON L J,MU L K.Deeply-recursive convolutionalnetwork for image super resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1637-1645.
[12]LEDIG C,THEIS L,HUSZÁR F,et al.Photo-realistic singleimage super-resolution using a generative adversarial network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4681-4690.
[13]GOODFELLOW I J,POUGET-ABADIE J,MIRZA M,et al.Generative adversarial nets[C]//Advances in Neural Information Processing Systems.2014:2672-2680.
[14]ZHANG H,XU T,LI H S.Stackgan:Text to photo-realisticimage synthesis with stacked generative adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:5907-5915.
[15]ZHU J Y,PARK T,ISOLA P,et al.Unpaired image-to-image translation using cycle-consistent adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2223-2232.
[16]MA L,JIA X,SUN Q,et al.Pose guided person image generation[C]//Advances in Neural Information Processing Systems.2017:406-416.
[17]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[18]WANG X,YU K,WU S,et al.Esrgan:Enhanced super-resolution generative adversarial networks[C]//Proceedings of the European Conference on Computer Vision(ECCV).2018.
[19]NAH S,KIM T H,LEE K M.Deep multi-scale convolutionalneural network for dynamic scene deblurring[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:3883-3891.
[20]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv:1409.1556,2014.
[21]JOLICOEUR-MARTINEAU A.The relativistic discriminator:a key element missing from standard GAN[J].arXiv:1807.00734,2018.
[22]SHI W,CABALLERO J,FERENC H,et al.Real-time singleimage and video super-resolution using an efficient sub-pixel convolutional neural network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1874-1883.
[23]TONG Y B,ZHANG Q S,QI Y P.Image quality assessing by combining PSNR with SSIM[J].Journal of Image and Graphics,2006,12:1758-1763.
[1] 张佳, 董守斌.
基于评论方面级用户偏好迁移的跨领域推荐算法
Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer
计算机科学, 2022, 49(9): 41-47. https://doi.org/10.11896/jsjkx.220200131
[2] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[3] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[4] 尹文兵, 高戈, 曾邦, 王霄, 陈怡.
基于时频域生成对抗网络的语音增强算法
Speech Enhancement Based on Time-Frequency Domain GAN
计算机科学, 2022, 49(6): 187-192. https://doi.org/10.11896/jsjkx.210500114
[5] 徐辉, 康金梦, 张加万.
基于特征感知的数字壁画复原方法
Digital Mural Inpainting Method Based on Feature Perception
计算机科学, 2022, 49(6): 217-223. https://doi.org/10.11896/jsjkx.210500105
[6] 高志宇, 王天荆, 汪悦, 沈航, 白光伟.
基于生成对抗网络的5G网络流量预测方法
Traffic Prediction Method for 5G Network Based on Generative Adversarial Network
计算机科学, 2022, 49(4): 321-328. https://doi.org/10.11896/jsjkx.210300240
[7] 黎思泉, 万永菁, 蒋翠玲.
基于生成对抗网络去影像的多基频估计算法
Multiple Fundamental Frequency Estimation Algorithm Based on Generative Adversarial Networks for Image Removal
计算机科学, 2022, 49(3): 179-184. https://doi.org/10.11896/jsjkx.201200081
[8] 周颖, 常明新, 叶红, 张燕.
基于元迁移的太阳能电池板缺陷图像超分辨率重建方法
Super Resolution Reconstruction Method of Solar Panel Defect Images Based on Meta-transfer
计算机科学, 2022, 49(3): 185-191. https://doi.org/10.11896/jsjkx.210100234
[9] 李建, 郭延明, 于天元, 武与伦, 王翔汉, 老松杨.
基于生成对抗网络的多目标类别对抗样本生成算法
Multi-target Category Adversarial Example Generating Algorithm Based on GAN
计算机科学, 2022, 49(2): 83-91. https://doi.org/10.11896/jsjkx.210800130
[10] 谈馨悦, 何小海, 王正勇, 罗晓东, 卿粼波.
基于Transformer交叉注意力的文本生成图像技术
Text-to-Image Generation Technology Based on Transformer Cross Attention
计算机科学, 2022, 49(2): 107-115. https://doi.org/10.11896/jsjkx.210600085
[11] 陈贵强, 何军.
自然场景下遥感图像超分辨率重建算法研究
Study on Super-resolution Reconstruction Algorithm of Remote Sensing Images in Natural Scene
计算机科学, 2022, 49(2): 116-122. https://doi.org/10.11896/jsjkx.210700095
[12] 冷佳旭, 王佳, 莫梦竟成, 陈泰岳, 高新波.
基于深度学习的视频超分辨率重构进展综述
Survey on Video Super-resolution Based on Deep Learning
计算机科学, 2022, 49(2): 123-133. https://doi.org/10.11896/jsjkx.211000007
[13] 石达, 芦天亮, 杜彦辉, 张建岭, 暴雨轩.
基于改进CycleGAN的人脸性别伪造图像生成模型
Generation Model of Gender-forged Face Image Based on Improved CycleGAN
计算机科学, 2022, 49(2): 31-39. https://doi.org/10.11896/jsjkx.210600012
[14] 唐雨潇, 王斌君.
基于深度生成模型的人脸编辑研究进展
Research Progress of Face Editing Based on Deep Generative Model
计算机科学, 2022, 49(2): 51-61. https://doi.org/10.11896/jsjkx.210400108
[15] 张玮琪, 汤轶丰, 李林燕, 胡伏原.
基于场景图的段落生成序列图像方法
Image Stream From Paragraph Method Based on Scene Graph
计算机科学, 2022, 49(1): 233-240. https://doi.org/10.11896/jsjkx.201100207
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!