计算机科学 ›› 2022, Vol. 49 ›› Issue (7): 113-119.doi: 10.11896/jsjkx.210600105

• 计算机图形学&多媒体 • 上一篇    下一篇

基于DNGAN的磁共振图像超分辨率重建算法

戴朝霞1, 李锦欣2, 张向东2, 徐旭3,4, 梅林3,4, 张亮3,5   

  1. 1 中国电子科技集团公司第三十研究所 成都610041
    2 西安电子科技大学通信工程学院 西安710071
    3 西安电子科技大学计算机科学与技术学院 西安710071
    4 公安部第三研究所 上海200031
    5 西安市智能软件工程重点实验室(西安电子科技大学) 西安710071
  • 收稿日期:2021-06-12 修回日期:2021-12-12 出版日期:2022-07-15 发布日期:2022-07-12
  • 通讯作者: 张亮(liangzhang@xidian.edu.cn)
  • 作者简介:(297208108@qq.com)
  • 基金资助:
    国家自然科学基金(62072358);国家重点研发计划(2020YFF0304900,2019YFB1311600);陕西省重点研发计划(2018ZDXM-GY-036)

Super-resolution Reconstruction of MRI Based on DNGAN

DAI Zhao-xia1, LI Jin-xin2, ZHANG Xiang-dong2, XU Xu3,4, MEI Lin3,4, ZHANG Liang3,5   

  1. 1 No.30 Institute of China Electronic Technology Corporation,Chengdu 610041,China
    2 College of Telecommunication Engineering,Xidian University,Xi'an 710071,China
    3 College of Computer Science and Technology,Xidian University,Xi'an 710071,China
    4 The Third Research Institute of Ministry of Public Security,Shanghai 200031,China
    5 Xi'an Key Laboratory of Intelligent Software Engineering(Xidian University),Xi'an 710071,China
  • Received:2021-06-12 Revised:2021-12-12 Online:2022-07-15 Published:2022-07-12
  • About author:DAI Zhao-xia,born in 1972,bachelor,senior engineer.Her main research interests include network information security and network management.
    ZHANG Liang,born in 1981,Ph.D,professor.His main research interests include robot and behavior identity.
  • Supported by:
    National Natural Science Foundation of China(62072358),National Key R&D Program of China(2020YFF0304900,2019YFB1311600) and Shanxi Province Key Research and Development Program(2018ZDXM-GY-036).

摘要: 磁共振图像的质量会影响医生对患者身体情况的判断,高清晰度的磁共振图像更有利于医生做出准确的诊断。利用计算机技术对磁共振图像进行超分辨率重建,可以由低分辨率的磁共振图像得到高分辨率的磁共振图像。基于生成对抗网络强大的生成能力及其非监督学习特性,文中研究了基于生成对抗网络的磁共振图像超分辨率算法,设计了一个结合残差网络结构及DenseNet结构作为生成网络的网络模型DNGAN。该网络使用WGAN-GP理论作为对抗损失来稳定生成对抗网络的训练。除此之外,使用内容损失函数以及感知损失函数作为网络的损失函数。同时,为了更好地利用磁共振图像丰富的频域信息,将磁共振图像的频域信息作为频域损失函数添加到网络中。为了证明DNGAN模型的有效性,将其磁共振图像超分辨率实验结果与SRGAN以及双三次插值法的磁共振图像超分辨率重建结果进行对比,表明DNGAN模型能够有效地对磁共振图像进行超分辨率重建。

关键词: DenseNet, 超分辨率重建, 磁共振图像, 卷积神经网络, 生成对抗网络

Abstract: The quality of MRI will affect doctor's judgment on patient's physical conditions,and the high-resolution MRI is more conducive to doctor to make an accurate diagnosis.Using computer technology to perform super-resolution reconstruction of MRI can obtain high-resolution MRI from existing low-resolution MRI.Based on the strong generation ability of the generative adversarial networks and the unsupervised learning characteristics of the generative adversarial networks,this paper studies the MRI super-resolution algorithm based on the generative adversarial networks.It designs a generative adversarial network model DNGAN that combines ResNet structure and DenseNet structure.In this network,the WGAN-GP theory is used as the adversarial loss to stabilize the training of the generative adversarial networks.In addition,the content loss function and the perceptual loss function are also used as the loss function of the network.At the same time,in order to make better use of the rich frequency domain information of MRI,the frequency domain information of MRI is added to the network as a frequency domain loss function.In order to prove the effectiveness of DNGAN,the MRI super-resolution experimental results of DNGAN are compared with that of SRGAN and bicubic interpolation method.Experimental results show that DNGAN model can effectively perform super-resolution reconstruction of MRI.

Key words: Convolutional neural network, DenseNet, Generative adversarial network, Magnetic resonance imaging, Super-resolution reconstruction

中图分类号: 

  • TP391
[1]ZHANG L Y,WANG L,LIU Y J,et al.Study on micromecha-nical behavior of the proximal femur based on micro-magnetic resonance imaging and finite element analysis[J].Beijing Biomedical Engineering,2020,39(2):111-116.
[2]HIDENOBU M,MARINA H,YOSHINOBU Y,et al.Magnetic resonance imaging(MRI) and dynamic MRI evaluation of extranodal non-Hodgkin lymphoma in oral and maxillofacial regions[J].Oral Surgery,Oral Medicine,Oral Pathology and Oral Radiology,2019,113(1):126-33.
[3]LI J Q.Investigation of Several Methods in Magnetic Resonance Imaging[D].Shanghai:East China Normal University,2010.
[4]BATZ M,EICHENSEER A,SEILER J,et al.Hybird super-reso-lution combining example-based single-image and interpolation-based multi-image reconstruction approaches[C]//IEEE International Conference on Image Processing.2015:58-62.
[5]ZHANG H,ZHANG L,SHEN H.A blind super-resolution reconstruction method considering image registration errors[J].International Journal of Fuzzy Systems,2015,17(2):353-364.
[6]XIAO J S,LIU E Y,ZHU L,et al.Improved Image Super-Resolution Algorithm Based on Convolutional Neural Network[J].Acta Optica Sinica,2017(3):103-111.
[7]GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al.Gene-rative adversarial nets[C]//Advances in Neural Information Processing Systems.2014:2672-2680.
[8]CHEN Y,FENG S,CHRISTODOULOU A G,et al.Efficient and Accurate MRI Super-Resolution Using a Generative Adversarial Network and 3D Multi-level Densely Connected Network[J].arXiv:1803.01417,2018.
[9]GAO Y,LIU Z,QIN P L,et al.Medical image super-resolution algorithm based on deep residual generative adversarial network[J].Journal of Computer Applications,2018(9):2689-2695.
[10]JIANG W H,LIU Z Y,LEE K H,et al.Respiratory Motion Correction in Abdominal MRI using a Densely Connected U-Net with GAN-guided Training[J].arXiv:1906.09745,2019.
[11]ZHAO H T,FANG H,WU X H,et al.K-space concept and its application in magnetic resonance imaging[J].Chinese J Med Imaging,1999,7(3):225-227.
[12]BRACEWELL R.The Fourier transform and its applications[M/OL].https://www.eee.hku.hk/~work8501/FTapp/FT-FM.pdf.
[13]HUANG G,LIU Z,LAURENS V D M,et al.Densely Connec-ted Convolutional Networks[J].arXiv:1608.06993,2016.
[14]ZHAO Z C,LUO Z,WANG P Y,et al.Survey on Image Classification Algorithms Based on Deep Residual Network[J].Computer Systems & Applications,2020,29(1):14-21.
[15]GULRAJANI I,AHMED F,ARJOVSKY M,et al.ImprovedTraining of Wasserstein GANs[C]//Advances in Neural Information Processing Systems.2017:5767-5777.
[16]SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition[J].arXiv:1409.1556,2014.
[17]WANG Y,LI J,LU Y,et al.Image quality evaluation based on image weighted separating block peak signal to noise ratio[C]//International Conference on Neural Networks & Signal Proces-sing.IEEE,2003.
[18]ZHOU W,BOVIK A C,SHEIKH H R,et al.Image quality assessment:from error visibility to structural similarity[J].IEEE Trans Image Process,2004,13(4):600-612.
[19]ZHANG A Z,LIU Z L,ZHOU X C,et al.Design of Image Sca-ling Engine Based Bicubic Interpolation Algorithm[J].Micro-electronics & Computer,2007(1):49-51.
[1] 张佳, 董守斌.
基于评论方面级用户偏好迁移的跨领域推荐算法
Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer
计算机科学, 2022, 49(9): 41-47. https://doi.org/10.11896/jsjkx.220200131
[2] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[3] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[4] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[5] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[6] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[7] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[8] 金方焱, 王秀利.
融合RACNN和BiLSTM的金融领域事件隐式因果关系抽取
Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM
计算机科学, 2022, 49(7): 179-186. https://doi.org/10.11896/jsjkx.210500190
[9] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[10] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[11] 徐鸣珂, 张帆.
Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法
Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition
计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085
[12] 张嘉淏, 刘峰, 齐佳音.
一种基于Bottleneck Transformer的轻量级微表情识别架构
Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer
计算机科学, 2022, 49(6A): 370-377. https://doi.org/10.11896/jsjkx.210500023
[13] 王建明, 陈响育, 杨自忠, 史晨阳, 张宇航, 钱正坤.
不同数据增强方法对模型识别精度的影响
Influence of Different Data Augmentation Methods on Model Recognition Accuracy
计算机科学, 2022, 49(6A): 418-423. https://doi.org/10.11896/jsjkx.210700210
[14] 孙洁琪, 李亚峰, 张文博, 刘鹏辉.
基于离散小波变换的双域特征融合深度卷积神经网络
Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation
计算机科学, 2022, 49(6A): 434-440. https://doi.org/10.11896/jsjkx.210900199
[15] 杨涵, 万游, 蔡洁萱, 方铭宇, 吴卓超, 金扬, 钱伟行.
基于步态分类辅助的虚拟IMU的行人导航方法
Pedestrian Navigation Method Based on Virtual Inertial Measurement Unit Assisted by GaitClassification
计算机科学, 2022, 49(6A): 759-763. https://doi.org/10.11896/jsjkx.211200148
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!