Computer Science ›› 2021, Vol. 48 ›› Issue (4): 169-173.doi: 10.11896/jsjkx.200600047

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Semantic-contrast Generative Adversarial Network Based Highly Undersampled MRI Reconstruction

MA Feng-fei1, LIN Su-zhen1, LIU Feng2, WANG Li-fang1, LI Da-wei1   

  1. 1 School of Data Science and Technology,North University of China,Taiyuan 030051,China
    2 School of Information Technology and Electrical Engineering,The University of Queensland,Brisbane QLD 4072,Australia
  • Received:2020-06-24 Revised:2020-09-15 Online:2021-04-15 Published:2021-04-09
  • About author:MA Feng-fei,born in 1991,postgra-duate,is a member of China Computer Federation.Her main research interests include image processing and MRI reconstruction.(751812591@qq.com)
    LIN Su-zhen,born in 1966,Ph.D,professor,master supervisor,is a member of China Computer Federation.Her main research interests include image processing and information fusion.
  • Supported by:
    Applied Basic Research Project of Shanxi Province,China(201701D121062), Natural Science Foundation of Shanxi Province,China(201901D111152) and 16th Graduate Science and Technology Project of North University of China(20191635).

Abstract: Exploiting the sparse nature of data to reconstruct image from randomly undersampled K-space is the main method to solve the problem of limited application of magnetic resonance imaging(MRI) due to long acquisition time.However,the loss of textures is serious when the existing methods are used to reconstruct the highly undersampled MRI.Aiming at this problem,referring to the adversarial learning idea of generative adversarial networks(GAN),a novel method for highly undersampled MRI reconstruction based on semantic-contrast generative adversarial network(SC-GAN) is proposed.This method consists of two successive parts.In the first part,the MRI image with Cartesian highly random undersampled is input into the U-NET-based ge-nerator to compete with the discriminator for generating the initial reconstructed image,so as to construct the reconstruction subnet.The other part is the semantic contrast subnet,which compares the semantic information between the initial reconstructed image and its fully-sampled image with VGG-16 network.Comparison results are fed back to the first part for parameter adjustment until the best reconstructed image is generated .Experimental results show that the excellent reconstructed results are verified by subjective and objective evaluation when the acceleration factor is up to 7(14%).Compared with the state-of-art methods,the proposed SC-GAN has lower memory consumption,faster convergence speed and more textures,and can provide algorithm support for the development of next-generation MRI machines.

Key words: Deep learning, Generative adversarial network, Highly undersampled images, MRI reconstruction, Semantic contrast, Sparsity

CLC Number: 

  • TP391
[1]SCHLEMPER J,CABALLERO J,HAJNAL J V,et al.A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction[J].IEEE transactions on medical imaging,2018,37(2):491-503.
[2]DESHMANE A,GULANI V,GRISWOLD M A,et al.Parallel MR imaging[J].Journal of Magnetic Resonance Imaging,2012,36(1):55-72.
[3]UECKER M,LAI P,MURPHY M J,et al.ESPIRiT—an eigenvalue approach to autocalibrating parallel MRIwhere SENSE meets GRAPPA[J].Magnetic Resonance in Medicine,2014,71(3):990-1001.
[4]HAMMERNIK K,KLATZER T,KOBLER E,et al.Learning a variational network for reconstruction of accelerated MRI data[J].Magnetic Resonance in Medicine,2018,79(6):3055-3071.
[5]WU Y,MA Y,LIU J,et al.Self-attention convolutional neural network for improved MR image reconstruction[J].Information Sciences,2019,490:317-328.
[6]SENOUF O,VEDULA S,WEISS T,et al.Self-supervised lear-ning of inverse problem solvers in medical imaging[J].arXiv:1905.09325,2019.
[7]YANG G,YU S,DONG H,et al.DAGAN:deep de-aliasing ge-nerative adversarial networks for fast compressed sensing MRI re-construction[J].IEEE Transactions on Medical Imaging,2018,37(6):1310-1321.
[8]HUANG J,ZHANG S,METAXAS D.Efficient MR image re-construction for compressed MR imaging[J].Medical Image Analysis,2011,15(5):670-679.
[9]WANG Y,YING L.Undersampled dynamic magnetic resonance imaging using kernel principal component analysis[C]//2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.IEEE,2014:1533-1536.
[10]YANG J,ZHANG Y,YIN W.A fast alternating direction me-thod for TVL1-L2 signal reconstruction from partial Fourier data[J].IEEE Journal of Selected Topics in Signal Processing,2010,4(2):288-297.
[11]YAO H,DAI F,ZHANG S,et al.Dr2-net:Deep residual reconstruction network for image compressive sensing[J].Neurocomputing,2019,359:483-493.
[12]LIU Y H,LIU S Y,FU F X.Optimization of Compressed Sen-sing Reconstruction Algorithms Based on Convolutional Neural Network[J].Computer Science,2020,47(3):143-148.
[13]WANG S,SU Z,YING L,et al.Accelerating magnetic resonance imaging via deep learning[C]//2016 IEEE 13th International Symposium on Biomedical Imaging(ISBI).IEEE,2016:514-517.
[14]LEE D,YOO J,YE J C.Deep artifact learning for compressed sensing and parallel MRI[J].arXiv:1703.01120,2017.
[15]QIN C,SCHLEMPER J,CABALLERO J,et al.Convolutionalrecurrent neural networks for dynamic MR image reconstruction[J].IEEE Transactions on Medical Imaging,2018,38(1):280-290.
[16]KE Z,WANG S,CHENG H,et al.CRDN:Cascaded Residual Dense Networks for Dynamic MR Imaging with Edge-enhanced Loss Constraint[J].arXiv:1901.06111,2019.
[17]QUAN T M,NGUYEN-DUC T,JEONG W K.Compressedsensing MRI reconstruction using a generative adversarial network with a cyclic loss[J].IEEE Transactions on Medical Imaging,2018,37(6):1488-1497.
[18]YANG X L,LIN S Z.Method for multi-band image feature-level fusion based on the attention mechanism[J].Journal of Xidian University,2020,47(1):120-127.
[19]ZHENG Z,HU Q H,LIU Q S,et al.Quantizing Weights and Activations in Generative Adversarial Networks[J].Computer Science,2020,47(5):144-148.
[20]TONG G,LI Y,CHEN H,et al.Improved U-NET network for pulmonary nodules segmentation[J].Optik,2018,174:460-469.
[21]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv:1409.1556,2014.
[22]DAI Y,ZHUANG P.Compressed Sensing MRI via a Multi-scale Dilated Residual Convolution Network[J].arXiv:1906.05251,2019.
[1] ZHANG Jia, DONG Shou-bin. Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer [J]. Computer Science, 2022, 49(9): 41-47.
[2] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[3] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[4] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[5] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[6] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[7] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[8] LI Xia, MA Qian, BAI Mei, WANG Xi-te, LI Guan-yu, NING Bo. RIIM:Real-Time Imputation Based on Individual Models [J]. Computer Science, 2022, 49(8): 56-63.
[9] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[10] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[11] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[12] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[13] SUN Xiao-han, ZHANG Li. Collaborative Filtering Recommendation Algorithm Based on Rating Region Subspace [J]. Computer Science, 2022, 49(7): 50-56.
[14] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[15] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!