Computer Science ›› 2024, Vol. 51 ›› Issue (8): 143-151.doi: 10.11896/jsjkx.230700162

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Super-resolution Reconstruction for Low-dose CT Based on Guidance of Gradient

XU Ying1, ZHANG Daoqiang1, GE Rongjun2   

  1. 1 College of Computer Science and Technology,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
    2 College of Instrument Science and Engineering,Southeast University,Nanjing 210096,China
  • Received:2023-07-21 Revised:2023-09-28 Online:2024-08-15 Published:2024-08-13
  • About author:XU Ying,born in 1997,postgraduate.His main research interests include medical image reconstruction and deep learning.
    GE Rongjun,born in 1992,Ph.D,asso-ciate professor,is a member of CCF(No.13248M).His main research interests include deep learning,intelligent reconstruction and analysis of medical image,medical information analysis and image processing.
  • Supported by:
    Natural Science Foundation of Jiangsu Province,China(BK20210291),National Natural Science Foundation of China(62101249) and China Postdoctoral Science Foundation(2022M721611,2021TQ0149).

Abstract: Low-dose CT(LDCT) scan plays a pivotal role in clinical practice,effectively decreasing cancer risks for radiologists and patients.However,the utilization of low-dose radiation introduces notable noise into the resulting CT images,highlighting the necessity of low-dose CT reconstruction.Another important task in the field of image reconstruction is super-resolution(SR),with the aim of achieving high-resolution CT imaging while minimizing computational expenses.High resolution CT images afford the capacity to capture intricate anatomical details in greater fidelity.Although significant progress has been made in their respective domains,there is still a lack of effective methodologies that can effectively harness the inherent correlation between these tasks and handle them concurrently.We employ edge information as a link between the two tasks,and utilize gradients to extract shared features from both tasks.This allows the LDCT reconstruction process to assist the SR reconstruction process and gene-rate resulting images with sharp edges.Our work consists of three components:1)Edge-enhanced framework.The framework fully exploits the correlation between the two tasks by extracting relevant features using gradient information,enabling the denoising(DN)task to assist the SR task in achieving superior performance.2)Gradient guided fusion block(GGFB),which enhances the highly correlated edge features while suppressing irrelevant features,thereby enabling effective reconstruction in edge regions.3)Gradient loss,which introduces richer gradient features into the model and guides the network to prioritize the reconstruction of edge regions.Extensive experiment demonstrates that our noise reduction and super resolution reconstruction network(NRSR-Net)achieves promising PSNR,SSIM,and LPIPS in quantitative evaluations,as well as gains high-quality readable visualizations.All of these advantages demonstrate the great potential of NRSR-Net in clinical CT imaging.

Key words: Low-dose CT, Super-resolution, Gradient guidance, Multi-task, Edge

CLC Number: 

  • TP391
[1]SUN F Q,CUI Z Q,ZOU P,et al.Brain Tumor Segmentation Algorithm Based on Multi-scale Features[J].Computer Science,2022,49(S1):12-16.
[2]YAO Z W,YANG F,HUANG J,et al.Improved CycleGANs for Intravascular Ultrasound Image Enhancement[J].Computer Science,2019,46(5):221-227.
[3]LIU P P,ZHANG W H,LU Z T,et al.Prediction of Malignant and Benign Gastrointestinal Stromal Tumors Based on Radiomics Feature[J].Computer Science,2019,46(1):285-290.
[4]WANG L F,WANG R F,LIN S Z,et al.Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks[J].Computer Science,2021,48(2):160-166.
[5]GHANI M U,KARL W C.CNN based sinogram denoising for low-dose CT[C]//Mathematics in Imaging.Optica Publishing Group,2018.
[6]MA Y J,REN Y,FENG P,et al.Sinogram denoising via attention residual dense convolutional neural network for low-dose computed tomography[J].Nuclear Science and Techniques,2021,32:1-14.
[7]CHEN H,ZHANG Y,KALRA M K,et al.Low-dose CT with a residual encoder-decoder convolutional neural network[J].IEEE Transactions on Medical Imaging,2017,36(12):2524-2535.
[8]ZHANG Y,HU D,ZHAO Q,et al.CLEAR:comprehensivelearning enabled adversarial reconstruction for subtle structure enhanced low-dose CT imaging[J].IEEE Transactions on Me-dical Imaging,2021,40(11):3089-3101.
[9]GE R,HE Y,XIA C,et al.DDPNet:A Novel Dual-Domain Parallel Network for Low-Dose CT Reconstruction[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Cham:Springer Nature Switzerland,2022:748-757.
[10]YOU C,LI G,ZHANG Y,et al.CT super-resolution GAN constrained by the identical,residual,and cycle learning ensemble(GAN-CIRCLE)[J].IEEE Transactions on Medical Imaging,2019,39(1):188-203.
[11]PENG C,LIN W A,LIAO H,et al.Saint:spatially aware interpolation network for medical slice synthesis[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:7750-7759.
[12]ZHANG Y,LI K,LI K,et al.MR image super-resolution with squeeze and excitation reasoning attention network[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:13425-13434.
[13]LI G,LYU J,WANG C,et al.WavTrans:Synergizing wavelet and cross-attention transformer for multi-contrast MRI super-resolution[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Cham:Springer Nature Switzerland,2022:463-473.
[14]SINGH A,PORIKLI F,AHUJA N.Super-resolving noisy images[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2014:2846-2853.
[15]YIM D,KIM B,LEE S.Simultaneous denoising and spatial resolution enhancement using convolutional neural network-based linear model in diagnostic CT images[C]//Medical Imaging 2020:Physics of Medical Imaging.SPIE,2020:1031-1036.
[16]HOU H,JIN Q,ZHANG G,et al.CT image quality enhancement via a dual-channel neural network with jointing denoising and super-resolution[J].Neurocomputing,2022,492:343-352.
[17]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C]//Advances in Neural NIPS’17:Proceedings of the 31st International Conference on Neural Information Processing Systems.2017:6000-6010.
[18]WANG Z,CUN X,BAO J,et al.Uformer:A general u-shaped transformer for image restoration[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:17683-17693.
[19]WANG X,YU K,WU S,et al.Esrgan:Enhanced super-resolution generative adversarial networks[C]//Proceedings of the European Conference on Computer Vision(ECCV)Workshops.2018.
[20]YU L,SHIUNG M,JONDAL D,et al.Development and validation of a practical lower-dose-simulation tool for optimizing computed tomography scan protocols[J].Journal of computer Assisted Tomography,2012,36(4):477-487.
[21]YANG L,LI Z,GE R,et al.Low-dose ct denoising via sinogram inner-structure transformer[J].IEEE Transactions on Medical Imaging,2022,42(4):910-921.
[22]LEDIG C,THEIS L,HUSZÁR F,et al.Photo-realistic singleimage super-resolution using a generative adversarial network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4681-4690.
[23]MA C,RAO Y,CHENG Y,et al.Structure-preserving super resolution with gradient guidance[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:7769-7778.
[24]LIANG J,CAO J,SUN G,et al.Swinir:Image restoration using swin transformer[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:1833-1844.
[25]KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[26]ZHANG R,ISOLA P,EFROS A A,et al.The unreasonable effectiveness of deep features as a perceptual metric[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:586-595.
[1] PU Bin, LIANG Zhengyou, SUN Yu. Monocular 3D Object Detection Based on Height-Depth Constraint and Edge Fusion [J]. Computer Science, 2024, 51(8): 192-199.
[2] CHEN Shanshan, YAO Subin. Study on Recommendation Algorithms Based on Knowledge Graph and Neighbor PerceptionAttention Mechanism [J]. Computer Science, 2024, 51(8): 313-323.
[3] ZHANG Shaoxia, LI Deyu, ZHAI Yanhui. Knowledge Compatibility Representation and Reasoning in Incomplete Formal Contexts from Logical Perspective [J]. Computer Science, 2024, 51(8): 75-82.
[4] WANG Xiaojie, LIU Jinhua, LU Shuyi, ZHOU Yuanfeng. Color Transfer Method for Unpaired Medical Images Based on Color Flow Model [J]. Computer Science, 2024, 51(8): 176-182.
[5] LIU Wei, SUN Jia, WANG Peng, CHEN Yafan. Development on Methods and Applications of Cognitive Computing of Urban Big Data [J]. Computer Science, 2024, 51(7): 49-58.
[6] BI Sheng, ZHAI Yanhui, LI Deyu. Decision Implication Preserving Attribute Reduction in Decision Context [J]. Computer Science, 2024, 51(7): 89-95.
[7] YAN Qiuyan, SUN Hao, SI Yuqing, YUAN Guan. Multimodality and Forgetting Mechanisms Model for Knowledge Tracing [J]. Computer Science, 2024, 51(7): 133-139.
[8] LI Jiaying, LIANG Yudong, LI Shaoji, ZHANG Kunpeng, ZHANG Chao. Study on Algorithm of Depth Image Super-resolution Guided by High-frequency Information ofColor Images [J]. Computer Science, 2024, 51(7): 197-205.
[9] XU Xiaohua, ZHOU Zhangbing, HU Zhongxu, LIN Shixun, YU Zhenjie. Lightweight Deep Neural Network Models for Edge Intelligence:A Survey [J]. Computer Science, 2024, 51(7): 257-271.
[10] WENG Yu, LUO Haoyu, Chaomurilige, LIU Xuan , DONG Jun, LIU Zheng. CINOSUM:An Extractive Summarization Model for Low-resource Multi-ethnic Language [J]. Computer Science, 2024, 51(7): 296-302.
[11] ZHANG Hui, ZHANG Xiaoxiong, DING Kun, LIU Shanshan. Device Fault Inference and Prediction Method Based on Dynamic Graph Representation [J]. Computer Science, 2024, 51(7): 310-318.
[12] LIU Hongli, WANG Yulin, SHAO Lei, LI Ji. Study on Monocular Vision Vehicle Ranging Based on Lower Edge of Detection Frame [J]. Computer Science, 2024, 51(6A): 231000077-6.
[13] SUN Yang, DING Jianwei, ZHANG Qi, WEI Huiwen, TIAN Bowen. Study on Super-resolution Image Reconstruction Using Residual Feature Aggregation NetworkBased on Attention Mechanism [J]. Computer Science, 2024, 51(6A): 230600039-6.
[14] SHI Songhao, WANG Xiaodan, YANG Chunxiao, WANG Yifei. SAR Image Target Recognition Based on Cross Domain Few Shot Learning [J]. Computer Science, 2024, 51(6A): 230800136-7.
[15] SUN Jianming, ZHAO Mengxin. Survey of Application of Differential Privacy in Edge Computing [J]. Computer Science, 2024, 51(6A): 230700089-9.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!