计算机科学 ›› 2022, Vol. 49 ›› Issue (11A): 211000171-6.doi: 10.11896/jsjkx.211000171
张瑛, 聂仁灿, 马朝振, 余仕双
ZHANG Ying, NIE Ren-can, MA Chao-zhen, YU Shi-shuang
摘要： 在医学图像中,MRI图像提供包含细节的纹理结构信息和较好的分辨率,而PET/SPECT图像保留了分子活性信息以及颜色功能信息,因此,将它们进行融合是一项重要的任务。大部分现有的方法在融合过程中存在颜色失真、模糊和噪声等问题。为此,提出了一种新的基于子空间注意力孪生自编码网络(Subspace Attention-Siamese Auto-encoding Network,SSA-SAEN)来融合MRI和PET/SPECT图像中有意义的信息。在图像融合网络中提出SSA-SAEN,引入了子空间特征相互学习概念,利用子空间注意力模块,使MRI和PET/SPECT图像能够在学习自己特征的同时互相学习彼此的特征,同时减少信息冗余,保证高效、完整的特征提取。此外,通过条件概率模型对所提取的特征进行互补融合,同时将加权保真项、梯度损失项加入到训练网络中,以达到网络优化的目的。在公共数据集上进行的大量定性和定量实验表明,该方法能够得到一幅清晰的融合图像,表明了该方法与其他先进方法相比的优越性和有效性。
中图分类号:
| [1]WANG L F,WANG R F,LIN S Z,et al.Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks [J].Computer Science,2021,48(2):160-166. [2]LI X,GUO X,HAN P,et al.Laplacian Re-Decomposition for Multimodal Medical Image Fusion [J].IEEE Transactions on Instrumentation and Measurement,2020,69(9 Pt.2):6880-6890. [3]WANG M,SHANG X.A Fast Image Fusion with Discrete Cosine Transform [J].IEEE Signal Processing Letters,2020,27:990-994. [4]RAJARSHI K,HIMABINDU C.DWT based medical image fusion with maximum local extrema [C]//Proceedings of the International Conference on Computer Communication & Informatics.2016. [5]ZHU Z,ZHENG M,QI G,et al.A Phase Congruency and Local Laplacian Energy Based Multi-Modality Medical Image Fusion Method in NSCT Domain [J].IEEE Access,2019,7:20811-20824. [6]LEWIS J J,O’CALLAGHAN R,NIKOLOV S G,et al.Pixel- and region-based image fusion with complex wavelets [J].Information Fusion,2007,8(2):119-30. [7]WEI T,TIWARI P,PANDEY H M,et al.Multimodal medical image fusion algorithm in the era of big data [J].Neural Computing and Applications,2020(3):1-21. [8]LIU Y,LIU S,WANG Z.A general framework for image fusion based on multi-scale transform and sparse representation [J].Information Fusion,2015,24:147-164. [9]XU H,MA J,LE Z,et al.FusionDN:A Unified Densely Connected Network for Image Fusion [C]//Proceedings of the AAAI.2020,44(1):502-518. [10]XU H,MA J,JIANG J,et al.U2Fusion:A Unified Unsupervised Image Fusion Network [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020. [11]ZHANG H,XU H,XIAO Y,et al.Rethinking the Image Fusion:A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity [C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:12797-804. [12]MA J,XU H,JIANG J,et al.DDcGAN:A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion [J].IEEE Transactions on Image Processing,2020,29:4980-4995. [13]JM A,PL A,WEI Y A,et al.Infrared and visible image fusion via detail preserving adversarial learning [J].Information Fusion,2020,54:85-98. [14]CHENG S,WANG Y,HUANG H,et al.NBNet:Noise Basis Learning for Image Denoising with Subspace Projection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:4896-4906. [15]SHI Y,YI Y,YAN H,et al.Region contrast and supervised locality-preserving projection-based saliency detection [J].The Visual Computer,2015,31(9):1191-205. [16]HENRIKSSON L,HYVÄRINEN A,VANNI S.Representation of cross-frequency spatial phase relationships in human visual cortex [J].Journal of Neuroscience,2009,29(45):14342-14351. [17]ZHANG L,ZHANG L,MOU X,et al.FSIM:A feature similarity index for image quality assessment [J].IEEE transactions on Image Processing,2011,20(8):2378-2386. [18]JOHNSON K A,BECKER J A.The Whole Brain Atlas of Harvard Medical School[EB/OL].http://www.med.harvard.edu/AANLIB/. [19]GUO X,NIE R,CAO J,et al.FuseGAN:Learning to fuse multi-focus image via conditional generative adversarial network [J].IEEE Transactions on Multimedia,2019,21(8):1982-96. [20]HOSSNY M,NAHAVANDI S,CREIGHTON D.Comments on Information measure for performance of image fusion [J].Electronics letters,2008,44(18):1066-1067. [21]YANG C,ZHANG J Q,WANG X R,et al.A novel similarity based quality metric for image fusion [J].Information Fusion,2008,9(2):156-160. [22]XYDEAS C A,PETROVIC V.Objective image fusion perfor-mance measure[J].Electronics Letters,2000,36:308-309. [23]TOET A,HOGERVORST M A.Performance comparison ofdifferent gray-level image fusion schemes through a universal image quality index [C]//Proceedings ofSPIE.2003:552-561. |
| [1] | 周芳泉, 成卫青. 基于全局增强图神经网络的序列推荐 Sequence Recommendation Based on Global Enhanced Graph Neural Network 计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085 |
| [2] | 周乐员, 张剑华, 袁甜甜, 陈胜勇. 多层注意力机制融合的序列到序列中国连续手语识别和翻译 Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion 计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026 |
| [3] | 宁晗阳, 马苗, 杨波, 刘士昌. 密码学智能化研究进展与分析 Research Progress and Analysis on Intelligent Cryptology 计算机科学, 2022, 49(9): 288-296. https://doi.org/10.11896/jsjkx.220300053 |
| [4] | 王润安, 邹兆年. 基于物理操作级模型的查询执行时间预测方法 Query Performance Prediction Based on Physical Operation-level Models 计算机科学, 2022, 49(8): 49-55. https://doi.org/10.11896/jsjkx.210700074 |
| [5] | 陈泳全, 姜瑛. 基于卷积神经网络的APP用户行为分析方法 Analysis Method of APP User Behavior Based on Convolutional Neural Network 计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121 |
| [6] | 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥. 基于注意力机制的医学影像深度哈希检索算法 Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism 计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153 |
| [7] | 檀莹莹, 王俊丽, 张超波. 基于图卷积神经网络的文本分类方法研究综述 Review of Text Classification Methods Based on Graph Convolutional Network 计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064 |
| [8] | 闫佳丹, 贾彩燕. 基于双图神经网络信息融合的文本分类方法 Text Classification Method Based on Information Fusion of Dual-graph Neural Network 计算机科学, 2022, 49(8): 230-236. https://doi.org/10.11896/jsjkx.210600042 |
| [9] | 李宗民, 张玉鹏, 刘玉杰, 李华. 基于可变形图卷积的点云表征学习 Deformable Graph Convolutional Networks Based Point Cloud Representation Learning 计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023 |
| [10] | 郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077 |
| [11] | 齐秀秀, 王佳昊, 李文雄, 周帆. 基于概率元学习的矩阵补全预测融合算法 Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning 计算机科学, 2022, 49(7): 18-24. https://doi.org/10.11896/jsjkx.210600126 |
| [12] | 杨炳新, 郭艳蓉, 郝世杰, 洪日昌. 基于数据增广和模型集成策略的图神经网络在抑郁症识别上的应用 Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition 计算机科学, 2022, 49(7): 57-63. https://doi.org/10.11896/jsjkx.210800070 |
| [13] | 张颖涛, 张杰, 张睿, 张文强. 全局信息引导的真实图像风格迁移 Photorealistic Style Transfer Guided by Global Information 计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036 |
| [14] | 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮. 基于DNGAN的磁共振图像超分辨率重建算法 Super-resolution Reconstruction of MRI Based on DNGAN 计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105 |
| [15] | 刘月红, 牛少华, 神显豪. 基于卷积神经网络的虚拟现实视频帧内预测编码 Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network 计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179 |
|
||
首页