Computer Science ›› 2021, Vol. 48 ›› Issue (9): 153-159.doi: 10.11896/jsjkx.200900054

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion

GUAN Zheng, DENG Yang-lin, NIE Ren-can   

  1. School of Information Science and Engineering,Yunnan University,Kunming 650091,China
  • Received:2020-09-07 Revised:2020-12-08 Online:2021-09-15 Published:2021-09-10
  • About author:GUAN Zheng,born in 1982,Ph.D,associate professor,master supervisor,is a member of China Computer Federation.Her main research interests include image processing and polling and communication systems.
    NIE Ren-can,born in 1982,Ph.D,associate professor,master supervisor.His main research interests include neural networks,image processing and machine learning.
  • Supported by:
    National Natural Science Foundation of China(61761045,61966037,61463052) and China Postdoctoral Science Foundation(2017M621586)

Abstract: An effective algorithm for unmixing hyperspectral and panchromatic images of non-negative matrix factorization based on spectral reconstruction constraint is proposed.Firstly,this algorithm employs the regularization with minimum spectral reconstruction error in the process of non-negative matrix factorization for the hyperspectral image,and searches for the optimal regularization parameter through multi-objective optimization to inspire the spectral signature matrix to contain more real spectral features.Then,the panchromatic image is factorized by non-negative matrix to obtain the abundance matrix with the details of the image.Finally,the fusion result is reconstructed by using the spectral signature matrix and the abundance matrix.The experimental results show that the fusion result of the proposed algorithm maintains more details of panchromatic images and effectively decreases spectral distortion simultaneously.It has better performance in both visual effects and objective evaluation than traditional algorithms.

Key words: Hyperspectral and panchromatic image, Image fusion, Multi-objective optimization, Non-negative factorization, Spectral reconstruction constraint

CLC Number: 

  • TP391
[1]OU X F,ZHANG Y M,WANG H P,et al.Hyperspectral Image Target Detection via Weighted Joint K-Nearest Neighbor and Multitask Learning Sparse Representation[J].IEEE Access,2020(8):11503-11511.
[2]YANG S,SHI Z W,TANG W.Robust Hyperspectral ImageTarget Detection Using an Inequality Constraint[J].IEEE Transactions on Geoscience and Remote Sensing,2015,53(6):3389-3404.
[3]ASADZADEH S,CARLOS R D S F.A review on spectral processing methods for geological remote sensing[J].International Journal of Applied Earth Observation and Geoinformation,2016,47:69-90.
[4]ZHU L X,WEN G J,QIU S H,et al.Improving Hyperspectral Anomaly Detection with a Simple Weighting Strategy[J].IEEE Geoscience and Remote Sensing Letters,2019,16(1):95-99.
[5]LI S T,ZHANG K Z,HAO Q B,et al.Hyperspectral Anomaly Detection with Multiscale Attribute and Edge-Preserving Filters[J].IEEE Geoscience and Remote Sensing Letters,2018,15(10):1605-1609.
[6]DAI S J,GAO Z B,SHI Z Y,et al.Material Intelligent Identification Based on Hyperspectral Imaging and SVM[C]//Computational Intelligence.2015:69-72.
[7]RODRIGUEZCOBO L,PILAR B G,COBO A,et al.Raw Material Classification by Means of Hyperspectral Imaging and Hie-rarchical Temporal Memories[J].IEEE Sensors Journal,2012,12(9):2767-2775.
[8]ZHANG M,LI J,DING R L,et al.Remote Sensing Image Object Detection Technology Based on Improved YOLO-V2 Algorithm[J].Computer Science,2020,47(S2):176-180.
[9]WANG Q,YAN P K,YUAN Y,et al.Multi-spectral saliency detection[J].Pattern Recognition Letters,2013,34(1):34-41.
[10]RONG K X,JIAO L C,WANG S,et al.Pansharpening Based on Low-Rank and Sparse Decomposition[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sen-sing,2014,7(12):4793-4805.
[11]YEE L,LIU J M,ZHANG J S.An Improved Adaptive Intensity-Hue-Saturation Method for the Fusion of Remote Sensing Images[J].IEEE Geoscience and Remote Sensing Letters,2014,11(5):985-989.
[12]YOKOYA N,CLAAS G,JOCELYN C.Hyperspectral and Multispectral Data Fusion:A comparative review of the recent litera-ture[J].IEEE Geoscience and Remote Sensing Magazine,2017,5(2):29-56.
[13]SELVA M,BRUNO A,FRANCESCO B,et al.Hyper-Sharpe-ning:A First Approach on SIM-GA Data[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2015,8(6):3008-3024.
[14]VINONE G,LUCIANO A,JOCELYN C,et al.A Critical Comparison Among Pansharpening Algorithms[J].IEEE Transactions on Geoscience and Remote Sensing,2015,53(5):2565-2586.
[15]YAN J J,XIA C M,ZHENG J R.Multispectral Image and Panchromatic Image Fusion Method Based on Non-negative Matrix Factorization[J].Computer Engineering,2007,33(21):169-171.
[16]WANG Z N,YU X C,ZHANG L B.A Remote Sensing Image Fusion Algorithm Based on Constrained Nonnegative Matrix Factorization[J].Congress on Image and Signal Processing,2008 (4):672-676.
[17]BIENIARZ J,CERRA D,AVBELJ J,et al.Hyperspectral image resolution enhancement based on spectral unmixing and information fusion[C]//ISPRS-International Archives of the Photo-grammetry,Remote Sensing and Spatial Information Sciences.2012,1:33-37.
[18]YOKOYA N,TAKEHISA Y,AKIRA I.Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion[J].IEEE Transactions on Geoscience and Remote Sensing,2012,50(2):528-537.
[19]LI H,CHANG Z Y.Multi-objective Optimization ProblemBased on Genetic Algorithm[J].Information Technology Journal,2013,12(22):6968-6973.
[20]LEE D D,SEUNG H S.Learning the parts of objects by non-negative matrix factorization[J].Nature,1999,401(6755):788-791.
[21]ZHANG H Y,ZHANG L P,SHEN H F.A super-resolution reconstruction algorithm for hyperspectral images[J].Signal Processing,2012,92(9):2082-2096.
[22]QIAO Y C,BALDUR V L,BOUDEWIJN P F L,et al.Fast Automatic Step Size Estimation for Gradient Descent Optimization of Image Registration[J].IEEE Transactions on Medical Imaging,2016,35(2):391-403.
[23]NASCIMENTO J M P,DIAS J M B.Vertex component analysis:a fast algorithm to unmix hyperspectral data[J].IEEE Transactions on Geoscience and Remote Sensing,2005,43(4):898-910.
[24]WALD L,THIERRY R,MARC M.Fusion of satellite images ofdifferent spatial resolutions:Assessing the quality of resulting images[J].Photogrammetric Engineering and Remote Sensing,1997,63(6):691-699.
[25]CHANG C I.An information theoretic-based approach to spectral variability,similarity,and discriminability for hyperspectral image analysis[C]//IEEE Trans Information Theory.2000.
[26]PALSSON F,JOHANNES R S,MAGNUS O U,et al.Quantitative Quality Evaluation of Pansharpened Imagery:Consistency Versus Synthesis[J].IEEE Transactions on Geoscience and Remote Sensing,2016,54(3):1247-1259.
[27]LONCAN L,LUIS B A,JOSE M B,et al.Hyperspectral Pansharpening:A Review[J].IEEE Geoscience and RemoteSen-sing Magazine,2015,3(3):27-46.
[28]ZHANG L F,ZHANG L P,TAO D C,et al.On CombiningMultiple Features for Hyperspectral Remote Sensing Image Classification[J].IEEE Transactions on Geoscience and Remote Sensing,2012,50(3):879-893.
[1] LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing [J]. Computer Science, 2022, 49(6A): 314-318.
[2] ZHAO Ming-hua, ZHOU Tong-tong, DU Shuang-li, SHI Zheng-hao. Single Backlit Image Enhancement Based on Virtual Exposure Method [J]. Computer Science, 2022, 49(6A): 384-389.
[3] SUN Gang, WU Jiang-jiang, CHEN Hao, LI Jun, XU Shi-yuan. Hidden Preference-based Multi-objective Evolutionary Algorithm Based on Chebyshev Distance [J]. Computer Science, 2022, 49(6): 297-304.
[4] GAO Yuan-hao, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Based on Feature Separation [J]. Computer Science, 2022, 49(5): 58-63.
[5] LI Hao-dong, HU Jie, FAN Qin-qin. Multimodal Multi-objective Optimization Based on Parallel Zoning Search and Its Application [J]. Computer Science, 2022, 49(5): 212-220.
[6] YAN Min, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning [J]. Computer Science, 2022, 49(4): 215-220.
[7] PENG Dong-yang, WANG Rui, HU Gu-yu, ZU Jia-chen, WANG Tian-feng. Fair Joint Optimization of QoE and Energy Efficiency in Caching Strategy for Videos [J]. Computer Science, 2022, 49(4): 312-320.
[8] HUANG Xiao-sheng, XU Jing. Multi-focus Image Fusion Method Based on PCANet in NSST Domain [J]. Computer Science, 2021, 48(9): 181-186.
[9] TIAN Song-wang, LIN Su-zhen, YANG Bo. Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator [J]. Computer Science, 2021, 48(8): 185-190.
[10] WANG Li-fang, WANG Rui-fang, LIN Su-zhen, QIN Pin-le, GAO Yuan, ZHANG Jin. Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks [J]. Computer Science, 2021, 48(2): 160-166.
[11] WANG Ke, QU Hua, ZHAO Ji-hong. Multi-objective Optimization Method Based on Reinforcement Learning in Multi-domain SFC Deployment [J]. Computer Science, 2021, 48(12): 324-330.
[12] CUI Guo-nan, WANG Li-song, KANG Jie-xiang, GAO Zhong-jie, WANG Hui, YIN Wei. Fuzzy Clustering Validity Index Combined with Multi-objective Optimization Algorithm and Its Application [J]. Computer Science, 2021, 48(10): 197-203.
[13] ZHU Han-qing, MA Wu-bin, ZHOU Hao-hao, WU Ya-hui, HUANG Hong-bin. Microservices User Requests Allocation Strategy Based on Improved Multi-objective Evolutionary Algorithms [J]. Computer Science, 2021, 48(10): 343-350.
[14] ZHU Zhen, HUANG Rui, ZANG Tie-gang, LU Shi-jun. Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion [J]. Computer Science, 2020, 47(8): 241-244.
[15] ZHANG Qing-qi, LIU Man-dan. Multi-objective Five-elements Cycle Optimization Algorithm for Complex Network Community Discovery [J]. Computer Science, 2020, 47(8): 284-290.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!