Computer Science ›› 2026, Vol. 53 ›› Issue (6): 270-280.doi: 10.11896/jsjkx.250400015

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Pansharpening Method Based on Double-side Guided Filtering and Multi-feature Recalibration

MA Ning1,3, CHANG Xia2,3, YUAN Lingyu2,3   

  1. 1 School of Computer Science and Engineering,North Minzu University,Yinchuan 750021,China
    2 School of Mathematics and Information Science,North Minzu University,Yinchuan 750021,China
    3 Ningxia Key Laboratory of Intelligent Information and Big Data Processing,Northern Minzu University,Yinchuan 750021,China
  • Received:2025-04-02 Revised:2025-06-21 Online:2026-06-15 Published:2026-06-09
  • About author:MA Ning,born in 2002,postgraduate.His main research interests include deep learning and image processing.
    CHANG Xia,born in 1982,Ph.D,professor,doctoral supervisor.Her main research interests include computational intelligence,image processing and understanding.
  • Supported by:
    National Natural Science Foundation of China(11761001,62366001),Construction of First-class Disciplines in Ningxia Colleges and Universities (NXYLXK2017B09) and Graduate Innovation Program of North Minzu University for Nationalities (YCX24377,YCX24262).

Abstract: During the imaging process of remote sensing satellites,high-resolution panchromatic images and low-resolution multispectral images are usually obtained.To make full use of the advantages of these two types of images,this paper proposes a panchromatic sharpening method based on double-side guided filtering and multi-feature recalibration,aiming to generate high-resolution multispectral images that can maintain both spatial and spectral information.This method designs a dual-stream U-Net encoder-decoder network architecture.The multi-scale features of multispectral and panchromatic images are extracted by parallel branches,which avoids the information loss caused by direct feature fusion.A double-side guided filtering module is proposed,which can enhance feature interaction through the parallel feature-guided path and adaptive weight fusion mechanism.A multi-feature recalibration module is developed.This module combines a multi-directional edge detector and multi-head feature extraction mechanism and enhances the reconstruction ability of spatial details through a dynamic feature recalibration strategy,which effectively avoids the artifacts caused by excessive enhancement.Experiments show that the proposed method has good band adaptability.It can not only effectively process 4-band GeoEye1 and PLeiades1 data,but also perform well on 8-band WorldView2 and WorldView3 data sets.Quantitative evaluation results show that the proposed method achieves a CC value of 0.957 3 on the WorldView3 dataset;on the GeoEye1 dataset,the PSNR value reaches 38.093 8 dB,with the ERGAS value decreasing by 94.9% and the Q4 value increasing by 2.3% compared to the best-competing method.It is superior to the existing techniques in subjective visual effect and objective evaluation index and provides an effective solution for remote sensing image panchromatic sharpening tasks.

Key words: Remote sensing image fusion, Pansharpening, Deep learning, Double-side guided filter, Multi-feature recalibration

CLC Number: 

  • TP391
[1]SEELAN S K,LAGUETTE S,CASADY G M,et al.Remote sensing applications for precision agriculture:A learning community approach[J].Remote Sensing of Environment,2003,88(1/2):157-169.
[2]HUANG G,WAN Z,LIU X,et al.Ship detection based onsqueeze excitation skip-connection path networks for optical remote sensing images[J].Neurocomputing,2019,332:215-223.
[3]BAKKEN S,LANGER D D,GARRETT J L,et al.Spatial resolution enhancement of hyperspectral images from miniaturized sensors[C]//Image and Signal Processing for Remote Sensing XXIX.SPIE,2023:24-38.
[4]LIU Z,SONG W,DENG A,et al.HyperESSANet:An Efficient Spatial-Spectral Attention Network for Hyperspectral Pansharpening[J].IEEE Sensors Journal,2025,25(13):25211-25266.
[5]OTAZU X,GONZÁLEZ-AUDÍCANA M,FORS O,et al.Introduction of sensor spectral responseinto image fusion methods.Application to wavelet-based methods[J].IEEE Transactions on Geoscience and Remote Sensing,2005,43(10):2376-2385.
[6]VIVONE G,DALLA M M,GARZELLI A,et al.A new benchmark based on recent advances in multispectral panshar-pening:Revisiting pansharpening with classical and emerging panshar-pening methods[J].IEEE Geoscience and Remote Sensing Maga-zine,2020,9(1):53-81.
[7]XU S,ZHANG J,ZHAO Z,et al.Deep gradient projection networks for pan-sharpening[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:1366-1375.
[8]ALCARAS E,PARENTE C,VALLARIO A.Automation ofpan-sharpening methods for pléiades images using GIS basic functions[J].Remote Sensing,2021,13(8):1550.
[9]WANG M,HE L X,CHENG Y F,et al.A pans-harpening me-thod based on adaptive Gaussian filter and SFIM model [J].Acta Geodaetica et Cartographica Sinica,2018,47(1):82-90.
[10]LI H,NIE R C,YANG X F,et al.Remote Sensing Image Fusion with Dual-branch Attention Network[J].Computer Science,2023,50(S2):230200072-7.
[11]MASI G,COZZOLINO D,VERDOLIVA L,et al.Pansharpening by convolutional neural networks[J].Remote Sensing,2016,8(7):594.
[12]RONNEBERGER O,FISCHER P,BROX T.Unet:Convolutio-nal networks for biomedical image segmentation[C]//18th International Conference Medical Image Computing and Compu-ter-assisted Intervention(MICCAI 2015).Springer,2015:234-241.
[13]YAN C,FAN X,FAN J,et al.Improved U-Net remote sensing classification algorithm based on Multi-Feature Fusion Perception[J].Remote Sensing,2022,14(5):1118.
[14]ZHANG C,DENG X,LING S H.Next-Gen medical imaging:U-Net evolution and the rise of transformers[J].Sensors,2024,24(14):4668.
[15]ADEEL H,ALI S S,RIAZ M M,et al.Learning Deep Pyramid-based Representations for Pan-sharpening[J].Arabian Journal for Science and Engineering,2022,47(8):10655-10666.
[16]LI J,FAN W,LIAN T,et al.Cross-Attention-Based Common and Unique Feature Extraction for Pansharpening[J].IEEE Geoscience and Remote Sensing Letters,2023,20:5002905.
[17]GUO H,JIN X,JIANG Q,et al.DMF-net:a dual remote sensing image fusion network based on multiscale convolutional dense connectivity with performance measure[J].IEEE Transactions on Instrumentation and Measurement,2024,73:1-15.
[18]WU H,ZHENG S,ZHANG J,et al.Fast end-to-end trainable guided filter[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:1838-1847.
[19]CHEN Y,LIU H,FANG F.A novel pansharpening methodbased on cross stage partial network and transformer[J].Scientific Reports,2024,14(1):12631.
[20]DE BORBA A A,MARENGONI M,FRERY A C.Fusion ofevidences in intensity channels for edge detection in PolSAR images[J].IEEE Geoscience and Remote Sensing Letters,2020,19:1-5.
[21]TANG L,DENG Y,YI X,et al.DRMF:Degradation-RobustMulti-Modal Image Fusion via Composable Diffusion Prior[C]//Proceedings of the 32nd ACM International Conference on Multimedia.2024:8546-8555.
[22]LI T,LIU L,LI M.Multi-Scale Residual Depthwise Separable Convolution for Metro Passenger Flow Prediction[J].Applied Sciences,2023,13(20):11272.
[23]YADAV O,GHOSAL K,LUTZ S,et al.Frequency-domain loss function for deep exposure correction of dark images[J].Signal,Image and Video Processing,2021,15(8):1829-1836.
[24]AIAZZI B,ALPARONE L,BARONTI S,et al.MTF-tailored multiscale fusion of high-resolution MS and Pan imagery[J].Photogrammetric Engineering & Remote Sensing,2006,72(5):591-596.
[25]ZHANG H,WANG H,TIAN X,et al.P2Sharpen:A progressive pansharpening network with deep spectral transformation[J].Information Fusion,2023,91:103-122.
[26]GARDNER B,HASKELL J,MATOUSEK P,et al.Guidedprincipal component analysis(GPCA):a simple method for improving detection of a known analyte[J].Analyst,2024,149(1):205-211.
[27]JAVAN F D,SAMADZADEGAN F,MEHRAVAR S,et al.A review of image fusion techniques for pansharpeningof high-reso-lution satellite imagery[J].ISPRS Journal of Photogrammetry and Remote Sensing,2021,171:101-117.
[1] WANG Yipin, CAI Chenghuan, XU Jiabin, ZHOU Xuegong, ZHANG Fengzhe, CAO Wei, ZHANG Fan, YU Xinsheng. Study on Compilation Technology of Neural Network Accelerator Based on RISC-V InstructionExtension [J]. Computer Science, 2026, 53(6): 128-136.
[2] LI Xiuying, CHEN Xuesong, LI Haoze, LIAO Hongwei, HAN Jiameng, DUAN Xiaoyi. MambaCS:Mamba-based Image Compressed Sensing Algorithm [J]. Computer Science, 2026, 53(6): 232-241.
[3] GUO Jingchen, YANG Kuiwu, DING Mengdi, WEI Jianghong. Survey of Adversarial Sample Attacks for Vision Transformer [J]. Computer Science, 2026, 53(5): 404-418.
[4] CHEN Yuansheng, CHEN Shunjue, MO Xuan, WU Weigang, LI Jialun. Deep Learning Training Time Prediction Algorithm Integrating Multi-dimensional Operator Features [J]. Computer Science, 2026, 53(5): 129-136.
[5] ZHENG Cheng, BAN Qingqing. Knowledge-assisted and Reinforced Syntax-driven for Aspect-based Sentiment Analysis [J]. Computer Science, 2026, 53(4): 406-414.
[6] YIN Chuang, LIU Jianyi, ZHANG Ru. Cross-modal Fusion Few-sample Ransomware Classifier:Multimodal Encoding Based on Pre-trained Models [J]. Computer Science, 2026, 53(4): 435-444.
[7] GAO Tai, REN Yanzhang, WANG Huiqing, LI Ying, WANG Bin. KGMamba:Gene Regulatory Network Prediction Model Based on Kolmogorov-Arnold Network Optimizing Graph Convolutional Network and Mamba [J]. Computer Science, 2026, 53(4): 101-111.
[8] ZHANG Xueqin, WANG Zhineng, LI Jinsheng, LU Yisong, LUO Fei. Key Node Identification in Temporal Social Networks Based on Deep Learning and Multi-feature Fusion [J]. Computer Science, 2026, 53(4): 143-154.
[9] GU Bokai, LIU Dun, SUN Yang. STWD-DLFRD:Multi-granularity Fake Review Detection via Sequential Three-way Decisions and Deep Learning [J]. Computer Science, 2026, 53(4): 188-196.
[10] LI Zequn, DING Fei. Fatigue Driving Detection Based on Dual-branch Fusion and Segmented Domain AdaptationTransfer Learning [J]. Computer Science, 2026, 53(3): 78-87.
[11] FU Yukai, LI Qingzhen, DONG Zhixue, SHI Dongli, ZHAO Peng. Pedestrian Re-identification Methods Based on Limited Target Data and Deep Learning [J]. Computer Science, 2026, 53(3): 287-294.
[12] YU Ding, LI Zhangwei. Prediction Method of RNA Secondary Structure Based on Transformer Architecture [J]. Computer Science, 2026, 53(3): 375-382.
[13] DU Jiantong, GUAN Zeli, XUE Zhe. Multi-task Learning-based Ophthalmic Video Feature Fusion and Multi-dimensional Profiling [J]. Computer Science, 2026, 53(3): 383-391.
[14] SU Ruitao, REN Jiongjiong, CHEN Shaozhen. Deep Learning-based Neural Differential Distinguishers for GIFT-128 and ASCON [J]. Computer Science, 2026, 53(3): 453-458.
[15] XI Penghui, WU Xiazhen, JIANG Wencong, FANG Liangda, HE Chaobo, GUAN Quanlong. Review of Personalized Educational Resource Recommendations [J]. Computer Science, 2026, 53(2): 1-15.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!