Computer Science ›› 2023, Vol. 50 ›› Issue (5): 161-169.doi: 10.11896/jsjkx.220300110

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Land Use Multi-classification Method of High Resolution Remote Sensing Images Based on MLUM-Net

HU Shaokai1, HE Xiaohui2, TIAN Zhihui2   

  1. 1 School of Information Engineering,Zhengzhou University,Zhengzhou 450001,China
    2 School of Earth Science and Technology,Zhengzhou University,Zhengzhou 450052,China
  • Received:2022-03-10 Revised:2022-04-29 Online:2023-05-15 Published:2023-05-06
  • About author:HU Shaokai,born in 1995,postgra-duate.His main research interests include artificial intelligence,remote sensing image processing.
    HE Xiaohui,born in 1978,Ph.D,professor.Her main research interests include artificial intelligence,computer vision,remote sensing image processing,and data mining.
  • Supported by:
    Key Technologies for the Construction and Service in Henan Province(201400210900) and Second Tibetan Pla-teau Scientific Expedition and Research(STEP) Program(2019QZKK0106).

Abstract: Aiming at the problems of incomplete land plot structure and poor boundary quality in high-resolution remote sensing image land use multi-classification,a multi-classification method of remote sensing image land use based on MLUM-Net model is proposed.This method uses the multi-scale hole convolution and channel attention mechanism to construct the MDSPA encoder,which improves the network multi-scale feature extraction ability and the accuracy of the parcel's location and adaptively enhances the multi-scale feature expression through the spatial attention mechanism.To eliminate the semantic loss of upsampling and reduce the noise of classification results,a hybrid pooling upsampling optimization module is designed to optimize the classification results and eliminate the network classification errors.According to the characteristics of unbalanced classification ratio of multi-classification data set of land use and the similarity index of plot structure,this paper designs a mixed loss function to eliminate the influence of data category ratio.This function improves the structural integrity of the block and refines the classification boundary.Experimental verification has been carried out on multiple data sets,and the overall accuracy and kappa index have been significantly improved.The classification result has a complete structure and accurate edge division,which has good practical value in the land use multi-classification.

Key words: Remote sensing image, Land use classification, MLUM-UNet, Attention mechanism, Multi-scale features

CLC Number: 

  • TP391.4
[1]SU M,GUO R Z,CHEN B,et al.Sampling Strategy for Detailed Urban Land Use Classification:A Systematic Analysis in Shen-zhen[J].Remote Sensing,2020,12(9):1497.
[2]MEN J L,LIU Y Y,ZHANG B.High-scoring Image Land Use Classification Based on Feature Cascades of Multi-Structure Convolutional Neural Network[J].Geomatics and Information Science of Wuhan University,2019,44(12):1841-1848.
[3]CHEN K Q,ZHU Z L,DENG X P,et al.Deep Learning forMulti-scale Object Detection:A Survey[J].Journal of Software,2021,32(4):1201-1227.
[4]FENG F,LIU P X,LI L,et al.Study of FCM Fusing Improved Gravitational Search Algorithm in Medical Image Segmentation[J].Computer Science,2018,45(S1):252-254.
[5]MARCOS D,VOLPI M,KELLENBERGER B,et al.Land covermapping at very high resolution with rotation equivariant CNNs Towards small yet accurate models[J].Isprs Journal of Photogrammetry & Remote Sensing,2018,145PA(NOV.):96-107.
[6]MEMON N,PARIKH H,PATEL D,et al.Automatic LandCover Classification of Multi-Resolution Dualpol Data using Convolutional Neural Network(CNN)[J].Remote Sensing Applications Society and Environment,2021(2):100491.
[7]XIA M,CAO G,WANG G Y,et al.Remote Sensing Image Classification Based on Deep Learning and Conditional Random Fields[J].Journal of Image and Graphics,2017,22(9):1289-1301.
[8]YAO X,YANG H,WU Y,et al.Land Use Classification of the Deep Convolutional Neural Network Method Reducing the Loss of Spatial Features[J].Sensors,2019,19(12):2792-2807.
[9]CHAI H B,YAN C,ZOU Y F,et al.Using PSP Net to Realize Land Cover Classification of Remote Sensing Imagery in Hubei Province[J].Geomatics and Information Science of Wuhan University,2021,46(8):1224-1232.
[10]MENG Q X,DUAN X L.High-resolution Remote SensingImage Scene Classification Based on DCNN[J].Journal of Central China Normal University(Natural Sciences),2019,53(4):568-574.
[11]ZHANG W,TANG P,ZHAO L.Fast and accurate land cover classification on medium resolution remote sensing images using segmentation models[J].International Journal of Remote Sen-sing,2021,42(9):3277-3301.
[12]YANG M,YU K,CHI Z,et al.DenseASPP for semantic segmentation in street scenes[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.2018:3684-3692.
[13]HUANG G,LIU Z,LAURENS V D M,et al.Densely connected convolutional networks[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2017:2261-2269.
[14]AIHICHRE H,ALSUWAYED A,BAZI Y,et al.Classification of Remote Sensing Images using EfficientNet-B3 CNN Model with Attention[J].IEEE Access,2021,9(9):14078-14094.
[15]RONNERBERGER O,FISCHERF P,BROX T.U-Net:Convolutional Networks for Biomedical Image Segmentation[J].Medical Image Computing and Computer Assisted Intervention,2015,28(4):234-241.
[16]LIN T Y,GOYAL P,GIRSHICK R,et al.Focal Loss for Dense Object Detection[C]//IEEE International Conference on Computer Vision(ICCV).2017:2999-3007.
[17]WANG Z,BOVIK A C,SHEIKH H R,et al.Image Quality Assessment:From Error Visibility to Structural Similarity[J].IEEE Transactions on Image Processing,2004,13(4):600-612.
[18]ROBINSON C,HOU L,MALKIN K,et al.Large Scale High-Resolution Land Cover Mapping with Multi-Resolution Data[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2019.
[19]TONG X Y,XIA G S,LU Q,et al.Land-cover classificationwith high-resolution remote sensing images using transferable deep models[J].Remote Sensing of Environment,2020,237:111322.
[20]CHAURASIA A,CULURCIELLO E.Exploiting encoder representations for efficient semantic segmentation[C]//2017 IEEE Visual Communications and Image Processing(VCIP).2017:1-4.
[21]YANG M,YU K,ZHANG Z,et al.DenseASPP for Semantic Segmentation in Street Scenes[C]//2018 IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.2018:3684-3692.
[22]CHEN L C,PAPANDREOU G,SCHROFFF,et al.Rethinking Atrous Convolution for Semantic Image Segmentation[C]//Computer Vision and Pattern Recognition.2017.
[1] ZHANG Shunyao, LI Huawang, ZHANG Yonghe, WANG Xinyu, DING Guopeng. Image Retrieval Based on Independent Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220300092-6.
[2] LIU Haowei, YAO Jingchi, LIU Bo, BI Xiuli, XIAO Bin. Two-stage Method for Restoration of Heritage Images Based on Muti-scale Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220600129-8.
[3] LI Fan, JIA Dongli, YAO Yumin, TU Jun. Graph Neural Network Few Shot Image Classification Network Based on Residual and Self-attention Mechanism [J]. Computer Science, 2023, 50(6A): 220500104-5.
[4] SUN Kaiwei, WANG Zhihao, LIU Hu, RAN Xue. Maximum Overlap Single Target Tracking Algorithm Based on Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220400023-5.
[5] WU Liuchen, ZHANG Hui, LIU Jiaxuan, ZHAO Chenyang. Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion [J]. Computer Science, 2023, 50(6A): 220200096-7.
[6] ZHANG Shuaiyu, PENG Li, DAI Feifei. Person Re-identification Method Based on Progressive Attention Pyramid [J]. Computer Science, 2023, 50(6A): 220200084-8.
[7] LUO Huilan, LONG Jun, LIANG Miaomiao. Attentional Feature Fusion Approach for Siamese Network Based Object Tracking [J]. Computer Science, 2023, 50(6A): 220300237-9.
[8] DOU Zhi, HU Chenguang, LIANG Jingyi, ZHENG Liming, LIU Guoqi. Lightweight Target Detection Algorithm Based on Improved Yolov4-tiny [J]. Computer Science, 2023, 50(6A): 220700006-7.
[9] ZENG Zehua, LUO Huilan. Cross-dataset Learning Combining Multi-object Tracking and Human Pose Estimation [J]. Computer Science, 2023, 50(6A): 220400199-7.
[10] DAI Tianhong, SONG Jieqi. Multimodal MRI Brain Tumor Segmentation Based on Multi-encoder Architecture [J]. Computer Science, 2023, 50(6A): 220200108-6.
[11] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
[12] ZHANG Tao, CHENG Yifei, SUN Xinxu. Graph Attention Networks Based on Causal Inference [J]. Computer Science, 2023, 50(6A): 220600230-9.
[13] CUI Lin, CUI Chenlu, LIU Zhengwei, XUE Kai. Speech Emotion Recognition Based on Improved MFCC and Parallel Hybrid Model [J]. Computer Science, 2023, 50(6A): 220800211-7.
[14] DUAN Jianyong, YANG Xiao, WANG Hao, HE Li, LI Xin. Document-level Relation Extraction of Graph Attention Convolutional Network Based onInter-sentence Information [J]. Computer Science, 2023, 50(6A): 220800189-6.
[15] GU Yuhang, HAO Jie, CHEN Bing. Semi-supervised Semantic Segmentation for High-resolution Remote Sensing Images Based on DataFusion [J]. Computer Science, 2023, 50(6A): 220500001-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!