计算机科学 ›› 2022, Vol. 49 ›› Issue (6A): 675-679.doi: 10.11896/jsjkx.210300177

• 交叉&应用 • 上一篇    下一篇

基于CNN-LSTM的卫星云图云分类方法研究

王杉1, 徐楚怡1, 师春香2, 张瑛3   

  1. 1 华东交通大学信息工程学院 南昌 330013
    2 国家气象信息中心气象数据研究室 北京 100081
    3 江西省气象科学研究所 南昌 330000
  • 出版日期:2022-06-10 发布日期:2022-06-08
  • 通讯作者: 徐楚怡(xuchu_yi@163.com)
  • 作者简介:(patrick_shan@163.com)
  • 基金资助:
    国家自然科学基金(41965007);江西省杰出青年人才培养计划项目(20192BCB23029)

Study on Cloud Classification Method of Satellite Cloud Images Based on CNN-LSTM

WANG Shan1, XU Chu-yi1, SHI Chun-xiang2, ZHANG Ying3   

  1. 1 College of Information Engineering,East China Jiaotong University,Nanchang 330013,China
    2 National Meteorological Information Center,China Meteorological Adminstration,Beijing 100081,China
    3 Jiangxi Provincial Meteorological Observatory,Jiangxi Meteorological Bureau,Nanchang 330000,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:WANG Shan,born in 1981,Ph.D,professor.His main research interests include image processing and artificial intelligence.
    XU Chu-yi,born in 1995,postgraduate.Her main research interests include meteorological data processing and so on.
  • Supported by:
    National Natural Science Foundation of China(41965007) and Jiangxi Outstanding Young Talents Subsidy Project(20192BCB23029).

摘要: 卫星云图分类一直都是气象领域的研究热点之一,但存在同一云型光谱特征不同、不同云型光谱特征相同以及主要利用点云光谱特征而忽视空间特征等问题。针对以上问题,提出一种基于CNN-LSTM网络的卫星云图云分类方法,充分利用光谱信息和空间信息来提升云分类准确率。首先,根据云的物理特性对光谱特征进行筛选,并结合点云的正方形邻域作为点云的空间信息;然后,通过卷积神经网络(Convolutional neural network,CNN)自动提取空间特征,解决了单用光谱特征分类难的问题;最后,在此基础上结合长短时记忆网络(Long short-term memory,LSTM)提取的空间局部差异特征,为卫星云图分类提供多角度特征,解决了云块空间结构相似导致误判的问题。实验结果表明,所提方法对卫星云图的整体分类准确率达到93.4%,相比单一CNN方法的整体云分类准确率提高了2.7%。

关键词: CNN-LSTM, 长短时记忆网络, 光谱特征, 卷积神经网络, 云分类

Abstract: The classification of satellite cloud images has always been one of the research hotspots in the field of meteorology.But there are some problems,such as the same cloud type has different spectral features,different cloud types have the same spectral features,and mainly use the spectral features and ignore spatial features.To solve the above problems,this paper proposes a cloud classification method of satellite cloud image based on CNN-LSTM,which makes full use of spectral information and spatial information to improve the accuracy of cloud classification.Firstly,the spectral features are screened based on the physical characteristics of the cloud,and the square neighborhood of the point cloud is used as the spatial information.Then,the convolutional neural network(CNN) is used to automatically extract the spatial features,which solves the problem of difficult classification with spectral feature alone.Finally,on this basis,combined with the spatial local difference features extracted by the long short-term memory(LSTM) network,it provides multi-view features for the classification of satellite cloud images,and solves the problem of misjudgment caused by the similarity of cloud spatial structure.Experimental results show that the overall classification accuracy of the proposed method for satellite cloud images reaches 93.4%,which is 2.7% higher than that of the single CNN method.

Key words: Cloud classification, CNN-LSTM, Convolution neural network, Long short-term memory network, Spectral features

中图分类号: 

  • TP183
[1] ZHOU W,LI W B.Classification of Cloud Using GMS-5 Infrared Data[J].Journal of Peking University(Natural Science Edition),2003,39(1):83-90.
[2] WANG J G,ZHANG R,HONG M,et al.Synthetical optimization clustering method for classifying cloud from satellite images[J].Journal of PLA University of Science and Technology(Na-tural Science Edition),2005,6(6):585-590.
[3] ZHANG Y,YANG H T,YUAN C H.A Survey of RemoteSensing Image Classification Methods[J].Journal of Sichuan Ordnance,2018,241(8):114-118.
[4] SHENK W E,HOLUB R J,NEFF R A.A Multispectral Cloud Type Identification Method Developed for Tropical Ocean Areas with Nimbus-3 MRIR Measurements[J].Monthly Weather Review,1976,104(3):284.
[5] ZHAO Y,ZHANG L,LI P,et al.Classification of High Spatial Resolution Imagery Using Improved Gaussian Markov Random-Field-Based Texture Features[J].IEEE Transactions on Geo-science and Remote Sensing,2007,45(5):1458-1468.
[6] ZHANG T,TANG H.A Comprehensive Evaluation of Approaches for Built-Up Area Extraction from Landsat OLI Images Using Massive Samples[J].Remote Sensing,2018,11(1):2.
[7] KOFFLER R,DECOTIIS A G,RAO P K.A Procedure for Estimating Cloud Amount and Height From Satellite Infrared Radia-tion Data[J].Monthly Weather Review,2009,101(3):240-243.
[8] KEY J R,MASLANIK J A,SCHWEIGER A J.Classification of merged AVHRR and SMMR Arctic data with neural networks[J].Photogrammetric Engineering and Remote Sensing,1989,55(9):1331.
[9] SHI C X,QU J H.Cloud Classification for NOAA-AVHRR byUsing a neural network[J].ACTA Meteorologica Sinica,2002,60(2):250-255.
[10] CAI K Y,WANG H.Cloud Classification of Satellite ImageBased on Convolutional Neural Networks[C]//IEEE International Conference on Software Engineering and Service Science(ICSESS).2017:894-897.
[11] GAO Y L,ZHAN X G,CHI C Y.Research on sentiment ana-lysis based on CNN-LSTM model[J].Journal of University of Science and Technology Liaoning,2018,41(6):469-474.
[12] LI T,HUA M,WU X.A Hybrid CNN-LSTM Model for Forecasting Particulate Matter(PM2.5)[J].IEEE Access,2020(8):26933-26940.
[13] REHMAN A U,MALIK A K,RAZA B,et al.A Hybrid CNN-LSTM Model for Improving Accuracy of Movie Reviews Sentiment Analysis[J].Multimedia Tools and Applications,2019,78(18):26597-26613.
[14] KBESSHO,DATE K,HAYASHI M,et al.An Introduction to Himawari-8/9-Japan's New-Generation Geostationary Meteorological Satellites[J].Journal of the Meteorological Society of Japan,2016,94(2):151-183.
[15] PURBANTORO B,AMINUDDIN J,MANAGO N,et al.Comparison of Cloud Type Classification with Split Window Algorithm Based on Different Infrared Band Combinations of Himawari-8 Satellite[J].Advances in Remote Sensing,2018,7(3):218-234.
[16] ZHANG C W.The Cloud-type Classification Research and itsApplication for the New Generation Geostationary Satellite Himawari-8[D].Nanjing:Nanjing University,2019.
[17] LI Y Y,FANG L Z,KOU X W.Principle and Standard of Auto-Observation Cloud Classification for Satellite,Ground Measurements and model[J].Chinense Journal of Geophysics,2014,57(8):2433-2441.
[18] LIU Y.Remote Sensing Precipitation Forecasting Model Using Radar and Geostationary Meteorological Satellite and Analysis on Precipitation Predictability[D].Beijing:Chinese Academy of Sciences,2014.
[19] FENG F,WANG S,WANG C,et al.Learning Deep Hierarchical Spatial-Spectral Features for Hyperspectral Image Classification Based on Residual 3D-2D CNN[J].Sensors,2019,19(23):5276.
[20] ROY S K,KRISHNA G,DUBEY S R,et al.HybridSN:Exploring 3D-2D CNN Feature Hierarchy for Hyperspectral Image Classification[J].IEEE Geoscience and Remote Sensing Letters,2020,17(2):277-281.
[1] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[2] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[3] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[4] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[5] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[6] 金方焱, 王秀利.
融合RACNN和BiLSTM的金融领域事件隐式因果关系抽取
Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM
计算机科学, 2022, 49(7): 179-186. https://doi.org/10.11896/jsjkx.210500190
[7] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[8] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[9] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[10] 徐鸣珂, 张帆.
Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法
Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition
计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085
[11] 孙福权, 崔志清, 邹彭, 张琨.
基于多尺度特征的脑肿瘤分割算法
Brain Tumor Segmentation Algorithm Based on Multi-scale Features
计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[12] 吴子斌, 闫巧.
基于动量的映射式梯度下降算法
Projected Gradient Descent Algorithm with Momentum
计算机科学, 2022, 49(6A): 178-183. https://doi.org/10.11896/jsjkx.210500039
[13] 杨涵, 万游, 蔡洁萱, 方铭宇, 吴卓超, 金扬, 钱伟行.
基于步态分类辅助的虚拟IMU的行人导航方法
Pedestrian Navigation Method Based on Virtual Inertial Measurement Unit Assisted by GaitClassification
计算机科学, 2022, 49(6A): 759-763. https://doi.org/10.11896/jsjkx.211200148
[14] 杨玥, 冯涛, 梁虹, 杨扬.
融合交叉注意力机制的图像任意风格迁移
Image Arbitrary Style Transfer via Criss-cross Attention
计算机科学, 2022, 49(6A): 345-352. https://doi.org/10.11896/jsjkx.210700236
[15] 杨健楠, 张帆.
一种结合双注意力机制和层次网络结构的细碎农作物分类方法
Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure
计算机科学, 2022, 49(6A): 353-357. https://doi.org/10.11896/jsjkx.210200169
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!