Computer Science ›› 2023, Vol. 50 ›› Issue (11): 41-48.doi: 10.11896/jsjkx.230500231

• Database & Big Data & Data Science • Previous Articles     Next Articles

Geo-sensory Time Series Prediction Based on Joint Model of Auto Regression and Deep NeuralNetwork

DONG Hongbin, HAN Shuang, FU Qiang   

  1. College of Computer Science and Technology,Harbin Engineering University,Harbin 150001,China
  • Received:2023-05-30 Revised:2023-08-31 Online:2023-11-15 Published:2023-11-06
  • About author:DONG Hongbin,born in 1963,Ph.D,professor,Ph.D supervisor,is a senior member of China Computer Federation.His main research interests include na-tural computation,multi-agent systems,machine learning,and data mining.HAN Shuang,born in 1990,postgra-duate.Her main research interests include time series forecasting and deep learning.
  • Supported by:
    National Natural Science Foundation of China(61472095) and Natural Science Foundation of Heilongjiang Province,China(LH2020F023).

Abstract: Geo-sensory time series contain complex and dynamic semantic spatio-temporal correlations and geographic spatio-temporal correlations.Although a variety of existing deep learning models have been developed for time series prediction,few of them focus on capturing multi-type of spatial-temporal correlations within geo-sensory time series.In addition,it is challenging to si-multaneously predict the future values of multiple sensors at a certain time step.To address these issues and challenges,this paper proposes a joint model of autoregression and deep neural network(J-ARDNN) to achieve the multi-objective prediction task of geo-sensory time series.In this model,the spatial module is proposed to capture the multi-type spatial correlations between diffe-rent series,the temporal module introduces the temporal convolutional network to extract the temporal dependencies within a single series.Moreover,the autoregression model is introduced to improve the robustness of the J-ARDNN prediction model.To prove the superiority and effectiveness of the J-ARDNN model,the proposed model is evaluated in three real-world datasets from different fields.Experimental results show that the proposed model can achieve better prediction performance than state-of-the-art contrast models.

Key words: Geo-sensory time series, Multi-objective prediction, Spatio-Temporal correlation, Autoregression model, Deep neural network

CLC Number: 

  • TP391
[1]LIANG Y,KE S,JUNZ,et al.GeoMAN:Multi-level Attention Networks for Geo-sensory Time Series Prediction[C]//Twenty-Seventh International Joint Conference on Artificial Intelligence.2018:3428-3434.
[2]YIN C,DAI Q.A deep multivariate time series multi-step forecasting network[J].Applied Intelligence,2022,52(8):8956-8974.
[3]CHEN D,CHEN L,ZHANG Y,et al.A Multiscale InteractiveRecurrent Network for Time- Series Forecasting[J].IEEE Transactions on Cybernetics,2022,52(9):8793-8803.
[4]CANDANEDO L,FELDHEIM V.Data driven prediction mo-dels of energy use of appliances in a low-energy house[J].Energy and Buildings,2017,140(4):81-97.
[5]MA Z,LIU S,GUO G,et al.Hybrid Attention Networks for Flow and Pressure Forecasting in Water Distribution Systems[J].IEEE Geoscience and Remote Sensing Letters,2022,19:1-5.
[6]DU S D,LI T R,YANG Y,et al.A Sequence-to-Sequence Spatial-Temporal Attention Learning Model for Urban Traffic Flow Prediction[J].Journal of Computer Research and Development,2020,57(8):1715-1728.
[7] LAI G,CHANG W,YANG Y,et al.Modeling long- and short-term temporal patterns with deep neural networks[C]//Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval.New York:Association for Computing Machinery,2018:95-104.
[8]SHIH S,SUN F,LEE H.Temporal pattern attention for multivariate time series forecasting[J].Machine Learning,2019,108:1421-1441.
[9]CHANG Y,SUN F,WU Y,et al.A Memory-Network Based Solution for Multivariate Time-Series Forecasting[J].arXiv:1809.02105,2018.
[10]HUANG S,WANG D,WU X,et al.DSANet:Dual Self-Attention Network for Multivariate Time Series Forecasting[C]//Proceedings ofthe 28th ACM International Conference on Information and Knowledge Management.New York:Association for Computing Machinery,2019:2129-2132.
[11]WU Z,PAN S,LONG G,et al.Connecting the Dots:Multiva-riate Time Series Forecasting with Graph Neural Networks[C]//Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:Association for Computing Machinery,2020:753-763.
[12]JAIN A,KUMAR A M.Hybrid neural network models forhydrologic time series forecasting[J].Applied Soft Computing,2007,7(2):585-592.
[13]HUANG G,WANG L.Hybrid Neural Network Models forHydrologic Time Series Forecasting Based on Genetic Algorithm[C]//Proceedings of the 4th International Joint Confe-rence on Computational Sciences and Optimization.New York:IEEE Press,2011:1347-1350.
[14]FENG X,CHEN J,ZHANG Z,et al.State-of-charge estimation of lithium-ion battery based on clockwork recurrent neural network[J].Energy,2021,236:1-10.
[15]ZHANG Y,PENG N,DAI M,et al.Memory-Gated Recurrent Networks[C]//Proceedings of the 35th AAAI Conference on Artificial Intelligence.Menlo Park:AAAI Press,2021:10956-10963.
[16]MA Q,LIN Z,CHEN E,et al.Temporal pyramid recurrent neural network[C]//Proceedings of the 34th AAAI Conference on Artificial Intelligence.Menlo Park:AAAI Press,2020:5061-5068.
[17]WANG X,ZHANG M,REN F.Sparse Gaussian ConditionalRandom Fields on top of Recurrent Neural Networks[C]//Proceedings of the 32nd AAAI Conference on Artificial Intelligence.Menlo Park:AAAI Press,2018:4219-4226.
[18]MALDONADO S,GONZALEZ A,CRONE S.Automatic time series analysis for electric load forecasting via support vector regression[J].Applied Soft Computing,2019,83(3):1-10.
[19]LIU J X,CHEN S.Non-Stationary Multi-variate Time SeriesPrediction with MIX Gated Unit[J].Journal of Computer Research and Development,2019,56(8):1642-1651.
[20]LI Z X,LIU H Y.Combining Global and Sequential Patterns for Multivariate Time Series Forecasting[J].Chinese Journal of Computes,2023,46(1):70-84.
[21]WANG J,SUN T,LIU B Y,et al.CLVSA:A Convolutional LSTM Based Variational Sequence-to-Sequence Model with Attention for Predicting Trends of Financial Markets[C]//Proceedings of International Joint Conference on Artificial Intelligence.San Francisco:Morgan Kaufmann.2021:3705-3711.
[22]OZDEMIR A,BULUS K,ZOR K.Medium-to long-term nickel price forecasting using LSTM and GRU networks[J].Resources Policy,2022,78:1-10.
[23]LIM B,ZOHREN S.Time Series Forecasting With Deep Lear-ning:A Survey[J].Philosophical Transactions of the Royal Society A,2021,379:1-12.
[24]GUO T,LIN T,ANTULOV-FANTULIN N.Exploring Inter-pretable LSTM Neural Networks over Multi-Variable Data[C]//Proceedings of the 36th International Conference on Machine Learning.New York:ACM,2019:4424-4440.
[25]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[J].Advances in Neural Information Processing Systems,2017,30:5999-6009.
[26]OORD A,DIELMAN S,ZEN H,et al.WaveNet:A Generative Model for Raw Audio[J].arXiv:1609.03499v2,2016.
[27]GAN Z,LI C,ZHOU J,et al.Temporal convolutional networks interval prediction model for wind speed forecasting[J].Electric Power Systems Research,2021,191:1-10.
[28]LI M,ZHU Z.Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecasting[C]//Proceedings of the 35th AAAI Conference on Artificial Intelligence.Menlo Park:AAAI Press,2021:4189-4196.
[29]ZHANG G P.Time series forecasting using a hybrid ARIMA and neural network model[J].Neurocomputing,2003,50(6):159-175.
[30]FRIFOLA R.Bayesian Time Series Learning with GaussianProcesses[D].Cambridgeshire:University of Cambridge,2015.
[1] BAI Zhixu, WANG Hengjun, GUO Kexiang. Adversarial Examples Generation Method Based on Image Color Random Transformation [J]. Computer Science, 2023, 50(4): 88-95.
[2] YIN Haitao, WANG Tianyou. Image Denoising Algorithm Based on Deep Multi-scale Convolution Sparse Coding [J]. Computer Science, 2023, 50(4): 133-140.
[3] RAO Dan, SHI Hongwei. Study on Air Traffic Flow Recognition and Anomaly Detection Based on Deep Clustering [J]. Computer Science, 2023, 50(3): 121-128.
[4] WANG Xiangwei, HAN Rui, Chi Harold LIU. Hierarchical Memory Pool Based Edge Semi-supervised Continual Learning Method [J]. Computer Science, 2023, 50(2): 23-31.
[5] REN Shuyao, SONG Jiangling, ZHANG Rui. Early Screening Method for Depression Based on EEG Signal [J]. Computer Science, 2023, 50(11A): 221100139-6.
[6] WEI Hui, CHEN Ze-mao, ZHANG Li-qiang. Anomaly Detection Framework of System Call Trace Based on Sequence and Frequency Patterns [J]. Computer Science, 2022, 49(6): 350-355.
[7] JIAO Xiang, WEI Xiang-lin, XUE Yu, WANG Chao, DUAN Qiang. Automatic Modulation Recognition Based on Deep Learning [J]. Computer Science, 2022, 49(5): 266-278.
[8] GAO Jie, LIU Sha, HUANG Ze-qiang, ZHENG Tian-yu, LIU Xin, QI Feng-bin. Deep Neural Network Operator Acceleration Library Optimization Based on Domestic Many-core Processor [J]. Computer Science, 2022, 49(5): 355-362.
[9] QIAN Dong-wei, CUI Yang-guang, WEI Tong-quan. Secondary Modeling of Pollutant Concentration Prediction Based on Deep Neural Networks with Federal Learning [J]. Computer Science, 2022, 49(11A): 211200084-5.
[10] ZHAO Hong, CHANG You-kang, WANG Wei-jie. Survey of Adversarial Attacks and Defense Methods for Deep Neural Networks [J]. Computer Science, 2022, 49(11A): 210900163-11.
[11] JIN Yu-jie, CHU Xu, WANG Ya-sha, ZHAO Jun-feng. Variational Domain Adaptation Driven Semantic Segmentation of Urban Scenes [J]. Computer Science, 2022, 49(11): 126-133.
[12] FAN Hong-jie, LI Xue-dong, YE Song-tao. Aided Disease Diagnosis Method for EMR Semantic Analysis [J]. Computer Science, 2022, 49(1): 153-158.
[13] ZHOU Xin, LIU Shuo-di, PAN Wei, CHEN Yuan-yuan. Vehicle Color Recognition in Natural Traffic Scene [J]. Computer Science, 2021, 48(6A): 15-20.
[14] LIU Dong, WANG Ye-fei, LIN Jian-ping, MA Hai-chuan, YANG Run-yu. Advances in End-to-End Optimized Image Compression Technologies [J]. Computer Science, 2021, 48(3): 1-8.
[15] PAN Yu, ZOU Jun-hua, WANG Shuai-hui, HU Gu-yu, PAN Zhi-song. Deep Community Detection Algorithm Based on Network Representation Learning [J]. Computer Science, 2021, 48(11A): 198-203.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!