Computer Science ›› 2024, Vol. 51 ›› Issue (3): 128-134.doi: 10.11896/jsjkx.221200055

• Database & Big Data & Data Science • Previous Articles     Next Articles

Time Series Completion and One-step Prediction Based on Two-channel Echo State Network

ZHENG Weinan1, YU Zhiyong1,2, HUANG Fangwan1,2   

  1. 1 College of Computer and Data Science,Fuzhou University,Fuzhou 350108,China
    2 Fujian Key Laboratory of Network Computing and Intelligent Information Processing,Fuzhou 350108,China
  • Received:2022-12-08 Revised:2023-04-02 Online:2024-03-15 Published:2024-03-13
  • About author:ZHENG Weinan,born in 1997,postgraduate.His main research interests include data completion and so on.HUANG Fangwan,born in 1980,Ph.D,senior lecturer,is a member of CCF(No.D3015M).Her main research interests include computational intelligence,machine learning and big data analysis.
  • Supported by:
    National Natural Science Foundation of China(61772136),Fujian Provincial Guiding Project(2020H0008) and Educational Research Project for Young and Middle-aged Teachers in Fujian Province(JAT210007).

Abstract: With the development of the Internet of Things,numerous sensors can collect a large number of time series with rich data correlation,providing powerful data support for various data mining applications.However,some objective or subjective reasons(such as equipment failure,sparse sensing) often lead to the loss of collected data to varying degrees.Although many approaches have been proposed to solve this problem,data correlation is either not fully considered or computationally expensive.In addition,existing methods only focus on the completion of missing values,and fail to take into account downstream applications.Aiming at the above shortcomings,this paper designs a two-channel echo state network to achieve both the completion task and the prediction task.Although the two channels share the input layer,they have their own reservoir and output layer.The biggest difference between them is that the output layer of the left/right channels respectively represents the target value or prefilled va-lue corresponding to the moment before/after the input layer.Finally,by fusing the estimates of the two channels,the data correlation from before and after the missing moments is fully utilized to further improve performance.Experimental results of diffe-rent missing rates with two missing mechanisms(random missing and piecewise missing) show that the proposed model is superior to the current methods in both completion accuracy and prediction accuracy.

Key words: Data correlation, Time series, Exogenous variables, Two-channel echo state network, Missing value completion, One-step

CLC Number: 

  • TP391
[1]LIN W C,TSAI C F.Missing value imputation:a review andanalysis of the literature(2006-2017)[J].Artificial Intelligence Review,2020,53(2):1487-1509.
[2]WANG L,ZHANG D,WANG Y,et al.Sparse mobile crowd-sensing:challenges and opportunities[J].IEEE Communications Magazine,2016,54(7):161-167.
[3]WANG S,ZHENG F,ZHAO D.Research on causal network of high-dimensional time series with insufficient information[J].Journal of Chinese Computer Systems,2023,44(5):981-990.
[4]HUANG F,ZHENG W,GUO W,et al.Estimating missing data for sparsely sensed time series with exogenous variables using bidirectional-feedback echo state networks[J].CCF Transactions on Pervasive Computing and Interaction,2023,5(1):45-63.
[5]YOON J,ZAME W R,VAN DER SCHAAR M.Estimatingmissing data in temporal data streams using multi-directional recurrent neural networks[J].IEEE Transactions on Biomedical Engineering,2018,66(5):1477-1490.
[6]LIU Y,ZHAO N,VANOS J K,et al.Effects of synoptic wea-ther on ground-level PM2.5 concentrations in the United States[J].Atmospheric Environment,2017,148:297-305.
[7]BOQUET G,MORELL A,SERRANO J,et al.A variationalutoencoder solution for road traffic forecasting systems:Missing data imputation,dimension reduction,model selection and anomaly detection[J].Transportation Research Part C:Emerging Technologies,2020,115:102622.
[8]ZHANG Z,LIN X,LI M,et al.A customized deep learning approach to integrate network-scale online traffic data imputation and prediction[J].Transportation Research Part C:Emerging Technologies,2021,132:103372.
[9]GRIGORYEVA L,ORTEGA J P.Echo state networks are universal[J].Neural Networks,2018,108:495-508.
[10]NOORN M,AL BAKRI ABDULLAHM M,YAHAYAA S,et al.Comparison of linear interpolation method and mean me-thod to replace the missing values in environmental data set[C]//Materials Science Forum.Trans. Tech. Publications Ltd.,2015,803:278-281.
[11]KARIM S A A,ISMAIL M T,OTHMAN M,et al.Rational cubic spline interpolation for missing solar data imputation[J].Journal of Engineering and Applied Sciences,2018,13(9):2587-2592.
[12]SONG X,GUO Y,LI N,et al.Missing data prediction based on compressive sensing in time series[J].Computer Science,2019,46(6):35-40.
[13]JADHAV A,PRAMOD D,RAMANATHAN K.Comparison of performance of data imputation methods for numeric dataset[J].Applied Artificial Intelligence,2019,33(10):913-933.
[14]LOH W Y,ZHANG Q,ZHANG W,et al.Missing data,imputation and regression trees[J].Statistica Sinica,2020,30(4):1697-1722.
[15]SANTOS M S,ABREU P H,WILK S,et al.How distance metrics influence missing data imputation with k-nearest neighbours[J].Pattern Recognition Letters,2020,136:111-119.
[16]ZHANG S,GONG L,ZENG Q,et al.Imputation of GPS coordinate time series using MissForest[J].Remote Sensing,2021,13(12):2312.
[17]LAQUEUR H S,SHEV A B,KAGAWA R M C.SuperMICE:an ensemble machine learning approach to multiple imputation by chained equations[J].American Journal of Epidemiology,2022,191(3):516-525.
[18]XIONG Z,WEI Y,XU R,et al.Low-rank traffic matrix completion with marginal information[J].Journal of Computational and Applied Mathematics,2022,410:114219.
[19]YU H F,RAO N,DHILLON I S.Temporal regularized matrix factorization for high-dimensional time series prediction[C]//Proceedings of the 30th International Conference on Neural Information Processing Systems.2016:847-855.
[20]KONG L,XIA M,LIU X Y,et al.Data loss and reconstruction in wireless sensor networks[J].IEEE Transactions on Parallel and Distributed Systems,2013,25(11):2818-2828.
[21]CHEN X,YANG J,SUN L.A nonconvex low-rank tensor completion model for spatiotemporal traffic data imputation[J].Transportation Research Part C:Emerging Technologies,2020,117(8):102673.1-102673-12.
[22]KIM Y J,CHI M.Temporal belief memory:imputing missing data during RNN training[C]//Proceedings of the 27th International Joint Conference on Artificial Intelligence.2018:2326-2332.
[23]YUAN H,XU G,YAO Z,et al.Imputation of missing data in time series for air pollutants using long short-term memory recurrent neural networks[C]//Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Compu-ters.2018:1293-1300.
[24]CHE Z,PURUSHOTHAM S,CHO K,et al.Recurrent neural networks for multivariate time series with missing values[J].Scientific Reports,2018,8(1):1-12.
[25]YU Z,ZHENG X,HUANG F,et al.A framework based onsparse representation model for time series prediction in smart city[J].Frontiers of Computer Science,2021,15(1):1-13.
[26]CHEN X,SUN L.Bayesian temporal factorization for multidimensional time series prediction[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,14(9):4659-4673.
[27]TIAN Y,ZHANG K,LI J,et al.LSTM-based traffic flow prediction with missing data[J].Neurocomputing,2018,318:297-305.
[1] LIN Binwei, YU Zhiyong, HUANG Fangwan, GUO Xianwei. Data Completion and Prediction of Street Parking Spaces Based on Transformer [J]. Computer Science, 2024, 51(4): 165-173.
[2] QIAO Fan, WANG Peng, WANG Wei. Multivariate Time Series Classification Algorithm Based on Heterogeneous Feature Fusion [J]. Computer Science, 2024, 51(2): 36-46.
[3] YANG Bo, LUO Jiachen, SONG Yantao, WU Hongtao, PENG Furong. Time Series Clustering Method Based on Contrastive Learning [J]. Computer Science, 2024, 51(2): 63-72.
[4] ZHANG Guohua, YAN Xuefeng, GUAN Donghai. Anomaly Detection of Time-series Based on Multi-modal Feature Fusion [J]. Computer Science, 2023, 50(6A): 220700094-7.
[5] HUANG Fangwan, LU Juhong, YU Zhiyong. Data Augmentation for Cardiopulmonary Exercise Time Series of Young HypertensivePatients Based on Active Barycenter [J]. Computer Science, 2023, 50(6A): 211200233-11.
[6] ZHANG Renbin, ZUO Yicong, ZHOU Zelin, WANG Long, CUI Yuhang. Multimodal Generative Adversarial Networks Based Multivariate Time Series Anomaly Detection [J]. Computer Science, 2023, 50(5): 355-362.
[7] LUO Xiaohui, WU Yun, WANG Chenxing, YU Wenting. Sequential Recommendation Model Based on User’s Long and Short Term Preference [J]. Computer Science, 2023, 50(4): 47-55.
[8] DUAN Mengmeng, JIN Cheng. Transformer Feature Fusion Network for Time Series Classification [J]. Computer Science, 2023, 50(12): 97-103.
[9] WANG Hao, ZHOU Jiantao, HAO Xinyu, WANG Feiyu. Multivariate Time Series Forecasting Method Based on FRA [J]. Computer Science, 2023, 50(11A): 221100144-8.
[10] PAN Liqun, WU Zhonghua, HONG Biao. Prediction Method of Long Series Time Series Based on Improved Informer Model with Kernel Technique [J]. Computer Science, 2023, 50(11A): 221100186-6.
[11] DONG Hongbin, HAN Shuang, FU Qiang. Geo-sensory Time Series Prediction Based on Joint Model of Auto Regression and Deep NeuralNetwork [J]. Computer Science, 2023, 50(11): 41-48.
[12] GAO Zhen-zhuo, WANG Zhi-hai, LIU Hai-yang. Random Shapelet Forest Algorithm Embedded with Canonical Time Series Features [J]. Computer Science, 2022, 49(7): 40-49.
[13] LIU Bao-bao, YANG Jing-jing, TAO Lu, WANG He-ying. Study on Prediction of Educational Statistical Data Based on DE-LSTM Model [J]. Computer Science, 2022, 49(6A): 261-266.
[14] CAI Xin-yu, FENG Xiang, YU Hui-qun. Adaptive Weight Based Broad Learning Algorithm for Cascaded Enhanced Nodes [J]. Computer Science, 2022, 49(6): 134-141.
[15] SHEN Shao-peng, MA Hong-jiang, ZHANG Zhi-heng, ZHOU Xiang-bing, ZHU Chun-man, WEN Zuo-cheng. Three-way Drift Detection for State Transition Pattern on Multivariate Time Series [J]. Computer Science, 2022, 49(4): 144-151.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!