Computer Science ›› 2021, Vol. 48 ›› Issue (12): 195-203.doi: 10.11896/jsjkx.210400022

• Database & Big Data & Data Science • Previous Articles     Next Articles

Travel Demand Forecasting Based on 3D Convolution and LSTM Encoder-Decoder

TENG Jian, TENG Fei, LI Tian-rui   

  1. School of Computing and Artificial Intelligence,Southwest Jiaotong University,Chengdu 611756,China
    National Engineering Laboratory of Integrated Transportation Big Data Application Technology,Chengdu 611756,China
  • Received:2021-04-01 Revised:2021-07-17 Online:2021-12-15 Published:2021-11-26
  • About author:TENG Jian,born in 1996,postgraduate.His main research interests include big data and urban computing.
    LI Tian-rui,born in 1969,professor,is a fellow of IRSS and senior member of China Computer Federation,ACM and IEEE.His main research interests include big data,data mining,granular computing and rough sets.
  • Supported by:
    National Key R & D Program of China (2019YFB2101802) and Key R & D Project of Sichuan Province (2021YFG0312).

Abstract: Reliable regional travel demand forecasting can provide reasonable and effective suggestions for the scheduling and planning of traffic resources.However,travel forecasting is a very challenging problem,facing massive spatial-temporal big data modeling problem.And how to extract the spatial and temporal features of the data effectively has become a research hotspot of urban computing.This paper proposes a demand forecasting model based on 3D deconvolution and encoder-decoder attention mechanism (in short 3D-EDADF),which is used to predict the inflow and outflow of travel demand in urban areas at the same time.3D-EDADF model first uses 3D convolution to extract spatial-temporal correlation of data,then uses LSTM encoder-decoder to capture temporal dependence,and combines attention mechanism to describe the difference of inflow and outflow.3D-EDADF model conducts hybrid modeling on the three time-dependent features of closeness dependency,daily dependency and periodic dependency,and then weights and fuses their multi-dimensional features to obtain the final prediction result.The experiments are carried out by using real travel demand data sets.The results show that compared with baseline models,the 3D-EDADF model has the lowest overall prediction error and has better prediction performance.

Key words: 3D convolution, Attention mechanism, Encoder-decoder, Spatial-temporal big data, Travel demand prediction

CLC Number: 

  • TP181
[1]YAO H,WU F,KE J,et al.Deep multi-view spatial-temporal network for taxi demand prediction[C]//2018 32nd AAAI Conference on Artificial Intelligence,AAAI.2018:2588-2595.
[2]CHU K F,LAM A Y S,LI V O K.Travel demand prediction using deep multi-scale convolutional LSTM network[C]//2018 21st International Conference on Intelligent Transportation Systems (ITSC).IEEE,2018:1402-1407.
[3]MACIEJEWSKI M,BISCHOFF J,NAGEL K.An assignment-based approach to efficient real-time city-scale taxi dispatching[J].IEEE Intelligent Systems,2016,31(1):68-77.
[4]WANG D,YANG Y,NING S.Deepstcl:A deep spatio-temporal convlstm for travel demand prediction[C]//2018 International Joint Conference on Neural Networks(IJCNN).IEEE,2018:1-8.
[5]YANG G F,XU R,QIN M,et al.Short-term traffic volume forecasting based on ARMA and Kalman filter[J].Journal of Zhengzhou University(Engineering Edition),2017,38(2):36-40.
[6]KANCHYMALAY K,SALIM N,SUKPRASERT A,et al. Multivariate time series forecasting of crude palm oil price using machine learning techniques[C]//IOP Conference Series:Materials Science and Engineering.IOP Publishing,2017,226(1):012117.
[7]LU J Z,CHENG H.Short-term traffic flow forecast based on modified GA optimized BP neural network [J].Journal of Hefei University of Technology (Natural Science Edition),2015,38(1):127-131.
[8]TEDJOPURNOMO D A,BAO Z,ZHENG B,et al.A Survey on Modern Deep Neural Network for Traffic Prediction:Trends,Methods and Challenges[J/OL].IEEE Transactions on Know-ledge and Data Engineering,2020,https://ieeexplore.ieee.org/document/9112608.
[9]LECUN Y,BENGIO Y,HINTON G.Deep learning[J].Nature,2015,521(7553):436-444.
[10]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.Imagenet classification with deep convolutional neural networks[J].Communications of the ACM,2017,60(6):84-90.
[11]KARPATHY A,FEI-FEI L.Deep visual-semantic alignments for generatingimage descriptions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3128-3137.
[12]CHO K,VAN MERRIENBOER B,GULCEHRE C,et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[J].arXiv:1406.1078,2014.
[13]SCHIMBINSCHI F,NGUYEN X V,BAILEY J,et al.Traffic forecasting in complex urban networks:Leveraging big data and machine learning[C]//2015 IEEE International Conference on Big Data.IEEE,2015:1019-1024.
[14]HABTEMICHAEL F G,CETIN M.Short-term traffic flow rate forecasting based on identifying similar traffic patterns[J].Transportation Research Part C:Emerging Technologies,2016,66:61-78.
[15]QIAN X,UKKUSURI S V,YANG C,et al.A model for short-term taxi demand forecasting accounting for spatio-temporal correlations[R].Transportation Research Board 96th Annual Meeting,2017.
[16]SAADI I,WONG M,FAROOQ B,et al.An investigation into machine learning approaches for forecasting spatio-temporal demand in ride-hailing service[J].arXiv:1703.02433,2017.
[17]ZHANG X,HUANG C,XU Y,et al.Spatial-Temporal Convolutional Graph Attention Networks for Citywide Traffic Flow Forecasting[C]//Proceedings of the 29th ACM International Conference on Information & Knowledge Management.2020:1853-1862.
[18]CHEN X,XIE X,TENG D.Short-term Traffic Flow Prediction Based on ConvLSTM Model[C]//2020 IEEE 5th Information Technology and Mechatronics Engineering Conference (ITOEC).IEEE,2020:846-850.
[19]REN Y,ZHAO D,LUO D,et al.Global-Local Temporal Convolutional Network for Traffic Flow Prediction[J/OL].IEEE Transactions on Intelligent Transportation Systems,2020.https://ieeexplore.ieee.org/document/9216498.
[20]GUO S,LIN Y,LI S,et al.Deep spatial-temporal 3D convolutional neural networks for traffic data forecasting[J].IEEE Transactions on Intelligent Transportation Systems,2019,20(10):3913-3926.
[21]GAO K,LI D,CHEN L,et al.Incorporating intra-flow depen- dencies and inter-flow correlations for traffic matrix prediction[C]//2020 IEEE/ACM 28th International Symposium on Qua-lity of Service (IWQoS).IEEE,2020:1-10.
[22]DU S D,LI T R,YANG Y,et al.An Sequence-to-Sequence Spatial-Temporal Attention Learning Model for Urban Traffic Flow Prediction [J].Journal of Computer Research and Development,2020,57(8):1715-1728.
[23]CHEN Y,ZOU X,LI K,et al.Multiple local 3D CNNs for region-based prediction in smart cities[J].Information Sciences,2021,542:476-491.
[24]ZHOU Y,LI J,CHEN H,et al.A spatiotemporal hierarchical attention mechanism-based model for multi-stepstation-level crowd flow prediction[J].Information Sciences,2021,544:308-324.
[25]DAI G,MA C,XU X.Short-term traffic flow prediction method for urban road sections based on space-time analysis and GRU[J].IEEE Access,2019,7:143025-143035.
[26]ZHOU W,YANG Y,ZHANG Y,et al.Deep Flexible Structured Spatial-Temporal Model for Taxi Capacity Prediction[J].Knowledge-Based Systems,2020,205:106286.
[27]ZHANG J B,ZHENG Y,SUN J K,et al.Flow Prediction in Spatio-Temporal Networks Based on Multitask Deep Learning[J].IEEE Transactions on Knowledge and Data Engineering,2019,32 (3):468-478.
[28]XU L H,GUO Y T.Short-term Forecasting Model of Demand for Network Booking Taxi Based on GWO-LSTM [J].Automation and Instrumentation,2020,35(5):86-90.
[29]MADAN R,MANGIPUDI P S.Predicting computer network traffic:a time series forecasting approach using DWT,ARIMA and RNN[C]//2018 Eleventh International Conference on Contemporary Computing (IC3).IEEE,2018:1-5.
[30]WANG Y,ZHU S,LI C.Research on Multistep Time Series Prediction Based on LSTM[C]//2019 3rd International Confe-rence on Electronic Information Technology and Computer Engineering (EITCE).IEEE,2019:1155-1159.
[1] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[2] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[3] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[4] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[5] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[6] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[7] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[8] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[9] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[10] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[11] JIN Fang-yan, WANG Xiu-li. Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM [J]. Computer Science, 2022, 49(7): 179-186.
[12] XIONG Luo-geng, ZHENG Shang, ZOU Hai-tao, YU Hua-long, GAO Shang. Software Self-admitted Technical Debt Identification with Bidirectional Gate Recurrent Unit and Attention Mechanism [J]. Computer Science, 2022, 49(7): 212-219.
[13] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[14] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[15] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!