Computer Science ›› 2026, Vol. 53 ›› Issue (4): 155-162.doi: 10.11896/jsjkx.250600047

• Database & Big Data & Data Science • Previous Articles     Next Articles

Pre-trained Spatio-Temporal Decoupling-based Traffic Flow Prediction Model

LI Jing, DU Shengdong, SHI Haochen, HU Jie, YANG Yan, LI Tianrui   

  1. School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611756, China
  • Received:2025-06-08 Revised:2025-09-15 Online:2026-04-15 Published:2026-04-08
  • About author:LI Jing,born in 2000,postgraduate.Her main research interests include artificial intelligence,deep learning and traffic flow prediction.
    DU Shengdong,born in 1981,Ph.D,associate professor,Ph.D supervisor,is a member of CCF(No.73290M).His main research interests include artificial intelligence,machine learning and knowledge engineering.
  • Supported by:
    Major Science and Technology Special Project of Sichuan Province(2024ZDZX0012),General Program of the National Natural Science Foundation of China(62276215) and Joint Fund of the National Natural Science Foundation of China(U2468207).

Abstract: Traffic flow prediction,as a core technology for dynamic decision-making in smart cities,plays a crucial role in traffic signal control,route planning,and emergency management.With the expansion of urban road networks and the rapid growth of traffic data,traditional methods face challenges in accurately modeling the complex spatio-temporal interactions among road network nodes.Although pre-trained models can transfer knowledge across domains,they still encounter limitations when applied to traffic flow prediction,primarily due to coupled spatio-temporal features and the mismatch between pre-trained representations and traffic-specific characteristics.To address these issues,this paper proposes the pre-trained spatio-temporal decoupling-based traffic flow prediction model(PT-STD).The method employs a spatio-temporal decoupling module to disentangle the deep feature learning of spatial topological relationships and multi-granularity temporal patterns.Furthermore,it designs a hierarchical adaptive fine-tuning strategy that progressively unfreezes the normalization layers and attention parameters of the pre-trained model,gradually transferring the general knowledge learned in the pre-trained model to spatio-temporal feature modeling.Experimental results demonstrate that PT-STD achieves significant improvements on standard benchmark datasets,with a 3.89% reduction in mean absolute error(MAE) under data-scarce scenarios.

Key words: Traffic flow prediction, Spatio-temporal decomposition, Hierarchical fine-tuning, Pretrained model, Urban computing

CLC Number: 

  • TP391
[1]AOUEDI O,LE V A,PIAMRAT K,et al.Deep learning on network traffic prediction:Recent advances,analysis,and future directions[J].ACM Computing Surveys,2025,57(6):1-37.
[2]LI J,LIN F,HAN G,et al.PAG-TSN:Ridership demand forecasting model for shared travel services of smart transportation[J].IEEE Transactions on Intelligent Transportation Systems,2023,24(12):15876-15889.
[3]ULVI H,YERLIKAYA M A,YILDIZ K.Urban traffic mobility optimization model:A novel mathematical approach for predictive urban traffic analysis[J].Applied Sciences,2024,14(13):5873.
[4]LI K,ZHAN T,FU K,et al.MergeNet:Knowledge Migration across Heterogeneous Models,Tasks,and Modalities[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2025:4824-4832.
[5]BOMMASANI R,HUDSON D A,ADELI E,et al.On the opportunities and risks of foundation models[J].arXiv:2108.07258,2021.
[6]SU J C,MAJI S,HARIHARAN B.When does self-supervision improve few-shot learning?[C]//European Conference on Computer Vision.Cham:Springer,2020:645-666.
[7]MIN B,ROSS H,SULEM E,et al.Recent advances in natural language processing via large pre-trained language models:A survey[J].ACM Computing Surveys,2023,56(2):1-40.
[8]LIU Y,OTT M,GOYAL N,et al.Roberta:A robustly opti-mized bert pretraining approach[J].arXiv:1907.11692,2019.
[9]QIU X,SUN T,XU Y,et al.Pre-trained models for natural language processing:A survey[J].Science China Technological Sciences,2020,63(10):1872-1897.
[10]HUSSAIN B,AFZAL M K,AHMAD S,et al.Intelligent traffic flow prediction using optimized GRU model[J].IEEE Access,2021,9:100736-100746.
[11]DAI G,MA C,XU X.Short-term traffic flow prediction method for urban road sections based on space-time analysis and GRU[J].IEEE Access,2019,7:143025-143035.
[12]HUSSAINA H A,TAHER M A,MAHMOOD O A,et al.Ur-ban traffic flow estimation system based on gated recurrent unit deep learning methodology for Internet of Vehicles[J].IEEE Access,2023,11:58516-58531.
[13]WEN Y,XU P,LI Z,et al.RPConvformer:A novel Transfor-mer-based deep neural networks for traffic flow prediction[J].Expert Systems with Applications,2023,218:119587.
[14]REZA S,FERREIRA M C,MACHADO J J M,et al.A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networks[J].Expert Systems with Applications,2022,202:117275.
[15]LUO Q,HE S,HAN X,et al.LSTTN:A long-short term transformer-based spatiotemporal neural network for traffic flow forecasting[J].Knowledge-Based Systems,2024,293:111637.
[16]ZHOU B,LIU J,CUI S,et al.A large-scale spatio-temporalmultimodal fusion framework for traffic prediction[J].Big Data Mining and Analytics,2024,7(3):621-636.
[17]GUO C,HWANG F J,CHEN C H,et al.Signal Decoupling Optimization for Robust Graph-Based Traffic Forecasting[J].IEEE Transactions on Industrial Informatics,2025,21(8):6158-6168.
[18]FANG Y,QIN Y,LUO H,et al.When spatio-temporal meetwavelets:Disentangled traffic forecasting via efficient spectral graph attention networks[C]//2023 IEEE 39th International Conference on Data Engineering(ICDE).IEEE,2023:517-529.
[19]SHAO Z,ZHANG Z,WEI W,et al.Decoupled dynamic spatial-temporal graph neural network for traffic forecasting[J].arXiv:2206.09112,2022.
[20]LI G,ZHONG S,DENG X,et al.A lightweight and accuratespatial-temporal transformer for traffic forecasting[J].IEEE Transactions on Knowledge and Data Engineering,2022,35(11):10967-10980.
[21]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[22]LI Y,WANG N,SHI J,et al.Revisiting batch normalization for practical domain adaptation[J].arXiv:1603.04779,2016.
[23]CHEN Y,WANG X,XU G.Gatgpt:A pre-trained large lan-guage model with graph attention network for spatiotemporal imputation[J].arXiv:2311.14332,2023.
[24]LIU C,YANG S,XU Q,et al.Spatial-temporal large languagemodel for traffic prediction[C]//2024 25th IEEE International Conference on Mobile Data Management(MDM).IEEE,2024:31-40.
[25]YU B,YIN H,ZHU Z.Spatio-temporal graph convolutional networks:A deep learning framework for traffic forecasting[J].arXiv:1709.04875,2017.
[26]LI Y,YU R,SHAHABI C,et al.Diffusion convolutional recurrent neural network:Data-driven traffic forecasting[J].arXiv:1707.01926,2017.
[27]BAI L,YAO L,LI C,et al.Adaptive graph convolutional recurrent network for traffic forecasting[J].Advances in Neural Information Processing Systems,2020,33:17804-17815.
[28]LI F,FENG J,YAN H,et al.Dynamic graph convolutional recurrent network for traffic prediction:Benchmark and solution[J].ACM Transactions on Knowledge Discovery from Data,2023,17(1):1-21.
[29]GUO S,LIN Y,FENG N,et al.Attention based spatial-temporal graph convolutional networks for traffic flow forecasting[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019:922-929.
[30]GUO S,LIN Y,WAN H,et al.Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting[J].IEEE Transactions on Knowledge and Data Engineering,2021,34(11):5415-5428.
[31]ZHOU T,NIU P,SUN L,et al.One fits all:Power general time series analysis by pretrained lm[J].Advances in Neural Information Processing Systems,2023,36:43322-43355.
[1] XU Shenjian. Cross-model Collaborative Unsupervised Representation Method for Legal Texts [J]. Computer Science, 2026, 53(4): 356-365.
[2] CHEN Bingting, ZOU Weiqin, CAI Biyu, LIU Wenjie. Bug Report Severity Prediction Based on Fine-tuned Embedding Model with Domain Knowledge [J]. Computer Science, 2024, 51(6A): 230400068-7.
[3] BAO Kainan, ZHANG Junbo, SONG Li, LI Tianrui. ST-WaveMLP:Spatio-Temporal Global-aware Network for Traffic Flow Prediction [J]. Computer Science, 2024, 51(5): 27-34.
[4] LI Zichen, YI Xiuwen, CHEN Shun, ZHANG Junbo, LI Tianrui. Government Event Dispatch Approach Based on Deep Multi-view Network [J]. Computer Science, 2024, 51(5): 216-222.
[5] LI Zichen, YI Xiuwen, CHEN Shun, ZHANG Junbo, LI Tianrui. Deep Contrastive Siamese Network Based Repeated Event Identification [J]. Computer Science, 2024, 51(12): 30-36.
[6] WANG Jiahao, LI Wenbin, GUO Shiyao, XIANG Ping. Urban Traffic Flow Prediction Based on Global Spatiotemporal Graph Convolutional NeuralNetwork [J]. Computer Science, 2024, 51(11A): 240200045-9.
[7] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[8] LI Peng, YI Xiu-wen, QI De-kang, DUAN Zhe-wen, LI Tian-rui. Heating Strategy Optimization Method Based on Deep Learning [J]. Computer Science, 2022, 49(4): 263-268.
[9] WANG Le-ye. Geographic Local Differential Privacy in Crowdsensing:Current States and Future Opportunities [J]. Computer Science, 2021, 48(6): 301-305.
[10] ZHANG De-gan, YANG Peng, ZHANG Jie, GAO Jin-xin, ZHANG Ting. New Method of Traffic Flow Forecasting of Connected Vehicles Based on Quantum Particle Swarm Optimization Strategy [J]. Computer Science, 2020, 47(11A): 327-333.
[11] KONG Fan-yu, ZHOU Yu-feng, CHEN Gang. Traffic Flow Prediction Method Based on Spatio-Temporal Feature Mining [J]. Computer Science, 2019, 46(7): 322-326.
[12] SHEN Xia-jiong, ZHANG Jun-tao, HAN Dao-jun. Short-term Traffic Flow Prediction Model Based on Gradient Boosting Regression Tree [J]. Computer Science, 2018, 45(6): 222-227.
[13] . Fuzzy Neural Networks Based on IPSO for Traffic Flow Prediction [J]. Computer Science, 2012, 39(10): 190-192.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!