Computer Science ›› 2023, Vol. 50 ›› Issue (8): 45-51.doi: 10.11896/jsjkx.220600160

• Database & Big Data & Data Science • Previous Articles     Next Articles

Traffic Data Restoration Method Based on Tensor Weighting and Truncated Nuclear Norm

WU Jiangnan, ZHANG Hongmei, ZHAO Yongmei, ZENG Hang, HU Gang   

  1. College of Equipment Management and Unmanned Aerial Vehicle Engineering,Air Force Engineering University,Xi'an 710051,China
  • Received:2022-12-27 Revised:2023-01-30 Online:2023-08-15 Published:2023-08-02
  • About author:WU Jiangnan,born in 1998,postgra-duate.His main research interests include data mining and machine lear-ning.
    ZHANG Hongmei,born in 1970,Ph.D,professor.Her main research interests include information assurance and systems engineering.
  • Supported by:
    National Natural Science Foundation of China(62002381).

Abstract: The problem of missing data seriously affects a series of activities in intelligent transportation systems,such as monitoring traffic dynamics,predicting traffic flow,and deploying traffic planning through data.Therefore,a traffic flow data reconstruction model WLRTC-TTNN(low rank tensor completion of weighted and truncated nuclear norm)combined with weighted and truncated nuclear norm is proposed by using the low-rank tensor completion framework based on tensor singular value decomposition,which can effectively repair the missing spatio-temporal traffic data.The truncated nuclear norm of the tensor is used as a convex proxy for tensor rank minimization instead of tensor rank minimization,which preserves the main feature information inside the spatio-temporal traffic data,and further optimizes the model by penalizing smaller singular values according to the gene-ralized singular value threshold theory,and finally the WLRTC-TTNN algorithm is implemented using the alternating multiplier method.Experiments are conducted on two publicly available spatio-temporal traffic datasets selected with different missing scenarios and missing rates,and the results show that the complementary performance of WLRTC-TTNNN is better than that of other baseline models,and the overall complementary accuracy improves by 3%~37%,and the complementary effect is more stable in extreme missing scenarios.

Key words: Intelligent transportation, Data repair, Tensor weighting, Truncated kernel norm, Alternating multiplier method

CLC Number: 

  • TP274.2
[1]LI H,LI M,LIN X,et al.A spatiotemporal approach for traffic data imputation with complicated missing patterns[J].Transportation Research Part C Emerging Technologies,2020,119(11):102730.1-102730.23.
[2]LI Q,TAN H,WU Y,et al.Traffic Flow Prediction With Mis-sing Data Imputed by Tensor Completion Methods[J].IEEE Access,2020,8:63188-63201.
[3]YUAN H,CHEN Z H.Short-term Traffic Flow PredictionBased on Temporal Convolutional Networks[J].Journal of South China University of Technology(Natural Science Edition),2020,48(11):107-113.
[4]YU H F,RAO N,DHILLON I S.Temporal regularized matrix factorization for high-dimensional time series prediction[C]//NeurIPS.2016:847-855.
[5]CHEN X B,CHEN C,CHEN L,et al.Missing value interpolation of traffic volume data based on improved low-rank matrix completion [J].Journal of Traffic and Transportation Enginee-ring,2019,19(5):180-190.
[6]SUN L,CHEN X.Bayesian temporal factorization for multidi-mensional time series prediction[J].arXiv:1910.06366,2021.
[7]CHEN X B,LIANG S R,KE J,et al.Traffic Data Recovery Method based on Graph regularization and Schatten-p norm [J].Journal of Southwest Jiaotong University,2022(6):1326-1333.
[8]TAN H,FENG G,FENG J,et al.A tensor-based method for missing traffic data completion[J].Transportation Research Part C,2013,28:15-27.
[9]LIU J,MUSIALSK P,WONKA P,et al.Tensor completion for estimating missing values in visual data[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(1):208-220.
[10]CHEN X,YANG J,SEN L.A Nonconvex Low-Rank TensorCompletion Model for Spatiotemporal Traffic Data Imputation[J].Transportation Research Part C:Emerging Technologies,2020,117(8),102673.1-102673.12.
[11]CHEN X Y,CHEN Y X,SAUNIER N,et al.Scalable low-rank tensor learning for spatiotemporal traffic data imputation[J].Transportation Research Part C:Emerging Technologies,2021,129,103226.1-103226.13.
[12]CHEN X,LEI M,SAUNIER N,et al.Low-Rank Autoregressive Tensor Completion for Spatiotemporal Traffic Data Imputation[J].arXiv:2104.14936,2021.
[13]ZHANG Z M,AERON S.Exact Tensor Completion Using t-SVD[J].IEEE Transactions on Signal Processing,2017(6):1511-1526.
[14]LIU C S,SHAN H,CHEN C L.Tensor p-shrinkage nuclearnorm for low-rank tensor completion[J].Neurocomputing,2020,387:255-267.
[15]LU C,FENG J,CHEN Y,et al.Tensor Robust Principal Component Analysis with A New Tensor Nuclear Norm[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(4):925-938.
[16]SONG Y,LI J,CHEN X,et al.An efficient tensor completion method via truncated nuclear norm[J].Journal of Visual Communication and Image Representation,2020,70:102791.1-102791.8.
[17]SU Y,WU X,LIU W.Low-rank Tensor Completion by Sum of Tensor Nuclear Norm Minimization[J].IEEE Access,2019,7:134943-134953.
[18]WANG Y,YIN W,ZENG J.Global Convergence of ADMM in Nonconvex Nonsmooth Optimization[J].arXiv:1511.06324,2018.
[19]BENTBI A H,HACHIMI A E,JBILOU K,et al.On the tensor nuclear norm and the total variation regularization for image and video completion[J].arXiv:2102.10393,2021.
[20]ZUO W,MENG D,ZHANG L,et al.A generalized iteratedshrinkage algorithm for non-convex sparse coding[C]//2013 IEEE International Conference on Computer Vision.2013:1-8.
[21]CUI Z,KE R,PU Z,et al.Deep Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction[J].arXiv:1801.02143,2018.
[22]TAN H C,YANG Z X,FENG G D,et al.Correlation Analysis for Tensor-based Traffic Data Imputation Method[J].Procedia-Social and Behavioral Sciences,2013,96:2611-2620.
[23]BATTAGLINO C,BALLARD G,KOLDA T G.A practical randomized CP tensor decomposition [J].SIAM Journal on Matrix Analysis and Applications,2018,39:876-901.
[24]CHEN X,HE Z,SUN L.A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation[J].Transportation Research Part C:Emerging Technologies,2019,98:73-84.
[25]CHEN X,HE Z,WANG J,et al.Spatial-temporal traffic speed patterns discovery and incomplete data recovery via svd-combined tensor decomposition[J].Transportation Research Part C:Emerging Technologies,2018,86:59-77.
[1] YU Ze, NING Nianwen, ZHENG Yanliu, LYU Yining, LIU Fuqiang, ZHOU Yi. Review of Intelligent Traffic Signal Control Strategies Driven by Deep Reinforcement Learning [J]. Computer Science, 2023, 50(4): 159-171.
[2] NIU Kang-li, CHEN Yu-zhang, ZHANG Gong-ping, TAN Qian-cheng, WANG Yi-chong, LUO Mei-qi. Vehicle Flow Measuring of UVA Based on Deep Learning [J]. Computer Science, 2021, 48(6A): 275-280.
[3] ZHOU Xin, LIU Shuo-di, PAN Wei, CHEN Yuan-yuan. Vehicle Color Recognition in Natural Traffic Scene [J]. Computer Science, 2021, 48(6A): 15-20.
[4] ZHANG Hang, TANG Dan, CAI Hong-liang. Study on Predictive Erasure Codes in Distributed Storage System [J]. Computer Science, 2021, 48(5): 130-139.
[5] ZENG Wei-liang, HAN Yu, HE Jin-yuan, WU Miao-sen, SUN Wei-jun. Simulation Analysis on Dynamic Ridesharing Efficiency of Shared Autonomous Taxi [J]. Computer Science, 2021, 48(2): 257-263.
[6] LI Hao, WANG Fei, XIE Si-yu, KOU Yong-qi, ZHANG Lan, YANG Bing, KANG Yan. Dual Autoregressive Components Traffic Prediction Based on Improved Graph WaveNet [J]. Computer Science, 2021, 48(11A): 159-165.
[7] LI Lin, ZHAO Kai-yue, ZHAO Xiao-yong, WEI Shuai-qin and ZHANG Bing. Contaminated and Shielded Number Plate Recognition Based on Convolutional Neural Network [J]. Computer Science, 2020, 47(6A): 213-219.
[8] SUN Hao,CHEN Chun-lin,LIU Qiong,ZHAO Jia-bao. Traffic Signal Control Method Based on Deep Reinforcement Learning [J]. Computer Science, 2020, 47(2): 169-174.
[9] ZHONG Feng-yan, WANG Yan, LI Nian-shuang. Node Selection Scheme for Data Repair in Heterogeneous Distributed Storage Systems [J]. Computer Science, 2019, 46(8): 35-41.
[10] LAI Jian-hui. Traffic Signal Control Based on Double Deep Q-learning Network with Dueling Architecture [J]. Computer Science, 2019, 46(11A): 117-121.
[11] LIU Qin. Study on Data Quality Based on Constraint in Computer Forensics [J]. Computer Science, 2018, 45(4): 169-172.
[12] DUAN Na and WANG Lei. Image Retrieval of Global and Personalized ROI Adjustment of Features [J]. Computer Science, 2016, 43(Z11): 205-207.
[13] GAO Fa-qin. Path Prediction and Query Algorithm Based on Probability [J]. Computer Science, 2016, 43(8): 207-211.
[14] LIU Bo, CAI Mei and ZHOU Xu-chuan. Study on Data Repair and Consistency Query Processing [J]. Computer Science, 2016, 43(1): 232-236.
[15] HOU Li-hong and LI Wei-dong. Internet of Things Technology in Application of ETC System [J]. Computer Science, 2015, 42(Z11): 532-535.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!