Computer Science ›› 2023, Vol. 50 ›› Issue (2): 130-137.doi: 10.11896/jsjkx.211200016

• Database & Big Data & Data Science • Previous Articles     Next Articles

Self-supervised Flight Trajectory Prediction Based on Data Augmentation

WANG Pengyu1, TAI Wenxin1, LIU Fang2, ZHONG Ting1, LUO Xucheng1, ZHOU Fan1   

  1. 1 School of Information and Software Engineering,University of Electronic Science and Technology of China,Chengdu 610054,China
    2 Civil Aviation Flight University of China,Guanghan,Sichuan 618307,China
  • Received:2021-12-01 Revised:2022-08-03 Online:2023-02-15 Published:2023-02-22
  • Supported by:
    Natural Science Foundation of Sichuan Province(2022NSFSC0505,2022NSFSC0956),Sichuan Youth Software Innovation Project Funding Project(2021023),Sichuan Science and Technology Program(2022YFSY0006,2020YFG0053) and National Natural Science Foundation of China(62176043,62072077)

Abstract: Accurate flight trajectory predictions can help air traffic management systems make warnings for potential hazards and effectively provide guidance for safe travel.However,the atmospheric situation in which the planes flying is complicated and changeable.The flight track is affected by external factors such as atmospheric disturbance,the air cloud,making prediction difficult.In addition,due to the harsh ground environment where some flight areas are located,it is impossible to deploy enough signal base stations,while the flight signals in some flight areas are collected and combined by multiple signal base stations,resulting in sparse and noisy aircraft track data,which further increases the difficulty of flight track prediction.This paper proposes a technically enhanced self-supervision flight trajectory learning method.This method uses a regularization-based data enhancement mode to extend the sparse track data and process the abnormal values included in the dataset.It provides a self-supervised learning diagram by maximizing mutual information to dig the mobility pattern contained in the flight trajectory.The method employs a multi-head self-attention model with a distillation mechanism as a fundamental model to solve the long-term dependence problem of the recurrent neural network.In addition,the approach uses the distillation mechanism to reduce the complexity of the model and utilizes the generating decoding method to accelerate the speed of its training and prediction.The evaluation results on the flight trajectory dataset show that our method has a significant increase in the results of trajectory prediction compared with the state-of-the-art method that our approach reduces the root mean square error of the prediction results in latitude,longitude,and altitude by 20.8%,26.4%,and 25.6%,respectively.

Key words: Flight trajectory prediction, Self-supervised learning, Self-attention, Deep learning

CLC Number: 

  • TP183
[1]CHATTERJI G.Short-term trajectory prediction methods[C]//Guidance,Navigation,and Control Conference and Exhibit.1999:4233.
[2]AVANZINI G.Frenet-based algorithm for trajectory prediction[J].Journal of Guidance,Control,and Dynamics,2004,27(1):127-135.
[3]SEAH C E,HWANG I.Terminal-area aircraft tracking using hybrid estimation[J].Journal of Guidance,Control,and Dyna-mics,2009,32(3):836-849.
[4]LYMPEROPOULOS I,LYGEROS J,LECCHINI A.Modelbased aircraft trajectory prediction during takeoff[C]//AIAA Guidance,Navigation,and Control Conference and Exhibit.2006.
[5]SCHUSTER W.Trajectory prediction for future air traffic ma-nagement-complex manoeuvres and taxiing[J].The Aeronautical Journal,2015,119(1212):121-143.
[6]YUAN C,LI D,XI Y.Campus trajectory forecast based on human activity cycle and Markov method[C]//2015 IEEE International Conference on Cyber Technology in Automation,Control,and Intelligent Systems(CYBER).IEEE,2015:941-946.
[7]WANG B,HU Y,SHOU G,et al.Trajectory prediction in campus based on Markov chains[C]//International Conference on Big Data Computing and Communications.Cham:Springer,2016:145-154.
[8]AWAD M A,KHALIL I.Prediction of user's web-browsing behavior:Application of markov model[J].IEEE Transactions on Systems,Man,and Cybernetics,Part B(Cybernetics),2012,42(4):1131-1142.
[9]SHI Z,XU M,PAN Q,et al.LSTM-based flight trajectory prediction[C]//2018 International Joint Conference on Neural Networks(IJCNN).IEEE,2018:1-8.
[10]ZENG W,QUAN Z,ZHAO Z,et al.A deep learning approach for aircraft trajectory prediction in terminal airspace[J].IEEE Access,2020,8:151250-151266.
[11]MA L,TIAN S.A hybrid CNN-LSTM model for aircraft 4D trajectory prediction[J].IEEE Access,2020,8:134668-134680.
[12]CHEN T,KORNBLITH S,NOROUZI M,et al.A simpleframework for contrastive learning of visual representations[C]//International Conference on Machine Learning.PMLR,2020:1597-1607.
[13]WU J,WANG X,WANG W Y.Self-supervised dialogue lear-ning[J].arXiv:1907.00448,2019.
[14]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Advances in Neural Information Processing Systems.2017:5998-6008.
[15]LE FABLEC Y,ALLIOT J M.Using Neural Networks to Predict Aircraft Trajectories[C]//IC-AI.1999:524-529.
[16]TASTAMBEKOV K,PUECHMOREL S,DELAHAYE D,et al.Aircraft trajectory forecasting using local functional regression in Sobolev space[J].Transportation Research Part C:Emerging Technologies,2014,39:1-22.
[17]WANG Z,LIANG M,DELAHAYE D.Short-term 4d trajectory prediction using machine learning methods[C]// Proceedings and Digests.2017:1-10.
[18]HERNÁNDEZ A M,MAGAÑA E J C,BERNA A G.Data-dri-ven aircraft trajectory predictions using ensemble meta-estimators[C]//2018 IEEE/AIAA 37th Digital Avionics Systems Conference(DASC).IEEE,2018:1-10.
[19]BARRATT S T,KOCHENDERFER M J,BOYD S P.Learning probabilistic trajectory models of aircraft in terminal airspace from position data[J].IEEE Transactions on Intelligent Transportation Systems,2018,20(9):3536-3545.
[20]ALLIGIER R,GIANAZZA D,DURAND N.Learning the aircraft mass and thrust to improve the ground-based trajectory prediction of climbing flights[J].Transportation Research Part C:Emerging Technologies,2013,36:45-60.
[21]ALLIGIER R,GIANAZZA D.Learning aircraft operational factors to improve aircraft climb prediction:A large scale multi-airport study[J].Transportation Research Part C:Emerging Technologies,2018,96:72-95.
[22]GUAN X,LV R,SUN L,et al.A study of 4D trajectory prediction based on machine deep learning[C]//2016 12th World Congress on Intelligent Control and Automation(WCICA).IEEE,2016:24-27.
[23]BELGHAZI M I,BARATIN A,RAJESWAR S,et al.Mine:mutual information neural estimation[J].arXiv:1801.04062,2018.
[24]GRILL J B,STRUB F,ALTCHÉ F,et al.Bootstrap your own latent:A new approach to self-supervised learning[J].arXiv:2006.07733,2020.
[25]DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[J].arXiv:1810.04805,2018.
[26]KONG L,D'AUTUME C M,LING W,et al.A mutual information maximization perspective of language representation lear-ning[J].arXiv:1910.08350,2019.
[27]OORD A,LI Y,VINYALS O.Representation learning with contrastive predictive coding[J].arXiv:1807.03748,2018.
[28]MA Z,COLLINS M.Noise contrastive estimation and negative sampling for conditional models:Consistency and statistical efficiency[J].arXiv:1809.01812,2018.
[1] DONG Yongfeng, HUANG Gang, XUE Wanruo, LI Linhao. Graph Attention Deep Knowledge Tracing Model Integrated with IRT [J]. Computer Science, 2023, 50(3): 173-180.
[2] HUA Xiaofeng, FENG Na, YU Junqing, HE Yunfeng. Shooting Event Detection of Free Kick in Soccer Video Based on Rule Reasoning [J]. Computer Science, 2023, 50(3): 181-190.
[3] MEI Pengcheng, YANG Jibin, ZHANG Qiang, HUANG Xiang. Sound Event Joint Estimation Method Based on Three-dimension Convolution [J]. Computer Science, 2023, 50(3): 191-198.
[4] BAI Xuefei, MA Yanan, WANG Wenjian. Segmentation Method of Edge-guided Breast Ultrasound Images Based on Feature Fusion [J]. Computer Science, 2023, 50(3): 199-207.
[5] LIU Hang, PU Yuanyuan, LYU Dahua, ZHAO Zhengpeng, XU Dan, QIAN Wenhua. Polarized Self-attention Constrains Color Overflow in Automatic Coloring of Image [J]. Computer Science, 2023, 50(3): 208-215.
[6] CHEN Liang, WANG Lu, LI Shengchun, LIU Changhong. Study on Visual Dashboard Generation Technology Based on Deep Learning [J]. Computer Science, 2023, 50(3): 238-245.
[7] ZHANG Yi, WU Qin. Crowd Counting Network Based on Feature Enhancement Loss and Foreground Attention [J]. Computer Science, 2023, 50(3): 246-253.
[8] YING Zonghao, WU Bin. Backdoor Attack on Deep Learning Models:A Survey [J]. Computer Science, 2023, 50(3): 333-350.
[9] ZOU Yunzhu, DU Shengdong, TENG Fei, LI Tianrui. Visual Question Answering Model Based on Multi-modal Deep Feature Fusion [J]. Computer Science, 2023, 50(2): 123-129.
[10] GUO Nan, LI Jingyuan, REN Xi. Survey of Rigid Object Pose Estimation Algorithms Based on Deep Learning [J]. Computer Science, 2023, 50(2): 178-189.
[11] LI Junlin, OUYANG Zhi, DU Nisuo. Scene Text Detection with Improved Region Proposal Network [J]. Computer Science, 2023, 50(2): 201-208.
[12] HUA Jie, LIU Xueliang, ZHAO Ye. Few-shot Object Detection Based on Feature Fusion [J]. Computer Science, 2023, 50(2): 209-213.
[13] ZHU Lei, WANG Shanmin, LIU Qingshan. Self-supervised 3D Face Reconstruction Based on Detailed Face Mask [J]. Computer Science, 2023, 50(2): 214-220.
[14] LIANG Jiali, HUA Baojian, SU Shaobo. Tensor Instruction Generation Optimization Fusing with Loop Partitioning [J]. Computer Science, 2023, 50(2): 374-383.
[15] CAI Xiao, CEHN Zhihua, SHENG Bin. SPT:Swin Pyramid Transformer for Object Detection of Remote Sensing [J]. Computer Science, 2023, 50(1): 105-113.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!