计算机科学 ›› 2023, Vol. 50 ›› Issue (3): 121-128.doi: 10.11896/jsjkx.220100086

• 数据库&大数据&数据科学 • 上一篇    下一篇

基于深度聚类的航空交通流识别与异常检测研究

饶丹, 时宏伟   

  1. 四川大学计算机学院 成都 610065
  • 收稿日期:2022-01-11 修回日期:2022-05-22 出版日期:2023-03-15 发布日期:2023-03-15
  • 通讯作者: 时宏伟(shihw001@126.com)
  • 作者简介:(3328456642@qq.com)

Study on Air Traffic Flow Recognition and Anomaly Detection Based on Deep Clustering

RAO Dan, SHI Hongwei   

  1. School of Computer Science,Sichuan University,Chengdu 610065,China
  • Received:2022-01-11 Revised:2022-05-22 Online:2023-03-15 Published:2023-03-15
  • About author:RAO Dan,born in 1996,postgraduate.Her main research interests include big data and data mining.SHI Hongwei,born in 1965,professor.His main research interests include intelligent decision based on big data,aviation safety big data,UAV intelligent information processing and air traffic management ATM/CNS.

摘要: 针对传统的聚类算法无法捕获高维轨迹数据在低维空间中的隐含关系,且难以定义适当的相似性度量以同时考虑轨迹的局部和全局特征的问题,提出了一种基于深度神经网络的多变量轨迹深度聚类框架(MTDC)并将其用于航空交通流识别与异常检测。该框架主要包含一个非对称的自编码器和一个自定义的轨迹聚类层。自编码器由一维卷积神经网络和双向长短时记忆网络堆叠而成,用于学习原始输入在低维隐空间中的特征表示。轨迹聚类层则通过计算隐空间中样本的Q分布实现聚类。结合自编码器的重建损失和轨迹聚类Q分布定义了一个新的异常分数,用于检测异常轨迹。使用基于广播式自动相关监视(ADS-B)的真实轨迹数据进行实验,结果表明,所提框架能有效地进行航空交通流识别,并能检测出具有实际意义且可解释的异常轨迹。

关键词: 轨迹聚类, 异常检测, 深度神经网络, 自编码器, ADS-B

Abstract: Aiming at the problem that traditional clustering algorithms cannot capture the implicit relationship of high-dimen-sional trajectory data in low-dimensional space,and it is difficult to define appropriate similarity measures to consider both local and global features of trajectories,a multivariate trajectory deep clustering(MTDC) framework based on deep neural network(DNN) is proposed and used for air traffic flow recognition and anomaly detection.The framework mainly includes an asymmetric autoencoder and a custom trajectory clustering layer.The autoencoder is mainly composed of 1D convolutional neural network and bi-directional long short-term memory to learn the feature representation of the original input in the low-dimensional latent space.The trajectory clustering layer realizes clustering by calculating the Q distribution of samples in the hidden space.Combined with reconstruction loss of autoencoder and trajectory clustering Q distribution,a new anomaly score is defined for anomaly trajectory detection.The results of experiments using real trajectory data based on automatic dependent surveillance-broadcast(ADS-B) show that the proposed framework is effective for air traffic flow recognition and can detect anomaly trajectories that are mea-ningful and interpretable.

Key words: Trajectory clustering, Anomaly detection, Deep neural network, Autoencoder, ADS-B

中图分类号: 

  • TP391
[1]WANG D,MIWA T,MORIKAWA T.Big trajectory data mi-ning:A survey of methods,applications,and services[J].Sensors,2020,20(16):4571.
[2]LLOYD S.Least squares quantization in PCM[J].IEEE Tran-sactions on Information Theory,1982,28(2):129-137.
[3]ESTER M,KRIEGEL H P,SANDER J,et al.A density-based algorithm for discovering clusters in large spatial databases with noise[C]//KDD.1996:226-231.
[4]BARRATT S T,KOCHENDERFER M J,BOYD S P.Learning probabilistic trajectory models of aircraft in terminal airspace from position data[J].IEEE Transactions on Intelligent Transportation Systems,2018,20(9):3536-3545.
[5]ENRIQUEZ M.Identifying temporally persistent flows in theterminal airspace via spectral clustering[C]//Tenth USA/Europe Air Traffic Management Research and Development Seminar(ATM2013)/Federal Aviation Administration(FAA) and EUROCONTROL.Chicago,IL,USA,2013:10-13.
[6]LI S,ZHAO H.A Survey on Representation Learning for User Modeling[C]//IJCAI.2020:4997-5003.
[7]FANG Z,DU Y,CHEN L,et al.E 2 DTC:An End to End Deep Trajectory Clustering Framework via Self-Training[C]//2021 IEEE 37th International Conference on Data Engineering(ICDE).IEEE,2021:696-707.
[8]SCHÄFER M,STROHMEIER M,LENDERS V,et al.Bringing up OpenSky:A large-scale ADS-B sensor network for research[C]//IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.IEEE,2014:83-94.
[9]YANAGISAWA Y,SATOH T.Clustering multidimensionaltrajectories based on shape and velocity[C]//22nd Interna-tional Conference on Data Engineering Workshops(ICDEW’06).IEEE,2006.
[10]CHEN J Y,SONG J T,LIU L X,et al.Trajectory clustering algorithm based on improved hausdorff distance[J].Computer Engineering,2012,38(17):157-161.
[11]AGRAWAL R,FALOUTSOS C,SWAMI A.Efficient similarity search in sequence databases[C]//International Conference on Foundations of Data Organization and Algorithms.Springer,1993:69-84.
[12]AYHAN S,SAMET H.Diclerge:Divide-cluster-merge frame-work for clustering aircraft trajectories[C]//Proceedings of the 8th ACM SIGSPATIAL International Workshop on Computational Transportation Science.2015:7-14.
[13]MAHBOUBI Z,KOCHENDERFER M J.Learning traffic patterns at small airports from flight tracks[J].IEEE Transactions on Intelligent Transportation Systems,2016,18(4):917-926.
[14]LI C Q,LI S M,MA W Y,et al.Research on automatic identification method of air traffic flow based on trajectory clustering [J].Computer Simulation,2021,38(10):73-77.
[15]OLIVE X,BASORA L.Identifying anomalies in past en-route trajectories with clustering and anomaly detection methods[C]//ATM Seminar.2019.
[16]ZENG W,XU Z,CAI Z,et al.Aircraft Trajectory Clustering in Terminal Airspace Based on Deep Autoencoder and Gaussian Mixture Model[J].Aerospace,2021,8(9):266.
[17]BASORA L,OLIVE X,DUBOT T.Recent advances in anomaly detection methods applied to aviation[J].Aerospace,2019,6(11):117.
[18]DAS S,MATTHEWS B L,SRIVASTAVA A N,et al.Multiple kernel learning for heterogeneous anomaly detection:algorithm and aviation safety case study[C]//Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Disco-very and Data Mining.2010:47-56.
[19]LI L,HANSMAN R J,PALACIOS R,et al.Anomaly detection via a Gaussian Mixture Model for flight operation and safety monitoring[J].Transportation Research Part C:Emerging Technologies,2016,64:45-57.
[20]JANAKIRAMAN V M,NIELSEN D.Anomaly detection in aviation data using extreme learning machines[C]//2016 International Joint Conference on Neural Networks(IJCNN).IEEE,2016:1993-2000.
[21]XIE J,GIRSHICK R,FARHADI A.Unsupervised deep embedding for clustering analysis[C]//International Conference on Machine Learning.PMLR,2016:478-487.
[22]ZENG J,KRUGER U,GELUK J,et al.Detecting abnormal si-tuations using the Kullback-Leibler divergence[J].Automatica,2014,50(11):2777-2786.
[23]RENDÓN E,ABUNDEZ I,ARIZMENDI A,et al.Internal versus external cluster validation indexes[J].International Journal of Computers and Communications,2011,5(1):27-34.
[24]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.Imagenetclassification with deep convolutional neural networks[J].Communications of the ACM,2017,60(6):84-90.
[25]GHASEDI DIZAJI K,HERANDI A,DENG C,et al.Deep clustering via joint convolutional autoencoder embedding and relative entropy minimization[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:5736-5745.
[26]GUO X,GAO L,LIU X,et al.Improved deep embedded clustering with local structure preservation[C]//IJCAI.2017:1753-1759.
[1] 崔竞松, 张童桐, 郭迟, 郭文飞.
基于时延特征的网络设备异常检测
Network Equipment Anomaly Detection Based on Time Delay Feature
计算机科学, 2023, 50(3): 371-379. https://doi.org/10.11896/jsjkx.211200280
[2] 王祥炜, 韩锐, 刘驰.
基于层级化数据记忆池的边缘侧半监督持续学习方法
Hierarchical Memory Pool Based Edge Semi-supervised Continual Learning Method
计算机科学, 2023, 50(2): 23-31. https://doi.org/10.11896/jsjkx.221100133
[3] 王冠宇, 钟婷, 冯宇, 周帆.
基于矢量量化编码的协同过滤推荐方法
Collaborative Filtering Recommendation Method Based on Vector Quantization Coding
计算机科学, 2022, 49(9): 48-54. https://doi.org/10.11896/jsjkx.210700109
[4] 徐天慧, 郭强, 张彩明.
基于全变分比分隔距离的时序数据异常检测
Time Series Data Anomaly Detection Based on Total Variation Ratio Separation Distance
计算机科学, 2022, 49(9): 101-110. https://doi.org/10.11896/jsjkx.210600174
[5] 李其烨, 邢红杰.
基于最大相关熵的KPCA异常检测方法
KPCA Based Novelty Detection Method Using Maximum Correntropy Criterion
计算机科学, 2022, 49(8): 267-272. https://doi.org/10.11896/jsjkx.210700175
[6] 王馨彤, 王璇, 孙知信.
基于多尺度记忆残差网络的网络流量异常检测模型
Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network
计算机科学, 2022, 49(8): 314-322. https://doi.org/10.11896/jsjkx.220200011
[7] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[8] 杜航原, 李铎, 王文剑.
一种面向电商网络的异常用户检测方法
Method for Abnormal Users Detection Oriented to E-commerce Network
计算机科学, 2022, 49(7): 170-178. https://doi.org/10.11896/jsjkx.210600092
[9] 郁舒昊, 周辉, 叶春杨, 王太正.
SDFA:基于多特征融合的船舶轨迹聚类方法研究
SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion
计算机科学, 2022, 49(6A): 256-260. https://doi.org/10.11896/jsjkx.211100253
[10] 焦翔, 魏祥麟, 薛羽, 王超, 段强.
基于深度学习的自动调制识别研究
Automatic Modulation Recognition Based on Deep Learning
计算机科学, 2022, 49(5): 266-278. https://doi.org/10.11896/jsjkx.211000085
[11] 高捷, 刘沙, 黄则强, 郑天宇, 刘鑫, 漆锋滨.
基于国产众核处理器的深度神经网络算子加速库优化
Deep Neural Network Operator Acceleration Library Optimization Based on Domestic Many-core Processor
计算机科学, 2022, 49(5): 355-362. https://doi.org/10.11896/jsjkx.210500226
[12] 韩洁, 陈俊芬, 李艳, 湛泽聪.
基于自注意力的自监督深度聚类算法
Self-supervised Deep Clustering Algorithm Based on Self-attention
计算机科学, 2022, 49(3): 134-143. https://doi.org/10.11896/jsjkx.210100001
[13] 武玉坤, 李伟, 倪敏雅, 许志骋.
单类支持向量机融合深度自编码器的异常检测模型
Anomaly Detection Model Based on One-class Support Vector Machine Fused Deep Auto-encoder
计算机科学, 2022, 49(3): 144-151. https://doi.org/10.11896/jsjkx.210100142
[14] 唐雨潇, 王斌君.
基于深度生成模型的人脸编辑研究进展
Research Progress of Face Editing Based on Deep Generative Model
计算机科学, 2022, 49(2): 51-61. https://doi.org/10.11896/jsjkx.210400108
[15] 冷佳旭, 谭明圮, 胡波, 高新波.
基于隐式视角转换的视频异常检测
Video Anomaly Detection Based on Implicit View Transformation
计算机科学, 2022, 49(2): 142-148. https://doi.org/10.11896/jsjkx.210900266
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!