计算机科学 ›› 2014, Vol. 41 ›› Issue (3): 27-31.

• 2013' 粗糙集 • 上一篇    下一篇

基于分布相似度迁移的关键路由设备检测

孟庆锴,张剡,杨琬琪,胡裕靖,史颖欢,潘红兵,王浩   

  1. 南京大学电子科学与工程学院微电子设计研究所 南京210046;南京大学计算机软件新技术国家重点实验室 南京210046;南京大学计算机软件新技术国家重点实验室 南京210046;南京大学计算机软件新技术国家重点实验室 南京210046;南京大学计算机软件新技术国家重点实验室 南京210046;南京大学电子科学与工程学院微电子设计研究所 南京210046;华为技术有限公司南京研究所 南京210012
  • 出版日期:2018-11-14 发布日期:2018-11-14
  • 基金资助:
    本文受国家自然科学基金项目(61035003,2,61021062),国家973项目(2009CB320702),江苏省973项目(BK2011005),教育部新世纪优秀人才支持计划(NCET-10-0476)资助

Critical Routers Detection Based on Distribution Similarity Transfer

MENG Qing-kai,ZHANG Yan,YANG Wan-qi,HU Yu-jing,SHI Ying-huan,PAN Hong-bing and WANG Hao   

  • Online:2018-11-14 Published:2018-11-14

摘要: 在基础设施网络(如电力网、互联网等)设施中,往往会出现关键节点,主要表现为节点流量大、在网络中位置关键等,其性能不稳定将制约网络部分区域的功能。因此从提高关键基础设施的性能和安全性的角度出发,针对关键基础设施的检测成为一个重要的研究课题。提出了一种新颖的基于分布相似度迁移的互联网关键路由设备的检测算法,其目的是自动地检测当前互联网线路中的关键路由设备。在真实环境中,不同线路中不同路由设备的行为特征由于若干客观因素(网络状态、路由设备性能等)导致其分布通常不相同。因此,所提方法主要基于路由之间的分布相似度迁移:首先在目标域(当前路由)中通过谱聚类方法自动判断出可疑的路由设备,然后通过提出的基于分布相似度迁移的分类器对上一步中检测出的可疑路由设备进行分类。在华为公司提供的真实数据集上进行的测试表明,所提方法能够有效发现线路中的关键路由设备,同时能够根据不同线路之间的分布相似度迁移来提高分类结果。

关键词: 谱聚类,迁移学习,关键路由设备检测 中图法分类号TP181文献标识码A

Abstract: Critical infrastructures,which usually have large flow and key position,are common in infrastructure networks (e.g.power transmission network,Internet).The performance and reliability of the critical infrastructures directly influence the local abilities of the whole networks.To improve the ability and security-level of infrastructure networks,we proposed a novel method for critical infrastructures detection,which is mainly based on distribution similarity transfer.The aim of the proposed method is to automatically detect the critical routers in the current route.In the real application,due to several factors (e.g.network status,performance of routers),the behaviors of different routers withindifferent routes often belong to different distributions.Therefore,the proposed method models the problem as the distribution similarity transfer among different routes:First,the suspected routers are detected in the target domain (current route) by using spectral clustering;then,a newly proposed distribution similarity transfer classifier finally classifies the suspected routers obtained from the previous step.The proposed method was evaluated on the real dataset provided by Huawei Inst.The experimental results validate the proposed method can effectively detect the critical infrastructures.Meanwhile, it is demonstrated that the proposed method can successfully adopt the distribution similarity transfer to improve the classification results.

Key words: Spectral clustering,Transfer learning,Critical routers detection

[1] Ellis J,Fisher D,Longstaff T,et al.Report to the President’sCommission on Critical Infrastructure Protection[R].CARNEGIE-MELLON UNIV Pittsburgh PA Software Engineering INST,1997
[2] Fang Y,Zio E.Unsupervised spectral clustering for hierarchical modelling and criticality analysis of complex networks[J].Reliability Engineering & System Safety,2013,116:64-74
[3] Wei L,Keogh E,Xi X.SAXually explicit images:Finding unusualshapes[C]∥Sixth International Conference on Data Mining,2006.ICDM’06.IEEE,2006:711-720
[4] Xi X,Keogh E,Shelton C,et al.Fast time series classification using numerosity reduction[C]∥Proceedings of the 23rd international conference on machine learning.ACM,2006:1033-1040
[5] Wang H,Wang W,Yang J,et al.Clustering by pattern similarityin large data sets[C]∥Proceedings of the 2002ACM SIGMOD international conference on management of data.ACM,2002:394-405
[6] Kalpakis K,Gada D,Puttagunta V.Distance measures for effective clustering of ARIMA time-series[C]∥ Proceedings IEEE International Conference on Data Mining,2001.ICDM 2001.IEEE,2001:273-280
[7] Aβfalg J,Kriegel H P,Krger P,et al.Similarity search on timeseries based on threshold queries[M]∥Advances in Database Technology-EDBT 2006.Berlin Heidelberg:Springer,2006:276-294
[8] Box G E P.Time Series Analysis:Forecasting and Control[M].Wiley,2008
[9] Mrchen F.Time series feature extraction for data mining using DWT and DFT[J].2003
[10] Ji X,Li-Ling J,Sun Z.Mining gene expression data using a novel approach based on hidden Markov models[J].FEBS letters,2003,542(1):125-131
[11] Jiang J,Zhang Z,Wang H.A new segmentation algorithm to stock time series based on PIP approach[C]∥ International Conference on Wireless Communications,Networking and Mobile Computing,2007.WiCom 2007.IEEE,2007:5609-5612
[12] Pan S J,Yang Q.A survey on transfer learning[J].IEEE Tran-sactions on Knowledge and Data Engineering,2010,22(10):1345-1359
[13] Peleg S,Werman M,Rom H.A unified approach to the change of resolution:Space and gray-level[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1989,11(7):739-742
[14] Rachev S T.The Monge-Kantorovich mass transference problemand its stochastic applications[J].Theory of Probability & Its Applications,1985,29(4):647-676
[15] Hitchcock F L.The distribution of a product from several sou-rces to numerous localities[J].J.Math.Phys.,1941,20(2):224-230
[16] Rubner Y,Tomasi C,Guibas L J.The earth mover's distance as a metric for image retrieval[J].International Journal of Compu-ter Vision,2000,40(2):99-121
[17] Pele O,Werman M.A linear time histogram metric for improved sift matching[M]∥Computer Vision-ECCV 2008.Berlin Heidelberg:Springer,2008:495-508
[18] Pele O,Werman M.Fast and robust earth mover’s distances[C]∥2009IEEE 12th International Conference on Computer vision.IEEE,2009:460-467
[19] Von Luxburg U.A tutorial on spectral clustering[J].Statistics and computing,2007,17(4):395-416
[20] Malik J,Belongie S,Leung T,et al.Contour and texture analysis for image segmentation[J].International Journal of Computer Vision,2001,43(1):7-27
[21] Hagen L,Kahng A B.New spectral methods for ratio cut partitioning and clustering[J].IEEE transactions on Computer-aided design of integrated circuits and systems,1992,11(9):1074-1085
[22] Borgwardt K M,Gretton A,Rasch M J,et al.Integrating structured biological data by kernel maximum mean discrepancy[J].Bioinformatics,2006,22(14):e49-e57

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!