实时网络流量分类研究综述

摘要/Abstract

摘要： 实时流量分类技术能够按照应用类型对在线网络流量分类,它对网络管理、流量控制以及网络相关研究具有重要意义。首先从不同层次上简单分析了实时流量分类技术的研究现状；给出了流量分类的实时性概念及其指标；然后从流量统计特征和机器学习算法两个方面综述了实时流量分类的主要技术及研究进展,并进行了实时性分析；最后根据未来网络发展对实时流量分类技术提出的新要求,展望了该领域未来的研究发展方向。

关键词: 流量分类,实时性,流特征,机器学习中图法分类号TP393文献标识码A

Abstract: Real-time traffic classification,identifying and classing online traffics according to their applications,is of fundamental importance to network managements,operations and correlative studies．The paper first analyzed the research statusquo of real-time traffic classificaiton from different levels.The definition and evaluation metric of real-time classif-caiton were given to address the situation that there is no measurable and accepted metrics.Next,the main techniques and research progresses of real-time traffic classifi-cation were summarized while the real-time property of eath techniques were analyzed from flow features and machine learning shcemes.Finally,we pointed out possible future research directions in real-time traffic classification according to the demand of future network.

Key words: Traffic classification,Real-time property,Traffic features,Machine learning

柏骏,夏靖波,吴吉祥,任高明,赵小欢. 实时网络流量分类研究综述[J]. 计算机科学, 2013, 40(9): 8-15. https://doi.org/

BAI Jun,XIA Jing-bo,WU Ji-xiang,REN Gao-ming and ZHAO Xiao-huan. Survey on Real-time Traffic Classification[J]. Computer Science, 2013, 40(9): 8-15. https://doi.org/

参考文献

[1] Internet Assigned Numbers Authority(IANA)．http://www.iana.org/assignments/port-numbers,August 28,2010
[2] Moore A W,Papagiannaki D．Toward the accurate Identification of network applications[C]∥Proc．6th Passive Active Measurement．Workshop(PAM),2005,3431:41-54
[3] Sen S,Spatscheck O,Wand D．Accurate,scalable in-networkidentification of P2P traffic using application signatures[C]∥Proceedings of the 13th International World Wide Web Confe-rence on Alternate Track Papers & Posters(WWW’04)．New York,NY,USA,ACM,2004:512-521
[4] Karagiannis T,Papagiannaki K,Faloutsos M．BLINC:Multilevel traffic classification in the dark [C]∥ACM SIGCOMM．Phila-delphia,PA,USA,2005
[5] Roughan M,Sen S,Spatscheck O,et al．Class-of-service mapping for QoS:A statistical signature-based approach to IP traffic classification [C]∥Proceedings of ACM SIGCOMM Internet Mea-surement Conference．Taormina,Sicily,Italy,2004
[6] Moore A W,Zuev D．Internet Traffic Classification UsingBayesian Analysis Techniques [C]∥Proceedings of ACM SIGMETRICS International Conference on Measurement and Mo-deling of Computer Systems．New York,USA,2005
[7] 徐鹏,刘琼,林森.基于支持向量机的Internet流量分类研究[J]．计算机研究与发展,2009,46(3):407-414
[8] 徐鹏,林森．基于C4.5决策树的流量分类方法[J]．软件学报,2009,10(20):2692-2704
[9] McGregor A,Hall M,Lorier P,et al．Flow Clustering UsingMachine Learning Techniques [C]∥Proceedings of PAM’04．Antibes Juan-les-Pins,France,2004
[10] Zander S,Nguyen T,Armitage G．Self-Learning IP Traffic Classification Based on Statistical Flow Characteristics [C]∥Proceedings of PAM’05．Boston,USA,2005
[11] Erman J,Arlitt M,Mahanti A.Traffic Classification Using Clustering Algorithms [C]∥Proceedings of SIGCOMM Workshop on Mining Network Data．Pisa,Italy,2006
[12] Dainotti A,Pescape A,Sansone C．Issues and Future Directions in Traffic Classification[J]．IEEE Network,2012,26(1):35-40
[13] Gu Cheng-jie,Zhang Shun-yi,Sun Yan-fei．Real-time Encrypted Traffic Identification using Machine Learning[J]．J ournal of Software,2011,6(6):1009-1016
[14] Hurley J,Garci-Palacios E,Sezer S．Classifying network protocols:A ‘two-way’ flow approach[J]．Communications,2012,5(1):19-89
[15] Hifn company．http://www.hifn.com,September,2008
[16] Karagiannis T,Broido A,Brownlee N．Is P2P Dying or Just Hi-ding?[C]∥GLOBECOM ’04．Dallas,USA,November 2004
[17] Bernaille L,Teixeira R,Akodkenou I,et al.Traffic classification on the fly[J]．ACM Special Interest Group on Data Communication(SIGCOMM)Computer Communication Review,2006,36(2)
[18] Bernaille L,Teixeira R,Salamatian K．Early Application Identification [C]∥Proceedings of Conference on Future Networking Technologies 2006(CoNEXT 06)．Lisbon,Portugal,2006
[19] Nguyen T,Armitage G．Training on multiple sub-flows to optimise the use of Machine Learning classifiers in real-world IP networks[C]∥Proc．IEEE 31st Conference on Local Computer Networks．Tampa,Florida,USA,November 2006
[20] Erman J,Mahanti A,Arlitt M F．Byte me:A case for byte accuracy in traffic classification[C]∥Sen S,Sahu S,eds．Proc.of the 3^rd Annual ACM Workshop on Mining Network Data(MineNet 2007)．New York:ACM Press,2007:35-37
[21] Mohammed A,Nor S M．Near Real Time Online Flow-based Internet Traffic Classification Using Machine Learning(C4.5)[J]．International Journal of Engineering(IJE),3(4):370-379
[22] 鲁刚,张宏莉,叶麟．P2P 流量识别[J]．软件学报,2011,22(6):1281-1298
[23] Bernaille L,Teixeira R．Early Recognition of Encrypted Applications[J]． Lecture Notes in Computer Science,2007,4427:165-175
[24] Sena G, Belzarena G P．Early traffic classification using support vector machines[C]∥Proceedings of the 5th International Latin American Networking Conference,LANC 09．2009:60-66
[25] 彭建芬,周亚建,王枞,等．TCP流量早期识别方法[J]．应用科学学报,2011,29(1):73-77
[26] Branch P,Heyde A,Armitage G．Rapid Identification of Skype Traffic Flows[C]∥NOSSDAV’09．Williamsburg,Virginia,USA,2009:3-5
[27] But J,Branch P,Le T．Rapid Identification of BitTorrent Traffic[C]∥Local Computer Networks(LCN)．2010:536-543
[28] Jiang Wei-rong,Gokhale M．Real-Time Classification of Multimedia Traffic using FPGA[C]∥Proceedings of the 2010International Conference on Field Programmable Logic and Applications,FPL’10． 2010:56-63
[29] NetMate．http://sourceforge.net/projects/netmate-me-ter/,2007
[30] 阳爱民,周咏梅,邓河,等．一种网络流量分类特征的产生及选择方法[J]．山东大学学报:工学版,2010,40(5):1-7
[31] Moore A W,Zuev D,Crogan M．Discriminators for use in flow-based classification,RR-05-13[R]．London:Queen Mary University of London,2005
[32] Wei Li,Abdin K,Dann R,et al.Approaching real-time network traffic classification[R]．Technical Report RR-06-12．Department of Computer Science,Queen Mary,University of London,December 2006
[33] Erman J,Mahanti A,Arlitt M,et al．Offline/Realtime trafficclassification using semi-supervised learning[J]．Performance Evaluation,2007,64(9-12):1194-1213
[34] Guyon I,Elisseef A．An Introduction to Variable and Feature Selection[J]．Journal of Machine Learning Research,2003,3:1157-1182
[35] 张剑,钱宗珏,寿国础,等．在线聚类的网络流量识别[J]．北京邮电大学学报,2011,34(1):103-106
[36] Sun Mei-feng,Chen Jing-tao．Research of the traffic characteristics for the real time online traffic classification[J]．The Journal of China Universities of Posts and Telecommunications,2011,18(3):92-98
[37] Yang Zhe,Li Ling-zhi,Ji Qi-jin,et al．Cocktail method for Bit-Torrent traffic identification in real time[J]．Journal of Compu-ters,2012,7(1):85-95
[38] Tan Pang-ning,Steinbach M,Kumar V．Introduction to DataMining[M]．Posts & Telecom Press,2011
[39] Qosmos．www.qosmos.com
[40] Bernaille L,Teixeira R．Early Recognition of Encrypted Applications[J]．Lecture Notes in Computer Science,2007,4427:165-175
[41] Ester,Martin,Kriegel H P,et al．A Density Based Algorithm for Discovering Clusters in Large Spatial Data bases with Noise[C]∥Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining(KDD-96)．Ortland,Oregon:[s.n.],1996
[42] Quinlan R J．C4.5:Programs for machine learning[M]．San Mateo,Calif:Morgan Kauffman,1993
[43] Li Jun,Zhang Shun-yi,Lu Yan-qing,et al.Real-time P2P Traffic Identification[C]∥Global Telecommunications Conference．2008:1-5
[44] Witten I,Frank E．Data Mining:Practical Machine LearningTools and Techniques with Java Implementations(Second Edition)[M]．Morgan Kaufmann Publishers,2005
[45] Vapnik V N．S tatistical learning theory [M]．New York:Wiley,1998
[46] JNI．http://java.sun.com
[47] Waikato Environment for Knowledge Analysis(WEKA)．http://www.cs.waikato.ac.nz/ml/weka/
[48] Li Zhu,Yuan Rui-xi,Guan Xiao-hong．Traffic Classification-Towards Accurate Real Time Network Applications[C]∥Human-Computer Interaction,Part IV,HCII 2007．LNCS 4553,2007:67-76
[49] Gu Cheng-jie,Zhang Shun-yi,Sun Yan-fei．Real-time Encrypted Traffic Identification using Machine Learning[J]． Journal of Software,2011,6(6):1009-1016
[50] Erman J,Mahanti A,Arlitt M,et al.Offline/realtime network traffic classificatioin using semisupervised learning[R]．Technical Repert.Department of Computer Science,University of Calgary,February 2007
[51] Bar-Yanai R,Langberg M,Peleg D,et al.Realtime Classification for Encrypted Traffic[C]∥SEA 2010．LNCS 6049,2010:373-385
[52] Tavallaee M,Lu W,Ghorbani A A．Online classification of network flows[C]∥Proceedings of the 7th Annual Communication Networks and Services Research Conference．CNSR 2009,2009:78-85
[53] Hifn company．http://www.hifn.com,September,2008
[54] Spencer H L,Domingos P．Mining timechangingdata streams[C]∥7^th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining．ACM Press,2001:97-106
[55] 王建东,祝超,谢应科,等．基于FPGA 的万兆流量并行实时处理系统研究[J]．计算机研究与发展,2009,46(2):177-185
[56] Tstat．http://tstat.tlc.polito.it/index.shtml

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed