计算机科学 ›› 2017, Vol. 44 ›› Issue (Z6): 366-371.doi: 10.11896/j.issn.1002-137X.2017.6A.083

• 信息安全 • 上一篇    下一篇

基于Spark框架和PSO优化算法的电力通信网络安全态势预测

金鑫,李龙威,苏国华,刘晓蕾,季佳男   

  1. 中央财经大学信息学院 北京100081,中央财经大学信息学院 北京100081,北京国电通网络技术有限公司 北京100070,北京国电通网络技术有限公司 北京100070,人力资源和社会保障部人事考试中心 北京100011
  • 出版日期:2017-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受国网科技部项目(SGTYHT/14-JS-188)资助

Prediction about Network Security Situation of Electric Power Telecommunication Based on Spark Framework and PSO Algorithm

JIN Xin, LI Long-wei, SU Guo-hua, LIU Xiao-lei and JI Jia-nan   

  • Online:2017-12-01 Published:2018-12-01

摘要: 随着电力通信网络规模的不断扩大,电力通信网络不间断地产生海量通信数据。同时,对通信网络的攻击手段也在不断进化,给电力通信网络的安全造成极大威胁。针对以上问题,结合Spark大数据计算框架和PSO优化神经网络算法的优点,提出基于Spark内存计算框架的并行PSO优化神经网络算法对电力通信网络的安全态势进行预测。本研究首先引入Spark计算框架,Spark框架具有内存计算以及准实时处理的特点,符合电力通信大数据处理的要求。然后提出PSO优化算法对神经网络的权值进行修正,以增加神经网络的学习效率和准确性。之后结合RDD的并行特点,提出了一种并行PSO优化神经网络算法。最后通过实验比较可以看出,基于Spark框架的PSO优化神经网络算法的准确度高,且相较于传统基于Hadoop的预测方法在处理速度上有显著提高。

关键词: Spark计算框架,粒子群算法,并行PSO优化神经网络,电力通信网络,安全态势预测

Abstract: With the expansion of the scale of electric power communication network,the electric power communication network continuously produce huge amounts of data communication.At the same time,the communication network attack means is in constant evolution,which brings threats for the safety of the electric power communication network.To solve above problems,combining with the Spark big data computing framework and the advantages of PSO,the Spark memory computing framework of parallel PSO optimization neural network algorithm is put forward to predict the security situation of electric power communication network.This study first introduced the Spark computing framework,the Spark frame has the characteristics of memory computing and quasi real-time processing,accord with the requirement of electric power communication big data processing.Then PSO optimization algorithm was proposed to modify the weights of neural network,in order to increase the study efficiency and accuracy of neural network.Then with the combination of RDD parallel characteristic,this paper proposed a parallel PSO optimization neural network algorithm.Through experiment and comparison,you can see that Spark framework based PSO optimization neural network algorithm has high accuracy,and compared with prediction method based on Hadoop,its processing speed has improved significantly.

Key words: Spark computing framework,Particle swarm optimization,Parallel optimization PSO neural network,Power communication network,Security situation prediction

[1] 徐茹枝,王宇飞,等.面向电力信息网络的安全态势感知研究[J].电网技术学报,2013,37(1):128-134.
[2] SPEROTTO A,SCHAFFRATH G,SADRE R,et al.An overview of IP flow-based intrusion detection[J].IEEE Communications Surverys& Tutorials,2010,12(3):343-356.
[3] 姚东.基于流的大规模网络安全态势感知关键技术研究[D].郑州:中国人民解放军信息工程大学,2013.
[4] TIM B.Intrusion systems and multisensor data fusion:creating cyberspace situational awareness[J].Communications of the ACM,2000,43(4):99-105.
[5] LAU S.The spinning cube of potential doom[J].Communications of the ACM,2004,47(6):25-26.
[6] YURCIK B.Security Incident Fusion Tool (SIFT) Research Project.http://www.projects.ncassr.org/sift.
[7] 陈秀真,郑庆华,管晓宏,等.网络化系统安全态势评估的研究[J].西安交通大学学报,2004,8(4):404-408.
[8] 胡华平,张怡,陈海涛,等.面向大规模网络的入侵检测与预警系统研究[J].国防科技大学学报,2003,5(1):21-25.
[9] 任伟,蒋兴浩,锬锋.基于 RBF 神经网络的网络安全态势预测方法[J].计算机工程与应用,2006,2(31):136-138.
[10] 胡明明,王慧强,赖积保.一种基于 GA-BPNN的网络安全态势预测方法[EB/OL].[2007-07-24].http://www.paper.edu.cn/releasepaper/content/20070-437 .
[11] 王宇飞,沈红岩.基于改进广义回归神经网络的网络安全态势预测[J].华北电力大学学报,2011,38(3):91-95.
[12] 丁硕,常晓恒,巫庆辉,等.GRNN与BPNN的函数逼近性能对比研究[J].现代电子技术,2014,37(7):114-117.
[13] 涂娟娟.粒子群优化算法的几种改进算法及应用[D].南京:中国矿业大学,2014.
[14] 曹蓉蓉.大数据环境下网络安全态势感知研究[J].数字图书馆论坛,2014(2):85-91.
[15] 孟建良,刘德超.一种基于Spark和聚类分析的辨识电力系统不良数据新方法[J].电力系统保护与控制,2016,44(3):85-91.
[16] 胡俊,胡贤德,程家兴,等.基于Spark的大数据混合计算模型[J].计算机系统应用,2015,24(4):214-218.
[17] ZAHARIA M,DAS T,LI H,et al.Discretized streams:an efficient and fault-tolerant model for stream processing on large clusters[C]∥Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing.USENIX Association,2012.
[18] 涂娟娟.PSO优化神经网络算法的研究及其应用[D].南京:江苏大学,2013.
[19] 唐振坤.基于Spark的机器学习平台设计与实现[D].厦门:厦门大学,2014.
[20] 刘世成,张建华,刘宗岐,等.并行自适应粒子群算法在电力系统无功优化中的应用[J].电网技术,2012,36(1):108-112.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!