计算机科学 ›› 2017, Vol. 44 ›› Issue (4): 140-143.doi: 10.11896/j.issn.1002-137X.2017.04.030

• NASAC 2015 • 上一篇    下一篇

CEStream:一种复杂事件流处理语言

王亦雄,廖湖声,孔祥翾,高红雨,苏航   

  1. 北京工业大学计算机学院 北京100124,北京工业大学软件学院 北京100124,北京工业大学计算机学院 北京100124,北京工业大学计算机学院 北京100124,北京工业大学计算机学院 北京100124
  • 出版日期:2018-11-13 发布日期:2018-11-13
  • 基金资助:
    本文受北京市自然科学基金项目(4122011),国家自然科学基金青年基金项目(61202074)资助

CEStream:A Complex Event Stream Processing Language

WANG Yi-xiong, LIAO Hu-sheng, KONG Xiang-xuan, GAO Hong-yu and SU Hang   

  • Online:2018-11-13 Published:2018-11-13

摘要: 复杂事件处理是支持大数据处理的流式计算平台的核心技术之一。CEStream语言作为一种新型的事件流处理语言,支持分布式环境下的复杂事件处理。该语言以XML等层次化数据为数据模型,为复杂事件检测提供了一种正规树模式匹配功能,并且支持结构连接和正规式匹配。同时,针对分布式的多个事件流,其能够将各个事件源模式匹配的结果按照时间顺序再一次进行正规式模式匹配,满足多源组合型复杂事件的检测需求,具有较强的事件处理能力。为了实现CEStream语言,研制了一个基于流数据处理集群和远端查询代理的执行引擎系统。该系统通过远程查询代理实现基于正规树模式的事件检测,通过流处理集群完成多源组合型复杂事件处理。实验表明,该系统实现了CEStream语言,有效地限制了各个节点之间的通信量,充分利用了集群的计算能力,整体性能能够满足应用需求。

关键词: 复杂事件处理,计算机语言,流式计算

Abstract: Complex event processing is one of the core technologies of stream processing platform which supports big data processing.A new style event stream processing language,named CEStream,supports complex event processing in distributed environment.This language takes hierarchical data as data model,such as XML,and also provides a feature for complex event detecting,which is named regular tree pattern matching.This feature supports structural connection and regular expression matching.Moreover,aiming at distributed multi-sources event stream,CEStream provides anotherfeature that matches each pattern matching result once again by regular expression which describes time sequence for each result.This feature supports the demand of multi-sources composite complex event detecting,and has good ability of event processing.To implement CEStream language,a process engine system was developed based on stream data processing cluster and remote querying agent.This system provides a feature which uses remote querying agent to detect events by regular tree pattern,and provides another feature which uses stream processing cluster to process multi-sources composite complex events.It’s demonstrated by experiments that this system has implemented CEStream language,has effectively made constraint on communication flows between each node in cluster,has capitalized on ability of cluster computing,and it supports the demand of comprehensive performance.

Key words: Complex event processing,Computer language,Stream computing

[1] ZHANG Q,CHENG L,BOUTABA R.Cloud computing:state-of-the-art and research challenges[J].Journal of Internet Servi-ces and Applications,2010,1(11):7-18.
[2] ZENG K,YANG M,MOZAFARI B,et al.Complex pattern mat-ching in complex structures:The XSeq approach[C]∥2013 IEEE 29th International Conference on Data Engineering (ICDE).IEEE,2013:1328-1331.
[3] BUGHIN J,CHUI M,MANYIKA J.Clouds,big data,and sma-rt assets:Ten tech-enabled business trends to watch[J].McKi- nsey Quarterly,2010,56:75-86.
[4] BAI Y,THAKKAR H,WANG H,et al.A data stream language and system designed for power and extensibility[C]∥CIKM.ACM,2006.
[5] CUGOLA G,MARGARA A.Processing flows of information:From data stream to complex event processing[J].ACM Computing Surveys (CSUR),2012,44(3):1-62.
[6] CUGOLA G,MARGARA A.RACED:an adaptive middleware for complex event detection[C]∥Proceedings of the 8th International Workshop on Adaptive and Reflective Middleware.ACM,2009:5.
[7] Peng F,Chawathe S S.Xpath queries on streaming data[C]∥SIGMOD.2003.
[8] DIAO Y,IMMERMAN N,GYLLSTROM D.Sase+:An agile language for kleene closure over event streams.[2012-12-23].http://archive,systems,ethz.ch/www,dbis.ethz.ch/education/ws0708/adv_top_infsyst/papers/sase_tr07,pdf.
[9] ABADI D,CARNEY D,CETINTEMEL U,et al.Aurora:a data stream management system[C]∥SIGMOD.ACM,2003.
[10] RASANEN O,KAKOUROS S.Modeling Dependencies in Multiple Parallel Data Streams with Hyper dimensional Computing[J].Gnal Rong Lr,2014,21:899-903.
[11] AGUADO J,MENDLER M.Towards Strategies for Data Flow Programming[C]∥Preproceedings of the 22nd Symposium on Implementation and Application of Functional Languages (IFL 2010).2010:372-473.
[12] KIEBURTZ R B.Codata and comonads in Haskell[J/OL].http://core.ac.uk/display/24270653.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!