计算机科学 ›› 2013, Vol. 40 ›› Issue (4): 64-68.

• 2012多值逻辑专栏 • 上一篇    下一篇

一种基于内容的数据分发网络及算法

朱昭萌,张功萱,张永平,郭箭,张巍   

  1. 南京理工大学计算机科学与技术学院南京 210094;南京理工大学计算机科学与技术学院南京 210094;南京理工大学计算机科学与技术学院南京 210094;南京理工大学计算机科学与技术学院南京 210094;南京理工大学计算机科学与技术学院南京 210094
  • 出版日期:2018-11-16 发布日期:2018-11-16
  • 基金资助:
    本文受江苏省973项目(BK2011022),国家自然科学重点基金(61170035),南京理工大学重点基金(2011YBXM18)资助

Design of Content-based Data Forwarding Network and Algorithm

ZHU Zhao-meng,ZHANG Gong-xuan,ZHANG Yong-ping,GUO Jian and ZHANG Wei   

  • Online:2018-11-16 Published:2018-11-16

摘要: 物联网中通常需要对海量传感数据进行有目的的聚合和分发。设计中通常使用集中式的大规模存储系统管理海量物联数据,合适的数据分发机制对这样的存储系统必不可少。提出一种基于内容的数据分发网络设计。该设计可以和大规模存储中节点网络相结合,在保证存储过程不受影响的前提下收集空闲计算资源,高效完成基于内容的数据分发工作。受虚拟化思想的启发,设计引入“工作者”和“功能块”角色,通过动态调节每个节点上“工作者”的数量实现网络中节点的负载自动调节,同时通过动态装载或切换“功能块”实现不同任务之间计算资源的动态调配。还具体给出了一种基于布隆过滤器的分布式基于内容的数据分发算法。该算法分布于上述数据分发网络,同时通过使用布隆过滤器表示对象及其属性所满足的约束集合,消除了大量冗余计算,可以并行、高效地完成数据分发工作。

关键词: 基于内容分发,分布式,发布订阅,布隆表达式

Abstract: The data in the Internet of Things needs to be aggregated and disseminated effectively.There are always central massive storage to manage the numeric data produced by sensors.Proper data forwarding mechanism is necessary for such a system.We proposed a design of content-based data forwarding network.This network can combined with the node network of massive storage,that is,utilizing the scattered computing resources of each node in a massive stora-ge network to take up the challenging task of dissemination of a great amount of data.Inspired by the system virtuali-zation,we introduced "workers" and "function bricks" to dynamically balance the loads of different nodes and tasks between nodes in the network automatically.We also proposed a distributed content-based publish/subscribe algorithm using Bloom filter.By efficiently using Bloom filter to represent the object as well as the set of constrains which is satisfied by the object,a large number of redundant computing can be eliminated to sure the algorithm’s efficiency.

Key words: Content-based forwarding,Distributed computing,Publish/subscribe,Bloom filter

[1] Pietzuch P,Muhl G,Fiege L.Distributed Event-Based Systems:An Emerging Community[J].Distributed Systems Online,IEEE,2007,8(2):1-3
[2] Zhang Z,Lian Q,Lin S,et al.BitVault:A highly reliable distribu-ted data retention platform[J].ACM SIGOPS Operating Systems Review,2007,41(2):27-36
[3] Kubiatowicz J,Bindel D,Chen Y,et al.OceanStore:An Architecture for Global-Scale Persistent Storage[J].ACM SIGPLAN Notices,ACM,2000,35(11):190-201
[4] Costa P,Picco G.Publish-subscribe on sensor networks:a semi-probabilistic approach[C]∥Mobile Adhoc and Sensor System Conference.Washington,DC:Costa P,2005:323-332
[5] Carzaniga A,Hall C P.Content-based communication:a research agenda[C]∥Proceedings of the 6th international workshop on Software engineering and middleware.2006:2-8
[6] Baldoni R,Virgillito A.Distributed Event Routing in Publish/Subscribe Communication Systems:a Survey[J].Communications Surveys & Tutorials,2010,12(1):39-58
[7] Barham P,Dragovic B,Fraser K,et al.Xen and the art of virtua-lization[C]∥Proceedings of the nineteenth ACM symposium on Operating systems principles.2003:164-177
[8] Kivity A,Kamay Y,Laor D,et al.kvm:the Linux virtual machine monitor[C]∥Proceedings of the Linux Symposium.2007:225-230
[9] Moreno-Vozmediano R,Montero R,Llorente I.IaaS Cloud Architecture:From Virtualized Data Centers to Federated Cloud Infrastructures[J].Computer,2012(99):1
[10] Bhardwaj S,Jain L.Cloud computing:A study of infrastructure as a service (IAAS)[J].International Journal of engineering and and Information Technology,2010,2(1):60-63
[11] Knuth D.The art of computer programming[M].Volume 3,1973
[12] Bentley J L,Sedgewick R.Fast algorithms for sorting andsearching strings[C]∥Proceedings of the eighth annual ACM-SIAM symposium on Discrete algorithms.1997:360-369
[13] Jerzak Z,Fetzer C.Bloom filter based routing for content-based publish/subscribe [C]∥Proceedings of the second international conference on Distributed event-based systems.2008:71-81

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!