Computer Science ›› 2019, Vol. 46 ›› Issue (6A): 1-5.

• Review •     Next Articles

Survey on Distributed Message System

WU Can1,2, WANG Xiao-ning1, XIAO Hai-li1, CAO Rong-qiang1, ZHAO Yi-ning1, CHI Xue-bin1,2   

  1. Computer Network Information Center,Chinese Academy of Sciences,Beijing 100190,China1;
    University of Chinese Academy of Sciences,Beijing 100049,China2
  • Online:2019-06-14 Published:2019-07-02

Abstract: With the advent of the Big Data Era,there have been increasing demands for the high concurrent access and mass data processing of all kinds of hardware and software systems.High availability,extensibility and scalability are the main driving forces for system development.Distributed systems emerge as new age comes,providing solutions for higher performance requirements.However,as distributed systems are deployed on different computers,message communication between the systems has become an important problem.This paper provided an overview of the research progress of four popular open source distributed message systems:RabbitMQ,Kafka,ActiveMQ and RocketMQ.The architecture and performance of them are compared and analyzed,providing information and references for researchers and developers when choosing distributed message systems as an option.

Key words: ActiveMQ, Distributed message system, Kafka, RabbitMQ, RocketMQ

CLC Number: 

  • TP311
[1]Distributed Systems Concepts and Design.George Coulouris [M].America:Addison-Wesley,2012.
[2]WOOD I.Distributed Message Transmission System and Me-thod:WO,EP1477034[P].2004.
[3]GE Y,LIANG X X,PAN Z,et al.MESSAGE PARSING IN A DISTRIBUTED STREAM PROCESSING SYSTEM:U.S.Patent Application 15/258,629[P].2018-3-8.
[4]CONSULTANT M P C T.Chapter 3.Point-to-Point(PTP) and Point-to-Multipoint(PMP) Wireless Systems and Antennas[M]∥Wireless Access Networks:Fixed Wireless Access and WLL Networks-Design and Operation.John Wiley & Sons,Ltd,2001:41-56.
[5]EUGSTER P T.The many faces of publish/subscribe[J].ACM Computing Surveys(CSUR),2003,35(2):114-131.
[6]GUPTA A,SAHIN O D,AGRAWAL D,et al.Meghdoot:Content-Based Publish/Subscribe over P2P Networks[M]∥Middleware 2004.Springer Berlin Heidelberg,2004:254-273.
[7]SURHONE L M,TIMPLEDON M T,MARSEKEN S F,et al.RabbitMQ[M].Betascript Publishing,2010.
[8]VIDELA A,WILLIAMS J J W.RabbitMQ in action:distributed messaging for everyone.Manning Publications Co.,2012.
[9]ROSTANSKI M,GROCHLA K,SEMAN A.Evaluation of highly available and fault-tolerant middleware clustered architectures using RabbitMQ[C]∥Computer Science and Information Systems.IEEE,2014:879-884.
[10]AYANOGLU E,AYTAS Y,NAHUM D.Mastering RabbitMQ[M].Packt Publishing,2016,1:76-77.
[11]TKRAMER J.Advanced message queuing protocol(AMQP).Belltown Media,2009.
[12]VIDELA A,VIDELA A.RabbitMQ in Action[M].Manning Publications,2012.
[13]GILLES.Kafka:toward a minor literature[M].University of Minnesota Press,1986.
[14]ESMAILI K S,ESMAILI K S.Kafka versus RabbitMQ:A comparative study of two industry reference publish/subscribe implementations:Industry Paper[C]∥ACM International Confe-rence on Distributed and Event-Based Systems.ACM,2017:227-238.
[15]PROULX T,HEINE S J.Connections from Kafka:exposure to meaning threats improves implicit learning of an artificial grammar[J].Psychological Science,2009,20(9):1125.
[16]COMPUTING C C,WANG M H,LI Y,et al.Redesigning Kafka Message Queue System:Toward a Decentralized Stateful Broker System[J].2017.
[17]GARG N.Apache Kafka[M].Packt Publishing Ltd,2013.
[18]HENJES R,SCHLOSSER D,MENTH M,et al.Throughput Performance of the ActiveMQ JMS Server[M]∥Kommunikation in VerteiltenSystemen(KiVS).DBLP,2007:113-124.
[19]IONESCU V M.The analysis of the performance of RabbitMQ and ActiveMQ[C]∥Roedunet International Conference-Networking in Education and Research.IEEE,2015:132-137.
[20]KLEIN A F,STEFANESCU M,SAIED A,et al.An experimental comparison of ActiveMQ and OpenMQ brokers in asynchronous cloud environment[C]∥Fifth International Confe-rence on Digital Information Processing and Communications.IEEE,2015:24-30.
[21]HENJES R,MENTH M,HIMMLER V.Impact of Complex Filters on the Message Throughput of the ActiveMQ JMS Ser-ver[M]∥Managing Traffic Performance in Converged Networks.Springer Berlin Heidelberg,2007:192-203.
[22]CHEN G,DU Y,QIN P,et al.Design and Realization of ActiveMQ Based High Performance Message Cluster[C]∥International Conference on Chemical Science and Engineering.2013.
[23]ZHANG Y,XU L X.Feature and Configuration Research of Ac-tiveMQ[J].Computer Programming Skills & Maintenance,2011,12:6-13.
[24]SURHONE L M,TENNOE M T,HENSSONOW S F,et al.OpenWire (binary protocol).Betascript Publishing,2010.
[25]SURHONE L M,TENNOE M T,HENSSONOW S F,et al.WS-Notification[M].Betascript Publishing,2010.
[26]MILLER J.A Feature Set for the Extensible Messaging and Presence Protocol (XMPP).China Educational Technology,2015,17:2025-2032.
[27]SNYDER B,BOSANAC D,DAVIES R.ActiveMQ in Action [M].Manning Publications Co,2011.
[28]LIAO J,ZHUANG X,FAN R,et al.Toward a General Distributed Messaging Framework for Online Transaction Processing Applications[J].IEEE Access,2017,PP(99):1.
[29]WANG X R,WANG X R,FENG J.From Alibaba to Apache:RocketMQ’s Past,Present,and Future[EB/OL].https://www.infoq.com/articles/alibaba-apache-rocketmq.
[30]MA Y,YAN R,SUN J,et al.A MQTT Protocol Message Push Server Based on RocketMQ[C]∥International Conference on Intelligent Computation Technology and Automation.2017:295-298.
[31]The Apache Software Foundation.RocketMQArchitecture[EB/OL].http://rocketmq.apache.org/docs/rmq-arc.
[32]HINTJENS P.ZeroMQ:messaging for many applications[M].O’Reilly Media,Inc.,2013.
[33]FENGPING P,JIANZHENG C.Distributed system based on ZeroMQ[J].Electronic Test,2012,7(7):24-29.
[34]HINTJENS P.ZeroMQ:云时代极速消息通信库.北京:电子工业出版社,2015.
[35]CARLSON J L.Redis in action[M].Manning Publications Co.,2013.
[36]CARLSON J L.Redis in Action.Manning Publications Co.,2012.
[1] XIE Wen-kang, FAN Wei-bei, ZHANG Yu-jie, XU He, LI Peng. ENLHS:Sampling Approach to Auto Tuning Kafka Configurations [J]. Computer Science, 2020, 47(8): 119-126.
[2] GAO Zi-yan and WANG Yong. Load Balancing Strategy of Distributed Messaging System for Cloud Services [J]. Computer Science, 2020, 47(6A): 318-324.
[3] WANG Xu-liang, NIE Tie-zheng, TANG Xin-ran, HUANG Ju, LI Di, YAN Ming-sen, LIU Chang. Study on Dynamic Adaptive Caching Strategy for Streaming Data Processing [J]. Computer Science, 2020, 47(11): 122-127.
[4] YI Jia, XUE Chen and WANG Shu-peng. Optimization on Distributed Stream Data Loading and Querying [J]. Computer Science, 2017, 44(5): 172-177.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!