计算机科学 ›› 2018, Vol. 45 ›› Issue (5): 163-167.doi: 10.11896/j.issn.1002-137X.2018.05.027

• 软件与数据库技术 • 上一篇    下一篇

一种基于中间件的异构数据库融合访问方法及系统

潘明明,李丁丁,汤庸,刘海   

  1. 华南师范大学计算机学院 广州510631,华南师范大学计算机学院 广州510631,华南师范大学计算机学院 广州510631,华南师范大学计算机学院 广州510631
  • 出版日期:2018-05-15 发布日期:2018-07-25
  • 基金资助:
    本文受国家自然科学基金(61502180),广东省自然科学基金(2014A030310238,2015B010129009,2016A030313441),广州市珠江科技新星项目(201710010189),广州市面向大数据安全产业链的协同创新项目(201508010067),广东省省级科技计划项目(2015B010109003)资助

Design and Implemention of Accessing Hybrid Database Systems Based on Middleware

PAN Ming-ming, LI Ding-ding, TANG Yong and LIU Hai   

  • Online:2018-05-15 Published:2018-07-25

摘要: 在大数据时代,信息化数据呈爆炸式增长,传统关系型数据库和新兴的NoSQL数据库都难以全面且高效地面对这些挑战。因此,提出一种基于中间件的异构数据库访问方法(MingleDB),以结合NoSQL和传统关系型数据库的优点。MingleDB透明融合了NoSQL数据库和传统数据库的主要运行逻辑,同时又能够根据当前用户请求的读写特征,自动选取合适的处理路径以避免二者的不足;它还支持轻量级的事务处理框架,该框架按需实施以保证异构数据库数据的最终一致性和完整性。将MingleDB分别与MongoDB,MySQL数据库进行读写性能对比,实验证明了MingleDB方法的正确性和合理性。同时将MingleDB部署在实际的社交网络系统中进行实际验证,结果亦证明了其实用性和可移植性。

关键词: 关系型数据库,NoSQL,异构数据库,中间件,事务提交

Abstract: In the big data era,with the explosive growth of informational data,traditional relational databases(SQL) and emerging NoSQL databases are difficult to face these challenges in a comprehensive and efficient manner.Therefore,this paper proposed MingleDB,a high-efficient middleware for incorporating both merits of traditional database and NoSQL systems.MingleDB is transparent for the underlying hybrid database systems,namely SQL and NoSQL,without any intrusive modifications on the original systems.MingleDB can detect the specific characteristic inside a user query,for example,the data is either unstructured or structured.Then it puts this user query into the suitable procedure(SQL or NoSQL) presented by MingleDB,and also provides a lightweight transaction processing framework which is implemented on demand to ensure the final consistency and completeness of hybrid database data.Extensive experiments were conducted to test the effective of MingleDB.Furthermore,this paper used a realistic scenario to verify the advantage of our work.The results are positive.

Key words: Relation database,NoSQL,Hybrid database,Middleware,Transaction commitment

[1] LI Y Y,TANG Y,HUANG Y H,et al.Research on Network Teaching Platform Based on Scholar’s Social Model [J].Computer Education,2015,252(24):112-115.(in Chinese) 李宇耀,汤庸,黄泳航,等.基于学者社交模式的网络教学平台研究[J].计算机教育,2015,252(24):112-115.
[2] WU S,CHEN G,ZHOU X,et al.PABIRS:A data access middleware for distributed file systems[C]∥IEEE International Conference on Data Engineering.IEEE,2015:113-124.
[3] AHN J S,SEO C,MAYURAM R,et al.ForestDB:A Fast Key-Value Storage System for Variable-Length String Keys[J].IEEE Transactions on Computers,2016,65(3):902-915.
[4] MARINO M D,LI K C.Last level cache size heterogeneity inembedded systems[J].The Journal of Supercomputing,2016,72(2):503-544.
[5] AGUILERA M K,LENERS J B,WALFISH M.Yesquel:scalable sql storage for web applications [C]∥Proceedings of the 25th Symposium on Operating Systems Principles(SOSP’15).New York:ACM,2015:245-262.
[6] LAWRENCE R.Integration and Virtualization of RelationalSQL and NoSQL Systems Including MySQL and MongoDB[C]∥International Conference on Computational Science and Computational Intelligence.IEEE,2014:285-290.
[7] WU X J.Hybrid Storage Strategy with MongoDB and MySQL for E-government[J].Computer and Modernization,2014(8):62-66.(in Chinese) 吴秀君.面向电子政务的 MongoDB与MySQL混合存储策略[J].计算机与现代化,2014(8):62-66.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!