计算机科学 ›› 2018, Vol. 45 ›› Issue (12): 12-18.doi: 10.11896/j.issn.1002-137X.2018.12.002

所属专题: 区块链技术

• 综述 • 上一篇    下一篇

区块链系统的数据存储与查询技术综述

王千阁, 何蒲, 聂铁铮, 申德荣, 于戈   

  1. (东北大学计算机科学与工程学院 沈阳110169)
  • 收稿日期:2017-12-22 出版日期:2018-12-15 发布日期:2019-02-25
  • 作者简介:王千阁(1994-),男,博士生,主要研究方向为大数据存储与分布式计算,E-mail:wangqiange@stumail.neu.edu.cn;何 蒲(1992-),男,硕士,主要研究方向为云计算与区块链系统;聂铁铮(1980-),男,博士,副教授,主要研究方向为分布式数据库、大数据管理;申德荣(1964-),女,博士,教授,主要研究方向为分布式数据库、大数据集成;于 戈(1962-),男,博士,教授,CCF会员,主要研究方向为数据库理论与技术、分布与并行式系统,E-mail:yuge@mail.neu.edu.cn(通信作者)。
  • 基金资助:
    本文受国家自然科学基金课题(U1435216,61433008),中央高校基本科研业务费(N150408001-3,N150404013),辽宁省自然科学基金(2015020018)资助。

Survey of Data Storage and Query Techniques in Blockchain Systems

WANG Qian-ge, HE Pu, NIE Tie-zheng, SHEN De-rong, YU Ge   

  1. (School of Computer Science and Engineering,Northeastern University,Shenyang 110169,China)
  • Received:2017-12-22 Online:2018-12-15 Published:2019-02-25

摘要: 目前,以比特币和以太坊为代表的区块链系统已经日趋成熟,区块链技术成为学术界与工业界的研究热点。然而,这些区块链系统在实际应用中因数据存储模式限制而普遍面临着查询功能简单、查询性能较低等严重问题。文中重点对区块链系统的数据存储与查询技术的研究进展进行综述与展望。首先,介绍当前流行区块链系统中使用的数据存储机制和查询处理策略。然后,详细介绍在现有区块链系统基础上扩展查询处理功能的两种方法,并从查询效率、写性能优化、存储空间占用、数据安全性和可用性5个方面对其进行对比和分析。最后,分析了未来区块链系统的查询技术发展趋势,探讨了其主要的研究方向。

关键词: 查询处理, 存储管理, 区块链, 数据库, 索引结构

Abstract: At present,blockchain systems,represented by Bitcoin and Ethereum,are becoming more and more mature,and blockchain technology has become a hot topic in academic and industrial circles.However,in practical applications,these systems are generally faced with tough problems such as simple query function and low query performance due to the limitation of data storage scheme.This paper presented the survey and prospect of the research progress on data storage and query technology of blockchain systems.First,the data storage mechanism and query processing strategy used in current popular blockchain systems were introduced .Then,two methods of extending query processing functions on the existing system were introduced in details.The features of their query efficiency,write performance optimization,storage space occupancy,data security and availability were compared and analyzed in detail.Finally,the trend of the query technology development in the future block chain system was analyzed,and the main research direction was discussed and explored.

Key words: Blockchain, Database, Index structures, Query processing, Storage management

中图分类号: 

  • TP315
[1]HE P,YU G,ZHANG Y F,et al.Survey on blockchain techno-logy and its application prospect .Computer Science,2017,44(4):1-7.(in Chinese)
何蒲,于戈,张岩峰,等.区块链技术与应用前瞻综述.计算机科学,2017,44(4):1-7.
[2]PASS R,SEEMAN L,SHELAT A.Analysis of the Blockchain protocol in asynchronous networks[C]∥International Confe-rence on the Theory and Applications of Cryptographic Techniques.2017:643-673.
[3]ALI M,NELSON J,SHEA R,et al.Block stack:a global naming and storage system secured by block chains[C]∥USENIX Annual Technical Conference.2016:181-194.
[4]ATENIESE G,MAGRI B,VENTURI D,et al.Redactableblockchain-or-rewriting history in bitcoin and friends[C]∥European Symposium on Security and Privacy.2017.
[5]KOSBA A,MILLER A,SHI E,et al.Hawk:the blockchainmodel of cryptography and privacy-preserving smart contracts[C]∥Security and Privacy.2016:839-858.
[6]HALPIN H,PIEKARSKA M.Introduction to security and pri-vacy on the blockchain[C]∥European Symposium on Security and Privacy Workshops.2017.
[7]LUU L,NARAYANAN V,ZHENG C,et al.A secure sharding protocol for open blockchains [C]∥ACM SIGSAC Conference on Computer and Communications Security.2016:17-30.
[8]EYAL I,GENCER A E,RENESSE R V.Bitcoin-NG:a scalable blockchain protocol // Usenix Conference on Networked Systems Design and Implementation.2016:45-59.
[9]JIN H,DAI X,XIAO J.Towards a Novel Architecture for Enabling Interoperability amongst Multiple Blockchains[C]∥International Conference on Distributed Computing Systems.IEEE Computer Society,2018:1203-1211.
[10]LevelDB.http://LevelDB.org.
[11]Etherchain.https://www.etherchain.org.
[12]DINH T T A,WANG J,CHEN G,et al.BLOC-KBENCH:aframework for analyzing private blockchains[C]∥International Conference on Management of Data.2017:1085-1100.
[13]O'NEIL P,CHENG E,GAWLICK D,et al.The log-structured merge-tree (LSM-tree).Acta-Informatica,1996,33(4):351-385.
[14]Wikepedia.Berkeley_DB.https://en.wikipedia.org /wiki/Berkeley_DB.
[15]Hyperledger.https://www.hyperledger.org.
[16]SHAWN W,TOME B,JOSH B,et al.Storj A peer-to-peer cloud storage network.https://storj.io/storj.pdf.2016.
[17]Protocol Labs.Filecoin:A decentralized storage network[EB/OL].http://www.filecoin.io/fi-lecoin.pdf.2017.
[18]Wikipedia.RLP.https://github.com/ethereum/wiki/wiki/RLP.
[19]LI Y,ZHENG K,YAN Y,et al.EtherQL:a query layer forblockchain system[C]∥Data-base Systems for Advanced Applications.2017:556-567.
[20]DINH T T A,LIU R,ZHANG M,et al.Untangling blockchain:a data processing view of blockchain systems.https://arxiv.org/abs/1708.05665.
[21]DINH A,WANG J,WANG S,et al.UStore:a distributed storage with rich semantics . https://arxiv.org/abs/1702.02799.
[22]CAI W D,YU L,WANG R,et al.Blockchain application devel-opment techniques.Journal of Software,2017,28(6):1474-1487.(in Chinese)
蔡维德,郁莲,王荣,等.基于区块链的应用系统开发方法研究.软件学报,2017,28(6):1474-1487.
[23]WANG S,DINH T T A,LIN Q,et al.ForkBase:An Efficient Storage Engine for Blockchain and Forkable Applications[J].PVLDB,2018,11(10):1137-1150.
[24]KARLSSON K,JIANG W,WICKER S,et al.Vegvisir:A Partition-Tolerant Blockchain for the Internet-of-Things[C]∥International Conference on Distributed Computing Systems.IEEE Computer Society,2018:1150-1158.
[25]JIA D,XIN J,WANG Z,et al.ElasticChain:Support Very Large Blockchain by Reducing Data Redundancy[C]∥Asia-Pacific Web.Springer,Cham,2018:440-454.
[26]LIND,JOSHUA,NAOR O,et al.Teechain:Reducing StorageCosts on the Blockchain With Offline Payment Channels[C]∥ SYSTOR.2018:125-125.
[27]WU X,XU Y,SHAO Z,et al.LSM-trie:an LSM-tree-based ultra-large key-value store for small data∥USENIX Annual Technical Conference.2015.
[28]AGARWAL R,KHANDELWAL A,STOICA I.Succinct :Enabling Queries on Compressed Data∥USENIX Conference on Networked Systems Design and Implementation.2015:337 -350.
[29]WANG P,SUN G,JIANG S,et al.An efficient design and implementation of LSM-tree based key-value store on open-channel SSD[C]∥Eurosys.2014:1-14.
[30]AHN J S,SEO C,MAYURAM R,et al.Forest DB:a fast key-value storage system for variable-length string keys.IEEE Transactions on Computers,2016,65(3):902-915.
[31]LU L,PILLAI T S,ARPACI-DUSSEAU A C,et al.WiscKey:separating keys from values in SSD-conscious storage[C]∥USENIX Conference on File and Storage Technologies.2016:133-148.
[32]NAKAMOTO S.Bitcoin:a peer-to-peer electro -nic cash system.https://bitcoin.or-g/bitcoin.pdf.
[33]BUTREN V.Ethereum:A next generation smart contractanddecentralized application platform.https://github.com/ethereum/wiki/wiki/White-paper,2013.
[34]TRENT M,RODOLPHE M,ANDREAS M,et al.BigchainDB:A Scalable Blockchain Data-base.https://www.big-chaindb.com/w hitepaper/bigchaindb-whitepaper.pdf.2016.
[35]SEARS R,RAMAKRISHNAN R.bLSM:a general purpose log structured merge tree[C]∥ACM International Conference on Management of Data.2012:217-228.
[36]LIM H,FAN B,ANDERSEN D G,et al.SILT:a memory efficient,high performance key-value store[C]∥ACM Symposium on Operating Systems Principles.2011:1-13.
[1] 王子凯, 朱健, 张伯钧, 胡凯.
区块链与智能合约并行方法研究与实现
Research and Implementation of Parallel Method in Blockchain and Smart Contract
计算机科学, 2022, 49(9): 312-317. https://doi.org/10.11896/jsjkx.210800102
[2] 王润安, 邹兆年.
基于物理操作级模型的查询执行时间预测方法
Query Performance Prediction Based on Physical Operation-level Models
计算机科学, 2022, 49(8): 49-55. https://doi.org/10.11896/jsjkx.210700074
[3] 李博, 向海昀, 张宇翔, 廖浩德.
面向食品溯源场景的PBFT优化算法应用研究
Application Research of PBFT Optimization Algorithm for Food Traceability Scenarios
计算机科学, 2022, 49(6A): 723-728. https://doi.org/10.11896/jsjkx.210800018
[4] 傅丽玉, 陆歌皓, 吴义明, 罗娅玲.
区块链技术的研究及其发展综述
Overview of Research and Development of Blockchain Technology
计算机科学, 2022, 49(6A): 447-461. https://doi.org/10.11896/jsjkx.210600214
[5] 高健博, 张家硕, 李青山, 陈钟.
RegLang:一种面向监管的智能合约编程语言
RegLang:A Smart Contract Programming Language for Regulation
计算机科学, 2022, 49(6A): 462-468. https://doi.org/10.11896/jsjkx.210700016
[6] 毛典辉, 黄晖煜, 赵爽.
符合监管合规性的自动合成新闻检测方法研究
Study on Automatic Synthetic News Detection Method Complying with Regulatory Compliance
计算机科学, 2022, 49(6A): 523-530. https://doi.org/10.11896/jsjkx.210300083
[7] 周航, 姜河, 赵琰, 解相朋.
适用于各单元共识交易的电力区块链系统优化调度研究
Study on Optimal Scheduling of Power Blockchain System for Consensus Transaction ofEach Unit
计算机科学, 2022, 49(6A): 771-776. https://doi.org/10.11896/jsjkx.210600241
[8] 王思明, 谭北海, 余荣.
面向6G可信可靠智能的区块链分片与激励机制
Blockchain Sharding and Incentive Mechanism for 6G Dependable Intelligence
计算机科学, 2022, 49(6): 32-38. https://doi.org/10.11896/jsjkx.220400004
[9] 孙浩, 毛瀚宇, 张岩峰, 于戈, 徐石成, 何光宇.
区块链跨链技术发展及应用
Development and Application of Blockchain Cross-chain Technology
计算机科学, 2022, 49(5): 287-295. https://doi.org/10.11896/jsjkx.210800132
[10] 阳真, 黄松, 郑长友.
基于区块链与改进CP-ABE的众测知识产权保护技术研究
Study on Crowdsourced Testing Intellectual Property Protection Technology Based on Blockchain and Improved CP-ABE
计算机科学, 2022, 49(5): 325-332. https://doi.org/10.11896/jsjkx.210900075
[11] 任畅, 赵洪, 蒋华.
一种量子安全拜占庭容错共识机制
Quantum Secured-Byzantine Fault Tolerance Blockchain Consensus Mechanism
计算机科学, 2022, 49(5): 333-340. https://doi.org/10.11896/jsjkx.210400154
[12] 冯了了, 丁滟, 刘坤林, 马科林, 常俊胜.
区块链BFT共识算法研究进展
Research Advance on BFT Consensus Algorithms
计算机科学, 2022, 49(4): 329-339. https://doi.org/10.11896/jsjkx.210700011
[13] 杨昕宇, 彭长根, 杨辉, 丁红发.
基于演化博弈的理性拜占庭容错共识算法
Rational PBFT Consensus Algorithm with Evolutionary Game
计算机科学, 2022, 49(3): 360-370. https://doi.org/10.11896/jsjkx.210900110
[14] 王鑫, 周泽宝, 余芸, 陈禹旭, 任昊文, 蒋一波, 孙凌云.
一种面向电能量数据的联邦学习可靠性激励机制
Reliable Incentive Mechanism for Federated Learning of Electric Metering Data
计算机科学, 2022, 49(3): 31-38. https://doi.org/10.11896/jsjkx.210700195
[15] 张潆藜, 马佳利, 刘子昂, 刘新, 周睿.
以太坊Solidity智能合约漏洞检测方法综述
Overview of Vulnerability Detection Methods for Ethereum Solidity Smart Contracts
计算机科学, 2022, 49(3): 52-61. https://doi.org/10.11896/jsjkx.210700004
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!