Computer Science ›› 2014, Vol. 41 ›› Issue (6): 142-147.doi: 10.11896/j.issn.1002-137X.2014.06.028

Previous Articles     Next Articles

PBPP:Pipelined Parallel Processing Based on Passing Buffer in Column-store System

DING Xiang-wu and ZHANG Guang-hui   

  • Online:2018-11-14 Published:2018-11-14

Abstract: Chip multiprocessor(CMP) with low-power dissipation,lowcost advantages becomes rapidly the leading role of the market,and it provides hardware support for multithread.Column-store has significant advantages in analytical applications.Query optimization is one of the key issues in column-store.In column-store,multi-core resources can improve performance of query processing.In order to improve query performance of column-stores,this paper established passing block buffer to make main thread and worker thread to read and write respectively different passing blocks,so parent node and child node of physical execution tree execute parallel.We used classic producer-consumer pattern to solve the problem of synchronization between the threads.In column-stores DWMS developed by our laboratory,experimental results on benchmark data set SSB show the effectiveness of this design,and it can improve 50% execution performance for some typical complex queries.

Key words: Multithread,Multicore,Column-store,Passing block buffer,Parallel processing

[1] Copeland G P,Khoshafian S N.A decomposition storage model[C]∥Proceedings of SIGMOD International Conference.Austin,Taxes:ACM,1985:268-279
[2] MacNicol R,French B.Sybase IQ multiplex-Designed for analy-tics[C]∥Proceedings of the 30th Very Large Data Base Confe-rence.Toronto,Canada:VLDB Endowment,2004:1227-1230
[3] Stonebraker M,Abadi D J,Batkin A,et al.C-Store:A column-oriented DBMS[C]∥Proceedings of the 31st Very Large Data Base Conference.Trondheim,Norway:VLDB Endowment,2005:553-564
[4] Boncz P A.Monet:A next-generation DBMS kernel for query-intensive applications[D].Amsterdam:Universiteit van Amsterdam,2002
[5] Hennessy J L,Patterson D A.Computer Architecture(4th ed)[M].Morgan Kaufman Publishers,2007
[6] Abadi D J.Query Execution in Column-Oriented Database System[D].MIT PhD Dissertation,2008
[7] Blanas S,Li Yi-nan,Patel J M.Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs[C]∥Proceedings of the ACM SIGMOD Conference.Athens,Greece:ACM,2011
[8] Zhou Jing-ren,Cieslewicz J,Ross K A,et al.Improving database performance on simultaneous multithreading processors[C]∥Proceedings of the 31st international conference on Very large data bases.Trondheim,Norway:VLDB Endowment,2005:49-60
[9] Cieslewicz J,Ross K A,Giannakakis I.Parallel buffers for chip multiprocessors[C]∥Proceedings of the 3rd International Workshop on Data Management on new Hardware.New York,USA:ACM,2007
[10] Garcia P,Madison,WiHenry,et al.Pipelined hash-join on multithreaded architectures[C]∥Proceedings of the 3rd internationalworkshop on Data management on new hardware.NewYork,USA:ACM,2007
[11] Nehme R,Bruno N.Automated Partitioning Design in Parallel Database Systems[C]∥ Proceedings of the ACM SIGMOD Conference.Athens,Greece:ACM,2011:1137-1148
[12] 汤子瀛,哲凤屏,汤小丹.计算机操作系统[M].西安:西安电子科技大学出版社,2002
[13] Harizopoulos S,Shkapenyuk V,Anastassia.QPipe:a simultaneously pipelined relational query engine[C]∥Proceedings of the 2005ACM SIGMOD international conference on Management of data.New York,USA:ACM,2005:383-394
[14] Hardavellas N,Pandis I,Johnson R,et al.Database servers onchip multiprocessors:Limitations and opportunities[C]∥CIDR.2007:79-87
[15] Manegold S,Boncz P,Nes N,et al.Cache-conscious radix-de-cluster projections[C]∥Proceedings of the Thirtieth International Conference on Very Large Data Bases.VLDB Endowment,2004:684-695
[16] Rao Jun,Zhang Chun,Megiddo N,et al.Automating physical database design in a parallel database [C]∥Proceedings of the 2002ACM SIGMOD Interna-tional Conference on Management of data.New York,USA:ACM,2002:558-569
[17] Cieslewicz J,Mee W,Ross K A.Cache-conscious buffering for database operators with state [C]∥Proceedings of the Fifth International Workshop on Data Management on New Hardware.New York,USA:ACM,2009:43-51
[18] 吴峻峰,许跃生,张永东,等.CC$:一种面向分布式众核平台的并行编程语言[J].计算机科学,2013,40(3):128-132
[19] O’Neil P,O’Neil B,Chen Xue-dong.Star schema bench-mark Revision 3June 5[EB/OL].http://www.cs.umb.edu/~poneil/,2010-02

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!