基于基准测试的高性能计算云研究

摘要/Abstract

摘要： 随着云计算技术的发展,高性能计算云(HPC in the Cloud)已得到学术界和产业界的关注。由于虚拟化技术带来的性能开销,高性能计算云面临着一些挑战。针对“高性能计算+云”的计算模式,分析了高性能计算云的优势,深入介绍了国内外基于基准测试的高性能计算云的性能评测、性能优化、能耗和成本效益等关键问题,得出了针对基准测试的高性能计算云研究的基本思路,并对当前面临的问题和今后的发展趋势进行了总结和展望。

关键词: 高性能计算,云计算,高性能计算云,基准测试

Abstract: With the development of Cloud computing, the academia and industry give HPC in the Cloud more attention．As virtualization technology brings performance overhead,HPC in the Cloud is facing some challenges．On the basis of the “HPC＋Cloud” computing paradigm,this paper analyzed the advantages of HPC in the Cloud,introduced the key issues about performance evaluation,performance optimization,power consumption,cost-benefit analysis at home and abroad in the implementation of benchmark-based high performance computing in the Cloud computing environment．Meanwhile,this paper got the basic ideas of research on benchmark-based HPC in the Cloud．At the end of this paper,we summarized the current issues,and prospected the foreground of HPC in the Cloud.

Key words: HPC,Cloud computing,HPC in the Cloud,Benchmark

李春艳,张学杰. 基于基准测试的高性能计算云研究[J]. 计算机科学, 2013, 40(12): 23-30. https://doi.org/

LI Chun-yan and ZHANG Xue-jie. Research on Benchmark-based HPC in Cloud[J]. Computer Science, 2013, 40(12): 23-30. https://doi.org/

参考文献

[1] TOP 500Supercomputer Site．http://www.top500.org
[2] 李乔,郑啸.云计算研究现状综述[J]．计算机科学,2011,38(4):32-37
[3] Gupta A,Milojicic DS,Kalé LV．Optimizing VM Placement for HPC in the Cloud[C]∥Proceedings of the Workshop on Cloud Services,Federation,and the 8th Open Cirrus Summit．2012:1-6
[4] Zhao Han,Li Xiao-lin．Designing Flexible Resource Rental Mo-dels for Implementing HPC-as-a-Service in Cloud[C]∥The 26th IEEE International Parallel and Distributed Processing Sympo-sium Workshops & PhD Forum．2012:2550-2553
[5] 吴松,陈海宝,金海．HPC Cloud——新兴的高性能计算模式[J]．中国计算机学会通讯,2011,7(10):48-55
[6] Younge A J,Henschel R,Brown J T,et al．Analysis of Virtualization Technologies for High Performance Computing Environments[C]∥ Proceedings of The 4th IEEE International Confe-rence on Cloud Computing(CLOUD 2011)．2011
[7] 王鹏,孟丹,詹剑锋,等．数据密集型计算编程模型研究进展[J]．计算机研究与发展,2010,47(11):1993-2002
[8] Dillon T,Wu C,Chang E．Cloud Computing:Issues and Challenges[C]∥The 24th IEEE International Conference on Advanced Information Networking and Applications．2010:27-33
[9] 钱磊,李宏亮,谢向辉,等．虚拟化技术在高性能计算机系统中的应用研究[J]．计算机工程与科学,2009,31(A1):307-311
[10] Youseff L,Wolski R,Gorda B,et al．Evaluating the Performance Impact of Xen on MPI and Process Execution For HPC Systems[C]∥ Proceedings of the 2nd International Workshop on Virtua-lization Technology in Distributed Computing(VTDC)．2006
[11] Mergen MF,Uhlig V,Krieger O,et al．Virtualization for high-performance computing[J]．ACM SIGOPS Operating System Review,2006,40(2):8-11
[12] Vallee G,Naughton T,Scott S．System-Level Virtualization for High Performance Computing[C]∥The 16th Euromicro Conference on Parallel,Distributed and Network-Based Processing．2008:636-643
[13] Evangelinos C,Hill C．Cloud Computing for parallel ScientificHPC Applications:Feasibility of running Coupled Atmosphere-Ocean Climate Modelson Amazon’s EC2[C]∥The First Workshop on Cloud Computing and its Applications (CCA’08)．October 2008
[14] Kim H,el-Khamra Y,Jha S,et al．An Autonomic Approach to Integrated HPC Grid and Cloud Usage[C]∥The 5th IEEE International Conference in e-Science’09．2009:366-373
[15] Napper J,Bientinesi P．Can Cloud Computing Reach TheTOP500?[C]∥ Proceedings of the Combined Workshops on Unconventional High Performance Computing Workshop Plus Memory Access Workshop．Ischia,Italy．May 2009
[16] 黄达伟,叶可江,陈建海,等．虚拟计算系统性能评测[J]．中国计算机学会通讯,2011,7(10):8-15
[17] Ekanayake J,Fox G．High performance parallel computing with clouds and cloud technologies[C]∥Cloud Computing Lecture Notes of the Institute for Computer Sciences,Social-Informatics and Telecommunications Engineering．2010:20-38
[18] 张士勋．云计算在科学计算中的应用研究[D]．郑州:郑州大学,2010
[19] Han J,Ahn J,Kim C,et al．The effect of multi-core on HPC applications in virtualized systems[C]∥The 5th Workshop on Virtualization and High-Performance Cloud Computing．2010
[20] Iosup A,Ostermann S,Yigitbasi N,et al．Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing[C]∥Proceedings of IEEE Trans．on Parallel and Distribute System．2010
[21] Vockler J-S,Juve G,Deelman E,et al．Experiences Using Cloud Computing for A Scientific Workflow Application[C]∥The 2nd Workshop on Scientific Cloud Computing (ScienceCloud)．2011
[22] Ramakrishnan L,Canon R S,Muriki K,et al．Evaluating Interconnect and Virtualization performance for High Performance Computing[C]∥The second international workshop on performance modeling,benchmarking and simulation of high performance computing systems．ACM,2011
[23] Birkenheuer G,Brinkmann A,Kaiser J,et al．Virtualized HPC:a contradiction in terms? [EB/OL]．Software:Practice and Experience 2011,DOI:10.1002/spe.1055,http://onlinelibrary.wiley.com/doi/10.1002/spe.1055/full
[24] Ghoshal D,Canon R S,Ramakrishnan L．I/O Performance ofVirtualized Cloud Environments[C]∥The second international workshop on data intensive computing in the clouds,ser．DataCloud-SC ’11．New York,NY,USA:ACM,2011:71-80
[25] Luszczek P,Meek E,Moore S,et al．Evaluation of the HPC Challenge benchmarks in virtualized environments[C]∥The 6th Workshop on Virtualization in High-Performance Cloud Computing．Bordeaux,France,August 2011
[26] Gómez J,Villar E,Molero G,et al．Evaluation of High Performance Clusters in Private Cloud Computing Environments[C]∥The 9th International Conference．Springer,2012:305-312
[27] Ahuja S P,Mani S．The State of High Performance Computing in the Cloud[J]．Journal of Emerging Trends in Computing and Information Sciences,2012,3(2)
[28] 英特尔开源软件技术中心,复旦大学并行处理研究所．系统虚拟化——原理与实现[M]．北京:清华大学出版社,2009
[29] HPC CHALLENGE[EB/OL]．http://icl.cs.utk.edu/hpcc/index.html
[30] PARSEC Benchmark[EB/OL]．http://parsec.cs.princeton.edu/
[31] Petrides P,Nicolaides G,Trancoso P．HPC Performance Do-mains on Multi-core Processors with Virtualization[C]∥The 25th International Conference．Munich Germany,2012
[32] LMBench Benchmark[EB/OL]．http://www.bitmover.com/lmbench/
[33] IOzone[EB/OL]．http://www.iozone.org/
[34] NAS Parallel Benchmark[EB/OL]．http://www.nas.nasa.gov/publications/npb.html
[35] Xavier M G,Neves M V,Rossi F D,et al．Performance Evaluation of Container-based Virtualization for High Performance Computing Environments[C]∥The 21st Euromicro International Conference on Parallel,Distributed,and Network-Based Processing．Belfast,Northern Ireland,2012
[36] SPEC Benchmark[EB/OL]．http://www.spec.org/
[37] Kudryavtsev A,Koshelev V,Pavlovic B,et al．Virtualizing HPC applications using modern hypervisors[C]∥ Proceedings of the Workshop on Cloud Services,Federation,and the 8th Open Cirrus Summit．2012:7-12
[38] 唐源,夏磊,崔峥,等．嵌入虚拟机监视器的高性能虚拟网络[J].仪器仪表学报,2012,33(5):1195-1200
[39] Mauch V,Kunze M,Hillenbrand M．High performance cloudcomputing[J]．Future Generation Computer Systems,2013,9(6):1408-1416
[40] Hillenbrand M,Mauch V,Stoess J,et al．Virtual InfiniBandClusters for HPC Clouds[C]∥The 2nd International Workshop on Cloud Computing Platforms,CloudCP ’12,New York,NY,USA:ACM,2012,9:1-9
[41] Lei Xia,Zheng Cui,Lange J,et al．Vnet/p:bridging the cloudand high performance computing through fast overlay networking[C]∥The 21st international symposium on High-Performance Parallel and Distributed Computing,ser．HPDC 12．New York,NY,USA:ACM,2012:259-270
[42] Lange J,Pedretti K,Dinda P,et al．Minimal-overhead virtualization of a large scale supercomputer[C]∥The 2011ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE)．2011
[43] Takano R,Nakada H,Hirofuchi T,et al．Cooperative VM Migration for a Virtualized HPC Cluster with VMM-Bypass I/O devices[C]∥The 8th IEEE International Conference on eScience．2012
[44] Huang Wei,Liu Jiu-xing,Abali B,et al．A Case for High Performance Computing with Virtual Machines[C]∥The 20th annual International Conference on Supercomputing．2006:125-134
[45] Liu M,Zhai J,Zhai Y,et al．One Optimized I/O Configurationper HPC Application:Leveraging the Configurability of Cloud[C]∥The Second Asia-Pacific Workshop on Systems,ser．APSys ’11．New York,NY,USA:ACM,2011:1-5
[46] Okorafor E．A Fault-tolerant High Performance Cloud Strategy for Scientific Computing[C]∥IEEE International Parallel & Distributed Processing Symp．2011
[47] Niolae B,Cappello F．BlobCR:Efficient Checkpoint-Restart for HPC Applications on IaaS Clouds using Virtual Disk Image Snapshots[C]∥The 24th International Conference for High Performane Computing,Networking,Storage and Analysis．Seattle,USA,2011:1-12
[48] Egwutuoha I P,Chen S,Levy D,et al．A Fault Tolerance Framework for High Performance Computing in Cloud[C]∥The 12th IEEE/ACM International Symposium on Cluster,Cloud and Grid Computing．2012
[49] Naughton T,Vallee G,Engelmann C,et al．A Case for Virtual Machine Based Fault Injection in a High-Performance Computing Environment[C]∥Lecture Notes in Computer Science,Parallel Proceedings Workshops．2012:234-243
[50] Brandt J,Gentile A,Mayo J,et al．Resource monitoring andmanagement with OVIS to enable HPC in cloud computing environments [C]∥The 23rd IEEE International Parallel and Distributed Processing Symposium.Washington DC:IEEE ComputerSociety,2009:1-8
[51] Moschakis I A,Karatza H D．Performance and Cost Evaluation of Gang Scheduling in a Cloud Computing System With Job Migrations and Starvation Handling,[C]∥The 16th IEEE Symposium on Computers and Communications (ISCC 2011)．2011:418-423
[52] Diaz J,Laszewski G V,Wang Fu-gang,et al．FutureGrid Image Management Framework to Support Cloud and HPC Dynamic Provisioning[R/OL]．http://cyberaide.googlecode.com/svn-history/r5739/trunk/papers/a-draft/draft-11-imagemanagement/draft-11-imagemanagement.pdf
[53] 过敏意．绿色计算:内涵及趋势[J]．计算机工程,2010,36(10):1-7
[54] Garg S K,Yeo C S,Anandasivam A,et al．Energy-EfficientScheduling of HPC Applications in Cloud Computing Environments[J]．Computer Science,Distributed,Parallel,and Cluter Computing,2009
[55] Garg S K,Yeo C S,Anandasivam A,et al．Environment-con-scious scheduling of HPC applications on distributed cloud-oriented data centers[J]．Journal of Parallel and Distributed Computing,2011,71(6):732-749
[56] Kessaci Y,Melab N,Talbi E G．A pareto-based GA for schedu-ling HPC applications on distributed cloud infrastructures[C]∥International Conference on High Performance Computing and Simulation (HPCS)．2011:456-462
[57] Kommeri J,Niemi T,Helin O．Energy Efficiency of Server Virtualization[C]∥The Second International Conference on Smart Grids,Green Communications and IT Energy-aware Technologies,2012
[58] BurnInSSE Benchmark[EB/OL]．http://www.roylongbottom.org.uk
[59] Coker R．Bonnie++ Benchmark[EB/OL]．http://www.co-ker.com.au/bonnie++/
[60] SARA HPC Cloud ．https://grid.sara.nl/wiki/index.php/Using_the_HPC_Cloud/betaevaluation
[61] Amazon Elastic Compute Cloud[EB/OL]．http://aws.amazon.com/ec2/,2007-01-01

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed