计算机科学 ›› 2015, Vol. 42 ›› Issue (1): 67-70.doi: 10.11896/j.issn.1002-137X.2015.01.015

• 2013年全国理论计算机科学学术年会 • 上一篇    下一篇

高能物理计算环境中KVM虚拟机的性能优化与应用

黄秋兰,李莎,程耀东,陈刚   

  1. 中国科学院高能物理研究所计算中心 北京100049,中国科学院高能物理研究所计算中心 北京100049,中国科学院高能物理研究所计算中心 北京100049,中国科学院高能物理研究所计算中心 北京100049
  • 出版日期:2018-11-14 发布日期:2018-11-14
  • 基金资助:
    本文受国家自然科学基金(11305192,11205179)资助

Performance Optimization and Application of KVM in HEP Computing Environment

HUANG Qiu-lan, LI Sha, CHENG Yao-dong and CHEN Gang   

  • Online:2018-11-14 Published:2018-11-14

摘要: 高能物理是典型的高性能计算的应用,对CPU计算能力要求很高,并且CPU利用率的高低直接影响高能物理的计算效率。虚拟化技术在实现资源共享和资源高利用率方面表现出很大的优势。基于KVM(Kernel-based Virtual Machine)虚拟机进行性能测试和性能优化。首先对KVM虚拟机的处理器、磁盘IO和网络IO等参数进行测试,给出虚拟机和物理机的性能差异和定量分析,然后从KVM虚拟机架构上分析影响KVM性能的各种因素,从硬件级、内核级对影响性能的因素包括扩展页表EPT(Extented Page Table)和CPU的亲和性(CPU affinity)展开研究,以对KVM进行性能优化。优化结果表明,KVM的CPU性能的损失率可以降低至3%左右。最后,给出了高能物理计算的虚拟集群,结果显示虚拟机群的计算性能能够满足高能物理计算的需求。

关键词: 高性能计算,KVM,CPU亲和性,扩展页表

Abstract: High Energy physics computing is a high-performance computing application,which highly requires computing power,and CPU utilization directly affects the computational efficiency of high-energy physics.Virtualization technology has demonstrated a great advantage in achieving high utilization of resources and resource sharing.This paper gave performance testing and optimization of KVM.Firstly,we showed testing results and quantitative analysis of performance between KVM and physical machines in aspect of CPU,disk IO and network IO.Then,we demonstrated various factors in hardware level and kernel level that affect the performance of KVM through the architecture of KVM virtual machine,including EPT (Extended Page Tables) and CPU affinity which are optimized for KVM.Experiment results show the penalty of CPU performance for KVM can be decreased to about 3%.Finally,virtual cluster of high ener-gy computing was shown and the performance of virtual cluster can meet the needs of high energy physics computing.

Key words: HPC,KVM,CPU affinity,Extended page table

[1] Zhang Yang,Chen Wen-bo,Li Lian,et al.Analysis and Implementation of TORQUE:A High-Performance Cluster Job Management System[J].Computer Engineering & Science,2007,10:42
[2] Frey J,Tannenbaum T,Livny M,et al.Condor-G:A Computation Management Agent for Multi-Institutional Grids[J].Cluster Computing,2002,5(3):237-246
[3] Etsion Y, Tsafrir D.A Short Survey of Commercial ClusterBatch Schedulers [J].School of Computer Science and Engineering, The Hebrew University of Jerusalem,2005(13):1-4
[4] Kamay K Y,Laor D,Lublin U.Kvm the Linux virtual machine monitor[C]∥Proceedings of the Linux.2007:225-230
[5] Gepner P,Kowalik M F.Multi-core Processors:New Way toAchieve High System Performance[C]∥Proceeding of the In-ternational Symposium on Parallel Computing in Electrical Engineering.2006:9-13
[6] Guo Zhao-liang,Hao Qin-fen.Optimization of KVM NetworkBased on CPU Affinity on Multi-cores[J].International Conference of Information Technology,Computer Engineering and Management Sciences,2011,4:347-351
[7] HEPSPEC06 benchmark.http://w3.hepix.org/bench-mar-ks/doku.php/
[8] 陈和生,张闯,李卫国.北京正负电子对撞机重大改造工程[J].工程研究-跨学科视野中的工程,2009,1(3):275-281
[9] 郝慧峰.大亚湾反应堆中微子试验中基于VME的RPC电子学研制[D].合肥:中国科技大学,2012
[10] 张朝鹏.基于Intel-VT 处理器的虚拟机内存虚拟化的实现和优化[J].应用科技,2009,123:143-144
[11] 李勇,郭玉东,王晓睿,等.基于EPT的内存虚拟化研究与实现[J].计算机工程与设计,2010,1(18):4101-4104

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!