科學運算在虛擬化環境上的效能評估和自動化調校

Performance Benchmarking and Auto-tuning for Scientific Applications in Virtualized Environment

許克柔

指導教授 ： 周志遠

國立清華大學/電機資訊學院/資訊工程學系/碩士(2014年)

摘要

虛擬化對資源管理有很多好處,像是高資源使用量、低效能耗損、快速失誤復原和彈性的資源配置等。因此,我們觀察到有越來越多資 料中心和私有叢集電腦應用虛擬機器的趨勢。然而,虛擬化也帶來很 多新的挑戰,尤其是對有複雜運算行為和高效能資源需求的科學運算 軟體來說更甚。
在此篇論文中,我們以實際應用的科學運算軟體和效能評估軟體 分析自行建立的私有虛擬叢集電腦的運算效能。我們發現透過適當的 虛擬環境設定和infiniBand的硬體支援(SR-IOV),虛擬化的效能耗損 可以降至極少量。但是,運算效能仍舊難以建模或預測。最後,我們 提出一套自動調校系統,以便找到虛擬環境中,最佳表現和價格的資 源配置。相較於測試所有可能的資源配置,我們證實自動調校系統能 夠快速地找出接近最佳解的答案。

關鍵字

虛擬化 ； 高效能 ； infiniBand ； 自動調校

並列摘要

Virtualization can provide many benefits for managing resources, including higher resource utilization, lower energy cost, faster fault recovery and more flexible re- source provisioning, etc. Hence, we have seen an increasing trend for adapting virtual machine in both datacenters and in-house clusters. However, virtualization also brings several new challenges, especially for scientific applications which have more complex runtime behavior and higher performance demand. In this work, we use real scientific applications and performance benchmarking tools to analyze the application performance of our in-house virtualized cluster. We found the perfor- mance degradation could be minimized with proper virtual machine configuration and the support of hardware virtualized InfiniBand, but the performance is still difficult to be modeled or predicted. Therefore, we developed an auto-tuning tool for finding the best resource provisioning in terms of both time and cost, and show that we can find close to optimal resource provisioning setting in much shorter time than searching though all possible settings.

並列關鍵字

virtualization ； high performance ； infiniBand ； auto-tuning

參考文獻

[1] A. Beloglazov, R. Buyya, Y. C. Lee, and A. Zomaya. A taxonomy and survey of energy-efficient data centers and cloud computing systems. International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), Oct. 2013.

[2] J. Delgado, S. M. Sadjadi, M. Bright, and H. A. Duran-Limon. Performance Prediction of Weather Forecasting Software on Multicore Systems. IEEE IPDPSW, 2010.

[3] P. Gschwandtner, T. Fahringer, and R. Prodan. Performance Analysis and Benchmarking of the Intel SCC. CLUSTER, 2011.

[4] A. Iosup, S. Ostermann, N. Yigitbasi, R. Prodan, T. Fahringer, and D. H. Epema. Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing. IEEE TPDS, 2011.

[6] Y. Kessaci, N. Melab, and E.-G. Talbi. A Pareto-based GA for Scheduling HPC Applications on Distributed Cloud Infrastructures. IEEE HPCS, 2011.