使用參數數值預測法最佳化記憶體效能於大規模應用程式

Optimizing Memory System Performance for Large Scale Applications via Parameter Value Prediction

周錦彥(Chin-Yen Chou)

指導教授 ： 廖世偉

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2009年)

https://doi.org/10.6342/NTU.2009.10590

摘要

無資料

關鍵字

資料中心 ； 記憶體 ； 硬體預取 ； 機器學習 ； 硬體事件

並列摘要

A typical data center application requires the processor cycles of thousands of machines. Even a single-digit performance improvement can significantly reduce the cost and power consumption of a data center. Unfortunately, achieving sustained improvement, even if modest, is difficult. Data centers are dynamic environments where applications are frequently released and servers are continually upgraded. For maintainability and fault tolerance, the physical capabilities and configuration of the servers are abstracted from the application programmer.
In this paper, we study application performance under different processor prefetch configurations. These configurations are largely transparent to the programmer, yet we observe a wide range of performance when comparing the worst and best configurations, with relative performance improvement ranging from 1.4% to 75.1%. Alarmingly, one application that consumes many processor cycles has a 23.6% improvement.
Default prefetch configurations favor aggressively prefetching memory, which benefits most applications, but some data center applications have highly tuned memory behavior and aggressive prefetching severely decreases performance. We develop a tuning framework which attempts to predict the optimal configuration based on hardware performance counters. It applies to a large number of performance-critical data center applications without modifying the source code or binaries. The framework achieves performance within 1% of the best performance of any single configuration for 11 important data center applications.

並列關鍵字

Data center ； Memory ； Hardware prefetch ； Machine learning ； Hardware events

參考文獻

[2] perfmon2: the hardware-based performance monitoring interface for Linux. perfmon2.sourceforge.net.

[3] Agakov, F., Bonilla, E., Cavazos, J., Franke, B., Fursin, G.,O'Boyle, M. F. P., Thomson, J., Toussaint, M., and Williams, C. K. I. Using machine learning to focus iterative optimization. In CGO '06: Proceedings of the International Symposium on Code Generation and Optimization (Washington, DC, USA, 2006), IEEE Computer Society, pp. 295-305.

[4] Aha, D. W., and Kibler, D. Instance-based learning algorithms. Machine Learning 6, 1 (1991), 37-66.

[5] Buhmann, M. D. Radial Basis Functions : Theory and Implementations. Cambridge University Press, Cambridge, UK, 2003.

[9] Hartigan, J. A., and Wong, M. A. A k-means clustering algorithm. Applied Statistics 28, 1 (1979), 100-108.