分散式運算中資源資訊與探索之非集中化管理

Decentralized Management of Resource Information and Discovery in Large-Scale Distributed Computing

鍾武君(Wu-Chun Chung)

指導教授 ： 鍾葉青

國立清華大學/電機資訊學院/資訊工程學系/博士(2013年)

摘要

由於運算能力與服務的需求與日俱增，驅使著大規模分散式運算系統邁入新的典範，例如格網運算以及雲端運算，為了能有效管理散佈於網路上的各種資源，資源資訊與探索系統致力於記錄資源屬性的狀態以及尋找滿足需求的資源。隨著系統規模擴大時，整合分散於電腦網路上的資源藉以避免通訊瓶頸、單點失效或是負載不平衡等問題，將是一門重大的課題。有鑑於此，一套適用大規模分散式資源的非集中化管理方式逐漸備受矚目，因此，講究延展性與穩健性而發展的點對點技術，深受這類型的環境所青睞。
　　在本論文中，我們針對分散式運算環境的非集中化資源管理進行一系列的探討。首先，對於格網運算結合點對點技術的可行性，我們提出非集中式的格網對格網框架，藉由協調分屬不同格網的資源得以實現格網聯盟的目的。接著對於大規模的運算環境，我們深入探討利用同儕網路的架構，如何進行資源資訊與探索的研究方法，並針對結構式與非結構式的網路架構提出相對應的解決方案，實驗結果顯示我們的方法在非集中化的管理下，能夠有效地組織散落在分散式環境中的資源資訊，並探索出可供運算使用的資源。最後我們考慮到分散式運算系統中，若廣泛使用疊蓋式網路將會衍生過多的維護成本，如何節省重複的維護成本激發我們提出適用於多個疊蓋式網路環境的協同合作策略，實驗證實採用我們的方法可以大幅減少維護多個疊蓋式網路所造成的額外負擔。

關鍵字

分散式系統 ； 非集中化管理 ； 格網運算 ； 雲端運算 ； 同儕網路 ； 資訊系統 ； 資源探索 ； 負載平衡 ； 協同策略 ； 疊蓋式網路維護

並列摘要

The increasing demand of computing power and services derives the development of new paradigm of large-scale distributed computing systems such as Grids and Clouds. To efficiently manage the diverse and scattered resources, the resource information and discovery system is employed to record the status of resource attributes and locate the resource fulfilled the requirement of demands. As the scale of a system expands, the major difficulty is to prevent a communication bottleneck, a single point of failure or the load imbalance by the federation of resources distributed over computer networks. In view of this, a decentralized management for large-scale distributed resources comes out with more attentions. With the inherent properties of scalability and robustness, the Peer-to-Peer (P2P) approach is attractive to such environments.
　　In this dissertation, we conduct a series of studies on the decentralized resource management for distributed computing environments. The first study investigates the synergy between Grids and P2P, in which a decentralized Grid-to-Grid (G2G) framework is introduced to harmonize autonomic Grid resources in realizing the Grid federation. Second, a further exploration of employing the P2P network is conducted on resource information and discovery for large-scale computing environments. We propose corresponding solutions for both structured and unstructured networks. The main results show that our approaches are able to efficiently organize the resource information among the distributed environment and locate those available resources under the decentralized management. Finally, the third study, we are concerned with the overlay maintenance if multiple overlays co-habit in the distributed computing system. How to simplify the common overlay-maintenance is motivated us to come up with a cooperative strategy for the multi-overlay maintenance. Experimental results demonstrate that the cost of multi-overlay maintenance could be significantly decreased while applying our approach.

並列關鍵字

Distributed System ； Decentralized Management ； Grid Computing ； Cloud Computing ； P2P Network ； Information System ； Resource Discovery ； Load Balance ； Cooperative Strategy ； Overlay Maintenance

參考文獻

[27]　Chin-Jung Hsu, Wu-Chun Chung, Kuan-Chou Lai, Kuan-Ching Li, and Yeh-Ching Chung, "Cooperative Failure Detection in Multi-Overlay Environments," Journal of Internet Technology, vol. 12, no. 2, 2011, pp. 259-267.

[3]　Chaitanya Baru, Reagan Moore, Arcot Rajasekar, and Michael Wan, "The SDSC Storage Resource Broker," in Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research (CASCON), Toronto, Ontario, Canada, 1998, pp. 5-16.

[4]　Ashwin R. Bharambe, Mukesh Agrawal, and Srinivasan Seshan, "Mercury: Supporting Scalable Multi-Attribute Range Queries," in Proceedings of the 2004 conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM), Portland, Oregon, USA, 2004, pp. 353-366.

[5]　Min Cai, Martin Frank, Jinbo Chen, and Pedro Szekely, "MAAN: A Multi-Attribute Addressable Network for Grid Information Services," Journal of Grid Computing, vol. 2, no. 1, 2004, pp. 3-14.

[10]　Ann Chervenak, Ian Foster, Carl Kesselman, Charles Salisbury, and Steven Tuecke, "The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets," Journal of Network and Computer Applications, vol. 23, no. 3, 2000, pp. 187-200.