Development of an In-House Grid Testbed Supporting Scheduling and Execution of Scientific Workflows

Harshadkumar B. Prajapati ； Vipul A. Shah

《MIS REVIEW：An International Journal》 20卷2期 (2015/03) Pp. 77-104

https://doi.org/10.6131/MISR.2015.2002.04

並列摘要

Researchers working in Grid workflow scheduling need a real Grid environment to produce the results of experiments. However, many interested researchers of academic institutes may not be able to produce experimental results due to unavailability of a required testbed at their institutes. This article addresses an important challenge of developing an in-house Grid testbed that supports workflow scheduling and execution. This article proposes the architectural design of the in-house testbed and then concisely presents chosen software tools, their understanding, installation, configuration, and the testing related to the implementation of the testbed. Furthermore, the article also presents the methodology of performing experiments on the testbed. The in-house Grid testbed is implemented using open-source, freely available, and widely used software components. In addition, the testbed allows to produce a real Grid scenario of varying bandwidth values by emulating the network characteristics among the Grid-sites of the testbed. This article addresses testing of all the internal components of the testbed and their integrations for their proper working. This article also provides testing and demonstration of workflow scheduling and execution. We believe that this article can educate novice users about developing a Grid testbed. The presented Grid testbed can easily be replicated or adapted; furthermore, the presented deployment of the Grid testbed can guide to researchers for carrying out real experimentation for their research purposes.

並列關鍵字

Grid Testbed ； Grid Deployment ； Grid Software Integration ； Workflow Scheduling ； Workflow Execution

參考文獻

(Allcock, W., Bester, J., Bresnahan, J., Chervenak, A., Liming, L. and Tuecke, S. (2003), 'GridFTP: protocol extensions to FTP for the grid', GFD-RP 20, Global Grid Forum, Muncie, IN.).

Altintas, I.,Berkley, C.,Jaeger, E.,Jones, M.,Ludascher, B.,Mock, S.(2004).Kepler: an extensible system for design and execution of scientific workflows.Proceedings of 16th International Conference on Scientific and Statistical Database Management.(Proceedings of 16th International Conference on Scientific and Statistical Database Management).:

Amin, K.,Von Laszewski, G.,Hategan, M.,Zaluzec, N.J.,Hampton, S.,Rossi, A.(2004).Gridant: a client-controllable grid workflow system.Proceedings of the 37th Annual Hawaii International Conference on System Sciences.(Proceedings of the 37th Annual Hawaii International Conference on System Sciences).:

Berman, F.,Chien, A.,Cooper, K.,Dongarra, J.,Foster, I.,Gannon, D.(2001).The grads project: Software support for high-level grid application development.International Journal of High Performance Computing Applications.15(4),327-344.

Bester, J.,Foster, I.,Kesselman, C.,Tedesco, J.,Tuecke, S.(1999).Gass: a data movement and access service for wide area computing systems.Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems.(Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems).: