應用派翠網路於Hadoop MapReduce 框架之建模與分析

Modeling and Analysis of Hadoop MapReduce Framework Using Petri Nets

何鴻緯(Hung-Wei Ho)

指導教授 ： 沈榮麟

國立臺北大學/電機資訊學院/資訊工程學系/碩士(2015年)

摘要

隨著科技的發展，公司企業的資料量日益龐大，進而發展出新的“雲端運算”、 “巨量資料” 概念，以及結合兩者使用的雲端運算作巨量資料分析的商機。Hadoop用在雲端運算系統的架設是非常熱門的，有許多雲端運算系統採用Hadoop作為實行之方法。其中，MapReduce框架為Hadoop進行巨量資料分析的核心，透過MapReduce的平行化架構可以大幅增加巨量資料分析的效率。本論文使用派翠網路針對MapReduce做視覺化建模，並驗證此模型滿足Reachability性質，再提出一個實際的巨量資料分析系統來驗證此模型的可行性，詳細描述了MapReduce平行化的內部細節，並指出在系統開發的過程中可能會犯下的錯誤，再以派翠網路模型提出錯誤預防機制，避免系統開發者與系統使用者犯錯，進而使系統開發能更有效率。

關鍵字

Visualization ； Reachability ； Petri nets ； MapReduce ； Hadoop ； Parallelization

並列摘要

Technological advances have significantly increased the amount of corporate data available, which has created a wide range of business opportunities related to big data and cloud computing. Hadoop is a popular programming framework used for the setup of cloud computing systems. The MapReduce framework forms the core of the Hadoop program for parallel computing and its parallel framework can greatly increase the efficiency of big data analysis. This study used Petri nets to create a visual model of the MapReduce framework and verify its reachability. We present an actual big data analysis system to demonstrate the feasibility of the model, describe the internal procedures of the MapReduce framework in detail, list common errors during the system development process and propose error prevention mechanisms using the Petri net model in order to increase efficiency in the system development.

並列關鍵字

Visualization ； Reachability ； Petri nets ； MapReduce ； Hadoop ； Parallelization

參考文獻

[4] N. Q. Wu and M. C. Zhou, System Modeling and Control with Resource-Oriented Petri Nets, CRC Press, New York, 2010.

[5] T. Murata, “Petri nets: properties, analysis, and applications,” Proc. IEEE, vol. 77, no. 4, pp. 541–580, Apr. 1989.

[6] A. Negahban and J. S. Smith, “Simulation for manufacturing system design and operation: literature review and analysis,” Journal of Manufacturing Systems, vol. 33, no. 2, pp. 241–261, Apr. 2014.

[8] Y. Ru and C. N. Hadjicostis, “Bounds on the number of markings consistent with label observations in Petri nets,” IEEE Trans. Autom. Sci. Eng., vol. 6, no. 2, pp. 334–344, Apr. 2009.

[9] J. Rosell, “Assembly and task planning using Petri nets: A survey,” J. Eng. Manuf., vol. 218, no. 8, pp. 987–994, Aug. 2004.