運用微服務架構於智慧數據分析平台建構之研究

伴隨著行動裝置及物聯網的發展，人們每日所能產生的資料量有著爆炸性的成長，為了從這些數據中取得真正需要被關注的知識，以此協助政府制定政策、研究並預測未來趨勢，數據分析成為了近年來備受矚目的議題。現今，有許多的資料分析工具及軟體被開發及應用在許多領域之中，各自獨立的開發及設計使得分析工具變得零碎，除了部分軟體需要指定的硬體及作業系統方能運作外，不同語言開發的分析方法無法互通，進行跨語言及分析模組之整合，導致無法有效利用及使用這些工具。微服務架構透過組合多個小型可獨立運行的服務完成系統功能，除了利於系統的擴展外，亦使得跨語言的分析服務開發變成了可能，相較於服務導向架構採用集中且單一語言的服務建置方式，隨著服務的擴展便難以進行更新及擴充之侷限性，微服務架構能夠有較好的表現與可開發性。對此，本研究提出了一個基於微服務架構所建置之雲端數據分析平台，透過介面結合視覺化工作流及友善使用者介面之設計，利用步驟式的引導協助使用者逐步建立資料探勘流程。除此之外，本研究更透過將分析工具進行封裝，並使用訊息通道之方式進行雲端分析工作之建立與派發，利用工作調度器達成按需啟動地分析工作有效的利用雲端運算資源，使用者僅需要透過瀏覽器即可在任何地點進行資料蒐集及處理，並使用多種不同的分析工具於雲端平台中進行分析。

關鍵字

雲端運算；微服務架構；資料探勘；工作流

並列摘要

With the progress of Mobile Device and Internet of Things, people generate huge volumes of data in their daily life. Extract the knowledge which should be the focus on data, to help government formulating policies, studying or predicting future trends has been more and more important. Therefore, the issue with Data Mining become popular in the recent study. Nowadays, there are lots of useful analysis tools and software released and used in multiple domains for knowledge extraction, but stand-alone development and design cause tools become fragmentation. Some software requires specific hardware and operating system to be used, only use specific program language to extend the function and difficult interactive use, result in cannot be used effectively. However, the propose of Microservice Architecture make the cross-language service development comes true, by using and combine multiple services to complete the system service. Thus, this study proposes a cloud data analysis platform based on Microservice Architecture. Use the visual workflow design and friendly user interface to help user creating create the analysis process step-by-step. In the other side, our study also packs each analysis method to single component, using message broker passing the job to analyze in a cloud, and through the job tracker to start component on demand for saving the cloud computing resource. Users can not only collect data on the fly but also use multiple analysis tools to analyze through our cloud platform using the web browser.