- 學位論文
Learning Combating Strategies in Real Time Strategy Games Based on Genetic Algorithms and Transfer Learning
基於基因演算法與轉移學習學習即時戰略遊戲中之戰鬥策略
摘要
A Real Time Strategy (RTS) Game is a game which simulates the real war and can be seen as a useful way to develop tactical, strategic and doctrinal solutions. To defeat enemies with equivalent competitive conditions is a novel and interesting issue in developing combating strategies in real-time strategy games. Genetic algorithms (GA) are heuristic search methods which simulate the natural evolution according to Darwin's theory of evolution and appropriate for solving search and optimization problem. GA is effective in the problems which contain uncertainty and then suitable in the developing strategies in RTS game. Transfer Learning is a method to improve the learning in the new task via using the previous learning experience and result in the similar tasks. We can save or avoid the learning time in solving the new problem by using the transfer learning. In this thesis, first we implement genetic algorithms by developing the military strategies and tactical formations in a simplified RTS game platform then build robust AI bots to defeat enemies with fixed formations and strategies. In the second part, we use transfer learning to improve and accelerate the evolving procedure of genetic algorithms by modifying the population via the evolved robust AI bots. The last part we combine the evolved result to construct a robust AI bot without evolution and gain the improvement. The winning percentage of the combination result is better than a robust bot which is evolved in another similar domain; it shows the success of applying transfer learning in this domain.
並列摘要
即時戰略遊戲為模擬戰爭之遊戲，並可視為一種用於發展戰術、策略之良好方法。於即時戰略遊戲中，如何於對等條件中，發展良好的策略及隊形以擊敗敵人為一值得探討的議題。 基因演算法(Genetic Algorithm)為以自然演化概念形成之演算法，適用於各式求解及最佳化問題，並於充斥不確定因素之問題環境有良好成效；而即時戰略遊戲之戰爭策略發展即為其適切之應用領域。轉移學習(Transfer Learning)為一利用先前機器學習所學習過的經驗及結果，改善或強化新問題之學習過程之方法，利用轉移學習，將可節省於新問題之機器學習時間，甚者更可直接利用經驗結果進行分析應用於新問題之解決，無需學習時間。 在此篇論文中，藉一簡化之即時戰略遊戲平台，首先以基因演算法進行戰術策略及戰鬥隊形之研發演化，用於建立強大人工智慧之機器人程序(AI bot)，其為一能擊敗特定敵人之隊形與戰略組合。次利用轉移學習進行基因演算法之改善，利用已演化之經驗結果之強大人工智慧機器人程序，改良原基因演算法之初始族群分布，以加速演化速度。第三部份以轉移學習之方式，將已演化之經驗結果進行組合，結合為無需演化過程之人工智慧機器人程序，並獲得初步成效，組合結果之勝率已優於直接利用演化結果進行對戰之勝率，說明轉移學習應用於此問題之成功。