以基因規劃法建構案例推理決策樹

A Case-Based Reasoning (CBR) Tree:The Genetic Programming Approach

王博群(Pro Chin Wang)

指導教授 ： 邱昭彰

元智大學/資訊學院/資訊管理學系/碩士(2004年)

摘要

在案例推理(CBR)研究中，主要應透過案例推理機制找出最符合現行問題需求之結果。在本研究使用機器學習的技術包括基因規劃法(GP)及基因演算法(GA)來產生CBR tree以提升單一CBR案例推理系統之學習能力。基因規劃法用於建立案例切割規則來區隔各子案例庫；基因演算法用以求出各子案例庫下特徵屬性比對相似值的對應權重。本研究乃利用UCI及DELVE資料庫中，包含分類及推估問題共六組實驗資料進行模式建構，同時也應用GA-CBR 、C5.0及CART三種技術進行實驗並比較其學習成效。實驗結果顯示CBR tree效果明顯比其它三種技術優越。

關鍵字

基因規劃法 ； 基因演算法 ； 案例推理 ； 機器學習 ； 決策樹

並列摘要

A critical issue must be correctly recognized in case-based reasoning (CBR) that is to retrieve not just a similar historical case but a usefully similar case from case base to the target problem. For this reason, this paper examines application of machine learning techniques, genetic programming (GP) and genetic algorithm (GA) to the integration of domain knowledge into the CBR. We call the integrated system GP-Based CBR tree system in this paper. First, we apply classification problems based on GP for case base and split up into several subcase bases in accordance with some important features from case base. Second, GA would be used to determine weight sets for features similarity degree of several subcase bases, and we call this part GA-CBR. The CBR tree reaps the benefits of three systems. The hybrid approach combined GP and GA both techniques with CBR systems for increasing the overall accuracy. We experimentally assess six datasets and accuracy of generated was comparable to four approaches that were CBR tree, GA-CBR, C5.0 and CART over six datasets.

並列關鍵字

genetic programming ； genetic algorithms ； case-based reasoning ； machine learning ； decision tree

參考文獻

[3] Aly, W.M., Sheta, A.F. and Abdelaziz, A.R., "Development of Evolutionary Models for Long-Term Load of Power Plant Systems," ACS/IEEE International Conference on Computer Systems and Applications, pp.117, 2003.

[4] Apte, G. and Weiss, S., "Data Mining with Decision Trees and Decision Rules," Future Generation Computer Systems , Vol. 13, pp.197-210, 1997.

[5] Brameier, M. and Banzhaf, W., "A Comparison of Linear Genetic Programming and Neural Networks in Medical Data Mining,"IEEE Transactions on Evolutionary Computation, Vol. 5, Issue:1, pp.17-26, 2001.

[7] Breslow, L. and D. W. Aha, "Simplifying Decision Trees: A Survey," Knowledge Engineering Review, Vol. 12, pp.1-40, 1997.

[8] Brill, F.Z., Brown, D.E. and Martin, W.N., "Fast Genetic Selection of Features for Neural Network Classifiers," IEEE Transactions on Neural Networks, Vol.3, pp.324-328, 1992.