演化式類神經網路分類技術於資料探勘上之應用

Hybrid Neural Network Classification Techniques in the Application of Data Mining

呂奇傑(Chi-Jie Lu)

指導教授 ： 李天行 ； 邱志洲

輔仁大學/管理學院/應用統計研究所/碩士(2002年)

摘要

由於商業環境不斷快速變遷，迫使企業必須持續求新求變來因應。企業要能夠生存、發展，進而爭取市場競爭的主導權，除了不斷提昇產品的市場價值，更重要的是必須能有效地掌握市場資訊、迅速因應各種來自內外在環境的變化與挑戰。而在資訊科技的推波助瀾下，現今企業所面對的是一個與以往截然不同的競爭環境，不僅企業競爭的強度與速度倍數於以往，激增的市場交易也使得各企業所需儲存與處理的資料量越來越龐大。在這種情況下，企業的焦點已從以往的資料蒐集與整理，轉變成如何有效的利用資料庫來進行資訊的獲取。換言之，企業如何因應外界的競爭，有效的利用資料探勘（data mining）的技術與觀念，在龐大的資料庫中尋找出有價值的隱藏事件，以反應市場或消費者的需求，已成為各企業急於解決的重要議題之一。
本研究嘗試提出兩種演化式類神經網路的分類技術，一為整合傳統的鑑別分析與類神經網路，另一個則是整合模糊鑑別分析與類神經網路來進行資料探勘中判別模式的建立。主要的研究目的乃針對使用類神經網路其學習、收斂速度較慢的缺點進行改善，期望經由傳統鑑別分析與模糊鑑別方法的額外輸入資訊，以提供類神經網路一個良好的空間搜尋起始原點，再透過類神經網路的學習、辨識能力，來發展一個更為快速、精確的判別模式。為驗證提出方法的可行性，本研究針對兩種不同資料進行判別模式的建構，其一為統計教科書中常用的鳶尾花資料；另一個則為台灣某大型銀行的信用卡客戶申請資料。根據研究結果顯示，在二個實證資料下，類神經網路與鑑別分析、模糊鑑別分析之判別績效是優劣互見。而本研究所提之演化式類神經網路分類技術，不管是在鳶尾花或是銀行信用卡的資料上，其判別結果均較單純使用類神經網路者為佳，且網路收斂速度也較快；再者，與鑑別分析及模糊鑑別分析相較，演化式模糊類神經網路分類技術在鳶尾花資料的判別結果上與模糊鑑別分析相同；但在銀行信用卡資料上，判別結果則較模糊鑑別分析為佳。

關鍵字

資料探勘 ； 類神經網路 ； 鑑別分析 ； 模糊鑑別分析 ； 分類問題

並列摘要

Data mining is the art of finding patterns in data and is a new approach based on a general recognition that there is undraped value in large databases and utilities data-driven extraction of information. However, it is still not easy to identify the complicate relationship in the huge data set. Moreover, in most case, the estimation of parameters or the classification results can not really describe the realization of business modeling. The artificial neural network is becoming a very popular alternative in prediction and classification task due to its associated memory characteristic and generalization capability. However, neural network has been criticized by its long training process in the application of classification problems. In order to solve the above-mentioned drawback, the proposed study trying to explore the performance of data classification by integrating the artificial neural networks technique with the linear discriminant analysis and fuzzy discriminant analysis approach respectively.
To demonstrate the inclusions of the classification results from the linear discriminant and fuzzy discriminant analysis would improve the classification accuracy of the designed neural networks, classification tasks are performed on two data sets, the often used Iris data and one practical bank credit card data. As the results reveal, the two proposed integrated approach provides a better initial solution and hence converges much faster than the conventional neural networks. Besides, in comparison with the traditional neural network approach, the classification accuracies increase for both cases in terms of the two proposed methodology. Moreover, the superiority of the proposed technique can be observed by comparing the classification results using only linear discriminant or fuzzy discrimintant analysis approaches.

並列關鍵字

Data Mining ； Linear Discriminant Analysis ； Fuzzy Discriminant Analysis ； Neural Network ； Classification

參考文獻

Bowen, J.E., “Using Neural Nets to Predict Several Sequential and Subsequent Future Values from Time Series Data”, The First International Conference on Artificial Intelligence in Wall Street, 1991, pp.30-34.

Chu, C.H. and Widjaja, D. “Neural Network System for Forecasting Method Selection”, Decision Support System, Vol.12, 1994, pp.13-24.

Craven, M.W. and Shavlik, J.W. “Using Neural Networks for Data Mining”, Future Generation Computer Systems, Vol. 13, 1997, pp. 221-229.

Cybenko, G. “Approximation by Superpositions of a Sigmoidal Function”, Mathematical Control Signal Systems, Vol. 2, 1989, pp. 303-314.

Davies, P.C. “Design Issues in Neural Network Development”, NEUROVEST Journal, 1994, pp. 21-25.