垃圾郵件分類及特徵選擇組合之分析研究

Analysis of combinations of the spam classification and feature selection

鄭奕騰(Yi-Teng Cheng)

指導教授 ： 周清江

淡江大學/商管學院/資訊管理學系碩士班/碩士(2016年)

https://doi.org/10.6846/TKU.2016.00769

摘要

垃圾郵件氾濫的問題主要是透過垃圾郵件分類過濾垃圾郵件，先依照相關指標選定特徵字集，再依照某個分類演算法進行分類。然而此問題一直沒有獲得徹底解決，需要進一步分析垃圾郵件分類相關特徵字選取指標及分類演算法之特性，以求更佳分類效果。本研究採用TFIDF和IG這兩種特徵字選取指標，並採用權重貝氏和支持向量機這兩種分類演算法，對這些特徵選取指標和分類演算法以各自獨立、交集和聯集的方式，進行組合分析，本研究將透過實驗來比較分析這16種組合在概念漂移情況下之分類效能，並就各組實驗之最佳分類組合，分析在不同時間點之效能及整體穩定度。

關鍵字

郵件分類 ； 概念漂移 ； 特徵選擇 ； 組合分析

並列摘要

The spam-email overflow problems are mainly solved by filtering spam-emails through spam email classifications. They first select a set of feature words according to their indicative figures, and then apply a classification algorithm to decide whether an incoming email is a spam. However, the problem has not been solved completely. There is a need to further analyze related characteristics of the feature words selection indicatives and classification algorithms to achieve better classification effectiveness. We use two feature words selection indicatives: TFIDF (Term Frequency–Inverse Document Frequency) and IG (Information Gain) and two classification algorithms: Weighted Naive Bayesian and SVM (Support Vector Machine) as representatives in the analysis. By using them independently, under the intersection operator, or under the union operator, through experiments in the context of concept drift, we compare the classification effectiveness of these 16 combinations of feature selection indicatives and classification algorithms. Additionally, for each experiment we analyse the classification effectiveness of the best combination different accumulated number of e-mails. Stability of the combination is also discussed.

並列關鍵字

e-mail categorization ； concept drift ； feature selection ； combination analysis

參考文獻

[1] 陳昱辰，一個處理概念漂移的垃圾郵件分類演算法，淡江大學資訊管理學系碩士論文，2009

[4] Delany, S. J., Cunningham, P., Tsymbal, A., & Coyle, L. (2005). A case-based technique for tacking concept drift in spam filtering. Knowledge-Based Systems, 187-195

[6] Drucker, H., Wu, D., & Vapnik, V. N. (1999). Support vector machines for spam categorization. IEEE Transactions on Neural Networks, Vol. 10, No. 5, 1048-1054.

[7] Fdez-Riverola, F., Iglesias, E. L., Díaz, F., Méndez J. R., & Corchado, J. M. (2007). Applying lazy learning algorithms to tackle concept drift in spam filtering. Expert Systems with Applications, Vol.33, No.1, 36-48

[8] Hsiao, W. F., & Chang, T. M. (2008). An incremental cluster-based approach to spam filtering. Expert Systems with Applications, Vol.34, No.3, 1599-1608