中文語意結構在垃圾信過濾的應用

為了阻擋垃圾信件, 各界都有所努力, 例如各個國家紛紛成立「反制垃圾郵件法」(「或稱垃圾郵件管制法」), 軟體公司發展防毒以及防惡意程式的軟體等等, 但是即使有再好的防護還是未能完全阻絕。一般使用資料採礦的方法辨別垃圾郵件, 大部分都是從技術方面提升其分類效用, 像是改良分類器或是尋求更好的分類方法,甚少從資料輸入這一部分著手, 本篇論文主要的目的就是透過改善資料輸入的方式, 來使得分類效果提升。在此考慮了三種類型的輸入變數組合, 除了14個寄件者行為特徵以及20個經由TF-IDF 權重計算所挑選的關鍵字是由前人所提出之外, 我們加入了24個語意成份(也就是各個詞語的詞性) 來表達垃圾郵件寄送者在郵件書寫時的方式。由C4.5、多層感知機以及機率神經網路所驗證的結果來看, 若是加入24個語意成份作為輸入變數, 其效果會比只有14個行為特徵變數加上關鍵字還要好。

關鍵字

垃圾郵件；資料採礦；中文斷詞；機率類神經網路；多層感知機； C4.5

並列摘要

In order to prevent spam mails, there are many achievement from the collective efforts of all sectors, although the protections become better and better, the challenges remain. The study focus on how much information is added in the odel, for this reason we hope to explain the output by meliorated version of input elements. We use 14 features of sender’s behavior and 20 keywords which calculated to be the most effectiveness by TF-IDF. Besides that, we proposed 24 new variables of semantic component that simulated the habits of writer and considered the expression between spam e-mail sender and ligitimate e-mail sender. The result shows that simultaneous use of all variables achieve the best results from the point of view of classifiers whatever in C4.5, MLP, or PNN.

並列關鍵字

spam ； data mining ； Chinese Word Segmentation ； MLP ； PNN ； C4.5

參考文獻

[3] Ahmad, Nor Shafrin, Nor Hashimah Hashim, and Rahimi Che Aman. [2007], “Ado-lescent Emotional Expression and Regulation: A Case Study in Malaysia”, The In-ternational Journal of Interdisciplinary Social Sciences, 5, 45–56.

[5] Cang, S. [2005], “Novel probabilty neural network”, IEE Proceedings - Vision Image

and Signal Processing, 152, pp. 535–544.

[6] Cang, S. and H. Yu [4-8 July 2005], “A Probabilty Neural Network for Continuous and Categorical Data”, in Proceedings of the 16th IFAC World Congress, Prague.

[8] Chou, Ying-Chieh [2007], The Application of Back-Propagation Network in E-mail

國際替代計量

中文語意結構在垃圾信過濾的應用

全文下載

主題瀏覽