- 期刊
- OpenAccess
Using Redundancy Reduction in Summarization to Improve Text Classification by SVMs
並列摘要
In this paper, we investigate the use of summarization technique to improve text classification. As summarization inherently assign more weights to the more important sentences in an article, this may improve the accuracy of classification of the article. Redundancy in summaries was reduced to different levels and its effect on classification performance was investigated. The classification algorithm used here was Support Vector Machines (SVMs) which has proven to be very effective and robust for text classification problem. Experimental results showed that summaries with lowest redundancy could improve the classification performance of Reuters corpus with more than 6% increase on average F1 measure. In order to explain why summarization can improve the performance while feature selection makes no sense for SVMs, a further experiment was conducted to demonstrate the difference between summarization and traditional feature selection techniques.
被引用紀錄
延伸閱讀
- Chiang, T. H. (2020). Representation Learning for Text Readability [doctoral dissertation, National Taiwan Normal University]. Airiti Library. https://doi.org/10.6345/NTNU202000173
- 熊瀚升（2009）。Improving the Accuracy of Text Categorization byUsing Association Rule with Class Priority〔碩士論文，淡江大學〕。華藝線上圖書館。https://doi.org/10.6846/TKU.2009.00569
- 馮樹仁（2001）。A LSA-based Evaluation System for Text Summarization〔碩士論文，國立臺灣師範大學〕。華藝線上圖書館。https://www.airitilibrary.com/Article/Detail?DocID=U0021-2603200719120095
- Chang, C. T. (2018). A Hybrid Word-Character Approach to Abstractive Summarization [master's thesis, National Taiwan University]. Airiti Library. https://doi.org/10.6342/NTU201801093
- Chen, Y. W. (2005). Combining SVMs with Various Feature Selection Strategies [master's thesis, National Taiwan University]. Airiti Library. https://doi.org/10.6342/NTU.2005.00479