基於多元化部落格網頁之自動化擷取部落格主要文章

近年來，部落格為主的相關研究蓬勃發展，例如：意見檢索、情緒分析。因此，擷取部落格的主要文章即是一個不可或缺的步驟。在此篇論文中，我們將探討如何從各式各樣的部落格網頁精確且自動化的擷取部落格的主要文章。許多先前的研究著重於擷取新聞網頁的主要文章，若將其應用於部落格網頁並無顯著的效果，這是由於部落格網頁風格五花八門且文章內容包含多種格式，致使擷取部落格主文變得較為複雜。針對此問題，我們結合MSS [24] 和CETR [34] 這兩篇論文的研究並加以修改調整，提出兩個部落格主文擷取的方法。第一個方法為PTR Scoring，結合了Post-to-Tag Ratio和Maximum Scoring Subsequence，是一個非監督式演算法。第二個方法為CRF Scoring，透過Conditional Random Fields此機率模型並利用Maximum Scoring Subsequence提升擷取的準確率。實驗結果顯示CRF Scoring的F-Measure可達到91.9%，是本篇論文中準確率最高的擷取方法。本篇論文所提出之方法可應用於PDA、手機…等螢幕較小的裝置，以及提升部落格搜尋引擎的效能，並提供後續相關研究之參考與幫助。

關鍵字

最大加總子序列；序列標記；資訊檢索；部落格

並列摘要

With the rapid development of the blogosphere, blog post extraction is an essential task for researches on blogosphere. However, very little attention has been given specifically to blog post extraction. In this paper, we address the issue of extracting blog posts from diverse blog pages, which aims at automatically and precisely finding the location of each blog post. Most of previous researches focused on extracting main content from news pages, but the problem becomes more complex when one turns to blog pages, since some blog posts may employ a variety of content formats concurrently and miscellaneous information could negatively affect the accuracy of extraction. Our research is based on the combination of MSS [24] and CETR [34] to develop algorithms that are suitable for blog pages. The 1st method that we propose is PTR Scoring, which combines Post-to-Tag Ratio with maximum scoring subsequence. The 2nd method is CRF Scoring, which applies Conditional Random Field to train models and use maximum scoring subsequence to improve the accuracy of extraction. The experimental results show that CRF Scoring achieves the best F-Measure at 91.9% among existing methods.

並列關鍵字

blog post extraction ； sequence labeling ； maximum subsequence

參考文獻

[1] L. Bing, Y. Wang, Y. Zhang and H. Wang. “Primary Content Extraction with Mountain Model”, CIT, IEEE, 2008, pp. 479–484.

[3] D. Cao and X. Liao and S. Bai. “Blog Post and Comment Extraction Using Information Quantity of Web Format”, AIRS, ACM, 2008, pp. 298–309.

[4] S. Debnath, P. Mitra, and C. L. Giles. “Automatic extraction of informative blocks from webpages”, SAC, ACM, 2005, pp. 1722–1726.

[5] S. Debnath, P. Mitra, and C. L. Giles. “Identifying content blocks from web documents”, ISMIS, 2005, pp. 285–293.

[8] J. Gibson, B. Wellner, S. Lubar. “Adaptive Web-page Content Identification”, WIDM, ACM, 2007, pp. 105-112.

國際替代計量

基於多元化部落格網頁之自動化擷取部落格主要文章

未授權

主題瀏覽