- 期刊
A Component Histogram Map Based Text Similarity Detection Algorithm
並列摘要
The conventional text similarity detection usually use word frequency vectors to represent texts. But it is high-dimensional and sparse. So in this research, a new text similarity detection algorithm using component histogram map (CHM-TSD) is proposed. This method is based on the mathematical expression of Chinese characters, with which Chinese characters can be split into components. Then each components occurrence frequency will be counted for building the component histogram map (CHM) in a text as text characteristic vector. Four distance formulas are used to find which the best distance formula in text similarity detection is. The experiment results indicate that CHM-TSD achieves a better precision, recall and F1 than cosine theorem and Jaccard coefficient.
延伸閱讀
- Li, F. Y., & Wei, W. M. (2016). Encrypted Image Retrieval with Scalable Color Histograms. 網際網路技術學刊, 17(1), 147-155. https://doi.org/10.6138/JIT.2016.17.1.20151109d
- Liu, H. H., & Liu, C. L. (2019). UNIVERSAL STEGANALYSIS METHOD FOR SPATIAL DOMAIN STEGANOGRAPHY TECHNIQUE BASED ON PREDICTION-ERROR HISTOGRAM FEATURE. 技術學刊, 34(1), 37-53. https://www.airitilibrary.com/Article/Detail?DocID=10123407-201803-201904190006-201904190006-37-53
- Kan, K. F. (2002). Maintenance of partial-sum-based histograms [master's thesis, The University of Hong Kong]. Airiti Library. https://www.airitilibrary.com/Article/Detail?DocID=U0029-1812201200010268
- Lin, X., Zeng, X., Pu, X., & Sun, Y. (2015). A Cardinality Estimation Approach Based on Two Level Histograms. Journal of Information Science and Engineering, 31(5), 1733-1756. https://doi.org/10.6688/JISE.2015.31.5.13
- 陳煒傑（2012）。A Histogram-Based Multi-Threshold Searching Algorithm for Multiple Color Objects Segmentation〔碩士論文，淡江大學〕。華藝線上圖書館。https://doi.org/10.6846/TKU.2012.00898