Frequency, Collocation, and Statistical Modeling of Lexical Items: A Case Study of Temporal Expressions in Two Conversational Corpora

Sheng-Fu Wang ； Jing-Chen Yang ； Yu-Yun Chang ； Yu-Wen Liu ； Shu-Kai Hsieh

《中文計算語言學期刊》 Volume 17 Issue 2 (2012/06) Pp. 37-54

https://doi.org/10.30019/IJCLCLP.201206.0003

Parallel abstracts

This study examines how different dimensions of corpus frequency data may affect the outcome of statistical modeling of lexical items. Our analysis mainly focuses on a recently constructed elderly speaker corpus that is used to reveal patterns of aging people's language use. A conversational corpus contributed by speakers in their 20s serves as complementary material. The target words examined are temporal expressions, which might reveal how the speech produced by the elderly is organized. We conduct divisive hierarchical clustering analyses based on two different dimensions of corporal data, namely raw frequency distribution and collocation-based vectors. When different dimensions of data were used as the input, results showed that the target terms were clustered in different ways. Analyses based on frequency distributions and collocational patterns are distinct from each other. Specifically, statistically-based collocational analysis generally produces more distinct clustering results that differentiate temporal terms more delicately than do the ones based on raw frequency.

Parallel keywords

Clustering ； Collocation ； Corpus Linguistics ； Temporal Expression ； Gerontology

References

Baayen, R. H.(2008).Analyzing linguistic data. A practical introduction to statistics using R.Cambridge:Cambridge University Press.

Bruke, D. M.,Shafto, M. A.(2004).Aging and language production.Current directions in psychological science.13,21-24.

Chen, C.-H.(2009).Corpus, lexicon, and construction: A quantitative corpus approach to Mandarin possessive construction.International Journal of Computational Linguigstics and Chinese Language Processing.14,305-340.

Cimiano, P.,Hotho, A.,Staab, S.(2004).Comparing conceptual, divisive and agglomerative clustering for learning taxonomies from text.Proceedings of the European Conference of Artificial Intelligence.(Proceedings of the European Conference of Artificial Intelligence).

Cimiano, P.,Hotho, A.,Staab, S.(2004).Clustering concept hierarchies from text.Proceedings of LREC 2004.(Proceedings of LREC 2004).