Assessing agreement between raters from the point of coefficients and log-linear models

Ayfer Ezgi Yilmaz ； Tulay Saracbasi

《Journal of Data Science》 15卷1期 (2017/01) Pp. 1-24

https://doi.org/10.6339/JDS.201701_15(1).0001

摘要

In square contingency tables, analysis of agreement between row and column classifications is of interest. For nominal categories, kappa co- efficient is used to summarize the degree of agreement between two raters. Numerous extensions and generalizations of kappa statistics have been pro- posed in the literature. In addition to the kappa coefficient, several authors use agreement in terms of log-linear models. This paper focuses on the approaches to study of inter-rater agreement for contingency tables with nominal or ordinal categories for multi-raters. In this article, we present a detailed overview of agreement studies and illustrate use of the approaches in the evaluation agreement over three numerical examples.

關鍵字

Agreement ； kappa ； log-linear models ； multi-raters ； nominal ； or-dinal ； weights