A simulation study of rater agreement measures with 2×2 contingency tables

A comparison between six rater agreement measures obtained using three different approaches was achieved by means of a simulation study. Rater coefficients suggested by Bennet’s σ (1954), Scott’s π (1955), Cohen’s κ (1960) and Gwet’s γ (2008) were selected to represent the classical, descriptive approach, α agreement parameter from Aickin (1990) to represent loglinear and mixture model approaches and ∆ measure from Martín and Femia (2004) to represent multiple-choice test. [...]

Experience the Next Generation Academic Publishing

Free Open Access
Open Peer Reviews
Indexed by JCR, DOAJ, Scopus
Published by DIGITAL. CSIC