01

irrCAC (v1.4, 2026-04-27)

An R package for analysing agreement among multiple raters using several chance-corrected coefficients, including Fleiss’ and Conger’s kappa, Gwet’s AC1/AC2 and Krippendorff’s alpha.

Fleiss' kappa vs Gwt's AC

We used irrCAC in a simulated multi-reader study to explore how prevalence can produce surprisingly low kappa values despite high observed agreement.

Methods in Practice