Analysis of interobserver variation on a programmable calculator.

A program for the analysis of interobserver variation using kappa statistics is described for the HP- 41C hand-held calculator. For an unlimited number of cases classified by as many as nine observers into a maximum of 10 categories of a normal scale, the program provides crude and adjusted measures of overall agreement, level of agreement on each category, and the extent of associations between categories. Use of the program is illustrated by an example.