Centre for Health Services and Nursing Research, Katholieke Universiteit Leuven, Kapucijnenvoer 35/4, Box 7001, B-3000 Leuven, Belgium.
Arch Gerontol Geriatr. 2012 Jul-Aug;55(1):165-72. doi: 10.1016/j.archger.2011.07.005. Epub 2011 Sep 8.
We examined the interrater reliability of the interRAI AC. An observational study was conducted on 3 geriatric wards. Two trained raters completed independently the interRAI AC between 24 and 48 h after admission. A sample of 100 patients (age 84.5 ± 5.6 years; 45% female) was analyzed. Interrater reliability was tested using observed agreement, kappa coefficients, and intraclass correlation coefficients. The overall kappa median value for nominal items was 0.82 (almost perfect). For items on ordinal level, both the overall weighted kappa median and the intraclass correlation coefficient median were 0.86 (almost perfect). According to conventional cut-offs for interpreting kappa statistics, reliability was almost perfect (K ≥ 0.81) for 60% of all items, substantial (0.60 < K ≤ 0.80) for 26%, moderate (0.41 < K ≤ 0.60) for 10%, and poor (K ≤ 0.40) for 4% of the items. The median observed agreement was 0.89. For 83% of the items, the observed agreement was greater than 0.80. This study showed substantial or almost perfect interrater reliability for 86% of the items. In addition to previous evidence, the current results suggest that the estimates of the interrater reliability of the interRAI AC are acceptable and provide preliminary evidence that the current version is appropriate for clinical application.
我们考察了 interRAI AC 的评定者间信度。在 3 个老年病房进行了一项观察性研究。2 位经过培训的评定者在入院后 24 至 48 小时之间独立完成了 interRAI AC。对 100 名患者(年龄 84.5 ± 5.6 岁,45%为女性)进行了分析。采用观察一致率、kappa 系数和组内相关系数来检验评定者间信度。名义项目的总体 kappa 中位数为 0.82(几乎完美)。对于等级水平的项目,加权 kappa 中位数和组内相关系数中位数均为 0.86(几乎完美)。根据 kappa 统计解释的常规截断值,60%的所有项目的可靠性几乎完美(K≥0.81),26%的项目为显著(0.60<K≤0.80),10%的项目为中度(0.41<K≤0.60),4%的项目为较差(K≤0.40)。观察一致率的中位数为 0.89。83%的项目的观察一致率大于 0.80。这项研究表明,86%的项目具有显著或几乎完美的评定者间信度。除了先前的证据外,当前的结果表明,interRAI AC 的评定者间信度估计是可以接受的,并提供了初步证据表明当前版本适合临床应用。