布里斯班循证语言测试的评分者间信度、评分者内信度和内部一致性。
Inter-rater reliability, intra-rater reliability and internal consistency of the Brisbane Evidence-Based Language Test.
机构信息
Speech Pathology Department, Southern Cross University, Bilinga, Australia.
Speech Pathology Department, The University of Queensland, Brisbane, Australia.
出版信息
Disabil Rehabil. 2022 Feb;44(4):637-645. doi: 10.1080/09638288.2020.1776774. Epub 2020 Jun 22.
PURPOSE
To examine the inter-rater reliability, intra-rater reliability, internal consistency and practice effects associated with a new test, the Brisbane Evidence-Based Language Test.
METHODS
Reliability estimates were obtained in a repeated-measures design through analysis of clinician video ratings of stroke participants completing the Brisbane Evidence-Based Language Test. Inter-rater reliability was determined by comparing 15 independent clinicians' scores of 15 randomly selected videos. Intra-rater reliability was determined by comparing two clinicians' scores of 35 videos when re-scored after a two-week interval.
RESULTS
Intraclass correlation coefficient (ICC) analysis demonstrated almost perfect inter-rater reliability (0.995; 95% confidence interval: 0.990-0.998), intra-rater reliability (0.994; 95% confidence interval: 0.989-0.997) and internal consistency (Cronbach's α = 0.940 (95% confidence interval: 0.920-1.0)). Almost perfect correlations (0.998; 95% confidence interval: 0.995-0.999) between face-to-face and video ratings were obtained.
CONCLUSION
The Brisbane Evidence-Based Language Test demonstrates almost perfect inter-rater reliability, intra-rater reliability and internal consistency. High correlation coefficients and narrow confidence intervals demonstrated minimal practice effects with scoring or influence of years of clinical experience on test scores. Almost perfect correlations between face-to-face and video scoring methods indicate these reliability estimates have direct application to everyday practice. The test is available from brisbanetest.org.Implications for RehabilitationThe Brisbane Evidence-Based Language Test is a new measure for the assessment of acquired language disorders.The Brisbane Evidence-Based Language Test demonstrated almost perfect inter-rater reliability, intra-rater reliability and internal consistency.High reliability estimates and narrow confidence intervals indicated that test ratings vary minimally when administered by clinicians of different experience levels, or different levels of familiarity with the new measure.The test is a reliable measure of language performance for use in clinical practice and research.
目的
研究新测试——布里斯班循证语言测试（Brisbane Evidence-Based Language Test）的组内信度、组间信度、内部一致性和练习效应。
方法
采用重复测量设计，通过分析完成布里斯班循证语言测试的中风患者的临床医生视频评分，得出可靠性估计。组间信度通过比较 15 名独立临床医生对 15 个随机选择视频的评分来确定。组内信度通过比较两名临床医生在两周间隔后重新评分的 35 个视频的评分来确定。
结果
组内相关系数（intraclass correlation coefficient，ICC）分析显示，组间信度几乎为完美（0.995；95%置信区间：0.990-0.998），组内信度（0.994；95%置信区间：0.989-0.997）和内部一致性（Cronbach's α=0.940（95%置信区间：0.920-1.0））几乎为完美。面对面评分和视频评分之间几乎存在完美的相关性（0.998；95%置信区间：0.995-0.999）。
结论
布里斯班循证语言测试的组间信度、组内信度和内部一致性几乎达到完美。高相关系数和狭窄的置信区间表明，评分或多年临床经验对测试分数的影响最小。面对面和视频评分方法之间几乎存在完美的相关性表明，这些可靠性估计值可以直接应用于日常实践。该测试可在 brisbanetest.org 上获得。
对康复的影响
布里斯班循证语言测试是一种新的获得性语言障碍评估方法。
布里斯班循证语言测试的组间信度、组内信度和内部一致性几乎达到完美。
高可靠性估计值和狭窄的置信区间表明，当由经验水平不同的临床医生或对新测量方法熟悉程度不同的临床医生进行管理时，测试评分的变化很小。
该测试是一种可靠的语言表现测量工具，可用于临床实践和研究。
Zotero 插件