Department of Otorhinolaryngology, Head and Neck Surgery, Maastricht University Medical Center, Maastricht, The Netherlands.
Eur J Radiol. 2013 Oct;82(10):1683-95. doi: 10.1016/j.ejrad.2013.05.009. Epub 2013 Jun 15.
Intrarater and interrater reliability is crucial to the quality of diagnostic and therapy-effect studies. This paper reports on a systematic review of studies on intrarater and interrater reliability for measurements in videofluoroscopy of swallowing. The aim of this review was to summarize and qualitatively analyze published studies on that topic.
Those published up to March 2013 were found through a comprehensive electronic database search using PubMed, Embase, and The Cochrane Library. Two reviewers independently assessed the studies using strict inclusion criteria.
Nineteen studies were included and then qualitatively analyzed. In several of these, methodological problems were found. Moreover, intrarater and interrater reliability varied with the measure applied. A meta-analysis was not carried out as studies were not of sufficient quality to warrant doing so.
In order to achieve reliable measurements in videofluoroscopy of swallowing, it is recommended that raters use well-defined guidelines for the levels of ordinal visuoperceptual variables. Furthermore, in order to make the measurements reliable (intrarater and interrater) it is recommended that, following protocolled pre-experimental training, the raters should have maximum consensus about the definition of the measured variables.
观察者内和观察者间可靠性对于诊断和治疗效果研究的质量至关重要。本文报告了一项对吞咽视频透视测量的观察者内和观察者间可靠性研究的系统评价。本综述的目的是总结和定性分析该主题的已发表研究。
通过使用 PubMed、Embase 和 The Cochrane Library 进行全面的电子数据库检索，检索截至 2013 年 3 月之前发表的研究。两名审查员使用严格的纳入标准独立评估研究。
纳入了 19 项研究，并进行了定性分析。其中有几项研究发现了方法学问题。此外，应用的测量方法不同，观察者内和观察者间可靠性也不同。由于研究质量不足以进行荟萃分析，因此未进行荟萃分析。
为了在吞咽视频透视中实现可靠的测量，建议评估者使用定义明确的等级视觉感知变量指南。此外，为了使测量具有可靠性（观察者内和观察者间），建议在经过协议的实验前培训后，评估者应该对测量变量的定义达成最大共识。
