Julius Centre University of Malaya, Department of Social & Preventive Medicine, Faculty of Medicine, University of Malaya, 50603, Kuala Lumpur, Malaysia.
Iran J Basic Med Sci. 2013 Jun;16(6):803-7.
OBJECTIVE(S): Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate statistical method used in the reliability analysis and its implication in the medical practice.
In 2010, five electronic databases were searched between 2007 and 2009 to look for reliability studies. A total of 5,795 titles were initially identified. Only 282 titles were potentially related, and finally 42 fitted the inclusion criteria.
The Intra-class Correlation Coefficient (ICC) is the most popular method with 25 (60%) studies having used this method followed by the comparing means (8 or 19%). Out of 25 studies using the ICC, only 7 (28%) reported the confidence intervals and types of ICC used. Most studies (71%) also tested the agreement of instruments.
This study finds that the Intra-class Correlation Coefficient is the most popular method used to assess the reliability of medical instruments measuring continuous outcomes. There are also inappropriate applications and interpretations of statistical methods in some studies. It is important for medical researchers to be aware of this issue, and be able to correctly perform analysis in reliability studies.
可靠性测量精度或测试结果可再现的程度。这是首次系统地综述，旨在确定用于测量连续变量测量设备可靠性的统计方法。本研究还旨在强调可靠性分析中使用的不适当的统计方法及其在医学实践中的影响。
2010 年，在 2007 年至 2009 年期间搜索了五个电子数据库以查找可靠性研究。最初确定了 5795 个标题。只有 282 个标题可能与研究相关，最终有 42 个符合纳入标准。
组内相关系数（ICC）是最受欢迎的方法，有 25 项（60%）研究使用了这种方法，其次是比较均值（8 项或 19%）。在使用 ICC 的 25 项研究中，只有 7 项（28%）报告了置信区间和使用的 ICC 类型。大多数研究（71%）还测试了仪器的一致性。
本研究发现，组内相关系数是评估测量连续结果的医学仪器可靠性最常用的方法。在一些研究中，也存在不适当的统计方法应用和解释。医学研究人员了解这一问题并能够正确地进行可靠性研究分析非常重要。
