Institute for Biomedical Research and Innovation (IRIB), National Research Council (CNR), Via Ugo La Malfa 153, Palermo, Italy.
Department of Pediatrics, Allergology and Immunology Division, Sapienza University, Viale Regina Elena 324, Rome, Italy.
BMC Med Res Methodol. 2020 Apr 17;20(1):86. doi: 10.1186/s12874-020-00969-1.
Repeatability and reproducibility are essential for clinicians for several purposes. Although discouraged, use of the Coefficient of Variation (CV) for assessing repeatability and reproducibility, rather than the Intraclass Correlation Coefficient (ICC), is still widespread. The aim of the present study was to highlight how using inappropriate indices may lead to misleading results, and this is done by simulation study and using real data on Anterior Active Rhinomanometry (AAR) in both healthy children and ones with rhinitis.
A simulation study was carried out to highlight how using inappropriate indices could be misleading. Then a comparison was made between CV and ICC to assess repeatability and reproducibility of AAR, for which previous studies have given underestimated results. AAR is recommended as the gold standard tool for measuring nasal resistance in clinical practice.
A simulation study showed that the ICCs estimated from data generated assuming a true CV yielded results in agreement with estimated CVs; by contrast, if data were generated assuming a true ICC, CVs yielded conflicting results. For AAR, ICCs showed good repeatability, whereas CVs showed unacceptable repeatability. AUC and 95% CI for AAR showed good performance in predicting current symptoms of rhinitis in the overall study population.
The present study focused on the importance of the choice of appropriate indices of repeatability and reproducibility, demonstrating the repeatability of AAR in both healthy children and ones with rhinitis.
ClinicalTrials.gov (ID: NCT03286049; Registration Date: September 15, 2017; Actual Study Start Date: January 10, 2018).
可重复性和再现性对于临床医生来说是至关重要的,有多种用途。尽管不鼓励使用变异系数(CV)来评估可重复性和再现性,但仍广泛使用而不是使用组内相关系数(ICC)。本研究旨在通过模拟研究和使用健康儿童和鼻炎儿童的前主动鼻测压(AAR)的真实数据,强调使用不合适的指标可能会导致误导性的结果。
进行了一项模拟研究,以突出使用不合适的指标可能会产生误导。然后,比较了 CV 和 ICC 以评估 AAR 的可重复性和再现性,先前的研究已经给出了低估的结果。AAR 被推荐为临床实践中测量鼻腔阻力的金标准工具。
模拟研究表明,从假设真实 CV 生成的数据中估计的 ICC 结果与估计的 CV 一致;相比之下,如果数据是根据真实 ICC 生成的,则 CV 会产生相互矛盾的结果。对于 AAR,ICC 显示出良好的可重复性,而 CV 显示出不可接受的可重复性。AAR 的 AUC 和 95%CI 在预测整个研究人群中当前鼻炎症状方面表现出良好的性能。
本研究重点关注选择适当的可重复性和再现性指标的重要性,证明了健康儿童和鼻炎儿童的 AAR 的可重复性。
ClinicalTrials.gov(注册号:NCT03286049;注册日期:2017 年 9 月 15 日;实际研究开始日期:2018 年 1 月 10 日)。