Lee Sangseok, Lee Dong Kyu
Department of Anesthesiology and Pain Medicine, Sanggye Paik Hospital, Inje University College of Medicine, Seoul, Korea.
Department of Anesthesiology and Pain Medicine, Guro Hospital, Korea University School of Medicine, Seoul, Korea.
Korean J Anesthesiol. 2018 Oct;71(5):353-360. doi: 10.4097/kja.d.18.00242. Epub 2018 Aug 28.
Multiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between the group means. A problem occurs if the error rate increases while multiple hypothesis tests are performed simultaneously. Consequently, in an MCT, it is necessary to control the error rate to an appropriate level. In this paper, we discuss how to test multiple hypotheses simultaneously while limiting type I error rate, which is caused by α inflation. To choose the appropriate test, we must maintain the balance between statistical power and type I error rate. If the test is too conservative, a type I error is not likely to occur. However, concurrently, the test may have insufficient power resulted in increased probability of type II error occurrence. Most researchers may hope to find the best way of adjusting the type I error rate to discriminate the real differences between observed data without wasting too much statistical power. It is expected that this paper will help researchers understand the differences between MCTs and apply them appropriately.
多重比较检验(MCTs)会在实验条件的均值上进行多次。当在验证中零假设被拒绝时,若某些实验条件存在统计学上显著的均值差异或组均值之间存在特定方面的差异,就会进行MCTs。如果在同时进行多个假设检验时错误率增加,就会出现问题。因此,在MCT中,有必要将错误率控制在适当水平。在本文中,我们讨论如何在限制由α膨胀引起的I型错误率的同时,同时检验多个假设。为了选择合适的检验方法,我们必须在统计功效和I型错误率之间保持平衡。如果检验过于保守,I型错误不太可能发生。然而,与此同时,该检验可能功效不足,导致II型错误发生的概率增加。大多数研究人员可能希望找到调整I型错误率的最佳方法,以区分观察数据之间的真实差异,而不会浪费过多的统计功效。期望本文能帮助研究人员理解MCTs之间的差异并正确应用它们。