Department of Mathematics, University of Siegen, Walter-Flex-Str. 3, Siegen, 57072, Germany.
BMC Med Res Methodol. 2020 Jun 5;20(1):142. doi: 10.1186/s12874-020-00980-6.
Although null hypothesis significance testing (NHST) is the agreed gold standard in medical decision making and the most widespread inferential framework used in medical research, it has several drawbacks. Bayesian methods can complement or even replace frequentist NHST, but these methods have been underutilised mainly due to a lack of easy-to-use software. JASP is an open-source software for common operating systems, which has recently been developed to make Bayesian inference more accessible to researchers, including the most common tests, an intuitive graphical user interface and publication-ready output plots. This article provides a non-technical introduction to Bayesian hypothesis testing in JASP by comparing traditional tests and statistical methods with their Bayesian counterparts.
The comparison shows the strengths and limitations of JASP for frequentist NHST and Bayesian inference. Specifically, Bayesian hypothesis testing via Bayes factors can complement and even replace NHST in most situations in JASP. While p-values can only reject the null hypothesis, the Bayes factor can state evidence for both the null and the alternative hypothesis, making confirmation of hypotheses possible. Also, effect sizes can be precisely estimated in the Bayesian paradigm via JASP.
Bayesian inference has not been widely used by now due to the dearth of accessible software. Medical decision making can be complemented by Bayesian hypothesis testing in JASP, providing richer information than single p-values and thus strengthening the credibility of an analysis. Through an easy point-and-click interface researchers used to other graphical statistical packages like SPSS can seemlessly transition to JASP and benefit from the listed advantages with only few limitations.
虽然零假设显著性检验(NHST)是医学决策中的公认黄金标准,也是医学研究中使用最广泛的推理框架,但它也存在一些缺点。贝叶斯方法可以补充甚至取代频率派 NHST,但这些方法主要由于缺乏易用的软件而未得到充分利用。JASP 是一种用于通用操作系统的开源软件,最近开发它是为了使研究人员更容易进行贝叶斯推理,包括最常见的测试、直观的图形用户界面和可发布的输出图形。本文通过将传统测试和统计方法与它们的贝叶斯对应方法进行比较,对 JASP 中的贝叶斯假设检验进行了非技术性介绍。
该比较展示了 JASP 用于频率派 NHST 和贝叶斯推理的优缺点。具体来说,通过贝叶斯因子进行的贝叶斯假设检验可以在 JASP 中的大多数情况下补充甚至取代 NHST。虽然 p 值只能拒绝零假设,但贝叶斯因子可以同时陈述零假设和备择假设的证据,从而使假设得到确认成为可能。此外,通过 JASP 可以在贝叶斯范式中精确估计效应大小。
由于缺乏可用的软件,贝叶斯推理至今尚未得到广泛应用。通过 JASP 中的贝叶斯假设检验,可以补充医学决策,提供比单个 p 值更丰富的信息,从而增强分析的可信度。通过易于点击的界面,习惯了像 SPSS 这样的图形统计软件包的研究人员可以无缝过渡到 JASP,并从列出的优势中受益,而只有很少的限制。