From the Department of Biostatistics, Yale School of Public Health, New Haven, CT.
Marshfield Clinic Research Institute, Center for Clinical Epidemiology & Population Health, Marshfield, WI.
Epidemiology. 2024 Mar 1;35(2):130-136. doi: 10.1097/EDE.0000000000001690. Epub 2023 Nov 14.
When a randomized controlled trial fails to demonstrate statistically significant efficacy against the primary endpoint, a potentially costly new trial would need to be conducted to receive licensure. Incorporating data from previous trials might allow for more efficient follow-up trials to demonstrate efficacy, speeding the availability of effective vaccines.
Based on the outcomes from a failed trial of a maternal vaccine against respiratory syncytial virus (RSV), we simulated data for a new Bayesian group-sequential trial. We analyzed the data either ignoring data from the previous trial (i.e., weakly informative prior distributions) or using prior distributions incorporating the historical data into the analysis. We evaluated scenarios where efficacy in the new trial was the same, greater than, or less than that in the original trial. For each scenario, we evaluated the statistical power and type I error rate for estimating the vaccine effect following interim analyses.
When we used a stringent threshold to control the type I error rate, analyses incorporating historical data had a small advantage over trials that did not. If control of type I error is less important (e.g., in a postlicensure evaluation), the incorporation of historical data can provide a substantial boost in efficiency.
Due to the need to control the type I error rate in trials used to license a vaccine, incorporating historical data provides little additional benefit in terms of stopping the trial early. However, these statistical approaches could be promising in evaluations that use real-world evidence following licensure.
当一项随机对照试验未能显示出对主要终点有统计学意义的疗效时,可能需要进行一项潜在成本高昂的新试验来获得许可。纳入先前试验的数据可能允许进行更有效的后续试验来证明疗效,从而加快有效疫苗的供应。
基于一项针对呼吸道合胞病毒(RSV)的母体疫苗的失败试验结果,我们模拟了一项新的贝叶斯分组序贯试验的数据。我们分析了数据,或者忽略了先前试验的数据(即弱信息先验分布),或者使用先验分布将历史数据纳入分析。我们评估了新试验的疗效与原始试验相同、大于或小于原始试验的情况。对于每种情况,我们评估了在中期分析后估计疫苗效果的统计功效和 I 型错误率。
当我们使用严格的阈值来控制 I 型错误率时,分析纳入历史数据比不纳入历史数据略有优势。如果控制 I 型错误率不那么重要(例如,在许可后评估中),那么纳入历史数据可以大大提高效率。
由于需要控制用于许可疫苗的试验的 I 型错误率,因此在提前停止试验方面,纳入历史数据对获得额外的益处不大。然而,这些统计方法在许可后使用实际证据进行评估时可能很有前景。