Conover Mitchell M, Albogami Yasser, Hardin Jill, Reich Christian G, Ostropolets Anna, Ryan Patrick B
Observational Health Data Science and Informatics, New York, New York, USA.
Observational Health Data Analytics, Johnson & Johnson, Titusville, New Jersey, USA.
Pharmacoepidemiol Drug Saf. 2025 Jan;34(1):e70087. doi: 10.1002/pds.70087.
The aim of this study is to use observational methods to evaluate reliability of evidence generated by a study of the effect of glucagon-like peptide 1 receptor agonists (GLP-1RA) on chronic lower respiratory disease (CLRD) outcomes among Type-2 diabetes mellitus (T2DM) patients.
We independently reproduced a study comparing effects of GLP-1RA versus dipeptidyl peptidase-4 inhibitors (DPP4-i) on CLRD outcomes among patients with T2DM and prior CLRD. We reproduced inputs and outputs using the original study data (national administrative claims) and evaluated the robustness of results in comparison to alternate design/analysis decisions. To evaluate generalizability, we applied an analysis protocol and conducted a meta-analysis across a research network that includes a diverse array of populations and data sources. We also produced additional analyses evaluating individual drugs within the GLP-1RA class and CLRD outcomes.
We confirmed alignment of study inputs and outputs and closely reproduced effect estimates and sensitivity analyses. Adjusted effect estimates were robust to empirical calibration. Network meta-analysis confirmed original findings but indicated weaker effects than originally published. Meta-analysis of drugs within the GLP-1RA class against DPP4-i provided evidence that effects vary within the GLP-1RA class, indicating stronger effects for exenatide and weaker effects of dulaglutide.
This study supports and establishes the reliability of the original study by (1) producing consistent findings in a range of alternate databases and populations, (2) demonstrating effects for multiple drugs within the GLP-1RA class, and (3) independently confirming the reproducibility of the original study and its findings. This reliability evaluation provides the beginnings of a broader framework for using standardized tools and distributed data networks to systematically interrogate the reliability of findings generated using observational data.
本研究旨在运用观察性方法，评估一项关于胰高血糖素样肽-1受体激动剂（GLP-1RA）对2型糖尿病（T2DM）患者慢性下呼吸道疾病（CLRD）结局影响的研究所得证据的可靠性。
我们独立重现了一项比较GLP-1RA与二肽基肽酶-4抑制剂（DPP4-i）对患有T2DM且既往有CLRD的患者CLRD结局影响的研究。我们使用原始研究数据（国家行政索赔数据）重现了输入和输出，并与替代设计/分析决策相比较评估结果的稳健性。为评估可推广性，我们应用了一种分析方案，并在一个包含多种人群和数据源的研究网络中进行了荟萃分析。我们还进行了额外分析，评估GLP-1RA类别内的个别药物与CLRD结局。
我们证实了研究输入和输出的一致性，并紧密重现了效应估计值和敏感性分析。调整后的效应估计值对经验校准具有稳健性。网络荟萃分析证实了原始研究结果，但显示效应比最初发表的要弱。GLP-1RA类别内药物与DPP4-i的荟萃分析提供了证据，表明GLP-1RA类别内效应存在差异，显示艾塞那肽的效应更强，度拉糖肽的效应较弱。
本研究通过以下方式支持并确立了原始研究的可靠性：（1）在一系列替代数据库和人群中得出一致的结果；（2）证明GLP-1RA类别内多种药物的效应；（3）独立确认原始研究及其结果的可重复性。这种可靠性评估为使用标准化工具和分布式数据网络系统地审视使用观察性数据得出的结果的可靠性提供了一个更广泛框架的开端。
