青少年大脑认知发展（ABCD）研究中的透明度与可重复性

Transparency and Reproducibility in the Adolescent Brain Cognitive Development (ABCD) Study.

作者信息

Lopez Daniel A, Cardenas-Iniguez Carlos, Subramaniam Punitha, Adise Shana, Bottenhorn Katherine L, Badilla Paola, Mukwekwerere Ellen, Tally Laila, Ahanmisi Omoengheme, Bedichek Isabelle L, Matera Serena D, Perez-Tamayo Gabriela Mercedes, Sissons Nicholas, Winters Owen, Harkness Anya, Nakiyingi Elizabeth, Encizo Jennell, Xiang Zhuoran, Wilson Isabelle G, Smith Allison N, Hill Anthony R, Adames Amanda K, Robertson Elizabeth, Boughter Joseph R, Lopez-Flores Arturo, Skoler Emma R, Dorholt Lyndsey, Nagel Bonnie J, Huber Rebekah S

机构信息

Department of Psychiatry, Oregon Health & Science University, Portland, Oregon.

Center for Mental Health Innovation, Oregon Health & Science University, Portland, Oregon.

出版信息

medRxiv. 2024 May 31:2024.05.30.24308222. doi: 10.1101/2024.05.30.24308222.

DOI:10.1101/2024.05.30.24308222

PMID:38854118

原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11160844/

Abstract

BACKGROUND

Transparency can build trust in the scientific process, but scientific findings can be undermined by poor and obscure data use and reporting practices. The purpose of this work is to report how data from the Adolescent Brain Cognitive Development (ABCD) Study has been used to date, and to provide practical recommendations on how to improve the transparency and reproducibility of findings.

METHODS

Articles published from 2017 to 2023 that used ABCD Study data were reviewed using more than 30 data extraction items to gather information on data use practices. Total frequencies were reported for each extraction item, along with computation of a Level of Completeness (LOC) score that represented overall endorsement of extraction items. Univariate linear regression models were used to examine the correlation between LOC scores and individual extraction items. Post hoc analysis included examination of whether LOC scores were correlated with the logged 2-year journal impact factor.

RESULTS

There were 549 full-length articles included in the main analysis. Analytic scripts were shared in 30% of full-length articles. The number of participants excluded due to missing data was reported in 60% of articles, and information on missing data for individual variables (e.g., household income) was provided in 38% of articles. A table describing the analytic sample was included in 83% of articles. A race and/or ethnicity variable was included in 78% of reviewed articles, while its inclusion was justified in only 41% of these articles. LOC scores were highly correlated with extraction items related to examination of missing data. A bottom 10% of LOC score was significantly correlated with a lower logged journal impact factor when compared to the top 10% of LOC scores (β=-0.77, 95% -1.02, -0.51; -value < 0.0001).

CONCLUSION

These findings highlight opportunities for improvement in future papers using ABCD Study data to readily adapt analytic practices for better transparency and reproducibility efforts. A list of recommendations is provided to facilitate adherence in future research.

摘要

背景

透明度有助于建立对科学过程的信任，但糟糕且模糊的数据使用和报告做法可能会削弱科学发现。本研究的目的是报告青少年大脑认知发展（ABCD）研究的数据截至目前的使用情况，并就如何提高研究结果的透明度和可重复性提供实用建议。

方法

对2017年至2023年发表的使用ABCD研究数据的文章进行审查，使用30多个数据提取项目来收集有关数据使用做法的信息。报告每个提取项目的总频率，并计算代表对提取项目总体认可程度的完整性水平（LOC）得分。使用单变量线性回归模型来检验LOC得分与各个提取项目之间的相关性。事后分析包括检查LOC得分是否与记录的两年期刊影响因子相关。

结果

主要分析纳入了549篇全文。30%的全文共享了分析脚本。60%的文章报告了因数据缺失而排除的参与者数量，38%的文章提供了单个变量（如家庭收入）缺失数据的信息。83%的文章包含了描述分析样本的表格。78%的被审查文章纳入了种族和/或族裔变量，而其中只有41%的文章说明了纳入该变量的理由。LOC得分与与缺失数据检查相关的提取项目高度相关。与LOC得分最高的前10%相比，最低的10%的LOC得分与较低的记录期刊影响因子显著相关（β=-0.77，95% -1.02，-0.51；P值<0.0001）。