评估体育活动行为改变干预评估中的开放科学实践。
Assessing Open Science practices in physical activity behaviour change intervention evaluations.
作者信息
Norris Emma, Sulevani Isra, Finnerty Ailbhe N, Castro Oscar
机构信息
Department of Health Sciences, Brunel University London, Uxbridge, Middlesex, UK.
Centre for Behaviour Change, University College London, London, UK.
出版信息
BMJ Open Sport Exerc Med. 2022 May 23;8(2):e001282. doi: 10.1136/bmjsem-2021-001282. eCollection 2022.
OBJECTIVES
Concerns on the lack of reproducibility and transparency in science have led to a range of research practice reforms, broadly referred to as 'Open Science'. The extent that physical activity interventions are embedding Open Science practices is currently unknown. In this study, we randomly sampled 100 reports of recent physical activity randomised controlled trial behaviour change interventions to estimate the prevalence of Open Science practices.
METHODS
One hundred reports of randomised controlled trial physical activity behaviour change interventions published between 2018 and 2021 were identified, as used within the Human Behaviour-Change Project. Open Science practices were coded in identified reports, including: study pre-registration, protocol sharing, data, materials and analysis scripts sharing, replication of a previous study, open access publication, funding sources and conflict of interest statements. Coding was performed by two independent researchers, with inter-rater reliability calculated using Krippendorff's alpha.
RESULTS
78 of the 100 reports provided details of study pre-registration and 41% provided evidence of a published protocol. 4% provided accessible open data, 8% provided open materials and 1% provided open analysis scripts. 73% of reports were published as open access and no studies were described as replication attempts. 93% of reports declared their sources of funding and 88% provided conflicts of interest statements. A Krippendorff's alpha of 0.73 was obtained across all coding.
CONCLUSION
Open data, materials, analysis and replication attempts are currently rare in physical activity behaviour change intervention reports, whereas funding source and conflict of interest declarations are common. Future physical activity research should increase the reproducibility of their methods and results by incorporating more Open Science practices.
目的
对科学研究缺乏可重复性和透明度的担忧引发了一系列研究实践改革,统称为“开放科学”。目前尚不清楚体育活动干预措施在多大程度上融入了开放科学实践。在本研究中,我们随机抽取了100篇近期体育活动随机对照试验行为改变干预的报告,以估计开放科学实践的流行程度。
方法
确定了2018年至2021年间发表的100篇随机对照试验体育活动行为改变干预报告,这些报告用于人类行为改变项目。对确定的报告中的开放科学实践进行编码,包括:研究预注册、方案共享、数据、材料和分析脚本共享、先前研究的重复、开放获取出版、资金来源和利益冲突声明。编码由两名独立研究人员进行,使用Krippendorff's alpha计算评分者间信度。
结果
100篇报告中有78篇提供了研究预注册的详细信息,41%提供了已发表方案的证据。4%提供了可获取的开放数据,8%提供了开放材料,1%提供了开放分析脚本。73%的报告以开放获取形式发表,没有研究被描述为重复尝试。93%的报告声明了其资金来源,88%提供了利益冲突声明。所有编码的Krippendorff's alpha为0.73。
结论
在体育活动行为改变干预报告中,开放数据、材料、分析和重复尝试目前很少见,而资金来源和利益冲突声明则很常见。未来的体育活动研究应通过纳入更多开放科学实践来提高其方法和结果的可重复性。