From the Division of Plastic and Reconstructive Surgery, Department of Surgery, Northwestern University Feinberg School of Medicine; Case Western Reserve University School of Medicine; Division of Plastic and Reconstructive Surgery, Department of Surgery, MetroHealth Medical Center; and Oklahoma State University Center for Health Sciences.
Plast Reconstr Surg. 2022 Apr 1;149(4):810e-823e. doi: 10.1097/PRS.0000000000008956.
Reproducible research-defined as the ability to replicate a study with its published materials and procedures-is integral to ensuring the validity of published studies and promoting scientific advancement. The primary aim of this study was to quantitatively evaluate the reproducibility and transparency of research in the plastic surgery literature.
A cross-sectional study was performed. Articles published in 12 plastic surgery journals over a 5-year period were randomly selected. Reproducibility-related and transparency-related variables were blindly and independently collected by two reviewers using previously published methods. Descriptive statistics and univariate analysis were performed for outcomes of interest.
The initial search yielded 18,461 publications, from which 400 were randomly selected. A total of 397 publications met inclusion criteria, of which 203 were empirical studies eligible for analysis of reproducibility-related and transparency-related variables. Among the empirical studies, most did not have a data availability statement (97.0 percent; 95 percent CI, 93.7 to 98.9). Only seven (3.4 percent; 95 percent CI, 1.4 to 7.0) were linked to an accessible protocol, four (2.0 percent; 95 percent CI, 0.5 to 5.0) were preregistered, and no studies provided analysis scripts or claimed to replicate another study. Of the 202 studies evaluated for material availability, only 17 (8.4 percent; 95 percent CI, 5.0 to 13.1) had a material availability statement.
There is an evident lack of reproducible research practices in plastic surgery literature. The majority of plastic surgery publications do not provide information and raw materials necessary to reproduce empirical studies. Increasing awareness at the individual and institutional levels can improve research quality and transparency.
可重复性研究——即使用已发表的材料和程序复制研究的能力——是确保已发表研究有效性和促进科学进步的关键。本研究的主要目的是定量评估整形外科学文献研究的可重复性和透明度。
进行了一项横断面研究。随机选择了 5 年内发表在 12 种整形外科学期刊上的文章。两名评审员使用先前发表的方法,盲法和独立地收集与可重复性和透明度相关的变量。对感兴趣的结果进行描述性统计和单变量分析。
最初的搜索产生了 18461 篇出版物,从中随机选择了 400 篇。共有 397 篇出版物符合纳入标准,其中 203 篇是符合可重复性和透明度相关变量分析条件的实证研究。在这些实证研究中,大多数没有数据可用性声明(97.0%;95%CI,93.7 至 98.9)。只有 7 篇(3.4%;95%CI,1.4 至 7.0)与可访问的方案相关联,4 篇(2.0%;95%CI,0.5 至 5.0)是预先注册的,没有研究提供分析脚本或声称复制了另一项研究。在评估材料可用性的 202 项研究中,只有 17 项(8.4%;95%CI,5.0 至 13.1)有材料可用性声明。
整形外科学文献中明显缺乏可重复性研究实践。大多数整形外科学出版物没有提供复制实证研究所需的信息和原材料。在个人和机构层面提高认识可以提高研究质量和透明度。