Ioannidis John P A
Clinical and Molecular Epidemiology Unit, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina 45110, Greece.
J Clin Epidemiol. 2007 Apr;60(4):324-9. doi: 10.1016/j.jclinepi.2006.09.011. Epub 2007 Jan 22.
Limitations are important to understand for placing research findings in context, interpreting the validity of the scientific work, and ascribing a credibility level to the conclusions of published research. This goes beyond listing the magnitude and direction of random and systematic errors and validity problems. Acknowledgment of limitations requires an interpretation of the meaning and influence of errors and validity problems on the published findings. An examination of the full-text files of the first 50 articles published in 2005 in the six most-cited research journals and in two recently launched leading open-access journals showed that only 67 articles (17%) used at least one word denoting limitations in the context of the presented scientific work. Only four articles (1%) used the word limitation in their abstract; none referred to limitations of the present work that materially affected conclusions. Only five articles had a separate section on limitations. Conversely, 243 articles (61%) used words detected by the roots error, valid, bias, reproducib, or false and 289 articles (72%) used words with the root importan. Among the 25 top-cited journals' instructions to the authors and editorial policies, only one encourages discussion of limitations; importance, novelty, and lack of error are typically encouraged. Limitations should be better covered and discussed in research articles. To facilitate this, journals should give better guidance and promote the discussion of limitations. Otherwise, we are facing an important loss of context for the scientific literature.
了解局限性对于将研究结果置于具体情境、解读科学工作的有效性以及为已发表研究的结论赋予可信度至关重要。这不仅仅是列出随机误差和系统误差的大小与方向以及有效性问题。承认局限性需要对误差和有效性问题对已发表研究结果的意义和影响进行解读。对2005年在六种引用率最高的研究期刊以及两种最近新推出的领先开放获取期刊上发表的前50篇文章的全文文件进行审查后发现,只有67篇文章(17%)在阐述科学工作的背景下使用了至少一个表示局限性的词汇。只有四篇文章(1%)在摘要中使用了“局限性”一词;没有一篇提及对结论有实质性影响的本研究的局限性。只有五篇文章有单独的局限性章节。相反,243篇文章(61%)使用了由“误差”“有效”“偏差”“可重复性”或“错误”等词根检测到的词汇,289篇文章(72%)使用了带有“重要”词根的词汇。在25种引用率最高的期刊给作者的投稿指南和编辑政策中,只有一种鼓励讨论局限性;通常鼓励强调重要性、新颖性和无误差。研究文章中应更好地涵盖和讨论局限性。为便于做到这一点,期刊应提供更好的指导并促进对局限性的讨论。否则,我们将面临科学文献在背景方面的重大缺失。