Woods Steven Paul, Mustafa Andrea, Beltran-Najera Ilex, Matchanova Anastasia, Thompson Jennifer L, Ridgely Natalie C
Department of Psychology, University of Houston, Houston, TX77204, USA.
J Int Neuropsychol Soc. 2023 Nov;29(9):885-892. doi: 10.1017/S1355617723000127. Epub 2023 Feb 10.
For decades, quantitative psychologists have recommended that authors report effect sizes to convey the magnitude and potential clinical relevance of statistical associations. However, fewer than one-third of neuropsychology articles published in the early 2000s reported effect sizes. This study re-examines the frequency and extent of effect size reporting in neuropsychology journal articles by manuscript section and over time.
A sample of 326 empirical articles were drawn from 36 randomly selected issues of six neuropsychology journals at 5-year intervals between 1995 and 2020. Four raters used a novel, reliable coding system to quantify the extent to which effect sizes were included in the major sections of all 326 articles.
Findings showed medium-to-large increases in effect size reporting in the Methods and Results sections of neuropsychology journal articles that plateaued in recent years; however, there were only very small and nonsignificant changes in effect size reporting in the Abstract, Introduction, and Discussion sections.
Authors in neuropsychology journals have markedly improved their effect size reporting in the core Methods and Results sections, but are still unlikely to consider these valuable metrics when motivating their study hypotheses and interpreting the conceptual and clinical implications of their findings. Recommendations are provided to encourage more widespread integration of effect sizes in neuropsychological research.
几十年来,定量心理学家一直建议作者报告效应量,以传达统计关联的大小和潜在临床相关性。然而,21世纪初发表的神经心理学文章中,报告效应量的不到三分之一。本研究按稿件部分并随时间重新审视神经心理学期刊文章中效应量报告的频率和程度。
从1995年至2020年期间每隔5年随机选取的6种神经心理学期刊的36期里抽取326篇实证文章作为样本。4名评分者使用一种新颖、可靠的编码系统来量化326篇文章各主要部分纳入效应量的程度。
研究结果显示,神经心理学期刊文章的方法和结果部分中效应量报告有中度到大幅增加,近年来趋于平稳;然而,摘要、引言和讨论部分的效应量报告仅有非常小且不显著的变化。
神经心理学期刊的作者在核心的方法和结果部分显著改进了效应量报告,但在提出研究假设以及解释研究结果的概念和临床意义时,仍不太可能考虑这些有价值的指标。本文给出了相关建议,以鼓励在神经心理学研究中更广泛地纳入效应量。