Jackson Dennis L, Gillaspy J Arthur, Purc-Stephenson Rebecca
Department of Psychology, University of Windsor, Ontario, Canada.
Psychol Methods. 2009 Mar;14(1):6-23. doi: 10.1037/a0014694.
Reporting practices in 194 confirmatory factor analysis studies (1,409 factor models) published in American Psychological Association journals from 1998 to 2006 were reviewed and compared with established reporting guidelines. Three research questions were addressed: (a) how do actual reporting practices compare with published guidelines? (b) how do researchers report model fit in light of divergent perspectives on the use of ancillary fit indices (e.g., L.-T. Hu & P. M. Bentler, 1999; H. W. Marsh, K.-T., Hau, & Z. Wen, 2004)? and (c) are fit measures that support hypothesized models reported more often than fit measures that are less favorable? Results indicate some positive findings with respect to reporting practices including proposing multiple models a priori and near universal reporting of the chi-square significance test. However, many deficiencies were found such as lack of information regarding missing data and assessment of normality. Additionally, the authors found increases in reported values of some incremental fit statistics and no statistically significant evidence that researchers selectively report measures of fit that support their preferred model. Recommendations for reporting are summarized and a checklist is provided to help editors, reviewers, and authors improve reporting practices.
对1998年至2006年发表在美国心理学会期刊上的194项验证性因素分析研究(1409个因素模型)的报告做法进行了审查,并与既定的报告指南进行了比较。研究了三个问题:(a)实际报告做法与已发表的指南相比如何?(b)鉴于对辅助拟合指数使用的不同观点(例如,胡LT和本特勒PM,1999年;马什HW、K-T、豪和温Z,2004年),研究人员如何报告模型拟合情况?以及(c)支持假设模型的拟合度测量报告是否比不太有利的拟合度测量报告更频繁?结果表明,在报告做法方面有一些积极发现,包括事先提出多个模型以及几乎普遍报告卡方显著性检验。然而,发现了许多不足之处,例如缺乏关于缺失数据的信息和正态性评估。此外,作者发现一些增量拟合统计量的报告值有所增加,并且没有统计学上的显著证据表明研究人员有选择地报告支持其首选模型的拟合度测量。总结了报告建议,并提供了一份清单,以帮助编辑、审稿人和作者改进报告做法。