Li Alvin Ho-Ting, Thomas Sonia M, Farag Alexandra, Duffett Mark, Garg Amit X, Naylor Kyla L
Division of Nephrology, Department of Medicine, and Department of Epidemiology & Biostatistics, Western University, London, Ontario, Canada;
Division of Nephrology, Department of Medicine, and.
Clin J Am Soc Nephrol. 2014 Dec 5;9(12):2089-94. doi: 10.2215/CJN.02130214. Epub 2014 Sep 29.
Survey research is an important research method used to determine individuals' attitudes, knowledge, and behaviors; however, as with other research methods, inadequate reporting threatens the validity of results. This study aimed to describe the quality of reporting of surveys published between 2001 and 2011 in the field of nephrology.
DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: The top nephrology journals were systematically reviewed (2001-2011: American Journal of Kidney Diseases, Nephrology Dialysis Transplantation, and Kidney International; 2006-2011: Clinical Journal of the American Society of Nephrology) for studies whose primary objective was to collect and report survey results. Included were nephrology journals with a heavy focus on clinical research and high impact factors. All titles and abstracts were screened in duplicate. Surveys were excluded if they were part of a multimethod study, evaluated only psychometric characteristics, or used semi-structured interviews. Information was collected on survey and respondent characteristics, questionnaire development (e.g., pilot testing), psychometric characteristics (e.g., validity and reliability), survey methods used to optimize response rate (e.g., system of multiple contacts), and response rate.
After a screening of 19,970 citations, 216 full-text articles were reviewed and 102 surveys were included. Approximately 85% of studies reported a response rate. Almost half of studies (46%) discussed how they developed their questionnaire and only a quarter of studies (28%) mentioned the validity or reliability of the questionnaire. The only characteristic that improved over the years was the proportion of articles reporting missing data (2001-2004: 46.4%; 2005-2008: 61.9%; and 2009-2011: 84.8%; respectively) (P<0.01).
The quality of survey reporting in nephrology journals remains suboptimal. In particular, reporting of the validity and reliability of the questionnaire must be improved. Guidelines to improve survey reporting and increase transparency are clearly needed.
调查研究是用于确定个体态度、知识和行为的重要研究方法;然而,与其他研究方法一样,报告不充分会威胁结果的有效性。本研究旨在描述2001年至2011年发表在肾脏病学领域的调查研究的报告质量。
设计、背景、参与者及测量方法:对顶级肾脏病学杂志进行系统回顾(2001 - 2011年:《美国肾脏病杂志》《肾脏病透析移植杂志》和《国际肾脏病杂志》;2006 - 2011年:《美国肾脏病学会临床杂志》),选取主要目的是收集和报告调查结果的研究。纳入的是高度关注临床研究且影响因子较高的肾脏病学杂志。所有标题和摘要均进行双人筛选。如果调查是多方法研究的一部分、仅评估心理测量特征或使用半结构化访谈,则将其排除。收集有关调查和受访者特征、问卷编制(如预试验)、心理测量特征(如效度和信度)、用于优化回复率的调查方法(如多次联系系统)以及回复率的信息。
在筛选了19970条引文后,对216篇全文文章进行了审查,纳入了102项调查。约85%的研究报告了回复率。近一半的研究(46%)讨论了问卷的编制方式,只有四分之一的研究(28%)提及了问卷的效度或信度。多年来唯一有所改善的特征是报告缺失数据的文章比例(2001 - 2004年:46.4%;2005 - 2008年:61.9%;2009 - 2011年:84.8%;P<0.01)。
肾脏病学杂志中调查研究报告的质量仍不理想。特别是,问卷效度和信度的报告必须改进。显然需要提高调查研究报告质量和增加透明度的指南。