Shea Beverley J, Grimshaw Jeremy M, Wells George A, Boers Maarten, Andersson Neil, Hamel Candyce, Porter Ashley C, Tugwell Peter, Moher David, Bouter Lex M
EMGO Institute, VU University Medical Center, Amsterdam, The Netherlands.
BMC Med Res Methodol. 2007 Feb 15;7:10. doi: 10.1186/1471-2288-7-10.
Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus.
A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity.
The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity.
A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.
我们的目标是在先前工具、实证证据和专家共识的基础上，开发一种用于评估系统评价方法学质量的工具。
通过合并以下内容形成一个包含37个条目的评估工具：1）增强版综述质量评估问卷（OQAQ）；2）萨克斯创建的一个清单；3）最近判定具有方法学重要性的另外三个条目。该工具应用于99篇纸质和52篇电子系统评价。采用探索性因子分析来识别潜在成分。方法学专家使用名义群体技术来考虑结果，旨在减少条目数量并设计一个具有表面效度和内容效度的评估工具。
因子分析识别出11个成分。名义群体从每个成分中选择一个条目。最终得到的工具被判定具有表面效度和内容效度。
开发了一种用于“评估多个系统评价”（AMSTAR）的测量工具。该工具由11个条目组成，在测量系统评价的方法学质量方面具有良好的表面效度和内容效度。在能够就其使用提出强有力的建议之前，需要开展更多侧重于AMSTAR的可重复性和结构效度的研究。
