Shahabi Saeed, Mojgani Parviz, Lankarani Kamran Bagheri, Jalali Maryam
Health Policy Research Center, Institute of Health Shiraz University of Medical Sciences Shiraz Iran.
Iran-Helal Institute of Applied Science and Technology Tehran Iran.
Health Sci Rep. 2023 Mar 1;6(3):e1130. doi: 10.1002/hsr2.1130. eCollection 2023 Mar.
Given the importance of systematic reviews (SRs) for practitioners, researchers, and policymakers, it is essential to assess them to ensure robust methodology and reliable results before applying them. The purpose of this methodological study was to assess the methodological and reporting quality of recently published SRs and/or meta-analyses (MAs) evaluating the effects of ankle-foot orthoses (AFOs) on clinical outcomes in stroke survivors.
PubMed, Scopus, Web of Science, Embase, ProQuest, CENTRAL, REHABDATA, and PEDro were searched. The research team applied A Measurement Tool to Assess Systematic Reviews 2 (AMSTAR-2) tool and Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) checklist for evaluating the reporting and methodological quality, respectively, and the ROBIS tool was used to evaluate the risk of bias (RoB) in the included reviews. The quality of the evidence was also judged using the (Grades of Recommendation, Assessment, Development and Evaluation) GRADE method.
In final, 14 SRs/MAs met inclusion criteria. Evaluation of methodological quality using the AMSTAR-2 tool demonstrated that the overall quality of included reviews was mostly "critically low" or "low," except for two studies that were "high." In addition, the findings showed that the mean score of the reporting quality of the included reviews based on the PRISMA criteria was 24.9, down from 42. In accordance with the overall evaluation applying the ROBIS tool, 14.3% of the review studies were evaluated as high RoB, 64.3% were evaluated as unclear RoB, and 21.4% were evaluated as low RoB. Regarding the level of evidence quality, the GRADE results indicated that the evidence quality of the included reviews was unsatisfactory.
This study showed that although the reporting quality of recently published SR/MAs evaluating the clinical effects of AFOs in stroke survivors was moderate, the methodological quality of almost all reviews was suboptimal. Therefore, reviewers must consider a number of criteria in designing, conducting, and reporting their studies to move toward transparent and conclusive results.
鉴于系统评价(SRs)对从业者、研究人员和政策制定者的重要性,在应用之前对其进行评估以确保方法的稳健性和结果的可靠性至关重要。本方法学研究的目的是评估最近发表的评估踝足矫形器(AFOs)对中风幸存者临床结局影响的SRs和/或荟萃分析(MAs)的方法学和报告质量。
检索了PubMed、Scopus、Web of Science、Embase、ProQuest、CENTRAL、REHABDATA和PEDro。研究团队分别应用评估系统评价的测量工具2(AMSTAR-2)工具和系统评价与荟萃分析的首选报告项目(PRISMA)清单来评估报告质量和方法学质量,并使用ROBIS工具评估纳入评价中的偏倚风险(RoB)。还使用推荐分级、评估、制定与评价(GRADE)方法判断证据质量。
最终,14项SRs/MAs符合纳入标准。使用AMSTAR-2工具评估方法学质量表明,纳入评价的总体质量大多为“极低”或“低”,只有两项研究为“高”。此外,研究结果显示,根据PRISMA标准,纳入评价的报告质量平均得分为24.9,低于42分。根据应用ROBIS工具的总体评价,14.3%的评价研究被评估为高RoB,64.3%被评估为RoB不明确,21.4%被评估为低RoB。关于证据质量水平,GRADE结果表明纳入评价的证据质量不令人满意。
本研究表明,尽管最近发表的评估AFOs对中风幸存者临床影响的SR/MAs的报告质量中等,但几乎所有评价的方法学质量都不理想。因此,评价者在设计、开展和报告研究时必须考虑一些标准,以得出透明且确凿的结果。