AMSTAR 在评价中医系统评价质量中的可靠性和外部有效性。
Reliability and External Validity of AMSTAR in Assessing Quality of TCM Systematic Reviews.
机构信息
Department of Evidence-Based Medicine and Clinical Epidemiology, West China Hospital, Sichuan University, Chengdu 610041, China.
出版信息
Evid Based Complement Alternat Med. 2012;2012:732195. doi: 10.1155/2012/732195. Epub 2012 Feb 16.
Abstract
Objective. The aim of this study is to measure the reliability and external validity of AMSTAR by applying it to a sample of TCM systematic reviews. Study Design and Methods. We tested the agreement, reliability, construct validity, and feasibility of AMSTAR through comparisons with OQAQ. Statistical analyses were performed by using SPSS 13.0. Results. A random of sample with 41 TCM systematic reviews was selected from a database. The interrater agreement of the individual items of AMSTAR was moderate with a mean kappa of 0.50 (95% CI: 0.26, 0.73). The ICC for AMSTAR against OQAQ (total score of 9 items, excluding item 10) was 0.87 (95% CI: 0.76, 0.93). Conclusions. Although there is room for improvement on few items, the new tool is reliable, valid, and easy to use for methodological quality assessment of systematic reviews on TCM.
摘要
目的。本研究旨在通过将 AMSTAR 应用于中医系统评价样本，来衡量其可靠性和外部有效性。
研究设计和方法。我们通过与 OQAQ 的比较来测试 AMSTAR 的一致性、可靠性、结构有效性和可行性。使用 SPSS 13.0 进行统计分析。
结果。从数据库中随机抽取 41 篇中医系统评价进行样本分析。AMSTAR 各项目的组内一致性中等，平均kappa 值为 0.50（95%置信区间：0.26，0.73）。AMSTAR 与 OQAQ（9 项总分，不包括第 10 项）的 ICC 为 0.87（95%置信区间：0.76，0.93）。
结论。尽管在少数项目上还有改进的空间，但新工具对于中医系统评价的方法学质量评估是可靠、有效且易于使用的。
相似文献
1
Reliability and External Validity of AMSTAR in Assessing Quality of TCM Systematic Reviews.
Evid Based Complement Alternat Med. 2012;2012:732195. doi: 10.1155/2012/732195. Epub 2012 Feb 16.
2
AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews.
J Clin Epidemiol. 2009 Oct;62(10):1013-20. doi: 10.1016/j.jclinepi.2008.10.009. Epub 2009 Feb 20.
3
[Assessment of reliability and validity of assessment of multiple systematic reviews in Chinese systematic reviews on stomatology].
Hua Xi Kou Qiang Yi Xue Za Zhi. 2013 Feb;31(1):49-52.
4
External validation of a measurement tool to assess systematic reviews (AMSTAR).
PLoS One. 2007 Dec 26;2(12):e1350. doi: 10.1371/journal.pone.0001350.
5
Comparison of methodological quality rating of systematic reviews on neuropathic pain using AMSTAR and R-AMSTAR.
BMC Med Res Methodol. 2018 May 8;18(1):37. doi: 10.1186/s12874-018-0493-y.
6
Measuring test-retest reliability (TRR) of AMSTAR provides moderate to perfect agreement - a contribution to the discussion of the importance of TRR in relation to the psychometric properties of assessment tools.
BMC Med Res Methodol. 2021 Mar 11;21(1):51. doi: 10.1186/s12874-021-01231-y.
7
Assessment of systematic reviews and meta-analyses available for bovine and equine veterinarians and quality of abstract reporting: A scoping review.
Prev Vet Med. 2018 Dec 1;161:50-59. doi: 10.1016/j.prevetmed.2018.10.011. Epub 2018 Oct 23.
8
Similarities, reliability and gaps in assessing the quality of conduct of systematic reviews using AMSTAR-2 and ROBIS: systematic survey of nutrition reviews.
BMC Med Res Methodol. 2021 Nov 27;21(1):261. doi: 10.1186/s12874-021-01457-w.
9
Systematic review found AMSTAR, but not R(evised)-AMSTAR, to have good measurement properties.
J Clin Epidemiol. 2015 May;68(5):574-83. doi: 10.1016/j.jclinepi.2014.12.009. Epub 2014 Dec 30.
10
[Methodological quality assessment of systematic reviews correlated to traditional Chinese medicine published in China].
Zhongguo Zhong Xi Yi Jie He Za Zhi. 2011 Mar;31(3):402-6.
引用本文的文献
1
[Not Available].
Physiother Can. 2022 Jan 1;74(1):15-24. doi: 10.3138/ptc-2019-0104. Epub 2021 Mar 2.
2
Psychometric properties and use of the DEMQOL suite of instruments in research: a systematic review protocol.
BMJ Open. 2021 Feb 5;11(2):e041318. doi: 10.1136/bmjopen-2020-041318.
3
Acupuncture for the Postcholecystectomy Syndrome: A Systematic Review and Meta-Analysis.
Evid Based Complement Alternat Med. 2020 Jul 30;2020:7509481. doi: 10.1155/2020/7509481. eCollection 2020.
4
Characteristics, trend, and methodological quality of systematic reviews and meta-analyses in nuclear medicine: A bibliometric analysis of studies published between 2005 and 2016.
Medicine (Baltimore). 2019 May;98(21):e15785. doi: 10.1097/MD.0000000000015785.
5
Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: protocol for a descriptive analytic study.
Syst Rev. 2018 Jun 13;7(1):85. doi: 10.1186/s13643-018-0746-1.
6
Traditional Chinese medicine for knee osteoarthritis: An overview of systematic review.
PLoS One. 2017 Dec 21;12(12):e0189884. doi: 10.1371/journal.pone.0189884. eCollection 2017.
7
Evaluation of AMSTAR to assess the methodological quality of systematic reviews in overviews of reviews of healthcare interventions.
BMC Med Res Methodol. 2017 Mar 23;17(1):48. doi: 10.1186/s12874-017-0325-5.
8
Exercise and sleep: a systematic review of previous meta-analyses.
J Evid Based Med. 2017 Feb;10(1):26-36. doi: 10.1111/jebm.12236.
9
[Not Available].
Physiother Can. 2017;69(1):20-29. doi: 10.3138/ptc.2015-80F.
10
Limitations of A Measurement Tool to Assess Systematic Reviews (AMSTAR) and suggestions for improvement.
Syst Rev. 2016 Apr 12;5:58. doi: 10.1186/s13643-016-0237-1.
本文引用的文献
1
Effect of integrated traditional Chinese medicine and western medicine on the treatment of severe acute respiratory syndrome: A meta-analysis.
Pharm Pract (Granada). 2007 Jan;5(1):1-9. doi: 10.4321/s1886-36552007000100001.
2
Analysis on the distinguishing features of traditional Chinese therapeutics and related statistical issues.
Front Med. 2011 Jun;5(2):203-7. doi: 10.1007/s11684-011-0138-6. Epub 2011 Jun 22.
3
Epidemiology, quality and reporting characteristics of systematic reviews of traditional Chinese medicine interventions published in Chinese journals.
PLoS One. 2011;6(5):e20185. doi: 10.1371/journal.pone.0020185. Epub 2011 May 25.
4
[Methodological quality assessment of systematic reviews correlated to traditional Chinese medicine published in China].
Zhongguo Zhong Xi Yi Jie He Za Zhi. 2011 Mar;31(3):402-6.
5
AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews.
J Clin Epidemiol. 2009 Oct;62(10):1013-20. doi: 10.1016/j.jclinepi.2008.10.009. Epub 2009 Feb 20.
6
Traditional Chinese medicine plus transcatheter arterial chemoembolization for unresectable hepatocellular carcinoma.
J Altern Complement Med. 2008 Oct;14(8):1027-42. doi: 10.1089/acm.2008.0060.
7
[Systematic review of randomized controlled trials on preventing and treating restenosis after percutaneous coronary intervention with Chinese medicine].
Zhongguo Zhong Xi Yi Jie He Za Zhi. 2008 Jul;28(7):597-601.
8
Chinese medicinal herbs for acute bronchitis.
Cochrane Database Syst Rev. 2008 Jan 23(1):CD004560. doi: 10.1002/14651858.CD004560.pub3.
9
Methodology and reporting quality of systematic review/meta-analysis of traditional Chinese medicine.
J Altern Complement Med. 2007 Oct;13(8):797-805. doi: 10.1089/acm.2007.7195.
10
Chinese herbal medicines in the treatment of ectopic pregnancy.
Cochrane Database Syst Rev. 2007 Oct 17(4):CD006224. doi: 10.1002/14651858.CD006224.pub2.
Zotero 插件