[口腔医学中文系统评价中多个系统评价评估的可靠性与有效性评估]

[Assessment of reliability and validity of assessment of multiple systematic reviews in Chinese systematic reviews on stomatology].

作者信息

Su Naichuan, Lü Jun, Li Chunjie, Chen Liangping, Shi Zongdao

机构信息

State Key Laboratory of Oral Diseases, Sichuan University, Chengdu 610041, China.

出版信息

Hua Xi Kou Qiang Yi Xue Za Zhi. 2013 Feb;31(1):49-52.

PMID:23484302

Abstract

OBJECTIVE

To measure the agreement, reliability and validity of assessment of multiple systematic reviews (AMSTAR) to assess Chinese systematic reviews on stomatology.

METHODS

A comprehensive electronic search was made through Chinese BioMedical Literature Database, VIP Database for Chinese Technical Periodicals and China National Knowledge Infrastructure electronically on March 1st 2011 together with handsearch through 19 stomatological journals to identify published Chinese systematic reviews on stomatology. Each systematic review was assessed by two reviewers with overview quality assessment questionnaire (OQAQ) and AMSTAR. And reliability (interobserver Kappa of the 11 AMSTAR items), interclass correlation coefficient (ICC) of the sum scores and construct validity (ICC of the sum scores of AMSTAR compared with those of the OQAQ) were reported.

RESULTS

A total of 52 systematic reviews on stomatology were eligible. The reviewers agreement of the individual items of AMSTAR was with a mean Kappa of 0.81 [95% CI(0.73, 0.89)] while the OQAQ was 0.74 [95% CI (0.66, 0.83)]. The ICC of the total score for AMSTAR was 0.98 [95% CI (0.97, 0.99), P = 0.000]. Cronbach' alpha was 0.69 [95% CI (0.56, 0.80), P = 0.000]. And ICC of the sum scores of AMSTAR compared with those of the OQAQ was 0.94 [95% CI (0.90, 0.97), P = 0.000].

CONCLUSION

AMSTAR has good agreement, reliability and validity. AMSTAR can be well used in Chinese stomatology and can bring dentists much convenience when assess the methodological quality of systematical reviews on stomatology.

摘要

目的

评估多系统评价评估工具（AMSTAR）用于评价中文口腔医学系统评价的一致性、可靠性和有效性。

方法

于2011年3月1日通过中国生物医学文献数据库、维普中文科技期刊数据库和中国知网进行全面电子检索，并手工检索19种口腔医学期刊，以识别已发表的中文口腔医学系统评价。由两名评价者使用综述质量评估问卷（OQAQ）和AMSTAR对每个系统评价进行评估。报告可靠性（11项AMSTAR条目的观察者间Kappa值）、总分的组内相关系数（ICC）以及结构效度（AMSTAR总分与OQAQ总分的ICC比较）。

结果

共有52篇口腔医学系统评价符合纳入标准。AMSTAR各条目评价者间一致性的平均Kappa值为0.81[95%CI（0.73，0.89）]，而OQAQ为0.74[95%CI（0.66，0.83）]。AMSTAR总分的ICC为0.98[95%CI（0.97，0.99），P = 0.000]。Cronbach's α为0.69[95%CI（0.56，0.80），P = 0.000]。AMSTAR总分与OQAQ总分的ICC为0.94[95%CI（0.90，0.97），P = 0.000]。