Akwar Holy, Kloeze Harold, Mukhi Shamir
Canadian Network for Public Health Intelligence, National Microbiology Laboratory, Winnipeg, Manitoba.
Canadian Food Inspection Agency, Owen Sound, Ontario.
Online J Public Health Inform. 2016 Sep 15;8(2):e187. doi: 10.5210/ojphi.v8i2.6720. eCollection 2016.
To validate the utility and effectiveness of a standardized tool for prioritization of information sources for early detection of diseases.
The tool was developed with input from diverse public health experts garnered through survey. Ten raters used the tool to evaluate ten information sources and reliability among raters was computed. The Proc mixed procedure with random effect statement and SAS Macros were used to compute multiple raters' Fleiss Kappa agreement and Kendall's Coefficient of Concordance.
Ten disparate information sources evaluated obtained the following composite scores: ProMed 91%; WAHID 90%; Eurosurv 87%; MediSys 85%; SciDaily 84%; EurekAl 83%; CSHB 78%; GermTrax 75%; Google 74%; and CBC 70%. A Fleiss Kappa agreement of 50.7% was obtained for ten information sources and 72.5% for a sub-set of five sources rated, which is substantial agreement validating the utility and effectiveness of the tool.
This study validated the utility and effectiveness of a standardized criteria tool developed to prioritize information sources. The new tool was used to identify five information sources suited for use by the KIWI system in the CEZD-IIR project to improve surveillance of infectious diseases. The tool can be generalized to situations when prioritization of numerous information sources is necessary.
验证一种用于疾病早期检测信息源优先级排序的标准化工具的实用性和有效性。
该工具是在通过调查收集的不同公共卫生专家的意见输入下开发的。十名评分者使用该工具评估十个信息源，并计算评分者之间的可靠性。使用带有随机效应声明的Proc混合程序和SAS宏来计算多个评分者的Fleiss Kappa一致性和肯德尔和谐系数。
对十个不同的信息源进行评估后得到以下综合得分：ProMed为91%；WAHID为90%；Eurosurv为87%；MediSys为85%；SciDaily为84%；EurekAl为83%；CSHB为78%；GermTrax为75%；谷歌为74%；CBC为70%。十个信息源的Fleiss Kappa一致性为50.7%，对五个被评级信息源子集的一致性为72.5%，这是验证该工具实用性和有效性的实质性一致性。
本研究验证了一种为信息源优先级排序而开发的标准化标准工具的实用性和有效性。该新工具用于识别五个适合KIWI系统在CEZD-IIR项目中使用的信息源，以改善传染病监测。该工具可推广到需要对众多信息源进行优先级排序的情况。
