Seidman Joshua J, Steinwachs Donald, Rubin Haya R
Center for Information Therapy, Healthwise, Inc, 600 New Hampshire Avenue, NW, Washington, DC 20037, USA.
J Med Internet Res. 2003 Nov 27;5(4):e30. doi: 10.2196/jmir.5.4.e30.
Most existing tools for measuring the quality of Internet health information focus almost exclusively on structural criteria or other proxies for quality information rather than evaluating actual accuracy and comprehensiveness.
This research sought to develop a new performance-measurement tool for evaluating the quality of Internet health information, test the validity and reliability of the tool, and assess the variability in diabetes Web site quality.
An objective, systematic tool was developed to evaluate Internet diabetes information based on a quality-of-care measurement framework. The principal investigator developed an abstraction tool and trained an external reviewer on its use. The tool included 7 structural measures and 34 performance measures created by using evidence-based practice guidelines and experts' judgments of accuracy and comprehensiveness.
Substantial variation existed in all categories, with overall scores following a normal distribution and ranging from 15% to 95% (mean was 50% and median was 51%). Lin's concordance correlation coefficient to assess agreement between raters produced a rho of 0.761 (Pearson's r of 0.769), suggesting moderate to high agreement. The average agreement between raters for the performance measures was 0.80.
Diabetes Web site quality varies widely. Alpha testing of this new tool suggests that it could become a reliable and valid method for evaluating the quality of Internet health sites. Such an instrument could help lay people distinguish between beneficial and misleading information.
大多数现有的衡量互联网健康信息质量的工具几乎完全专注于结构标准或其他质量信息的代理指标，而非评估实际的准确性和全面性。
本研究旨在开发一种用于评估互联网健康信息质量的新的性能测量工具，测试该工具的有效性和可靠性，并评估糖尿病网站质量的变异性。
基于医疗质量测量框架开发了一种客观、系统的工具来评估互联网糖尿病信息。主要研究者开发了一种提取工具并培训一名外部评审员如何使用它。该工具包括7项结构指标和34项性能指标，这些指标是通过使用循证实践指南以及专家对准确性和全面性的判断而创建的。
所有类别中均存在显著差异，总体得分呈正态分布，范围为15%至95%（均值为50%，中位数为51%）。用于评估评分者之间一致性的林氏一致性相关系数产生的rho值为0.761（皮尔逊r值为0.769），表明一致性为中度到高度。评分者之间对性能指标的平均一致性为0.80。
糖尿病网站质量差异很大。对这个新工具的阿尔法测试表明，它可能成为评估互联网健康网站质量的一种可靠且有效的方法。这样一种工具可以帮助外行人区分有益信息和误导性信息。
