韩国在线报纸文章的健康信息质量评估工具：开发研究

A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study.

作者信息

Lee Naae, Oh Seung-Won, Cho Belong, Myung Seung-Kwon, Hwang Seung-Sik, Yoon Goo Hyeon

机构信息

Department of Public Health Science, Graduate School of Public Health, Seoul National University, Seoul, Republic of Korea.

Department of Family Medicine, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Republic of Korea.

出版信息

J Med Internet Res. 2021 Jul 29;23(7):e24436. doi: 10.2196/24436.

DOI:10.2196/24436

PMID:34326038

原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC8367132/

Abstract

BACKGROUND

Concern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers.

OBJECTIVE

This study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles.

METHODS

We reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation.

RESULTS

Overall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69).

CONCLUSIONS

We developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea.

摘要

背景

人们对在线报纸文章所提供的健康相关信息的可靠性和准确性的担忧日益增加。关于在线信息质量评估，已经提出并发表了许多标准和条目，但目前尚无适用于在线报纸的标准质量评估工具。

目的

本研究旨在开发用于在线报纸文章的健康信息质量评估工具（HIQUAL）。

方法

我们回顾了以往的健康信息质量评估工具及相关研究，并据此制定和定制了新的标准。使用Fleiss κ系数和Gwet一致性系数，对3篇关于不同主题（结直肠癌、肥胖基因检测和高血压诊断标准）的报纸文章评估新评估工具的评分者间一致性。为比较各工具对生成的质量得分，使用Kendall τ等级相关性来测量收敛效度。

结果

总体而言，报纸文章的HIQUAL包括5个领域的10个条目：可靠性、有用性、可理解性、充分性和透明度。关于结直肠癌文章的评分者间一致性处于中等至较高范围（Fleiss κ = 0.48，标准误0.11；Gwet一致性系数 = 0.74，标准误0.13），而对于介绍肥胖基因检测的文章，一致性处于较高范围，两种测量方法的值分别为0.63（标准误0.28）和0.86（标准误0.10）。关于高血压诊断标准的文章一致性相对较低，分别为0.20（标准误0.10）和0.75（标准误0.13）。用Kendall τ评估的相关性效度显示工具间具有良好相关性（HIQUAL与DISCERN = 0.72，HIQUAL与QUEST [质量评估评分工具] = 0.69）。