Hu Yang, Yang Yiran, Li Wei, Zhou Yan, Sun Jing
Peking University Third Hospital, Beijing, China.
School of Nursing, Peking University, 38 Xueyuan Rd, Haidian District, Beijing, China, 86 13520238688.
J Med Internet Res. 2025 Sep 18;27:e72661. doi: 10.2196/72661.
With the increasing use of social media platforms for health communication, the quality of health educational short videos (HESVs) has become a key concern. However, no standardized framework exists to evaluate the quality of health videos on social media, highlighting the need for a comprehensive evaluation system.
This study aimed to develop a valid and structured evaluation tool for assessing the quality of HESVs on social media.
The initial evaluation indicators obtained from the literature review and brainstorming undertaken in the study group were provided to the nominal group reference Lasswell's 5W communication model, and 2 rounds of nominal group technique (NGT) were carried out to screen, add, revise, and adjust indicators, and reach a consensus of evaluation system. The indicators were then ranked based on their significance, as scored by the experts using the analytic hierarchy process. The content validity was assessed by experts who rated the relevance of each indicator on a 4-point Likert scale.
The primary indicators include communicator, communication content, communication channel, and communication effect, along with 13 secondary indicators and 34 tertiary indicators. In total, 11 experts were enrolled in the NGT, 45% (5/11) of experts had a doctoral degree, and 80% (9/11) of them were ranked as an associate professor or professor. The average values of the expert judgment coefficient and authority coefficient were 0.93 (SD 0.08) and 0.85 (SD 0.10), respectively. In round 1 of NGT, the "communication target" of 5 primary indicators, 7 of 20 secondary indicators, and 66 of 94 tertiary indicators did not reach a consensus, and therefore, they were not deleted and proceeded to the next round of NGT. In round 2 of NGT, 1 primary indicator, 7 secondary indicators, and 59 tertiary indicators were deleted based on the consensus criteria. Among primary indicators, communication content was found to be the most influential, accounting for 45.68%. Among secondary indicators, credibility, scientificity, availability, and social attention were the most influential indicators, with priorities of 56.67%, 24.26%, 74.62%, and 39.89% in their respective categories. Among tertiary indicators, "become a hot search recommended by the platform" was the most influential indicator with a weight of 0.07. The content validity of all the evaluation indicators was 0.73-1.0, and the scale-level content validity index (average) was 0.87 (SD 0.15), which was indicated as acceptable.
The evaluation system for the quality of HESVs on social media (LassVQ; the Lasswell's Video Quality scale) was developed, and its validity was acceptable. The proposed evaluation system can be used in conjunction with qualitative methods to gain a holistic perspective on the multidimensional quality of HESVs on social media.
随着社交媒体平台在健康传播中的使用日益增加，健康教育短视频（HESV）的质量已成为关键关注点。然而，目前尚无用于评估社交媒体上健康视频质量的标准化框架，这凸显了建立全面评估系统的必要性。
本研究旨在开发一种有效且结构化的评估工具，用于评估社交媒体上HESV的质量。
将研究组通过文献回顾和头脑风暴获得的初始评估指标提供给名义小组，参考拉斯韦尔的5W传播模式，进行两轮名义小组技术（NGT）以筛选、添加、修订和调整指标，并达成评估系统的共识。然后，专家们使用层次分析法根据指标的重要性对其进行排序。通过专家以4分李克特量表对每个指标的相关性进行评分来评估内容效度。
主要指标包括传播者、传播内容、传播渠道和传播效果，以及13个二级指标和34个三级指标。共有11名专家参与了NGT，45%（5/11）的专家拥有博士学位，80%（9/11）的专家被评为副教授或教授。专家判断系数和权威系数的平均值分别为0.93（标准差0.08）和0.85（标准差0.10）。在NGT的第一轮中，5个主要指标中的“传播目标”、20个二级指标中的7个以及94个三级指标中的66个未达成共识，因此未被删除并进入下一轮NGT。在NGT的第二轮中，根据共识标准删除了1个主要指标、7个二级指标和59个三级指标。在主要指标中，传播内容被发现是最具影响力的，占45.68%。在二级指标中，可信度、科学性、可用性和社会关注度是最具影响力的指标，在各自类别中的优先级分别为56.67%、24.26%、74.62%和39.89%。在三级指标中，“成为平台推荐的热搜”是最具影响力的指标，权重为0.07。所有评估指标的内容效度为0.73 - 1.0，量表级内容效度指数（平均值）为0.87（标准差0.15），表明可接受。
开发了社交媒体上HESV质量评估系统（LassVQ；拉斯韦尔视频质量量表），其效度可接受。所提出的评估系统可与定性方法结合使用，以全面了解社交媒体上HESV的多维度质量。
