Kantor Daniel, Farlow Martin, Ludolph Albert, Montaner Joan, Sankar Raman, Sawyer Robert N, Stocchi Fabrizio, Lara Agnès, Clark Sarah, Deschet Karine, Ouyahia Loucif, Hadjiat Yacine
Florida Atlantic University, Boca Raton, FL, United States.
Nova Southeastern University, Fort Lauderdale, FL, United States.
Interact J Med Res. 2022 Jun 9;11(1):e35698. doi: 10.2196/35698.
Digital communication has emerged as a major source of scientific and medical information for health care professionals. There is a need to set up an effective and reliable methodology to assess and monitor the quality of content that is published on the internet.
The aim of this project was to develop content quality guidelines for Neurodiem, an independent scientific information platform dedicated to neurology for health care professionals and neuroscientists. These content quality guidelines are intended to be used by (1) content providers as a framework to meet content quality standards and (2) reviewers as a tool for analyzing and scoring quality of content.
Specific scientific criteria were designed using a 5-point scale to measure the quality of curated and original content published on the website: for Summaries, (1) source reliability and topic relevance for neurologists, (2) structure, and (3) scientific and didactic value; for Congress highlights, (1) relevance of congress selection, (2) congress coverage based on the original program, and (3) scientific and didactic value of individual abstracts; for Expert points of view and talks, (1) credibility (authorship) and topic relevance for neurologists, (2) scientific and didactic value, and (3) reliability (references) and format. The criteria were utilized on a monthly basis and endorsed by an independent scientific committee of widely recognized medical experts in neurology.
Summary content quality for the 3 domains (reliability and relevance, structure, and scientific and didactic value) increased in the second month after the implementation of the guidelines. The domain scientific and didactic value had a mean score of 8.20/10. Scores for the domains reliability and relevance (8-9/10) and structure (45-55/60) showed that the maintenance of these 2 quality items over time was more challenging. Talks (either in the format of interviews or slide deck-supported scientific presentations) and expert point of view demonstrated high quality after the implementation of the content quality guidelines that was maintained over time (15-25/25).
Our findings support that content quality guidelines provide both (1) a reliable framework for generating independent high-quality content that addresses the educational needs of neurologists and (2) are an objective evaluation tool for improving and maintaining scientific quality level. The use of these criteria and this scoring system could serve as a standard and reference to build an editorial strategy and review process for any medical news or platforms.
数字通信已成为医疗保健专业人员获取科学和医学信息的主要来源。有必要建立一种有效且可靠的方法来评估和监测互联网上发布内容的质量。
本项目的目的是为Neurodiem制定内容质量指南，Neurodiem是一个为医疗保健专业人员和神经科学家提供的专注于神经病学的独立科学信息平台。这些内容质量指南旨在供（1）内容提供者作为满足内容质量标准的框架使用，以及（2）评审人员作为分析和评估内容质量的工具使用。
设计了具体的科学标准，采用5分制来衡量网站上策划内容和原创内容的质量：对于摘要，（1）来源可靠性和对神经科医生的主题相关性，（2）结构，以及（3）科学和教学价值；对于会议亮点，（1）会议选择的相关性，（2）基于原始议程的会议报道，以及（3）各个摘要的科学和教学价值；对于专家观点和讲座，（1）可信度（作者身份）和对神经科医生的主题相关性，（2）科学和教学价值，以及（可靠性（参考文献）和格式。这些标准每月使用一次，并得到由广泛认可的神经学医学专家组成的独立科学委员会的认可。
在指南实施后的第二个月，三个领域（可靠性和相关性、结构以及科学和教学价值）的摘要内容质量有所提高。科学和教学价值领域的平均得分为8.20/10。可靠性和相关性领域（8 - 9/10）以及结构领域（45 - 55/60）的得分表明，随着时间的推移维持这两个质量项目更具挑战性。在实施内容质量指南后，讲座（以访谈或幻灯片支持的科学演示形式）和专家观点显示出高质量，并在一段时间内得以维持（15 - 25/25）。
我们的研究结果支持，内容质量指南既（1）为生成满足神经科医生教育需求的独立高质量内容提供了可靠框架，又（2）是用于提高和维持科学质量水平的客观评估工具。使用这些标准和评分系统可为任何医学新闻或平台构建编辑策略和评审流程提供标准和参考。
