Yang Nathan, Hosseini Sarah, Mascarella Marco A, Young Meredith, Posel Nancy, Fung Kevin, Nguyen Lily H P
Faculty of Medicine, McGill University, Montreal, QC, Canada.
Department of Otolaryngology - Head and Neck Surgery, McGill University, Montreal, QC, Canada.
J Otolaryngol Head Neck Surg. 2017 May 25;46(1):42. doi: 10.1186/s40463-017-0220-4.
Learners often utilize online resources to supplement formalized curricula, and to appropriately support learning, these resources should be of high quality. Thus, the objectives of this study are to develop and provide validity evidence supporting an assessment tool designed to assess the quality of educational websites in Otolaryngology- Head & Neck Surgery (ORL-HNS), and identify those that could support effective web-based learning. METHODS: After a literature review, the Modified Education in Otolaryngology Website (MEOW) assessment tool was designed by a panel of experts based on a previously validated website assessment tool. A search strategy using a Google-based search engine was used subsequently to identify websites. Those that were free of charge and in English were included. Websites were coded for whether their content targeted medical students or residents. Using the MEOW assessment tool, two independent raters scored the websites. Inter-rater and intra-rater reliability were evaluated, and scores were compared to recommendations from a content expert.
The MEOW assessment tool included a total of 20 items divided in 8 categories related to authorship, frequency of revision, content accuracy, interactivity, visual presentation, navigability, speed and recommended hyperlinks. A total of 43 out of 334 websites identified by the search met inclusion criteria. The scores generated by our tool appeared to differentiate higher quality websites from lower quality ones: websites that the expert "would recommend" scored 38.4 (out of 56; CI [34.4-42.4]) and "would not recommend" 27.0 (CI [23.2-30.9]). Inter-rater and intra-rater intraclass correlation coefficient were greater than 0.7.
Using the MEOW assessment tool, high quality ORL-HNS educational websites were identified.
学习者经常利用在线资源来补充正规课程，为了适当地支持学习，这些资源应该具有高质量。因此，本研究的目的是开发并提供效度证据，以支持一种旨在评估耳鼻咽喉-头颈外科（ORL-HNS）教育网站质量的评估工具，并识别那些能够支持有效的基于网络学习的网站。方法：在进行文献综述后，一个专家小组基于先前经过验证的网站评估工具设计了改良耳鼻咽喉科教育网站（MEOW）评估工具。随后使用基于谷歌的搜索引擎的搜索策略来识别网站。纳入那些免费且为英文的网站。对网站进行编码，以确定其内容是针对医学生还是住院医师。使用MEOW评估工具，两名独立评分者对网站进行评分。评估评分者间和评分者内的信度，并将分数与内容专家的建议进行比较。
MEOW评估工具共有20个项目，分为8个类别，涉及作者身份、修订频率、内容准确性、交互性、视觉呈现、可导航性、速度和推荐的超链接。通过搜索识别出的334个网站中，共有43个符合纳入标准。我们的工具生成的分数似乎能够区分高质量网站和低质量网站：专家“会推荐”的网站得分为38.4（满分56分；CI[34.4-42.4]），“不会推荐”的网站得分为27.0（CI[23.2-30.9]）。评分者间和评分者内的组内相关系数均大于0.7。
使用MEOW评估工具，识别出了高质量的ORL-HNS教育网站。
