Madle Gemma, Berger Anouk, Cognat Sebastien, Menna Sylvio, Kostkova Patty
City eHealth Research Centre, City University, London, UK.
Inform Health Soc Care. 2009 Jan;34(1):30-8. doi: 10.1080/17538150902779204.
Evaluation on Internet portals is a key component of any online resource development. Understanding user information seeking behaviour and user perceived behaviour is essential to obtain the full picture of user needs, online activities and draw lessons to improve the design of Internet portals to better meet user expectations. This article discusses the evaluation of a WHO Internet portal: the Labresources website. The evaluation investigates user satisfaction with the resource, usability, demographic information about users and how well they could complete specific tasks using the website and compared this with the actual online behaviour revealing a number of discrepancies. An online questionnaire was advertised on the Labresources website during the period 25 November 2005 to 20 February 2006. As the site caters to English and French speakers, the questionnaire was made available in both languages. It consisted of two sections - the first section required the participant to complete three tasks using the website whereas the second section tested user satisfaction, information needs and appropriateness of the content. Weblogs data were compared with the questionnaire results to compare user perceived and actual online behaviour. Twenty one respondents completed the online questionnaire from a total of 18 countries. This was out of a potential 60 website users among whom the questionnaire was promoted. In general, respondents were satisfied with the website layout and navigation. 61.9% of respondents listed WHO among their top 5 and a third listed the Labresources website. The number of sessions where users browse (146) the information resources is almost three times more than the number of users who search (52) the resources. Weblogs revealed most interesting results with differences between what users reported doing when completing tasks and how easy they perceived the tasks and what they actually did. Twelve respondents completed at least one task. Of the remaining nine respondents, three did visit the Labresources website from the link in the questionnaire but did not go on to complete the tasks. Only one of the twelve who completed a task reported it being difficult. Three of the respondents who didn't complete a task reported the tasks to be difficult but only one of these actually followed the link to begin the tasks in the questionnaire. This article described an evaluation study investigating user perceived and actual behaviour at the WHO Labresources Internet portal. Although the questionnaire results demonstrated general satisfaction with the resource, a combination of a weblog evaluation with the questionnaire revealed a clearer picture of the user perception of and satisfaction with the website compared to their actual activity when completing the set tasks.
对互联网门户网站进行评估是任何在线资源开发的关键组成部分。了解用户的信息寻求行为和用户感知行为对于全面了解用户需求、在线活动以及吸取经验教训以改进互联网门户网站设计从而更好地满足用户期望至关重要。本文讨论了对世界卫生组织(WHO)的一个互联网门户网站——实验室资源网站(Labresources website)的评估。该评估调查了用户对该资源的满意度、可用性、用户的人口统计学信息,以及他们使用该网站完成特定任务的情况,并将其与实际在线行为进行比较,发现了一些差异。2005年11月25日至2006年2月20日期间,实验室资源网站上登出了一份在线调查问卷。由于该网站面向讲英语和法语的用户,调查问卷提供了这两种语言版本。它由两部分组成——第一部分要求参与者使用该网站完成三项任务,而第二部分测试用户满意度、信息需求以及内容的适用性。将网络日志数据与调查问卷结果进行比较,以对比用户感知的和实际的在线行为。共有来自18个国家的21名受访者完成了在线调查问卷。在推广调查问卷的潜在60名网站用户中,这是完成问卷的人数。总体而言,受访者对网站布局和导航感到满意。61.9%的受访者将世界卫生组织列为他们排名前5的机构,三分之一的受访者将实验室资源网站列入其中。用户浏览(146次)信息资源的会话次数几乎是搜索(52次)资源的用户数量的三倍。网络日志揭示了最有趣的结果,即用户在完成任务时报告的行为、他们认为任务的难易程度以及他们实际的行为之间存在差异。12名受访者完成了至少一项任务。在其余9名受访者中,有3人通过调查问卷中的链接访问了实验室资源网站,但没有继续完成任务。在完成任务的12人中,只有1人报告任务困难。在未完成任务的受访者中,有3人报告任务困难,但其中只有1人实际点击链接开始了调查问卷中的任务。本文描述了一项评估研究,该研究调查了世界卫生组织实验室资源互联网门户网站上用户感知的和实际的行为。尽管调查问卷结果显示用户对该资源总体满意,但将网络日志评估与调查问卷相结合,相比于用户在完成既定任务时的实际活动,能更清晰地呈现用户对该网站的感知和满意度情况。