Monteiro Maristela Goldnadel, Pantani Daniela, Pinsky Ilana, Hernandes Rocha Thiago Augusto
Department of Noncommunicable Diseases and Mental Health, Pan American Health Organization, Washington, DC, United States.
Department of Health Analysis, Metrics and Evidence, Pan American Health Organization, Washington, DC, United States.
JMIR Form Res. 2023 Apr 6;7:e43165. doi: 10.2196/43165.
There is widespread misinformation about the effects of alcohol consumption on health, which was amplified during the COVID-19 pandemic through social media and internet channels. Chatbots and conversational agents became an important piece of the World Health Organization (WHO) response during the COVID-19 pandemic to quickly disseminate evidence-based information related to COVID-19 and tobacco to the public. The Pan American Health Organization (PAHO) seized the opportunity to develop a conversational agent to talk about alcohol-related topics and therefore complement traditional forms of health education that have been promoted in the past.
This study aimed to develop and deploy a digital conversational agent to interact with an unlimited number of users anonymously, 24 hours a day, about alcohol topics, including ways to reduce risks from drinking, that is accessible in several languages, at no cost, and through various devices.
The content development was based on the latest scientific evidence on the impacts of alcohol on health, social norms about drinking, and data from the WHO and PAHO. The agent itself was developed through a nonexclusive license agreement with a private company (Soul Machines) and included Google Digital Flow ES as the natural language processing software and Amazon Web Services for cloud services. Another company was contracted to program all the conversations, following the technical advice of PAHO staff.
The conversational agent was named Pahola, and it was deployed on November 19, 2021, through the PAHO website after a launch event with high publicity. No identifiable data were used and all interactions were anonymous, and therefore, this was not considered research with human subjects. Pahola speaks in English, Spanish, and Portuguese and interacts anonymously with a potentially infinite number of users through various digital devices. Users were required to accept the terms and conditions to enable access to their camera and microphone to interact with Pahola. Pahola attracted good attention from the media and reached 1.6 million people, leading to 236,000 clicks on its landing page, mostly through mobile devices. Only 1532 users had a conversation after clicking to talk to Pahola. The average time users spent talking to Pahola was 5 minutes. Major dropouts were observed in different steps of the conversation flow. Some questions asked by users were not anticipated during programming and could not be answered.
Our findings showed several limitations to using a conversational agent for alcohol education to the general public. Improvements are needed to expand the content to make it more meaningful and engaging to the public. The potential of chatbots to educate the public on alcohol-related topics seems enormous but requires a long-term investment of resources and research to be useful and reach many more people.
关于饮酒对健康的影响存在广泛的错误信息,在新冠疫情期间,这些错误信息通过社交媒体和网络渠道进一步扩散。聊天机器人和对话代理成为世界卫生组织(WHO)在新冠疫情期间应对措施的重要组成部分,用于快速向公众传播与新冠疫情和烟草相关的循证信息。泛美卫生组织(PAHO)抓住机会开发了一个对话代理,用于谈论与酒精相关的话题,从而补充过去推广的传统健康教育形式。
本研究旨在开发并部署一个数字对话代理,该代理可以每天24小时、以多种语言免费通过各种设备与不限数量的用户进行匿名互动,讨论酒精相关话题,包括降低饮酒风险的方法。
内容开发基于关于酒精对健康影响的最新科学证据、饮酒的社会规范以及WHO和PAHO的数据。该代理本身是通过与一家私人公司(Soul Machines)签订的非独家许可协议开发的,包括谷歌数字流ES作为自然语言处理软件和亚马逊网络服务用于云服务。另一家公司根据PAHO工作人员的技术建议,负责编写所有对话程序。
这个对话代理被命名为帕奥拉(Pahola),在一场高关注度的发布活动后,于2021年11月19日通过PAHO网站进行了部署。未使用可识别的数据,所有互动都是匿名的,因此,这并不被视为对人类受试者的研究。帕奥拉能用英语、西班牙语和葡萄牙语交流,并通过各种数字设备与潜在的无限数量的用户进行匿名互动。用户需要接受条款和条件才能启用摄像头和麦克风与帕奥拉互动。帕奥拉引起了媒体的广泛关注,覆盖人数达160万,其着陆页的点击量达23.6万次,大部分点击来自移动设备。只有1532名用户在点击与帕奥拉交谈后进行了对话。用户与帕奥拉交谈的平均时间为5分钟。在对话流程的不同步骤中出现了大量流失。用户提出的一些问题在编程时未被预料到,无法得到回答。
我们的研究结果显示了使用对话代理对公众进行酒精教育存在的若干局限性。需要改进以扩展内容,使其对公众更有意义且更具吸引力。聊天机器人在向公众宣传酒精相关话题方面的潜力似乎巨大,但需要长期投入资源和进行研究才能发挥作用并覆盖更多人群。