ZHAW Zurich University of Applied Sciences, Winterthur, Switzerland.
ZHAW School of Applied Linguistics, Winterthur, Switzerland.
Technol Health Care. 2021;29(6):1057-1069. doi: 10.3233/THC-202665.
Avatars in Virtual Reality (VR) can not only represent humans, but also embody intelligent software agents that communicate with humans, thus enabling a new paradigm of human-machine interaction.
The research agenda proposed in this paper by an interdisciplinary team is motivated by the premise that a conversation with a smart agent avatar in VR means more than giving a face and body to a chatbot. Using the concrete communication task of patient education, this research agenda is rather intended to explore which patterns and practices must be constructed visually, verbally, para- and nonverbally between humans and embodied machines in a counselling context so that humans can integrate counselling by an embodied VR smart agent into their thinking and acting in one way or another.
The scientific literature in different bibliographical databases was reviewed. A qualitative narrative approach was applied for analysis.
A research agenda is proposed which investigates how recurring consultations of patients with healthcare professionals are currently conducted and how they could be conducted with an embodied smart agent in immersive VR.
Interdisciplinary teams consisting of linguists, computer scientists, visual designers and health care professionals are required which need to go beyond a technology-centric solution design approach. Linguists' insights from discourse analysis drive the explorative experiments to identify test and discover what capabilities and attributes the smart agent in VR must have, in order to communicate effectively with a human being.
虚拟现实 (VR) 中的虚拟化身不仅可以代表人类,还可以体现与人类进行交流的智能软件代理,从而实现人机交互的新模式。
本文由跨学科团队提出的研究议程的前提是,与 VR 中的智能代理虚拟化身进行对话不仅仅是为聊天机器人赋予面孔和身体。使用患者教育的具体交流任务,本研究议程旨在探索在咨询环境中,人类和体现机器之间必须在视觉、语言、副语言和非语言方面构建哪些模式和实践,以便人类可以将通过体现 VR 的智能代理进行的咨询以某种方式融入他们的思维和行动中。
回顾了不同文献数据库中的科学文献。应用定性叙述方法进行分析。
提出了一个研究议程,该议程调查了当前如何进行患者与医疗保健专业人员的反复咨询,以及如何在沉浸式 VR 中使用体现智能代理的咨询。
需要由语言学家、计算机科学家、视觉设计师和医疗保健专业人员组成的跨学科团队,需要超越以技术为中心的解决方案设计方法。语言学家从语篇分析中获得的见解推动了探索性实验,以确定测试和发现 VR 中的智能代理必须具备哪些能力和属性,以便与人类进行有效沟通。