IEEE Trans Vis Comput Graph. 2022 Nov;28(11):3748-3758. doi: 10.1109/TVCG.2022.3203116. Epub 2022 Oct 21.
Learning vocabulary in a primary or secondary language is enhanced when we encounter words in context. This context can be afforded by the place or activity we are engaged with. Existing learning environments include formal learning, mnemonics, flashcards, use of a dictionary or thesaurus, all leading to practice with new words in context. In this work, we propose an enhancement to the language learning process by providing the user with words and learning tools in context, with VocabulARy. VocabulARy visually annotates objects in AR, in the user's surroundings, with the corresponding English (first language) and Japanese (second language) words to enhance the language learning process. In addition to the written and audio description of each word, we also present the user with a keyword and its visualisation to enhance memory retention. We evaluate our prototype by comparing it to an alternate AR system that does not show an additional visualisation of the keyword, and, also, we compare it to two non-AR systems on a tablet, one with and one without visualising the keyword. Our results indicate that AR outperforms the tablet system regarding immediate recall, mental effort and task-completion time. Additionally, the visualisation approach scored significantly higher than showing only the written keyword with respect to immediate and delayed recall and learning efficiency, mental effort and task-completion time.
当我们在上下文中遇到单词时，学习初级或中级语言的词汇会得到增强。这种上下文可以通过我们正在参与的场所或活动来提供。现有的学习环境包括正式学习、记忆术、闪卡、使用字典或词库，所有这些都可以在上下文中练习新单词。在这项工作中，我们通过在 VocabulARy 中为用户提供上下文中的单词和学习工具，为语言学习过程提供了增强。VocabulARy 通过在 AR 中对用户周围的物体进行视觉注释，用相应的英语（第一语言）和日语（第二语言）单词来增强语言学习过程。除了每个单词的书面和音频描述外，我们还为用户提供了关键字及其可视化，以增强记忆保留。我们通过将其与不显示关键字额外可视化的替代 AR 系统进行比较，以及与在平板电脑上的两个非 AR 系统进行比较，来评估我们的原型，其中一个系统显示关键字，另一个系统不显示关键字。我们的结果表明，AR 在即时回忆、心理努力和任务完成时间方面优于平板电脑系统。此外，与仅显示书面关键字相比，可视化方法在即时和延迟回忆以及学习效率、心理努力和任务完成时间方面的得分显著更高。
