Chojecki Paul, Strazdas Dominykas, Przewozny David, Gard Niklas, Runde Detlef, Hoerner Niklas, Al-Hamadi Ayoub, Eisert Peter, Bosse Sebastian
Fraunhofer HHI, 10587 Berlin, Germany.
Neuro-Information Technology, Otto-von-Guericke-University Magdeburg, 39106 Magdeburg, Germany.
Sensors (Basel). 2023 May 24;23(11):5043. doi: 10.3390/s23115043.
Multimodal user interfaces promise natural and intuitive human-machine interactions. However, is the extra effort for the development of a complex multisensor system justified, or can users also be satisfied with only one input modality? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and the use of multiple input modalities is valuable and that it is difficult to predict the usability of individual input modalities for complex systems.
多模态用户界面有望实现自然直观的人机交互。然而，开发复杂多传感器系统所付出的额外努力是否合理，或者用户仅使用一种输入方式是否也能满意？本研究调查了工业焊接检测工作站中的交互情况。测试了三种单模态界面，包括与工件或工作台上增强按钮的空间交互以及语音命令，这些界面分别单独测试以及进行多模态组合测试。在单模态条件下，用户更喜欢增强工作台，但总体而言，多模态条件下所有输入技术的个体使用情况排名最佳。我们的研究结果表明，多种输入方式的实现和使用是有价值的，而且很难预测复杂系统中单个输入方式的可用性。
