Xie Jingyi, Yu Rui, Lee Sooyeon, Lyu Yao, Billah Syed Masum, Carroll John M
Pennsylvania State University, University Park, PA, USA.
Rochester Institute of Technology, Rochester, NY, USA.
DIS (Des Interact Syst Conf). 2022 Jun;2022:881-897. doi: 10.1145/3532106.3533560. Epub 2022 Jun 13.
Remote sighted assistance (RSA) has emerged as a conversational assistive service, where remote sighted workers, ., agents, provide real-time assistance to blind users via video-chat-like communication. Prior work identified several challenges for the agents to provide navigational assistance to users and proposed computer vision-mediated RSA service to address those challenges. We present an interactive system implementing a high-fidelity prototype of RSA service using augmented reality (AR) maps with localization and virtual elements placement capabilities. The paper also presents a confederate-based study design to evaluate the effects of AR maps with 13 untrained agents. The study revealed that, compared to baseline RSA, agents were significantly faster in providing indoor navigational assistance to a confederate playing the role of users, and agents' mental workload was significantly reduced-all indicate the feasibility and scalability of AR maps in RSA services.
远程视力辅助(RSA)已成为一种对话式辅助服务,在这种服务中,远程视力工作者(如代理)通过类似视频聊天的通信方式为盲人用户提供实时帮助。先前的工作确定了代理为用户提供导航辅助时面临的几个挑战,并提出了计算机视觉介导的RSA服务来应对这些挑战。我们展示了一个交互式系统,该系统使用具有定位和虚拟元素放置功能的增强现实(AR)地图实现了RSA服务的高保真原型。本文还提出了一种基于同盟者的研究设计,以评估13名未经训练的代理使用AR地图的效果。研究表明,与基线RSA相比,代理在为扮演用户角色的同盟者提供室内导航辅助时速度明显更快,并且代理的心理工作量显著降低——所有这些都表明AR地图在RSA服务中的可行性和可扩展性。