IEEE Trans Vis Comput Graph. 2018 Apr;24(4):1437-1446. doi: 10.1109/TVCG.2018.2794058.
Drones allow exploring dangerous or impassable areas safely from a distant point of view. However, flight control from an egocentric view in narrow or constrained environments can be challenging. Arguably, an exocentric view would afford a better overview and, thus, more intuitive flight control of the drone. Unfortunately, such an exocentric view is unavailable when exploring indoor environments. This paper investigates the potential of drone-augmented human vision, i.e., of exploring the environment and controlling the drone indirectly from an exocentric viewpoint. If used with a see-through display, this approach can simulate X-ray vision to provide a natural view into an otherwise occluded environment. The user's view is synthesized from a three-dimensional reconstruction of the indoor environment using image-based rendering. This user interface is designed to reduce the cognitive load of the drone's flight control. The user can concentrate on the exploration of the inaccessible space, while flight control is largely delegated to the drone's autopilot system. We assess our system with a first experiment showing how drone-augmented human vision supports spatial understanding and improves natural interaction with the drone.
无人机可以从远处的视角安全地探索危险或无法通行的区域。然而,在狭窄或受限的环境中从自我中心的视角进行飞行控制可能具有挑战性。可以说,从外部视角可以提供更好的整体视图,从而更直观地控制无人机的飞行。不幸的是,在探索室内环境时,无法获得这种外部视角。本文研究了无人机增强的人类视觉的潜力,即从外部视角间接探索环境和控制无人机。如果与透视显示器一起使用,这种方法可以模拟 X 射线视觉,从而提供对原本被遮挡的环境的自然视图。用户的视图是使用基于图像的渲染从室内环境的三维重建中合成的。该用户界面旨在降低无人机飞行控制的认知负荷。用户可以专注于探索无法到达的空间,而飞行控制则主要委托给无人机的自动驾驶系统。我们通过第一个实验评估了我们的系统,该实验表明,无人机增强的人类视觉如何支持空间理解并改善与无人机的自然交互。