Computer Science and Communication Research Centre, School of Technology and Management, Polytechnic Institute of Leiria, Campus 2, Morro do Lena-Alto do Vieiro, Apartado 4163, 2411-901 Leiria, Portugal.
INESC TEC, University of Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801 Vila Real, Portugal.
Sensors (Basel). 2021 Feb 19;21(4):1456. doi: 10.3390/s21041456.
Data and services are available anywhere at any time thanks to the Internet and mobile devices. Nowadays, there are new ways of representing data through trendy technologies such as augmented reality (AR), which extends our perception of reality through the addition of a virtual layer on top of real-time images. The great potential of unmanned aerial vehicles (UAVs) for carrying out routine and professional tasks has encouraged their use in the creation of several services, such as package delivery or industrial maintenance. Unfortunately, drone piloting is difficult to learn and requires specific training. Since regular training is performed with virtual simulations, we decided to propose a multiplatform cloud-hosted solution based in Web AR for drone training and usability testing. This solution defines a configurable trajectory through virtual elements represented over barcode markers placed on a real environment. The main goal is to provide an inclusive and accessible training solution which could be used by anyone who wants to learn how to pilot or test research related to UAV control. For this paper, we reviewed drones, AR, and human-drone interaction (HDI) to propose an architecture and implement a prototype, which was built using a Raspberry Pi 3, a camera, and barcode markers. The validation was conducted using several test scenarios. The results show that a real-time AR experience for drone pilot training and usability testing is achievable through web technologies. Some of the advantages of this approach, compared to traditional methods, are its high availability by using the web and other ubiquitous devices; the minimization of technophobia related to crashes; and the development of cost-effective alternatives to train pilots and make the testing phase easier for drone researchers and developers through trendy technologies.
由于互联网和移动设备的存在,数据和服务现在可以随时随地获取。如今,通过增强现实(AR)等流行技术,可以以新的方式呈现数据,通过在实时图像上叠加虚拟层来扩展我们对现实的感知。无人机(UAV)在执行日常和专业任务方面具有巨大潜力,这促使人们将其用于创建各种服务,例如包裹投递或工业维护。不幸的是,无人机驾驶难以学习,需要特定的培训。由于常规培训是在虚拟模拟中进行的,因此我们决定提出一个基于 Web AR 的多平台云托管解决方案,用于无人机培训和可用性测试。该解决方案通过虚拟元素定义可配置的轨迹,这些虚拟元素通过放置在真实环境上的条码标记来表示。主要目标是提供一种包容性和可访问的培训解决方案,任何想要学习如何驾驶或测试与无人机控制相关的研究的人都可以使用该解决方案。在本文中,我们回顾了无人机、AR 和人机交互(HDI),以提出一种架构并实现一个原型,该原型使用 Raspberry Pi 3、摄像头和条码标记构建。通过使用多个测试场景进行了验证。结果表明,通过 Web 技术可以实现用于无人机驾驶员培训和可用性测试的实时 AR 体验。与传统方法相比,这种方法的一些优势在于它通过使用 Web 和其他普及设备的高可用性;与崩溃相关的技术恐惧症最小化;以及通过流行技术为飞行员培训开发具有成本效益的替代方案,并使无人机研究人员和开发人员的测试阶段更加容易。