Rao Jinmeng, Qiao Yanjun, Ren Fu, Wang Junxing, Du Qingyun
School of Resources and Environmental Science, Wuhan University, 129 Luoyu Road, Wuhan 430079, China.
Key Laboratory of GIS, Ministry of Education, Wuhan University, 129 Luoyu Road, Wuhan 430079, China.
Sensors (Basel). 2017 Aug 24;17(9):1951. doi: 10.3390/s17091951.
The purpose of this study was to develop a robust, fast and markerless mobile augmented reality method for registration, geovisualization and interaction in uncontrolled outdoor environments. We propose a lightweight deep-learning-based object detection approach for mobile or embedded devices; the vision-based detection results of this approach are combined with spatial relationships by means of the host device's built-in Global Positioning System receiver, Inertial Measurement Unit and magnetometer. Virtual objects generated based on geospatial information are precisely registered in the real world, and an interaction method based on touch gestures is implemented. The entire method is independent of the network to ensure robustness to poor signal conditions. A prototype system was developed and tested on the Wuhan University campus to evaluate the method and validate its results. The findings demonstrate that our method achieves a high detection accuracy, stable geovisualization results and interaction.
本研究的目的是开发一种强大、快速且无标记的移动增强现实方法,用于在不受控制的户外环境中进行配准、地理可视化和交互。我们提出了一种用于移动或嵌入式设备的基于深度学习的轻量级目标检测方法;该方法基于视觉的检测结果通过主机设备内置的全球定位系统接收器、惯性测量单元和磁力计与空间关系相结合。基于地理空间信息生成的虚拟对象被精确地注册到现实世界中,并实现了一种基于触摸手势的交互方法。整个方法独立于网络,以确保在信号条件不佳时的鲁棒性。开发了一个原型系统并在武汉大学校园进行了测试,以评估该方法并验证其结果。研究结果表明,我们的方法实现了高检测精度、稳定的地理可视化结果和交互。