Alletto Stefano, Abati Davide, Serra Giuseppe, Cucchiara Rita
Department of Engineering, Università degli Studi di Modena e Reggio Emilia, Via Vivarelli 10, Modena 41125, Italy.
Sensors (Basel). 2016 Feb 17;16(2):237. doi: 10.3390/s16020237.
Augmented user experiences in the cultural heritage domain are in increasing demand by the new digital native tourists of 21st century. In this paper, we propose a novel solution that aims at assisting the visitor during an outdoor tour of a cultural site using the unique first person perspective of wearable cameras. In particular, the approach exploits computer vision techniques to retrieve the details by proposing a robust descriptor based on the covariance of local features. Using a lightweight wearable board, the solution can localize the user with respect to the 3D point cloud of the historical landmark and provide him with information about the details at which he is currently looking. Experimental results validate the method both in terms of accuracy and computational effort. Furthermore, user evaluation based on real-world experiments shows that the proposal is deemed effective in enriching a cultural experience.
21世纪新兴的数字原生代游客对文化遗产领域增强型用户体验的需求与日俱增。在本文中，我们提出了一种新颖的解决方案，旨在利用可穿戴相机独特的第一人称视角，在文化遗址的户外游览过程中为游客提供协助。具体而言，该方法利用计算机视觉技术，通过基于局部特征协方差提出一种鲁棒描述符来检索细节。借助一块轻便的可穿戴板，该解决方案能够相对于历史地标的三维点云对用户进行定位，并为其提供有关他当前所看细节的信息。实验结果在准确性和计算量方面均验证了该方法。此外，基于实际实验的用户评估表明，该方案在丰富文化体验方面被认为是有效的。
