Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan.
Center for Cyber-Physical System Innovation, National Taiwan University of Science and Technology, Taipei 106, Taiwan.
Sensors (Basel). 2020 Jul 31;20(15):4286. doi: 10.3390/s20154286.
Augmented reality (AR) has been demonstrated to improve efficiency by up to thrice the level of traditional methods. Specifically, the adoption of visual AR is performed widely using handheld and head-mount technologies. Despite spatial augmented reality (SAR) addressing several shortcomings of wearable AR, its potential is yet to be fully explored. To date, it enhances the cooperation of users with its wide field of view and supports hands-free mobile operation, yet it has remained a challenge to provide references without relying on restrictive static empty surfaces of the same object or nearby objects for projection. Towards this end, we propose a novel approach that contextualizes projected references in real-time and on demand, onto and through the surface across a wireless network. To demonstrate the effectiveness of the approach, we apply the method to the safe inspection of printed circuit board assembly (PCBA) wirelessly networked to a remote automatic optical inspection (AOI) system. A defect detected and localized by the AOI system is wirelessly remitted to the proposed remote inspection system for prompt guidance to the inspector by augmenting a rectangular bracket and a reference image. The rectangular bracket transmitted through the switchable glass aids defect localization over the PCBA, whereas the image is projected over the opaque cells of the switchable glass to provide reference to a user. The developed system is evaluated in a user study for its robustness, precision and performance. Results indicate that the resulting contextualization from variability in occlusion levels not only positively affect inspection performance but also supersedes the state of the art in user preference. Furthermore, it supports a variety of complex visualization needs including varied sizes, contrast, online or offline tracking, with a simple robust integration requiring no additional calibration for registration.
增强现实(AR)已被证明可将效率提高至传统方法的三倍。具体来说,广泛采用手持和头戴技术来实现视觉 AR。尽管空间增强现实(SAR)解决了可穿戴 AR 的一些缺点,但它的潜力尚未得到充分探索。迄今为止,它通过其广阔的视野增强了用户之间的协作,并支持免提移动操作,但它仍然面临着一个挑战,即无需依赖相同物体或附近物体的限制静态空表面进行投影来提供参考。为此,我们提出了一种新方法,可以实时按需将参考内容投影到表面上并穿过表面,通过无线网络进行。为了证明该方法的有效性,我们将该方法应用于通过无线网络与远程自动光学检测(AOI)系统连接的印刷电路板组件(PCBA)的安全检查。AOI 系统检测到并定位的缺陷通过无线方式传输到所提出的远程检查系统,通过在矩形支架和参考图像上进行增强,为检查员提供及时的指导。通过可切换玻璃传输的矩形支架有助于在 PCBA 上定位缺陷,而图像则投影到可切换玻璃的不透明单元上,为用户提供参考。该开发系统在用户研究中进行了评估,以评估其稳健性、精度和性能。结果表明,遮挡水平变化所产生的上下文化不仅对检查性能有积极影响,而且超过了用户偏好的最新水平。此外,它支持各种复杂的可视化需求,包括各种大小、对比度、在线或离线跟踪,只需简单、稳健的集成,无需额外的注册校准。
IEEE Trans Vis Comput Graph. 2024-6-6
Sensors (Basel). 2018-11-16
Sensors (Basel). 2024-6-6
Front Robot AI. 2018-8-20
Sensors (Basel). 2021-6-13
Sensors (Basel). 2019-10-7
Sensors (Basel). 2023-3-27
Sci Rep. 2024-8-20
Sensors (Basel). 2019-6-12
IEEE Trans Vis Comput Graph. 2018-11
IEEE Trans Vis Comput Graph. 2018-7
IEEE Trans Vis Comput Graph. 2018-4
IEEE Comput Graph Appl. 2014
IEEE Trans Cybern. 2013-6-25
IEEE Trans Vis Comput Graph. 2013-8