Shahria Md Tanzil, Sunny Md Samiul Haque, Zarif Md Ishrak Islam, Khan Md Mahafuzur Rahaman, Modi Preet Parag, Ahamed Sheikh Iqbal, Rahman Mohammad H
Department of Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI, United States.
Department of Computer Science, Marquette University, Milwaukee, WI, United States.
JMIR Biomed Eng. 2022 May 17;7(1):e36734. doi: 10.2196/36734.
BACKGROUND: Applications of robotics in daily life are becoming essential by creating new possibilities in different fields, especially in the collaborative environment. The potentials of collaborative robots are tremendous as they can work in the same workspace as humans. A framework employing a top-notch technology for collaborative robots will surely be worthwhile for further research. OBJECTIVE: This study aims to present the development of a novel framework for the collaborative robot using mixed reality. METHODS: The framework uses Unity and Unity Hub as a cross-platform gaming engine and project management tool to design the mixed reality interface and digital twin. It also uses the Windows Mixed Reality platform to show digital materials on holographic display and the Azure mixed reality services to capture and expose digital information. Eventually, it uses a holographic device (HoloLens 2) to execute the mixed reality-based collaborative system. RESULTS: A thorough experiment was conducted to validate the novel framework for mixed reality-based control of a collaborative robot. This framework was successfully applied to implement a collaborative system using a 5-degree of freedom robot (xArm-5) in a mixed reality environment. The framework was stable and worked smoothly throughout the collaborative session. Due to the distributed nature of cloud applications, there is a negligible latency between giving a command and the execution of the physical collaborative robot. CONCLUSIONS: Opportunities for collaborative robots in telerehabilitation and teleoperation are vital as in any other field. The proposed framework was successfully applied in a collaborative session, and it can also be applied in other similar potential applications for robust and more promising performance.
背景:机器人技术在日常生活中的应用正变得至关重要,因为它在不同领域创造了新的可能性,尤其是在协作环境中。协作机器人的潜力巨大,因为它们可以与人类在同一工作空间中工作。采用一流技术的协作机器人框架肯定值得进一步研究。 目的:本研究旨在介绍一种使用混合现实的协作机器人新型框架的开发。 方法:该框架使用Unity和Unity Hub作为跨平台游戏引擎和项目管理工具来设计混合现实界面和数字孪生。它还使用Windows混合现实平台在全息显示器上显示数字材料,并使用Azure混合现实服务来捕获和公开数字信息。最终,它使用全息设备(HoloLens 2)来执行基于混合现实的协作系统。 结果:进行了全面的实验以验证基于混合现实控制协作机器人的新型框架。该框架已成功应用于在混合现实环境中使用五自由度机器人(xArm-5)实现协作系统。该框架在整个协作过程中稳定且运行顺畅。由于云应用程序的分布式特性,发出命令与物理协作机器人执行之间的延迟可忽略不计。 结论:与其他任何领域一样,协作机器人在远程康复和远程操作中的机会至关重要。所提出的框架已成功应用于协作会话,并且它也可以应用于其他类似的潜在应用中,以实现强大且更有前景的性能。
JMIR Biomed Eng. 2022-5-17
Front Robot AI. 2022-4-28
Sensors (Basel). 2022-6-30
Sensors (Basel). 2021-9-6
Sensors (Basel). 2022-10-24
Sensors (Basel). 2020-4-12
IISE Trans Occup Ergon Hum Factors. 2024
Micromachines (Basel). 2022-6-29
J Neuroeng Rehabil. 2021-12-18
Auton Robots. 2022