文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

一种基于混合现实的协作机器人控制新框架:开发研究

A Novel Framework for Mixed Reality-Based Control of Collaborative Robot: Development Study.

作者信息

Shahria Md Tanzil, Sunny Md Samiul Haque, Zarif Md Ishrak Islam, Khan Md Mahafuzur Rahaman, Modi Preet Parag, Ahamed Sheikh Iqbal, Rahman Mohammad H

机构信息

Department of Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI, United States.

Department of Computer Science, Marquette University, Milwaukee, WI, United States.

出版信息

JMIR Biomed Eng. 2022 May 17;7(1):e36734. doi: 10.2196/36734.


DOI:10.2196/36734
PMID:38875679
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11041473/
Abstract

BACKGROUND: Applications of robotics in daily life are becoming essential by creating new possibilities in different fields, especially in the collaborative environment. The potentials of collaborative robots are tremendous as they can work in the same workspace as humans. A framework employing a top-notch technology for collaborative robots will surely be worthwhile for further research. OBJECTIVE: This study aims to present the development of a novel framework for the collaborative robot using mixed reality. METHODS: The framework uses Unity and Unity Hub as a cross-platform gaming engine and project management tool to design the mixed reality interface and digital twin. It also uses the Windows Mixed Reality platform to show digital materials on holographic display and the Azure mixed reality services to capture and expose digital information. Eventually, it uses a holographic device (HoloLens 2) to execute the mixed reality-based collaborative system. RESULTS: A thorough experiment was conducted to validate the novel framework for mixed reality-based control of a collaborative robot. This framework was successfully applied to implement a collaborative system using a 5-degree of freedom robot (xArm-5) in a mixed reality environment. The framework was stable and worked smoothly throughout the collaborative session. Due to the distributed nature of cloud applications, there is a negligible latency between giving a command and the execution of the physical collaborative robot. CONCLUSIONS: Opportunities for collaborative robots in telerehabilitation and teleoperation are vital as in any other field. The proposed framework was successfully applied in a collaborative session, and it can also be applied in other similar potential applications for robust and more promising performance.

摘要

背景:机器人技术在日常生活中的应用正变得至关重要,因为它在不同领域创造了新的可能性,尤其是在协作环境中。协作机器人的潜力巨大,因为它们可以与人类在同一工作空间中工作。采用一流技术的协作机器人框架肯定值得进一步研究。 目的:本研究旨在介绍一种使用混合现实的协作机器人新型框架的开发。 方法:该框架使用Unity和Unity Hub作为跨平台游戏引擎和项目管理工具来设计混合现实界面和数字孪生。它还使用Windows混合现实平台在全息显示器上显示数字材料,并使用Azure混合现实服务来捕获和公开数字信息。最终,它使用全息设备(HoloLens 2)来执行基于混合现实的协作系统。 结果:进行了全面的实验以验证基于混合现实控制协作机器人的新型框架。该框架已成功应用于在混合现实环境中使用五自由度机器人(xArm-5)实现协作系统。该框架在整个协作过程中稳定且运行顺畅。由于云应用程序的分布式特性,发出命令与物理协作机器人执行之间的延迟可忽略不计。 结论:与其他任何领域一样,协作机器人在远程康复和远程操作中的机会至关重要。所提出的框架已成功应用于协作会话,并且它也可以应用于其他类似的潜在应用中,以实现强大且更有前景的性能。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/9098f78758b2/biomedeng_v7i1e36734_fig7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/f571599fe7f5/biomedeng_v7i1e36734_fig1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/7e6f1a7b9221/biomedeng_v7i1e36734_fig2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/521f3d28aee1/biomedeng_v7i1e36734_fig3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/a18e7e8f37f7/biomedeng_v7i1e36734_fig4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/722c3464a624/biomedeng_v7i1e36734_fig5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/eb4290cc80a8/biomedeng_v7i1e36734_fig6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/9098f78758b2/biomedeng_v7i1e36734_fig7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/f571599fe7f5/biomedeng_v7i1e36734_fig1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/7e6f1a7b9221/biomedeng_v7i1e36734_fig2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/521f3d28aee1/biomedeng_v7i1e36734_fig3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/a18e7e8f37f7/biomedeng_v7i1e36734_fig4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/722c3464a624/biomedeng_v7i1e36734_fig5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/eb4290cc80a8/biomedeng_v7i1e36734_fig6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b9be/11041473/9098f78758b2/biomedeng_v7i1e36734_fig7.jpg

相似文献

[1]
A Novel Framework for Mixed Reality-Based Control of Collaborative Robot: Development Study.

JMIR Biomed Eng. 2022-5-17

[2]
Framework for Armature-Based 3D Shape Reconstruction of Sensorized Soft Robots in eXtended Reality.

Front Robot AI. 2022-4-28

[3]
Digital Twin for Human-Robot Interactions by Means of Industry 4.0 Enabling Technologies.

Sensors (Basel). 2022-6-30

[4]
Programming Robots by Demonstration Using Augmented Reality.

Sensors (Basel). 2021-9-6

[5]
Augmented Reality for Human-Robot Collaboration and Cooperation in Industrial Applications: A Systematic Literature Review.

Sensors (Basel). 2022-4-1

[6]
A Mixed-Reality Tele-Operation Method for High-Level Control of a Legged-Manipulator Robot.

Sensors (Basel). 2022-10-24

[7]
Design of a Hyper-Redundant Robot and Teleoperation Using Mixed Reality for Inspection Tasks.

Sensors (Basel). 2020-4-12

[8]
Comparing Human Factors for Augmented Reality Supported Single-User and Collaborative Repair Operations of Industrial Robots.

Front Robot AI. 2019-5-31

[9]
Teleoperator-Robot-Human Interaction in Manufacturing: Perspectives from Industry, Robot Manufacturers, and Researchers.

IISE Trans Occup Ergon Hum Factors. 2024

[10]
Experimental Setup Employed in the Operating Room Based on Virtual and Mixed Reality: Analysis of Pros and Cons in Open Abdomen Surgery.

J Healthc Eng. 2020

引用本文的文献

[1]
Hand Rehabilitation Devices: A Comprehensive Systematic Review.

Micromachines (Basel). 2022-6-29

本文引用的文献

[1]
XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis.

J Clin Med. 2022-1-17

[2]
Eye-gaze control of a wheelchair mounted 6DOF assistive robot for activities of daily living.

J Neuroeng Rehabil. 2021-12-18

[3]
Learning latent actions to control assistive robots.

Auton Robots. 2022

[4]
Mixed Reality Visualization of Radiation Dose for Health Professionals and Patients in Interventional Radiology.

J Med Syst. 2021-2-17

[5]
How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens.

J Healthc Eng. 2018-11-1

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索