Faculty of Science, School of Mathematics, Computer Science, and Engineering, Liverpool Hope University, Liverpool L16 9JD, UK.
Department of Electronics and Computer Engineering, De La Salle University, 2401 Taft Avenue, Manila 0922, Philippines.
Sensors (Basel). 2022 Mar 1;22(5):1924. doi: 10.3390/s22051924.
During open surgery, a surgeon relies not only on the detailed view of the organ being operated upon and on being able to feel the fine details of this organ but also heavily relies on the combination of these two senses. In laparoscopic surgery, haptic feedback provides surgeons information on interaction forces between instrument and tissue. There have been many studies to mimic the haptic feedback in laparoscopic-related telerobotics studies to date. However, cutaneous feedback is mostly restricted or limited in haptic feedback-based minimally invasive studies. We argue that fine-grained information is needed in laparoscopic surgeries to study the details of the instrument's end and can convey via cutaneous feedback. We propose an exoskeleton haptic hand wearable which consists of five 4 × 4 miniaturized fingertip actuators, 80 in total, to convey cutaneous feedback. The wearable is described as modular, lightweight, Bluetooth, and WiFi-enabled, and has a maximum power consumption of 830 mW. Software is developed to demonstrate rapid tactile actuation of edges; this allows the user to feel the contours in cutaneous feedback. Moreover, to demonstrate the idea as an object displayed on a flat monitor, initial tests were carried out in 2D. In the second phase, the wearable exoskeleton glove is then further developed to feel 3D virtual objects by using a virtual reality (VR) headset demonstrated by a VR environment. Two-dimensional and 3D objects were tested by our novel untethered haptic hand wearable. Our results show that untethered humans understand actuation in cutaneous feedback just in a single tapping with 92.22% accuracy. Our wearable has an average latency of 46.5 ms, which is much less than the 600 ms tolerable delay acceptable by a surgeon in teleoperation. Therefore, we suggest our untethered hand wearable to enhance multimodal perception in minimally invasive surgeries to naturally feel the immediate environments of the instruments.
在开放式手术中,外科医生不仅依赖于正在操作的器官的详细视图,并且能够感受到该器官的精细细节,还严重依赖于这两种感觉的结合。在腹腔镜手术中,触觉反馈为外科医生提供了有关器械与组织之间相互作用力的信息。迄今为止,已经有许多研究致力于模拟腹腔镜相关遥操作研究中的触觉反馈。然而,在基于触觉反馈的微创研究中,皮肤反馈大多受到限制或限制。我们认为,腹腔镜手术中需要精细的信息来研究器械末端的细节,并可以通过皮肤反馈来传达。我们提出了一种外骨骼触觉手套,它由五个 4×4 微型指尖执行器组成,总共 80 个,用于传递皮肤反馈。该可穿戴设备被描述为模块化,重量轻,支持蓝牙和 WiFi,并具有 830 mW 的最大功耗。开发了软件来演示边缘的快速触觉致动;这允许用户在皮肤反馈中感受到轮廓。此外,为了将其作为在平面监视器上显示的对象的想法进行演示,首先在 2D 中进行了初始测试。在第二阶段,然后进一步开发可穿戴式外骨骼手套,以通过虚拟现实(VR)环境中使用的 VR 耳机来感受 3D 虚拟对象。通过我们的新型无绳触觉手套,对二维和三维物体进行了测试。我们的结果表明,无绳人类只需通过单次点击即可在皮肤反馈中理解致动,准确率为 92.22%。我们的可穿戴设备的平均延迟为 46.5ms,远小于遥操作中外科医生可接受的 600ms 可容忍延迟。因此,我们建议使用无绳式手穿戴设备来增强微创手术中的多模态感知,以自然地感受到器械的即时环境。