Engineering Product Development, Singapore University of Technology and Design, Singapore 487372, Singapore.
Information Systems Technology and Design, Singapore University of Technology and Design, Singapore 487372, Singapore.
Sensors (Basel). 2022 Jul 12;22(14):5214. doi: 10.3390/s22145214.
Cebrenus Rechenburgi, a member of the huntsman spider family have inspired researchers to adopt different locomotion modes in reconfigurable robotic development. Object-of-interest perception is crucial for such a robot to provide fundamental information on the traversed pathways and guide its locomotion mode transformation. Therefore, we present a object-of-interest perception in a reconfigurable rolling-crawling robot and identifying appropriate locomotion modes. We demonstrate it in Scorpio, our in-house developed robot with two locomotion modes: rolling and crawling. We train the locomotion mode recognition framework, named Pyramid Scene Parsing Network (PSPNet), with a self-collected dataset composed of two categories paths, unobstructed paths (e.g., floor) for rolling and obstructed paths (e.g., with person, railing, stairs, static objects and wall) for crawling, respectively. The efficiency of the proposed framework has been validated with evaluation metrics in offline and real-time field trial tests. The experiment results show that the trained model can achieve an mIOU score of 72.28 and 70.63 in offline and online testing, respectively for both environments. The proposed framework's performance is compared with semantic framework (HRNet and Deeplabv3) where the proposed framework outperforms in terms of mIOU and speed. Furthermore, the experimental results has revealed that the robot's maneuverability is stable, and the proposed framework can successfully determine the appropriate locomotion modes with enhanced accuracy during complex pathways.
采采蝇属的 Rechenburgi 是一种猎人蛛科蜘蛛,它启发研究人员在可重构机器人开发中采用不同的运动模式。目标感知对于这种机器人来说至关重要,它可以提供关于所经过路径的基本信息,并指导其运动模式转换。因此,我们提出了一种可重构滚动爬行机器人中的目标感知方法,并识别了适当的运动模式。我们在 Scorpio 中展示了这一点,Scorpio 是我们自主开发的具有两种运动模式的机器人:滚动和爬行。我们使用一个自我收集的数据集来训练运动模式识别框架,该数据集由两类路径组成:分别用于滚动的无障碍路径(例如地板)和用于爬行的障碍路径(例如有人、栏杆、楼梯、静态物体和墙壁)。该框架的效率已经通过离线和实时现场测试中的评估指标进行了验证。实验结果表明,训练后的模型在离线和在线测试中分别可以达到 72.28 和 70.63 的 mIOU 得分,这两种环境下的得分都很高。与语义框架(HRNet 和 Deeplabv3)进行比较,该框架在 mIOU 和速度方面表现更优。此外,实验结果还表明,机器人的操纵性能稳定,并且该框架可以在复杂路径中成功确定适当的运动模式,并提高准确性。