State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou 310027, China.
Sensors (Basel). 2021 Feb 15;21(4):1365. doi: 10.3390/s21041365.
Semantic segmentation of room maps is an essential issue in mobile robots' execution of tasks. In this work, a new approach to obtain the semantic labels of 2D lidar room maps by combining distance transform watershed-based pre-segmentation and a skillfully designed neural network lidar information sampling classification is proposed. In order to label the room maps with high efficiency, high precision and high speed, we have designed a low-power and high-performance method, which can be deployed on low computing power Raspberry Pi devices. In the training stage, a lidar is simulated to collect the lidar detection line maps of each point in the manually labelled map, and then we use these line maps and the corresponding labels to train the designed neural network. In the testing stage, the new map is first pre-segmented into simple cells with the distance transformation watershed method, then we classify the lidar detection line maps with the trained neural network. The optimized areas of sparse sampling points are proposed by using the result of distance transform generated in the pre-segmentation process to prevent the sampling points selected in the boundary regions from influencing the results of semantic labeling. A prototype mobile robot was developed to verify the proposed method, the feasibility, validity, robustness and high efficiency were verified by a series of tests. The proposed method achieved higher scores in its recall, precision. Specifically, the mean recall is 0.965, and mean precision is 0.943.
房间地图的语义分割是移动机器人执行任务的一个基本问题。在这项工作中,提出了一种新的方法,通过结合距离变换分水岭预分割和精心设计的神经网络激光雷达信息采样分类,来获取二维激光雷达房间地图的语义标签。为了高效、高精度和快速地对房间地图进行标注,我们设计了一种低功耗、高性能的方法,可以部署在低计算能力的 Raspberry Pi 设备上。在训练阶段,模拟激光雷达采集手动标注地图中每个点的激光雷达检测线图,然后使用这些线图和相应的标签来训练设计的神经网络。在测试阶段,首先使用距离变换分水岭方法将新地图预分割成简单的单元,然后使用训练好的神经网络对激光雷达检测线图进行分类。通过使用预分割过程中生成的距离变换结果,提出了稀疏采样点的优化区域,以防止在边界区域选择的采样点影响语义标注的结果。开发了一个原型移动机器人来验证所提出的方法,通过一系列测试验证了其可行性、有效性、鲁棒性和高效性。所提出的方法在召回率和精度方面都取得了更高的分数。具体来说,平均召回率为 0.965,平均精度为 0.943。