高级检索

    基于相机与雷达信息融合的障碍物检测技术

    Obstacle Detection Technology Based on Camera and Radar Information Fusion

    • 摘要: 文中针对六足轮腿式移动机器人设计了激光雷达和工业相机多传感器信息融合的障碍物检测方案。首先,基于体素下采样和欧氏聚类,实现激光雷达点云数据的障碍物目标识别;其次,进行移动机器人相机内参标定,针对复杂天气下目标识别不准确的问题,利用带颜色恢复的多尺度图像增强算法对采集到的图像数据进行增强处理,并利用YOLOv5神经网络模型实现了基于图像的目标检测;然后,利用库恩–芒克勒斯(Kuhn-Munkres, KM)算法实现了两个传感器的融合检测,并通过仿真验证算法的有效性;最后,在六足轮腿式移动机器人平台进行实验验证。实验结果表明:该方案有效实现了对周围环境的实时准确感知,提升了机器人的环境适应性与感知能力,在移动机器人领域具有应用潜力。

       

      Abstract: In this paper a multi-sensor information fusion of LiDAR and industrial camera for obstacle detection is designed for a hexapod wheel-legged mobile robot. Firstly, based on voxel downsampling and Euclidean clustering, the obstacle target recognition of LiDAR point cloud data is realized. Secondly, the internal parameter calibration of mobile robot camera is carried out. For the problem of inaccurate target recognition under complex weather, multi-scale retinex with color restoration algorithm is used to do image enhancement processing on the collected data, and the image-based target detection is realized by using YOLOv5. Then, the fusion detection of two sensors is realized by using Kuhn-Munkres (KM) algorithm, and the effectiveness of the algorithm is verified by simulation, and finally the experimental verification is carried out in the hexapod wheel-legged mobile robot platform. The experimental results show that the scheme can effectively realize the accurate perception of the surrounding environment, and can improve the environmental adaptability and perception ability of robot. The scheme has application potential in the field of mobile robot.

       

    /

    返回文章
    返回