主办：陕西省汽车工程学会
ISSN 1671-7988  CN 61-1394/TH
创刊：1976年
汽车实用技术

汽车实用技术 ›› 2022, Vol. 47 ›› Issue (1): 19-23.DOI: 10.16638/j.cnki.1671-7988.2022.001.005

• 智能网联汽车 • 上一篇    

基于激光视觉融合的帧间匹配方法

何仲伟，张小俊，张明路   

  1. 河北工业大学 机械工程学院
  • 出版日期:2022-01-15 发布日期:2022-01-15
  • 通讯作者: 何仲伟
  • 作者简介:何仲伟，男，硕士研究生，河北工业大学机械工程学院，主要研究方向为智能车环境感知。

Frame-matching Method Based on Laser and Vision Fusion

HE Zhongwei, ZHANG Xiaojun, ZHANG Minglu   

  1. School of Mechanical Engineering of Hebei University of Technology
  • Online:2022-01-15 Published:2022-01-15
  • Contact: HE Zhongwei

PDF

摘要： 同步定位与地图构建（Simultaneous Location and Mapping, SLAM）是机器人在未知环境中 实现自我导航能力的重要保证。目前 SLAM 算法使用的主传感器基本是激光雷达或视觉相机。二 者各具优劣，激光雷达能更精确地进行测距，视觉相机能反映环境丰富的纹理信息。与使用单一 传感器相比，将二者融合的 SLAM 算法能够获得更多环境信息，达到更好的定位和建图效果。文 章提出一种融合激光雷达和视觉相机的帧间匹配方法，通过在 SLAM 帧间匹配过程中加入地面约 束以及视觉特征约束，提高帧间匹配过程精度，增强算法鲁棒性，从而提升 SLAM 算法整体效果。 文章最后利用采集的地下停车库数据进行结果验证，与开源算法 A-LOAM 进行对比。结果表明， 相比 A-LOAM 的帧间匹配方法，文章提出的方法相对位姿误差提升约 30%。

关键词: SLAM；多传感器融合；地面提取；迭代最近点；随机一致性采样；Fast 特征；光流法； 帧间匹配

Abstract: Simultaneous location and mapping (SLAM) is an important guarantee for robot to realize self navigation ability in unknown environment. At present, the main sensors used in SLAM algorithm are lidar or vision camera. Lidar can range more accurately, and visual camera can reflect the rich texture information of the environment. Compared with using a single sensor, SLAM algorithm can obtain more environmental information and achieve better positioning and mapping effect. In this paper, an inter frame matching method combining lidar and vision camera is proposed. By adding ground constraints and visual feature constraints in the process of slam inter frame matching, the accuracy of inter frame matching process is improved, the robustness of algorithm is enhanced, and the overall effect of SLAM algorithm is improved. Finally, the paper uses the collected underground parking data to verify the results, and compares with the open source algorithm A-LOAM. The results show that the relative pose error of the proposed method is improved by about 30% compared with A-LOAM.

Key words: SLAM; Laser and vision fusion; Ground extraction; ICP; RANSAC; FAST; Optical flow method; Inter frame match