• 访客 您好
  •  | 
  • 注册
  • 全部
主办单位:煤炭科学研究总院有限公司、中国煤炭学会学术期刊工作委员会
基于视觉−惯导信息融合的采场支架姿态感知方法
  • Title

    Method of support posture perception in mining face based on visual-inertial information fusion

  • 作者

    邢轲轲程敬义许忠鑫万志军薛民体闫万梓包阔易俊杰

  • Author

    XING Keke;CHENG Jingyi;XU Zhongxin;WAN Zhijun;XUE Minti;YAN Wanzi;BAO Kuo;YI Junjie

  • 单位

    中国矿业大学 矿业工程学院中国矿业大学 信息与控制工程学院

  • Organization
    School of Mines, China University of Mining and Technology
    School of Information and Control Engineering, China University of Mining and Technology
  • 摘要

    针对目前采场支架姿态感知中惯导方法存在漂移误差大、解算精度低,以及视觉方法存在相机易受粉尘与设备遮挡而位姿识别误差大等问题,提出了一种基于视觉−惯导信息融合的采场支架姿态感知方法。首先将四特征点红外标靶固定于支架底座凸台,将双目相机分别固定于支架顶梁与掩护梁,采用基于Canny−最小二乘法的靶标识别方法和基于四特征点的BA−PnP算法解算顶梁、掩护梁相对底座的俯仰角、横滚角。然后将惯性测量单元固定于液压支架顶梁、掩护梁、底座,通过惯性测量单元中MEMS陀螺仪和加速度计的互补滤波方法解算顶梁、掩护梁、底座在世界坐标系下的俯仰角、横滚角。最后将视觉系统解算的姿态角与惯导解算的姿态角进行扩展卡尔曼滤波多源信息融合,利用视觉信息的低频稳定性抑制惯性测量单元的累计误差,得到精确的采场支架姿态。采用基于视觉、惯导和视觉−惯导信息融合3种支架姿态感知方法进行对比实验,结果表明:① 初始静止状态下,3种方法的精度均较高,但随着支架运行循环次数增加,基于视觉、惯导的感知结果逐渐偏离真值。② 基于视觉、惯导和视觉−惯导信息融合方法的顶梁相对底座的俯仰角感知均方根误差分别为0.201,0.190,0.081°,掩护梁相对底座的俯仰角感知均方根误差分别为0.340,0.297,0.162°。③ 基于视觉−惯导信息融合方法解算的液压支架立柱伸缩长度的均方根误差为13.682 mm,满足现场需求。基于视觉−惯导信息融合的采场支架姿态感知方法可为液压支架智能化控制提供更准确的姿态参数。

  • Abstract

    To address the issues of large drift errors and low calculation accuracy in inertial navigation methods, as well as significant posture recognition errors in visual methods due to camera interference from dust and equipment obstructions, a method of support posture perception in mining face based on visual-inertial information fusion was proposed. First, four feature points of infrared targets were fixed to the base platform of the support, and binocular cameras were fixed to the support top beam and shield beam. A target recognition method based on Canny and least squares, along with a BA-PnP algorithm based on four feature points, was used to solve the pitch and roll angles of the top beam and shield beam relative to the base. Then, an inertial measurement unit (IMU) was fixed to the hydraulic support top beam, shield beam, and base. The complementary filtering method of the MEMS gyroscope and accelerometer in the IMU was used to solve the pitch and roll angles of the top beam, shield beam, and base in the world coordinate system. Finally, the posture angles calculated by the visual system and the inertial navigation system were fused using the extended Kalman filter for multi-source information fusion. The low-frequency stability of the vision information was used to suppress the accumulated errors of the IMU, resulting in accurate posture perception of the mining support. Three methods for support posture perception, based on vision, inertial navigation, and visual-inertial information fusion, were compared in experimental results. The findings showed that: ① In the initial stationary state, all three methods had high accuracy, but as the support operation cycles increased, the vision-based and inertial navigation-based results gradually deviated from the true values. ② The root mean square errors (RMSE) of pitch angle perception for the top beam relative to the base were 0.201°, 0.190°, and 0.081° for the vision-based, inertial navigation-based, and visual-inertial information fusion methods, respectively. For the shield beam relative to the base, the RMSE of pitch angle perception were 0.340°, 0.297°, and 0.162°, respectively. ③ The RMSE of the hydraulic support column extension length calculated by the visual-inertial information fusion method was 13.682 mm, meeting on-site requirements. The visual-inertial information fusion-based support posture perception method could provide more accurate posture parameters for the intelligent control of hydraulic supports.

  • 关键词

    液压支架姿态感知视觉惯导信息融合惯性测量单元扩展卡尔曼滤波光束平差−透视点定位姿态估计算法IMU

  • KeyWords

    hydraulic support posture perception;visual-inertial information fusion;inertial measurement unit;extended Kalman filter;bundle adjustment-perspective point posture estimation algorithm;IMU

  • 基金项目(Foundation)
    国家自然科学基金青年科学基金资助项目(51604267);中央高校基本科研业务费专项资金资助项目(2022XSCX21)。
  • DOI
  • 引用格式
    邢轲轲,程敬义,许忠鑫,等. 基于视觉−惯导信息融合的采场支架姿态感知方法[J]. 工矿自动化,2025,51(3):32-38.
  • Citation
    XING Keke, CHENG Jingyi, XU Zhongxin, et al. Method of support posture perception in mining face based on visual-inertial information fusion[J]. Journal of Mine Automation,2025,51(3):32-38.
  • 相关专题
  • 图表
    •  
    •  
    • 坐标系和支架姿态角定义

    图(8) / 表(1)

相关问题
立即提问

主办单位:煤炭科学研究总院有限公司 中国煤炭学会学术期刊工作委员会

©版权所有2015 煤炭科学研究总院有限公司 地址:北京市朝阳区和平里青年沟东路煤炭大厦 邮编:100013
京ICP备05086979号-16  技术支持:云智互联
累计访问量:27708810,今日访问人数:42979 站长统计