• 论文
主办单位:煤炭科学研究总院有限公司、中国煤炭学会学术期刊工作委员会
融合多级特征增强与权重网格统计的煤矿井下图像匹配
  • Title

    Coalmine image matching by fusing multi-level feature enhancement and weighted grid statistics

  • 作者

    李和平洪劭楸程健安宁赵海龙修海鑫

  • Author

    LI Heping;HONG Shaoqiu;CHENG Jian;AN Ning;ZHAO Hailong;XIU Haixin

  • 单位

    煤炭科学研究总院煤炭科学研究总院有限公司 矿山人工智能研究院煤炭智能开采与岩层控制全国重点实验室天地科技股份有限公司

  • Organization
    China Coal Research Institute
    Research Institute of Mine Artificial Intelligence, Chinese Institute of Coal Science
    State Key Laboratory for Intelligent Coal Mining and Strata Control
    Tiandi Science and Technology Co., Ltd.
  • 摘要

    图像特征提取与匹配是实现煤矿井下视频和图像拼接、视觉定位导航等任务的一项关键技术,但受井下低光、不均匀光照以及重复纹理等环境因素的影响,相机采集到的图像往往对比度低、纹理信息不明显,存在特征点提取困难、误匹配率高的问题。对此,文章提出一种融合多级特征增强与权重网格统计的方法,以实现煤矿井下图像的有效匹配。首先,设计多级特征检测网络,在堆叠网络层的基础上引入可变形卷积层,保证特征的旋转不变性;其次,利用特征增强模块,将提取的特征点与描述子信息编码投影到高维空间,并通过Transformer网络增强特征间的可区分性;最后,采用基于权重网格的多阶段匹配优化策略,结合匹配质量因子与运动平滑性约束对初步匹配结果进行筛选,解决井下重复纹理感知混淆的问题,提高相似区域间的误匹配判识能力。在井下实际采集数据集和LOL、HPatches公开数据集上的大量实验表明:所提图像匹配方法具有更高的精度与鲁棒性。具体地,相较于ORB、SIFT、ASLFeat和Superpoint算法,所提特征提取方法的平均精度分别提升了33.07%、69.78%、17.65%和33.52%;相较于FLANN、BF+KNN、BF+RANSAC和BF+GMS特征匹配方法,所提特征匹配算法的平均精度分别提升了19.66%、23.26%、4.16%和18.46%。

  • Abstract

    Image feature extraction and matching is a critical technique for video and image stitching, visual localization and navigation in underground coal mines. However, underground tunnelling environmental factors, such as low light, uneven illumination, and repetitive textures, result in low-contrast images with indistinct texture information, making feature point extraction difficult and increasing the rate of mismatches. To address these issues, an coalmine image matching method based on multi-level feature fusion enhancement and weighted grid statistics is proposed. Firstly, multi-level feature detection network based on deformable convolution layers and stacked network is adopted for ensuring the rotational invariance of features. Secondly, both the extracted feature points and descriptors are encoded and projected into a high-dimensional space using a feature enhancement module, and the Transformer is then used to enhance the distinguishability of the features. Finally, to address the perceptual confusion problem caused by repetitive textures in underground scenes, a multi-stage matching optimization strategy based on weighted grids is used. This strategy can combine matching quality factors and motion smoothness constraints to filter the mismatches. A lot of experiments were conducted on an underground actual dataset, as well as on two public datasets including LOL and HPatches. The experimental results show that the proposed feature extraction and matching method has higher accuracy and robustness. Specifically, compared with the ORB, SIFT, ASLFeat and Superpoint algorithms, the proposed feature extraction method achieved average accuracy improvements of 33.07%, 69.78%, 17.65% and 33.52% respectively. Compared with the feature matching methods including FLANN, BF+KNN, BF+RANSAC and BF+GMS, the proposed feature matching method achieved average accuracy improvements of 19.66%, 23.26%, 4.16% and 18.46%.

  • 关键词

    煤矿井下图像特征提取特征增强特征匹配深度学习

  • KeyWords

    underground coal mine images;feature extraction;feature enhancement;feature matching;deep learning

  • 基金项目(Foundation)
    国家重点研发计划资助项目(2023YFC2907600); 天地科技股份有限公司科技创新创业资金专项重点资助项目(2022-TD-ZD004, 2021-TD-ZD002)
  • DOI
  • 相关文章
  • 相关专题
  • 图表
    •  
    •  
    • 本文算法结构

    图(13) / 表(4)

相关问题

主办单位:煤炭科学研究总院有限公司 中国煤炭学会学术期刊工作委员会

©版权所有2015 煤炭科学研究总院有限公司 地址:北京市朝阳区和平里青年沟东路煤炭大厦 邮编:100013
京ICP备05086979号-16  技术支持:云智互联