• 论文
主办单位:煤炭科学研究总院有限公司、中国煤炭学会学术期刊工作委员会
改进YOLOv5s和DeepSORT的井下人员检测及跟踪算法
  • Title

    Underground personnel detection and tracking based on improved YOLOv5s and DeepSORT

  • 作者

    邵小强李鑫杨涛杨永德刘士博原泽文

  • Author

    SHAO Xiaoqiang;LI Xin;YANG Tao;YANG Yongde;LIU Shibo;YUAN Zewen

  • 单位

    西安科技大学电气与控制工程学院

  • Organization
    College of Electrical and Control Engineering, Xi’an University of Science and Technology
  • 摘要

    矿井移动目标的实时监测及跟踪系统是建设智慧矿山必不可少的内容,井下巡检机器人的出现可以实现对作业人员的实时监测,但是井下光照不均、煤尘干扰等因素的存在导致传统图像检测算法无法准确检测出作业人员。基于此提出一种可部署于井下巡检机器人的改进YOLOv5s和DeepSORT的井下人员检测及跟踪算法。首先利用监控摄像头与巡检机器人所录视频制作数据集,然后使用改进YOLOv5s网络对井下人员进行识别:考虑到井下人员检测及跟踪算法包含复杂的网络结构和庞大的参数体量,限制了检测模型的响应速度,使用改进轻量化网络ShuffleNetV2替代原YOLOv5s主干网络CSP-Darknet53。同时,为减少图像中复杂背景的干扰,提升作业人员的关注度,将Transformer自注意力模块融入改进ShuffleNetV2。其次,为了使多尺度特征能够有效融合且使得推理信息能够有效传输,将Neck 中FPN+PAN结构替换为BiFPN结构。接着利用改进DeepSORT对人员进行编码追踪:考虑到井下环境黑暗,照度低,无纹理性,DeepSORT难以有效提取到人员的外观信息,于是采用更深层卷积替换DeepSORT中小型残差网络来强化DeepSORT的外观信息提取能力。最后通过公开行人数据集及自建井下人员检测及跟踪数据集对本文改进算法进行验证,结果表明:改进的检测模型相比于原YOLOv5s模型平均检测精度提高了5.2%,参数量减少了41%,速度提升了21%;改进YOLOv5s-DeepSORT的井下人员跟踪方法精度达到了89.17%,速度达到了67FPS,可以有效部署于井下巡检机器人实现作业人员的实时检测及跟踪。

  • Abstract

    The real-time monitoring and tracking system of mine moving targets is an essential part of the construction of smart mines. The appearance of downhole inspection robots can realize the real-time monitoring of operators, but the existence of uneven lighting, coal dust interference and other factors lead to the traditional image detection algorithm can not accurately detect operators. Based on this, this paper proposes an improved YOLOv5s and DeepSORT algorithm for downhole personnel detection and tracking that can be deployed in downhole inspection robots. Firstly, the data set was made by using the video recorded by the surveillance camera and inspection robot, and then the improved YOLOv5s network was used to identify the underground personnel: Considering that the detection and tracking algorithm for downhole personnel contains complex network structure and huge parameter volume, which limits the response speed of the detection model, this paper uses an improved lightweight network ShuffleNetV2 to replace the original YOLOv5s backbone network CSP-Darknet53. Meanwhile, in order to reduce the interference of complex image background and improve the attention of operators, Transformer self-attention module is integrated into the ShuffleNetV2. Secondly, the FPN+PAN structure in Neck is replaced by BiFPN structure in order to effectively fuse multi-scale features and effectively transmit inference information. Then, improved DeepSORT was used to encode and track personnel: considering that the underground environment was dark, with low illumination and no texture, it was difficult for DeepSORT to effectively extract personnel's appearance information, so DeepSORT's small and medium residual network was replaced by deeper convolution to enhance DeepSORT's appearance information extraction ability. Finally, the improved algorithm is verified by open pedestrian data set and self-built underground personnel detection and tracking data set. The results show that compared with the original YOLOv5s model, the average detection accuracy of the improved detection model is increased by 5.2%, the number of parameters is reduced by 41%, and the speed is increased by 21%. The improved YOLOv5s-DeepSORT downhole personnel tracking method has a precision of 89.17% and a speed of 67FPS, which can be effectively deployed in downhole inspection robots to realize real-time detection and tracking of operators.

  • 关键词

    井下巡检机器人YOLOv5s轻量化DeepSORT实时检测及跟踪

  • KeyWords

    downhole inspection robot;YOLOv5s;Lightweight;DeepSORT;Real-time detection and tracking

  • 基金项目(Foundation)
    国家自然科学基金资助项目(52174198)
  • DOI
  • 引用格式
    邵小强,李 鑫,杨 涛,等. 改进YOLOv5s和DeepSORT的井下人员检测及跟踪算法[J]. 煤炭科学技术,2023,51(10):291−301.
  • Citation
    SHAO Xiaoqiang,LI Xin,YANG Tao,et al. Underground personnel detection and tracking based on improved YOLOv5s and DeepSORT[J]. Coal Science and Technology,2023,51(10):291−301.
  • 相关专题
  • 图表
    •  
    •  
    • 本文目标检测算法框架

    图(10) / 表(0)

相关问题

主办单位:煤炭科学研究总院有限公司 中国煤炭学会学术期刊工作委员会

©版权所有2015 煤炭科学研究总院有限公司 地址:北京市朝阳区和平里青年沟东路煤炭大厦 邮编:100013
京ICP备05086979号-16  技术支持:云智互联