• 论文
主办单位:煤炭科学研究总院有限公司、中国煤炭学会学术期刊工作委员会
基于Transformer和自适应特征融合的矿井低照度图像亮度提升和细节增强方法
  • Title

    An illuminance improvement and details enhancement method on coal mine low-light images based on Transformer and adaptive feature fusion

  • 作者

    田子建吴佳奇张文琪陈伟周涛杨伟王帅

  • Author

    TIAN Zijian;WU Jiaqi;ZHANG Wenqi;CHEN Wei;ZHOU Tao;YANG Wei;WANG Shuai

  • 单位

    中国矿业大学(北京)机电与信息工程学院中国矿业大学 计算机科学与技术学院中国石油大学(华东)石油工程学院国家矿山安全监察局内蒙古局

  • Organization
    School of Mechanical Electronic & Information Engineering, China University of Mining and Technology- Beijing
    School of Computer Science & Technology, China University of Mining and Technology
    School of Petroleum Engineering, China University of Petroleum (East China)
    Inner Mongolia Bureau of the National Mine Safety Administration, Inner Mongolia Autonomous Region
  • 摘要

    高质量矿井影像为矿山安全生产提供保障,也有利于提高后续图像分析技术的性能。矿井影像受低照度环境的影响,易出现亮度低,照度不均,颜色失真,细节信息丢失严重等问题。针对上述问题,提出一种基于Transformer和自适应特征融合的矿井低照度图像亮度提升和细节增强方法。基于生成对抗思想搭建生成对抗式主体模型框架,使用目标图像域而非单一参考图像驱动判别器监督生成器的训练,实现对低照度图像的充分增强;基于特征表示学习理论搭建特征编码器,将图像解耦为亮度分量和反射分量,避免图像增强过程中亮度与颜色特征相互影响从而导致颜色失真问题;设计CEM-Transformer Encoder通过捕获全局上下文关系和提取局部区域特征,能够充分提升整体图像亮度并消除局部区域照度不均;在反射分量增强过程中,使用结合CEM-Cross-Transformer Encoder的跳跃连接将低级特征与深层网络处特征进行自适应融合,能够有效避免细节特征丢失,并在编码网络中添加ECA-Net,提高浅层网络的特征提取效率。制作矿井低照度图像数据集为矿井低照度图像增强任务提供数据资源。试验显示,在矿井低照度图像数据集和公共数据集中,与5种先进的低照度图像增强算法相比,该算法增强图像的质量指标PSNR、SSIM、VIF平均提高了16.564%,10.998%,16.226%和14.438%,10.888%,14.948%,证明该算法能够有效提升整体图像亮度,消除照度不均,避免颜色失真和细节丢失,实现矿井低照度图像增强。

  • Abstract

    High quality mine images can provide guarantee for mine safety production, and improve the performance of subsequent image analysis technologies. Affected by low illuminance environment, mine images suffer low brightness, uneven brightness, color distortion, and serious loss of details. Aiming at the above problems, an illuminance improvement and details enhancement method on coal mine low-light images based on Transformer and adaptive feature fusion was proposed to enhance the brightness and detail of mine low illuminance images. Based on the idea of generative confrontation, a framework of generative adversary agent model was built, and the target image domain was used instead of a single reference image to drive discriminator to supervise the training of generator, so as to achieve adaptive enhancement of low illuminance images; The feature encoder was built based on the feature representation learning theory to decouple the image into illuminance component and reflection component, the method can avoid the interaction between illuminance and color features during image enhancement to solve the color distortion; the CEM-Transformer Encoder was designed to enhance the brightness component, the method can improve the overall image brightness and eliminate the local area brightness unevenness, by capturing the global context and extracting the local area features; In the process of reflection component enhancement, the skip connection combined with CEM-Cross-Transformer Encoder was used to adaptively fuse low-level features with features at the deep CNN layers, which can effectively avoid the loss of detailed features, and ECA-Net was added to the encode network to improve the feature extraction efficiency of the shallow CNN layers. The low illuminance mine image dataset was produced to provide data resources for the low illuminance mine image enhancement task. The experiments show that, compared with five advanced low illuminance image enhancement algorithms, the quality indicators PSNR, SSIM and VIF of the images enhanced by the algorithm are improved by 16.564%, 10.998%, 16.226% and 14.438%, 10.888% and 14.948% on average on the low illuminance mine image dataset and the public dataset. And the algorithm also perform well in subjective visual evaluation. The above results prove that the algorithm can effectively improve the overall image brightness and eliminate the uneven brightness, thus to achieve mine low illuminace image enhancement.

  • 关键词

    图像增强图像识别生成对抗网络特征解耦Transformer

  • KeyWords

    image enhancement;image recognition;generative adversarial network;feature disentanglement;Transformer

  • 基金项目(Foundation)
    国家自然科学基金资助项目(52074305,52274160);国家自然科学基金委员会−山西省人民政府煤基低碳联合基金资助项目(U1510115)
  • DOI
  • 引用格式
    田子建,吴佳奇,张文琪,等. 基于Transformer和自适应特征融合的矿井低照度图像亮度提升和细节增强方法[J]. 煤炭科学技术,2024,52(1):297−310.
  • Citation
    TIAN Zijian,WU Jiaqi,ZHANG Wenqi,et al. An illuminance improvement and details enhancement method on coal mine low-light images based on Transformer and adaptive feature fusion[J]. Coal Science and Technology,2024,52(1):297−310.
  • 相关文章
  • 相关专题
  • 图表
    •  
    •  
    • 整体模型结构

    图(10) / 表(0)

相关问题

主办单位:煤炭科学研究总院有限公司 中国煤炭学会学术期刊工作委员会

©版权所有2015 煤炭科学研究总院有限公司 地址:北京市朝阳区和平里青年沟东路煤炭大厦 邮编:100013
京ICP备05086979号-16  技术支持:云智互联