Construction and application of lakehouse system for coal mine big earth data
耿恒高彭苏萍王占刚许娜许献磊杜文凤
GENG Henggao;PENG Suping;WANG Zhangang;XU Na;XU Xianlei;DU Wenfeng
中国矿业大学(北京) 地球科学与测绘工程学院煤炭精细勘探与智能开发全国重点实验室
为满足煤矿智能化发展过程中对海量、多源、异构数据高效管理与应用的需求,提出基于多种大数据技术的煤矿地学大数据智能湖仓系统。针对多源异构煤矿地学数据的高效索引需求,提出基于希尔伯特曲线与GeoHash编码的时空分类方法,将时间、空间、分类等多维属性进行统一编码,降低数据索引维度,提升数据检索效率。智能湖仓系统的构建不仅提高煤矿地学数据的整合与利用效率,还为煤矿企业的数字化转型与透明化发展提供重要实践经验,推动煤矿行业向智能化、透明化、高效化方向迈进。
In order to meet the needs of efficient management and application of massive, multi-sourc and heterogeneous data in the process of intelligent development of coal mines, this paper proposes an intelligent lakehouse system for coal mine big earth data based on multiple big data technologies. In response to the needs in efficient indexing of multi-source heterogeneous coal mine geological data, this paper proposes a spatiotemporal classification method based on Hilbert curves and GeoHash coding, which uniformly encodes multidimensional attributes such as time, space and classification, reduces the data index dimension, and improves retrieval efficiency. The construction of the intelligent lake house system not only optimizes the integration and utilization efficiency of coal mine geological data, but also provides important practical experience for the digital transformation and transparent development of coal mining enterprises, and promotes the coal mining industry to move towards intelligence, transparency, and high efficiency.
煤矿智能化地学大数据大数据技术智能湖仓
intelligent coal mine;big earth data;big data technology;lakehouse
主办单位:煤炭科学研究总院有限公司 中国煤炭学会学术期刊工作委员会