基于数据湖平台的工业大数据分析实践:以智能油田能效分析为例  

Industrial big data analytics practice based on data lake platform:an example of intelligent oilfield energy efficiency analysis

作　　者：李满 安创锋 高静 牛永胜 姚嘉琨 Li Man;An Chuangfeng;Gao Jing;Niu Yongsheng;Yao Jiakun(CNOOC(China)Tianjin Branch,Tianjin 300450,China;China Electronics System Technology Co.,Beijing 100089,China)

机构地区：[1]中海石油(中国)有限公司天津分公司,天津300450 [2]中国电子系统技术有限公司,北京100089

出　　处：《网络安全与数据治理》2024年第11期75-84,共10页CYBER SECURITY AND DATA GOVERNANCE

摘　　要：工业系统以及工业企业应用场景日益复杂,导致系统处理数据量与数据类型日益增多。面对多样化的业务应用场景和海量多源异构数据,对数据分析的流动性与灵活性要求越来越高。而传统基于数据库的大数据分析平台无法满足不同结构数据汇入与数据源变化。因此,构建了一套端到端、高效协同的大数据分析应用实施框架,结合数据湖平台与智能算法建立针对工业大数据的分析模型,实现以业务分析需求为驱动,结合数据湖平台对于海量多源异构数据的处理、汇聚、管理能力,高效开展数据建模、准备、测试、训练与验证。最后,在智能油田能效分析场景进行应用验证,成功实现对于智能油田能效分析场景下的系统预测、优化与决策功能,为油田全业务流程提供数据支撑,推动智能油田可持续发展。As industrial systems and the application scenarios of industrial enterprises become increasingly complex,the quantity and variety of data processed by the system also increase.In light of the growing number of diverse business application scenarios and the increasing volume of heterogeneous data from a multitude of sources,the need for enhanced mobility and flexibility in data analysis is becoming increasingly apparent.The conventional database-centric approach to big data analysis is inadequate for accommodating the heterogeneous structural characteristics of data sinks and the evolving nature of data sources.Accordingly,this paper presents a comprehensive,integrated and collaborative big data analysis application implementation framework.This framework combines the data lake platform and intelligent algorithms to establish an analysis model for industrial big data.Furthermore,driven by business analysis requirements,the data lake platform′s processing,aggregation,and management capabilities are leveraged to efficiently carry out data modeling,preparation,testing,training,and validation.Subsequently,the application is verified in an intelligent oilfield energy efficiency analysis scenario.This successfully demonstrates the system′s ability to predict,optimize,and make decisions in this context,providing data support for the entire business process of oil fields and promoting the sustainable development of intelligent oilfields.

关 键 词：大数据分析 数据湖 工程化架构 智能油田 商业智能 人工智能 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]