基于Spark的火电大数据挖掘方法的研究  被引量:11

The Research of Big Data Mining of Thermal Power Method Based on Spark

在线阅读下载全文

作  者:宋鸣程 贾立[1] 叶灵芝 SONG Ming-cheng;JIA Li;YE Ling-zhi(School of Mechatronics Engineering and Automation,Shanghai University,Shanghai Key Laboratory of Power Station Automation Technology,Shanghai 200072,China)

机构地区:[1]上海大学机电与自动化工程学院上海市电站自动化技术重点实验室

出  处:《控制工程》2018年第12期2158-2165,共8页Control Engineering of China

基  金:国家自然科学基金资助项目(61773251);上海市科委创新行动计划(15510722100,16111106300,17511109400)

摘  要:传统数据挖掘在处理火电大数据时,普遍存在计算瓶颈。针对此问题,提出了基于Spark的火电大数据挖掘方法。该方法根据机组实际运行特点,对火电大数据进行稳态工况判定和基于外部约束的工况划分,并在Spark计算框架下,引入了分布式的理念,使用基于Spark的K-means算法对火电大数据进行离散化,并使用基于Spark的FP-growth算法对火电大数据进行关联规则分析,挖掘出各工况的强关联规则,进而得到符合优化目标的参数所达到过的最优值。该方法应用到安徽某电厂300MW机组,对该机组某月10天的运行数据进行挖掘。仿真结果表明,该方法能够有效地对火电大数据进行数据挖掘,且在数据量大时。该方法与传统的数据挖掘相比计算效率具有明显优势。There are computational bottlenecks in the traditional data mining when dealing with big data of thermal power.For this problem,a big data mining method of thermal power based on Spark is presented in this paper.According to the characteristics of the actual operation of the unit,this method determines the steady-state conditions of big data of thermal power and divides the working conditions based on external constraints,and under the framework of Spark,the concept of distributed is introduced.K-means algorithm based on Spark is used to discretize the big data of thermal power.And FP-growth algorithm based on Spark is used to analyze the association rules of thermal power big data so as to mine the strong association rules of each working condition and then get the optimal value of the parameters that meet the optimization goals.This method is applied to a 300MW unit in a power plant in Anhui Province,and mines the operation data of the unit for 10 days in a month.The results of simulation show that this method can.effectively mine big data of thermal power,and has the advantage of computational efficiency compared with the traditional data mining when the data volume is large.

关 键 词:火电大数据 SPARK 大数据挖掘 关联规则 运行优化 

分 类 号:TP18[自动化与计算机技术—控制理论与控制工程]

 

参考文献:

正在载入数据...

 

二级参考文献:

正在载入数据...

 

耦合文献:

正在载入数据...

 

引证文献:

正在载入数据...

 

二级引证文献:

正在载入数据...

 

同被引文献:

正在载入数据...

 

相关期刊文献:

正在载入数据...

相关的主题
相关的作者对象
相关的机构对象