一种实现抽取数据的kettle插件开发  

A kettle Plugin Development for Extracting Data

作　　者：吴莉珊 鲍远松[1] 李亚贝 黄明[1] 沈春锋[1] 

机构地区：[1]上海宝信软件股份有限公司

出　　处：《信息技术与标准化》2020年第8期27-31,共5页Information Technology & Standardization

摘　　要：介绍Elasticsearch和ETL工具以及Kettle插件的开发流程,通过两个示例展示本文开发的一种从Elasticsearch抽取数据的Kettle插件,支持Elasticsearch集群模式和权限认证,并通过增加嵌套自增字段有效地解决嵌套数组字段的输出流无法区分的问题,实现数据迁移,从而为企业的商业智能分析奠定了数据基础,提升企业决策水平。This article first introduces the development process of ES(Elasticsearch)and ETL(Extraction-Transformation-Loading)tools and the Kettle plug-in,and then uses two examples to show the Kettle plugin development solution that extracts data from ES,which supports ES cluster mode and authority authentication,and the problem of indistinguishable output stream of nested array fields is effectively solved by adding nested auto-increment fields,so that data migration between different databases can be achieved,which is able to lay a data foundation for business intelligence analysis of enterprises,and improve the level of enterprise decision-making.

关 键 词：工业大数据 数据迁移 KETTLE Elasticsearch 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论] TP391.3[自动化与计算机技术—计算机科学与技术]