银联数据仓库系统中ETL的设计和实现  

Design and Realization of ETL System in Unionpay Data Warehouse

作　　者：王磊[1] 李一凡[1] 赵怀慈[1] 

机构地区：[1]中国科学院沈阳自动化研究所

出　　处：《微电子学与计算机》2007年第5期66-68,72,共4页Microelectronics & Computer

基　　金：中国科学院院长基金(A050414)

摘　　要：针对银联数据的特点,设计实现了银联数据仓库ETL系统。该系统采用模块化的设计方式,增强了系统的可控性和灵活性。元数据模块使ETL系统能够灵活地适应银联业务逻辑的频繁变化;调度模块采用线程池技术,改进了以往多线程技术,提高了数据抽取的效率和系统资源的使用率;日志、监控信息及通知模块解决了系统出错快速恢复的问题。测试表明该ETL系统很好地满足了银联的需求。The system of ETL is designed and implemented for unionpay＇s data. The modules of ETL make the system more controllable and more flexible. Metadata module can adapt the logic business change of unionpay flexibly; and the schedule module adopts thread pool technology which improves the muhithreading technology to raise the efficiency of data extraction and make full use of the system resources. The logs, monitoring and informing module resolve the question of the quick recover when the system gets wrong. The test results indicate that ETL system satisfies the requirements of unionpay.

关 键 词：ETL 元数据 调度 银联 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]