分析数据库ClickHouse在国家地球物理台网中心的应用  

Application of the Analytical Database ClickHouse in the National Geophysical Observatory Network Center

作　　者：王军[1] 黄经国[1] 余丹[1] 纪寿文[1] 王方建 WANG Jun;HUANG Jingguo;YU Dan;JI Shouwen;WANG Fangjian(China Earthquake Networks Center,Beijing 100045,China)

机构地区：[1]中国地震台网中心,北京100045

出　　处：《地震研究》2023年第2期308-314,共7页Journal of Seismological Research

基　　金：公共安全信息化工程(中国地震局建设项目)(12151013401)。

摘　　要：面对日益增长的地球物理观测数据,传统的Oracle数据库已经力不从心。根据地球物理历史数据可大量被读取的使用特点,通过技术选型,以具备横向扩展能力的分布式OLAP数据库ClickHouse作为数据底座,重新设计适用于ClickHouse的地球物理观测数据表结构。经过全库迁移、增量迁移和数据对比,国家地球物理台网中心的Oracle数据库中约13 TB的数据已经迁移到ClickHouse并每日更新。实际测试表明:ClickHouse显著提升数据读写性能,增强了数据统计查询能力,并且通过多副本保证了数据库的一致性和安全性。Traditional Oracle database has been unable to cope with the rapidly-growing seismic geophysical observation data.To meet the need of mass data processing of the historical geophysical data from the National Geophysical Observatory Network Center,through technology selection,the distributed OLAP database ClickHouse with horizontal expansion capability is used to redesign the structure of the data table which is suitable for ClickHouse.By full database migration,incremental migration,and data comparison,about 13 TB data in the Oracle database have been migrated to the ClickHouse database and have been keeping daily updating.Tests show that in ClickHouse,the performance of data reading and writing is significantly improved,the capability of data query is enhanced,and the consistency and security of the database is guaranteed through multiple copies.

关 键 词：ClickHouse 大数据 地球物理台网 观测数据 

分 类 号：P315-391.2[天文地球—地震学]