面向海量天文数据的分布式MySQL锥形检索研究  

Research on Cone Search of Distributed MySQL for Massive Astronomical Data

作　　者：杨超 梁波 戴伟[1,2] 卫守林 邓辉[3] 王锋 Yang Chao;Liang Bo;Dai Wei;Wei Shoulin;Deng Hui;Wang Feng(School of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500,China;Key Laboratory of Application of the Computer Technology of the Yunnan Province,Kunming University of Science and Technology,Kunming 650500,China;Center for Astrophysics,Guangzhou University,Guangzhou 510006,China)

机构地区：[1]昆明理工大学信息工程与自动化学院,云南昆明650500 [2]昆明理工大学云南省计算机技术应用重点实验室,云南昆明650500 [3]广州大学天体物理中心,广东广州510006

出　　处：《天文研究与技术》2021年第3期397-404,共8页Astronomical Research & Technology

基　　金：国家重点研发计划(2018YFA0404603);国家自然科学天文联合基金(U1831204,U1931141);国家自然科学基金(11961141001,11903009);广州大学“创新强校工程”项目(2017KZDXM062);云南省重点研发计划(2018IA054);云南省应用基础研究项目(2017FB001,2018FB103)资助.

摘　　要：随着巡天观测计划的进行,传统的数据库技术无法满足海量天文数据的存储以及检索性能的需求。针对海量天文数据存储以及锥形检索的高并发、高性能问题,采用数据库中间件技术,当海量数据到达传统数据库存储阈值时,能够通过中间件技术以分库分表的形式存储到数据库集群,充分整合关系型数据库和分布式技术的优点。利用MySQL数据库集成动态索引工具(Dynamic Index Facility,DIF)插件,在分布式数据库中建立伪球面索引,能够满足海量天文数据锥形索引的需求。With the progress of sky survey projects,traditional database technology cannot satisfy the requirements of massive astronomical data storage and retrieval performance.In this paper,aiming at the high concurrency and performance of massive astronomical data storage and cone search,database middleware technology is used.When massive data reaches the limit of traditional database storage,it can be stored in the form of sub-database and sub-table through middleware technology.In the database cluster,the characteristics of the relational databases and distributed technology are fully integrated.In this article,with the application of MySQL database integrated DIF plug-in technology a pseudo-spherical index in a distributed database is established,which can meet the needs of spatial indexing in massive astronomical data.

关 键 词：海量数据 分布式中间件 锥形检索 DIF插件 MYSQL 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论] TP391.3[自动化与计算机技术—计算机科学与技术]