3DT-CM: A Low-complexity Cross-matching Algorithm for Large Astronomical Catalogues Using 3d-tree Approach  

作　　者：Yifei Mu Ce Yu Chao Sun Kun Li Yajie Zhang Jizeng Wei Jian Xiao Jie Wang 

机构地区：[1]College of Intelligence and Computing,Tianjin University,Tianjin 300350,China [2]Technical R&D Innovation Center,National Astronomical Data Center,Tianjin 300350,China [3]Xinjiang Astronomical Observatory,Chinese Academy of Sciences,Urumqi 830011,China

出　　处：《Research in Astronomy and Astrophysics》2023年第10期324-334,共11页天文和天体物理学研究（英文版）

基　　金：supported by the National Key Research and Development Program of China (2022YFF0711502);the National Natural Science Foundation of China (NSFC) (12273025 and 12133010);supported by China National Astronomical Data Center (NADC), CAS Astronomical Data Center and Chinese Virtual Observatory (China-VO)。

摘　　要：Location-based cross-matching is a preprocessing step in astronomy that aims to identify records belonging to the same celestial body based on the angular distance formula. The traditional approach involves comparing each record in one catalog with every record in the other catalog, resulting in a one-to-one comparison with high computational complexity. To reduce the computational time, index partitioning methods are used to divide the sky into regions and perform local cross-matching. In addition, cross-matching algorithms have been adopted on highperformance architectures to improve their efficiency. But the index partitioning methods and computation architectures only increase the degree of parallelism, and cannot decrease the complexity of pairwise-based crossmatching algorithm itself. A better algorithm is needed to further improve the performance of cross-matching algorithm. In this paper, we propose a 3d-tree-based cross-matching algorithm that converts the angular distance formula into an equivalent 3dEuclidean distance and uses 3d-tree method to reduce the overall computational complexity and to avoid boundary issues. Furthermore, we demonstrate the superiority of the 3d-tree approach over the 2d-tree method and implement it using a multi-threading technique during both the construction and querying phases. We have experimentally evaluated the proposed 3d-tree cross-matching algorithm using publicly available catalog data. The results show that our algorithm applied on two 32-core CPUs achieves equivalent performance than previous experiments conducted on a six-node CPU-GPU cluster.

关 键 词：methods:data analysis catalogs techniques:miscellaneous 

分 类 号：P11[天文地球—天文学]