中国天眼的超低丢包率天文数据流传输优化  

Optimization of astronomical data stream transmission with ultra-low packet loss rate for FAST

作　　者：张钦润 郑小盈[1,3] 祝永新 汪辉 朱岩[2] 岳友岭 ZHANG Qin-run;ZHENG Xiao-ying;ZHU Yong-xin;WANG Hui;ZHU Yan;YUE You-ling(Center for Intelligent Info&Comm Technology,Shanghai Advanced Research Institute,Chinese Academy of Sciences,Shanghai 201210,China;Key Laboratory of Five-Hundred-Meter Aperture Spherical Radio Telescope,National Astronomical Observatories,Chinese Academy of Sciences,Beijing 100101,China;University of Chinese Academy of Sciences,Beijing 100049,China)

机构地区：[1]中国科学院上海高等研究院智能信息通信技术研究与发展中心,上海201210 [2]中国科学院国家天文台FAST重点实验室,北京100101 [3]中国科学院大学,北京100049

出　　处：《计算机工程与设计》2023年第7期2214-2222,共9页Computer Engineering and Design

基　　金：科技部SKA专项基金项目(2020SKA0120202);国家自然科学基金项目(U1831118);上海市自然科学基金项目(19ZR1463900)。

摘　　要：当前UDP已经成为以中国天眼为代表的射电天文领域进行数据分发所采用的事实标准,在流量控制、拥塞控制、丢包重传等传统手段无法应用的情况下,为解决单处理器应用现有射电大数据流接入方法损耗过高的问题,形式化地论证丢包重传机制无法应用于射电天文场景,提出一套面向以FAST为代表的射电天文场景的定制化通信优化方法,包括基于缓存行对齐的巨型帧设计、CPU亲和性绑定、网卡直访缓存、三级缓存适配的内核缓冲区调整和旁路内核等手段。在25 Gbps的实际终端网络实验和8 Gbps模拟中,该套方法分别将网络传输丢包率从60%和e-4降为e-4和e-8,性能显著提高,验证了优化策略的有效性。The user datagram protocol has become the de facto standard for data distribution in the field of radio astronomy represented by the 500-meter spherical radio telescope.Traditional means such as flow control,congestion control and packet loss retransmission can not be applied.To solve the problem of high loss of existing radio large data stream access methods by single processor application,this paper formally argued that the packet loss retransmission mechanism cannot be applied to radio astronomy scenarios.A customized communication optimization method was proposed for radio astronomy scenarios represented by FAST.The methods included cache line-alignment based jumbo frame design,CPU affinity binding,direct cache access by the NIC,L3 cache adaptive kernel buffer adjustment and bypass kernels.In the terminal network experiment with 25 Gbps bandwidth and FAST simulation experiment with 8 Gbps bandwidth,the method reduces the network transmission packet loss rate from 60%and e-4 to e-4 and e-8 respectively,and the performance is significantly improved,which verifies the effectiveness of the optimization strategy.

关 键 词：射电天文 大数据流 五百米口径球面射电望远镜(中国天眼) 定制化通信优化 数据分发 用户数据报协议 丢包率 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]