面向有效载荷高速数据流的数据处理方法  

Technology of data processing for high speed data stream of payload

作　　者：王静 王春梅[1] 智佳[1] 杨甲森[1] 陈托[1] 

机构地区：[1]中国科学院国家空间科学中心,北京100190 [2]中国科学院大学,北京100049

出　　处：《计算机工程与设计》2017年第4期941-945,共5页Computer Engineering and Design

摘　　要：针对卫星有效载荷数传数据传输速度快、实时处理难等特点,提出一种面向有效载荷高速数据流的实时数据处理方法。借鉴MapReduce的多线程并行模式,采用hash算法与归并排序算法相结合的方式,提高数据处理吞吐率,实现实时处理;采用基于XTCE(XML telemetry&command exchange)数据模型的参数解析算法,实现通用性。实验结果表明,该方法能够满足有效载荷对数据处理的实时性和正确性的要求。Aiming at the characteristics of high speed transmitting and difficulty in real-time data processing for payload transmit- ted data, a method of data processing for high speed data stream of payload was presented. By drawing on multi-threaded parallel mode of MapReduce framework, hash algorithm and merge sort algorithm were combined to improve the throughput rate of data processing and achieve real-time processing. A parameter parsing algorithm based on XTCE （XML telemetry ＆ command ex- change） data model was employed to improve generality. Results of the experiments indicate the proposed method can meet data processing requirements of payload on real-time performance and validity.

关 键 词：有效载荷高速数据流 数据处理 映射归约 吞吐率 基于可扩展标记的遥测遥控信息交换 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]