不对称内存计算平台OLAP查询处理技术研究  

Research on OLAP query processing technology for asymmetric in-memory computing platform

作　　者：张延松[1,2,3] 张宇[4] 周烜[1,2] 王珊[1,2] 

机构地区：[1]中国人民大学DEKE实验室,北京100872 [2]中国人民大学信息学院,北京100872 [3]中国人民大学中国调查与数据中心,北京100872 [4]国家卫星气象中心,北京100081

出　　处：《华东师范大学学报（自然科学版）》2016年第5期89-102,共14页Journal of East China Normal University(Natural Science)

基　　金：国家863计划项目(2015AA015307);中央高校基本科研业务费专项资金项目(16XNLQ02);华为创新研究计划(HIRP 20140507;HIRP 20140510)

摘　　要：给出了一种面向当前和未来不对称内存计算平台的OLAP查询处理技术.不对称内存计算平台是指配置有不同计算类型的处理器、不同存储访问设备的计算机,因此需要对OLAP查询处理模型按不同的计算特点进行优化存储配置和实现算法设计,从而使OLAP查询处理的不同阶段更好地适应相应的存储与计算设备的硬件特点,提高硬件设备的利用率,更好地发挥硬件的性能.提出了3阶段OLAP计算模型,将传统基于迭代处理模型的OLAP查询处理过程分解为计算密集型和数据密集型负载,分别由功能完备的通用处理器和并行计算能力强大的协处理器分而治之地完成,并最小化不同存储与计算设备之间的数据传输代价.实验结果表明基于负载划分的3阶段OLAP计算模型能够较好地适应CPU-Phi不对称计算平台,实现通过计算型硬件加速计算密集型负载,从而加速整个OLAP查询处理性能的目标.This paper proposes an OLAP query processing technology for nowadays and future asymmetric in-memory computing platform. Asymmetric in-memory computing platform means that computer equips with different computing feature processors and dif- ferent memory access devices so that the OLAP processing model needs to be optimized for different computing features and implementation designs to enable the different processing stages to adapt to the characteristics of corresponding storage and computing hardware for higher hardware utilization and performance. This paper proposes the 3-stage OLAP computing model, which divides the traditional iterative processing model into computing intensive and data intensive workloads to be assigned to general purpose processor with full fiedged functions and coprocessor with powerful parallel processing capacity. The data transmission overhead between different storage and computing devices is also minimized. The experimental results show that the 3-stage OLAP computing model based on workload partitioning can be adaptive to CPU-Phi asymmetric computing platform, the acceleration on OLAP query processing can be achieved by accelerating computing intensive workload by computing intensive hardware.

关 键 词：内存计算 不对称计算平台 内存联机分析处理 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]