位图连接索引服务机制研究  

Research on bitmap join index service mechanism

作　　者：张延松[1,2] 苏明川 张宇[1] 王方舟[1] 

机构地区：[1]中国人民大学信息学院,北京100872 [2]中国人民大学中国调查与数据中心,北京100872

出　　处：《计算机工程与应用》2015年第5期107-115,共9页Computer Engineering and Applications

基　　金：中国人民大学科学研究基金(中央高校基本科研业务费专项资金资助)(No.12XNQ072;No.13XNLF01);中国人民大学研究生基金项目(No.13XNH217)

摘　　要：位图连接索引是数据仓库中一种有效的优化表间连接操作性能的索引机制。在大内存分析处理应用场景下,位图连接索引不仅需要权衡索引的内存和CPU开销,还需要进一步考虑处理器平台所带来的性能收益和数据访问延迟。提出了基于服务的位图连接索引管理机制,其主要特点体现在三个方面:独立于数据库的自管理索引机制;基于存储空间约束的TOP K关键字位图连接索引机制;处理器敏感(processor-conscious)的位图连接索引技术。索引服务将索引从数据库中内置的数据结构变成数据库外的索引服务层,通过对用户查询负载的分析模块和索引服务管理模块改变传统的由数据库管理员人工管理索引的模式,同时借助于协处理器和内存云技术提高索引服务的性能和灵活性。实验测试结果表明,索引服务机制能够有效地提高索引存储和访问效率,在通用GPU的强大并行处理能力的支持下,位图连接索引服务的性能和数据库整体查询处理性能都得到了显著的提升。Bitmap join index is an effective index mechanism for optimizing join performance between tables in data warehouse. In big data in-memory analytical processing scenario, bitmap join index has to consider tradeoffs between memory and CPU cost. Moreover, new processor platform should also be considered for its performance gains and data access latency. This paper proposes a service oriented bitmap join index mechanism, its main characteristics can be summarized as follows：independent of database as a self-management index mechanism, memory space constraint TOP Kkeywords bitmap join index mechanism, processor-conscious bitmap join index technique. The bitmap join index service removes the built-in bitmap join index from database as an outside bitmap join index service layer, the query workloads analysis and index management models change the traditional DBA manual management on index. Furthermore, bitmap join index service mechanism can effectively promote performance of bitmap join index service and make it more flexible. The experimental results show that bitmap join index service mechanism can effectively promote efficiency of index storage and access, with parallel processing power of GPGPU, the performance of bitmap join index service and the whole database query processing can be markedly promoted.

关 键 词：位图连接索引 通用图形处理器(GPGPU) 关键字位图连接索引 处理器敏感位图连接索引 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]