基于HBase数据库的数据分布式存储方法  

Data Distributed Storage Method Based on HBase Database

作　　者：曹丽蓉 CAO Lirong(College of Information Engineering,Lanzhou Technology and Business College,Lanzhou 730000,China)

机构地区：[1]兰州工商学院信息工程学院,甘肃兰州730000

出　　处：《兰州工业学院学报》2022年第5期46-50,共5页Journal of Lanzhou Institute of Technology

基　　金：2020年甘肃省高等教育教学成果培育项目(甘教高[2020]8号);2021年甘肃省高等教育教学成果培育项目(甘教高函[2021]16号)。

摘　　要：针对互联网数据种类繁杂、数量过多且占用内存较大等问题,提出基于HBase数据库的数据分布式存储方法。鉴于HBase稀疏行/列矩阵存储的特点,从逻辑模型和物理模型两方面展开分析;利用OGC简单要素模型建立空间数据模型,将几何对象转换为字节对象,提高用户读写效率;利用网格空间索引作为索引机制,通过分析每个网格的索引ID值得到属性信息和拓扑关系,便于用户查询;数据存储模型由网格金字塔模型完成构建,根据数据的多尺度层级结构特征,划分为不同的层级,每个层级都有其各自的数据图层表结构和字典表结构,用户可快速找到所需的数据。结果表明:所提方法可生成合适的节点数量,取得理想的读写效率和存储效率。Aiming at the problems of complex types,excessive quantity and large memory occupation of internet data,a data distributed storage method based on HBase database is proposed.In view of the characteristics of HBase sparse row/column matrix storage,it is analyzed from two aspects:logical model and physical model.OGC simple element model is used to establish spatial data model,convert geometric objects into byte objects,and improve user reading and writing efficiency.The grid spatial index is used as the index mechanism,and the attribute information and topological relationship are obtained by analyzing the index ID value of each grid,which is convenient for users to query.The data storage model is constructed by the grid pyramid model.According to the multi-scale hierarchical structure characteristics of the data,it is divided into different levels.Each level has its own data layer table structure and dictionary table structure.Users can quickly find the required data.The results show that the proposed method can generate an appropriate number of nodes and achieve ideal read-write efficiency and storage efficiency.

关 键 词：HBase数据库 数据分布式存储 空间数据模型 网格金字塔模型 图层表结构 

分 类 号：TP391.2[自动化与计算机技术—计算机应用技术]