基于HBase的分布式海量小型文件存储系统  

A Distributed Massive Small File Storage System Based on HBase

作　　者：秦栋华 QIN Donghua(Zhiyang Network Technology(Shanghai)Co.,Ltd.,Shanghai 200000,China)

机构地区：[1]智阳网络技术(上海)有限公司,上海200000

出　　处：《数字通信世界》2023年第4期74-75,79,共3页Digital Communication World

摘　　要：随着互联网公司的业务不断发展,企业的大量数据以非结构化的形式存在,非结构化数据常常以小型文件为主,不仅体量大,而且分散性高,因此海量小型文件存储面临着存储性能和访问效率较低等问题。分布式小型文件存储系统是指在集群服务器的硬件存储资源环境下,对小型文件保存、读取和修改进行统一管理的系统。文章基于HBase实现了一个分布式小型文件存储系统,该文件系统有超强的处理海量小型文件的能力,同时有着良好的扩展性、容错性和稳定性,可以更好地支撑互联网企业的业务发展。As the business of Internet companies continues to grow,a large amount of enterprise data exists as unstructured data.Unstructured data,tends to be in small files,is not only large in volume but also high in dispersion,so massive small file storage faces problems such as low storage performance and access efficiency.Distributed small file storage system is a system that unifies the management of small file saving,reading,and modification under the hardware storage resource environment of clustered servers.The article implements a distributed small file storage system based on HBase.The file system has a superb ability to handle a large number of small files,and at the same time has good scalability,fault tolerance,and stability,which can better support the development of Internet companies.

关 键 词：分布式 HBASE 文件系统 存储 

分 类 号：TP308[自动化与计算机技术—计算机系统结构]