大数据基础存储系统技术研究  

Research on Technology of Basic Large Data Storage System

作　　者：王瑞通[1] 李炜春 

机构地区：[1]南京邮电大学计算机学院,江苏南京210003 [2]福州大学数学与计算机科学学院,福建福州350116

出　　处：《计算机技术与发展》2017年第8期66-72,共7页Computer Technology and Development

基　　金：国家"863"高技术发展计划项目(2006AA01Z201)

摘　　要：随着大数据技术的发展和对海量数据存储、分析需求的提高,成熟的分布式存储系统越来越多。通过对不同分布式基础存储系统内部的存储策略、管理策略、架构思想等关键技术点的对比和分析,对当前流行的分布式存储系统在设计思想、创新性技术上进行了追根溯源。对比传统数据存储与分布式数据存储的技术发展和应用实例,揭示了数据存储追求更大、更快、更安全的发展潮流,重点研究了大数据基础存储实例中基于文件、键值对和表格这三种分布式存储方式。正如网络技术的发展到SDN(Software Defined Network)一样,存储方式也在发生深刻变化—软件定义存储。通过对当前大数据主流基础存储系统技术的发展和应用实例所进行的对比研究,为分布式存储系统,特别是基础存储系统的开发,提供了一些在系统设计上的参考,也为在从事大数据方面有业务需求的工作人员在选择底层存储策略时提供了借鉴。With the development of big data technology and the enhanced requirements on storage and analysis of the mass data, more and more mature distributed data storage systems have been provided. According to comparison and analysis on the key technical points like storage strategy, management strategies and architecture in the foundation system of various data distributed storage system, the existing prevailing distributed storage system is gone back to the roots from design philosophy and innovative technologiesl. Comparison on devel- opment and application between traditional and distributed data storage, it is revealed that data storage pursues the larger, the faster and the safer. The three distributed storage methods are emphasized including file-based,key-value-based and form-based in instances of basic big data storage. As the development of network technology evolved at SDN （ Software Defined Network） ,the basic storage technology reaches SDS （ Software Defined Storage）. The elaborating current mainstream development and application instance of big data storage technology has been presented in detail as a reference of design in distributed storage system, especially in basic distributed storage system and some recommendations on the selection of the underlying storage with special business for engineers.

关 键 词：大数据 存储架构 数据管理 基础数据存储系统 分布式存储系统 

分 类 号：TP302[自动化与计算机技术—计算机系统结构]