一种支持网络硬盘存储系统的大数据传输技术  

Transmission Technique for Huge-data in Online Storage System

作　　者：周娇[1] 傅颖勋[2] 刘青昆[1] 舒继武[2] 

机构地区：[1]辽宁师范大学计算机与信息技术学院,辽宁大连116081 [2]清华大学计算机科学与技术系,北京100084

出　　处：《小型微型计算机系统》2014年第2期329-333,共5页Journal of Chinese Computer Systems

基　　金：国家科技支撑计划子课题项目(2011BAH04B02)资助

摘　　要：随着网络的迅速发展和普及,网络硬盘存储系统的应用越来越广泛.但现有的网络硬盘存储系统在超大数据文件传输、传输过程的内存占有率、数据安全性及断点续传等方面仍存在着一些缺陷.针对这些问题提出一种高效便捷的DTOSS(Data Transmission in Online Storage System)数据传输技术.DTOSS数据传输技术基于服务器端的目录树结构,利用分块传输的思想,实现了超大数据文件的传输.同时DTOSS技术还提高了数据的安全性,压缩了传输过程中的内存开销,并实现了超大数据文件的断点续传.实验结果表明,DTOSS技术以64MB作为单个数据块大小可以达到最大的传输速率,此条件下的内存开销大约为67MB,并能节省约2/3的中断重传时间.With the rapid development and popularization of network, the application of online storage system is more and more exten- sive. But the existing online storage system has some defects in transmission of huge-data file, memory occupancy in the process of transmission, data security,breakpoint continuingly etc. In order to solve these problems, this paper proposes an efficient and conven- ient DTOSS （ Data Transmission in Online Storage System } Data Transmission technology. The DTOSS data transmissio-n technology is based on the server directory tree structure, and use the thoughts of block transmission to realize transmission of huge-data file. Be- sides, DTOSS technology improves the data security, compresses the memory overhead of transmission processes and realizes the breakpoint continuingly of huge-data files. Our experiment results show that when using 64MB as the size of a single data block, DTOSS technology can achieve the maximum transmission rate, memory overhead is about 67MB in this condition. More important- ly, it can save about two-thirds of interrupt retransmission time.

关 键 词：网络硬盘存储系统 超大数据传输 DTOSS技术 断点续传 内存消耗 

分 类 号：TP309[自动化与计算机技术—计算机系统结构]