分布式存储系统中文件传输优化的设计与实现  

The design of file transfer system with high speed and its implementation in GDSS

作　　者：金海[1] 官象山[1] 吴松[1] 谢超[1] 

机构地区：[1]华中科技大学计算机科学与技术学院,湖北武汉430074

出　　处：《华中科技大学学报（自然科学版）》2005年第1期4-6,9,共4页Journal of Huazhong University of Science and Technology(Natural Science Edition)

基　　金：国家高技术研究发展计划资助项目 (2 0 0 1AA1110 11) ;国家杰出青年基金资助项目 (6 0 12 5 2 0 8) ;湖北省自然科学基金资助项目 (2 0 0 4ABA0 5 3) .

摘　　要：针对在基于FTP的传统文件传输系统中 ,批量小文件和大文件的传输效率很低的问题 ,研究了不同类型文件传输任务的优化方法 ,提出了文件的自适应传输策略 :对小文件的传输采用通道复用技术 ,对大文件的传输则采用并行传输 .以此为基础设计和实现了GDSS(广域网分布式存储系统 )的文件传输系统 .研究结果表明 ,广域网分布式存储系统中 ,批量小文件传输性能明显优于传统FTP ,而对于大文件的传输 ,由于采用分片并行的传输方式 ,其性能也比标准FTP的要好 .The efficiency of transferring a pack of small sized files or a large sized file is very low in FTP(File Transfer Protocol) based file transfer system, the optimized method for different types of file transfer was studied and a self adaptive file transfer strategy was presented. Socket multiplex technoloy and parallel transferring were invited to transfer small files and large files. Based on this strategy, the GDSS (Global Distributed Storage System) file transfer system has been designed and implemented. The test result shows that the performance of GDSS is superior to FTP when transferring batch small files and large files.

关 键 词：分布式存储系统 自适应传输 通道复用 并行文件传输 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]