基于极值点自适应的快速文件同步方法  

An Adaptive Method for Fast File Synchronization Based on Extreme Point

作　　者：陆泽宁 刘晓洁 黄泽源 LU Zening;LIU Xiaojie;HUANG Zeyuan(School of Computer,Sichuan University,Chengdu,610064,China;College of Cyberseeurity,Sichuan University,Chengdu,610065,China)

机构地区：[1]四川大学计算机学院,成都610064 [2]四川大学网络空间安全学院,成都610065

出　　处：《网络新媒体技术》2018年第6期17-23,共7页Network New Media Technology

基　　金：国家重点研发计划(编号:2016yfb0800604;2016yfb0800605);国家自然科学基金项目(编号:61572334;U1736212)

摘　　要：Rsync差异同步方法是一种高效的文件同步方法,但是在差异数据分布离散和同步网络速度较快等情况下,可能会出现其同步效率低于完全同步的问题。为了避免这种问题,提出了一种基于极值点分块自适应的快速文件同步方法。该方法利用数据极值点进行基于内容的可变长分块,快速估算同步源端和同步目的端在差异数据分布不同时的动态数据差异度,根据计算出的差异度和当前同步网络速度的定量值,自适应地选择采用更优的同步方法。实验结果表明,在差异数据分布不同和网络同步速率不同的情况下,本文的方法能有效地选择更优的同步方法,达到减少同步时间,提高同步效率的目的。Rsync differential synchronization is a highly efficient method of file synchronization.However,Rsync differential synchronization's efficiency will be lower than full synchronization,when the distribution of differential data is discrete and the speed of synchronization network is fast.In order to avoid this problem,we proposed an adaptive method for fast file synchronization based on extreme point partition.The method gives a fast estimation of the diversity degree (different with actual value)of data in source and destination,using data extreme value points for content based variable partitioned blocks.Experiments show that under the condition of different data distribution and different network environment,this method can effectively select better synchronization methods,so as to reduce the time and improve the efficiency of synchronization.

关 键 词：文件同步 极值点分块 基于内容分块 RSYNC算法 

分 类 号：TP301.6[自动化与计算机技术—计算机系统结构]