Rsync速度测试对比.doc

Rsync速度测试对比本文链接: /2009/02/21/rsync-test.html 因为一直对rsync的速度有疑问,所以昨天测试了一下.测试的环境为了1000M的网络.二天机器各接了一个存储.同步一个大的文件,所以大量的小问题不在考虑的范围.主要是速度测试.对比的项目.1.rsync使用ssh和不使用ssh时的速度分别(其实默认也是ssh).2.使用NFS挂到本地,然后在本地rsync的速度和rsync对比3.使用NFS挂到本地,然后cp到本地的速度来对比4.加优化的参数对比使用rsync的ssh的方法来传送文件,看看会不会慢很多time rsync -avlR -e ssh Pearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkv 172.16.xxx.xxx:/data/sending incremental file listPearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkvsent 4370744200 bytes received 31 bytes 19821969.30 bytes/sectotal size is 4370210591 speedup is 1.00real 3m40.864suser 1m36.867ssys 0m37.546s去掉ssh的选项来对比time rsync -avlR Pearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkv 172.16.xxx.xxx:/datasending incremental file listPearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkvsent 4370744200 bytes received 31 bytes 19643794.30 bytes/sectotal size is 4370210591 speedup is 1.00real 3m41.538suser 1m37.270ssys 0m37.984s给nfs来mount到本地,使用rsync同步,看看是否会快些time rsync -avlR Pearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkv /data sending incremental file listPearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkvsent 4370744200 bytes received 31 bytes 19732479.60 bytes/sectotal size is 4370210591 speedup is 1.00real 3m40.754suser 0m28.250ssys 0m22.297s使用cp命令来测试time cp Pearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkv /data/real 3m41.571suser 0m0.444ssys 0m5.324s加入size-only参数后对比time rsync -avl size-only Pearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkv 172.16.xxx.xxx:/datasending incremental file listPearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkvsent 4370744200 bytes received 31 bytes 21799223.10 bytes/sectotal size is 4370210591 speedup is 1.00real 3m20.962suser 1m37.645ssys 0m37.688s加入blocking-io参数对比time rsync -avl size-only blocking-io Pearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkv 172.16.xxx.xxx:/data sending incremental file listPearl.Harbor.Blu-Ray.Remux.MPEG2.1080P.DTS.LPCM.DD51.FanxySilu.mkvsent 4370744200 bytes received 31 bytes 2xxx2973.19 bytes/sectotal size is 4370210591 speedup is 1.00real 3m15.617suser 1m37.587ssys 0m37.793s由上面可以看出来,使用nfs来mount和远程直接rsync速度没有分别,单线程的rsync都很快,打不满网络.如果是文件对比少的话,rsync和使用cp的时间基本一样.另外加入优化参数能提高rsync的速度,但是我不太明白blocking-io 表示什么意思,有达人知道,请告诉.另外给大家放上我写的一个简单的perl程序来控制rsync多线程同步#!/usr/bin/perlmy $path = /data; #本地目录my $ip=172.16.xxx.xxx; #远程目录my $maxchild=5; #同时并发的个数open FILE,ls $path|;while() chomp; my $filename = $_; my $i = 1; while($i=1) my $un = ps -ef |grep rsync|grep -v grep |grep avl|wc -l; $i =$i+1; if( $un $maxchild) system(rsync -avl -size-only $path/$_ $ip:$path &) ; else sleep 5; $i = 1; rsync同步的多进程脚本为了备份网站数据，服务器主机在电信线路，备份主机在移动线路。单个连接的网速基本上就200kbps，可是rsync的客户端没办法同时启动多个连接进行同步，带宽利用不么10%。参考了：/2009/02/21/rsync-test.html用PHP改一改，在LINUX下测试OK，基于WINDOWS应该也可以。启动多个连接进行同步，效率大大提高。适合暴力解决互联互通问题?php$dir = /var/www/; /要备份的本地文件夹$remote_prefix = your.ip:dest /rsync主机的IP和目标$local_prefix = sub_folder; /对应的子文件夹$max_connect = 10; /最大的连接$files = scandir($dir, 2);array_pop($files);array_pop($files);/prin