From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:56103) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1c44EE-0003OH-V5 for qemu-devel@nongnu.org; Tue, 08 Nov 2016 06:06:18 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1c44E7-0004LJ-Sa for qemu-devel@nongnu.org; Tue, 08 Nov 2016 06:06:10 -0500 Received: from mx1.redhat.com ([209.132.183.28]:53532) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1c44E7-0004L7-DV for qemu-devel@nongnu.org; Tue, 08 Nov 2016 06:06:03 -0500 Date: Tue, 8 Nov 2016 11:05:53 +0000 From: "Dr. David Alan Gilbert" Message-ID: <20161108110552.GD2042@work-vm> References: <5feb15.7e53.1576070ae2d.Coremail.lichunguang@hust.edu.cn> <20160926112349.GF2029@work-vm> <13289d.86da.15766fdf27c.Coremail.lichunguang@hust.edu.cn> <20160930054610.GA1429@amit-lp.rh> <1401177.991b.157a34a9dea.Coremail.lichunguang@hust.edu.cn> <20161014111548.GD2030@work-vm> <1fce900.7b41.158294afd28.Coremail.lichunguang@hust.edu.cn> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <1fce900.7b41.158294afd28.Coremail.lichunguang@hust.edu.cn> Content-Transfer-Encoding: quoted-printable Subject: Re: [Qemu-devel] Migration dirty bitmap: should only mark pages as dirty after they have been sent List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Chunguang Li Cc: Amit Shah , qemu-devel@nongnu.org, pbonzini@redhat.com, stefanha@redhat.com, quintela@redhat.com * Chunguang Li (lichunguang@hust.edu.cn) wrote: >=20 >=20 >=20 > > -----Original Messages----- > > From: "Dr. David Alan Gilbert" > > Sent Time: Friday, October 14, 2016 > > To: "Chunguang Li" > > Cc: "Amit Shah" , qemu-devel@nongnu.org, pbonzi= ni@redhat.com, stefanha@redhat.com, quintela@redhat.com > > Subject: Re: [Qemu-devel] Migration dirty bitmap: should only mark pa= ges as dirty after they have been sent > >=20 > > * Chunguang Li (lichunguang@hust.edu.cn) wrote: > > >=20 > > >=20 > > >=20 > > > > -----=E5=8E=9F=E5=A7=8B=E9=82=AE=E4=BB=B6----- > > > > =E5=8F=91=E4=BB=B6=E4=BA=BA: "Amit Shah" > > > > =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4: 2016=E5=B9=B49=E6=9C=8830=E6= =97=A5 =E6=98=9F=E6=9C=9F=E4=BA=94 > > > > =E6=94=B6=E4=BB=B6=E4=BA=BA: "Chunguang Li" > > > > =E6=8A=84=E9=80=81: "Dr. David Alan Gilbert" , qemu-devel@nongnu.org, pbonzini@redhat.com, stefanha@redhat.com, quint= ela@redhat.com > > > > =E4=B8=BB=E9=A2=98: Re: Re: [Qemu-devel] Migration dirty bitmap: = should only mark pages as dirty after they have been sent > > > >=20 > > > > On (Mon) 26 Sep 2016 [22:55:01], Chunguang Li wrote: > > > > >=20 > > > > >=20 > > > > >=20 > > > > > > -----=E5=8E=9F=E5=A7=8B=E9=82=AE=E4=BB=B6----- > > > > > > =E5=8F=91=E4=BB=B6=E4=BA=BA: "Dr. David Alan Gilbert" > > > > > > =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4: 2016=E5=B9=B49=E6=9C=88= 26=E6=97=A5 =E6=98=9F=E6=9C=9F=E4=B8=80 > > > > > > =E6=94=B6=E4=BB=B6=E4=BA=BA: "Chunguang Li" > > > > > > =E6=8A=84=E9=80=81: qemu-devel@nongnu.org, amit.shah@redhat.c= om, pbonzini@redhat.com, stefanha@redhat.com, quintela@redhat.com > > > > > > =E4=B8=BB=E9=A2=98: Re: [Qemu-devel] Migration dirty bitmap: = should only mark pages as dirty after they have been sent > > > > > >=20 > > > > > > * Chunguang Li (lichunguang@hust.edu.cn) wrote: > > > > > > > Hi all! > > > > > > > I have some confusion about the dirty bitmap during migrati= on. I have digged into the code. I figure out that every now and then dur= ing migration, the dirty bitmap will be grabbed from the kernel space thr= ough ioctl(KVM_GET_DIRTY_LOG), and then be used to update qemu's dirty bi= tmap. However I think this mechanism leads to resendness of some NON-dirt= y pages. > > > > > > >=20 > > > > > > > Take the first iteration of precopy for instance, during wh= ich all the pages will be sent. Before that during the migration setup, t= he ioctl(KVM_GET_DIRTY_LOG) is called once, so the kernel begins to produ= ce the dirty bitmap from this moment. When the pages "that haven't been s= ent" are written, the kernel space marks them as dirty. However I don't t= hink this is correct, because these pages will be sent during this and th= e next iterations with the same content (if they are not written again af= ter they are sent). It only makes sense to mark the pages which have alre= ady been sent during one iteration as dirty when they are written. > > > > > > >=20 > > > > > > >=20 > > > > > > > Am I right about this consideration? If I am right, is ther= e some advice to improve this? > > > > > >=20 > > > > > > I think you're right that this can happen; to clarify I think= the > > > > > > case you're talking about is: > > > > > >=20 > > > > > > Iteration 1 > > > > > > sync bitmap > > > > > > start sending pages > > > > > > page 'n' is modified - but hasn't been sent yet > > > > > > page 'n' gets sent > > > > > > Iteration 2 > > > > > > sync bitmap > > > > > > 'page n is shown as modified' > > > > > > send page 'n' again > > > > > > > > > > >=20 > > > > > Yes=EF=BC=8Cthis is right the case I am talking about. > > > > > =20 > > > > > > So you're right that is wasteful; I guess it's more wasteful > > > > > > on big VMs with slow networks where the length of each iterat= ion > > > > > > is large. > > > > >=20 > > > > > I think this is "very" wasteful. Assume the workload writes the= pages dirty randomly within the guest address space, and the transfer sp= eed is constant. Intuitively, I think nearly half of the dirty pages prod= uced in Iteration 1 is not really dirty. This means the time of Iteration= 2 is double of that to send only really dirty pages. > > > >=20 > > > > It makes sense, can you get some perf numbers to show what kinds = of > > > > workloads get impacted the most? That would also help us to figu= re > > > > out what kinds of speed improvements we can expect. > > > >=20 > > > >=20 > > > > Amit > > >=20 > > > I have picked up 6 workloads and got the following statistics numbe= rs=20 > > > of every iteration (except the last stop-copy one) during precopy. > > > These numbers are obtained with the basic precopy migration, withou= t=20 > > > the capabilities like xbzrle or compression, etc. The network for t= he=20 > > > migration is exclusive, with a separate network for the workloads.=20 > > > They are both gigabit ethernet. I use qemu-2.5.1. > > >=20 > > > Three (booting, idle, web server) of them converged to the stop-cop= y phase,=20 > > > with the given bandwidth and default downtime (300ms), while the ot= her > > > three (kernel compilation, zeusmp, memcached) did not. > > >=20 > > > One page is "not-really-dirty", if it is written first and is sent = later > > > (and not written again after that) during one iteration. I guess th= is=20 > > > would not happen so often during the other iterations as during the= 1st=20 > > > iteration. Because all the pages of the VM are sent to the dest nod= e during=20 > > > the 1st iteration, while during the others, only part of the pages = are sent.=20 > > > So I think the "not-really-dirty" pages should be produced mainly d= uring=20 > > > the 1st iteration , and maybe very little during the other iteratio= ns. > > >=20 > > > If we could avoid resending the "not-really-dirty" pages, intuitive= ly, I > > > think the time spent on Iteration 2 would be halved. This is a chai= n reaction, > > > because the dirty pages produced during Iteration 2 is halved, whic= h incurs > > > that the time spent on Iteration 3 is halved, then Iteration 4, 5..= . > >=20 > > Yes; these numbers don't show how many of them are false dirty though= . > >=20 > > One problem is thinking about pages that have been redirtied, if the = page is dirtied > > after the sync but before the network write then it's the false-dirty= that > > you're describing. > >=20 > > However, if the page is being written a few times, and so it would ha= ve been written > > after the network write then it isn't a false-dirty.=20 > >=20 > > You might be able to figure that out with some kernel tracing of when= the dirtying > > happens, but it might be easier to write the fix! > >=20 > > Dave >=20 > Hi, I have made some new progress now. >=20 > To tell how many false dirty pages there are exactly in each iteration,= I malloc a > buffer in memory as big as the size of the whole VM memory. When a page= is=20 > transferred to the dest node, it is copied to the buffer; During the ne= xt iteration,=20 > if one page is transferred, it is compared to the old one in the buffer= , and the > old one will be replaced for next comparison if it is really dirty. Thu= s, we are now=20 > able to get the exact number of false dirty pages. > > This time, I use 15 workloads to get the statistic number. They are: >=20 > 1. 11 benchmarks picked up from cpu2006 benchmark suit. They are all = scientific=20 > computing workloads like Quantum Chromodynamics, Fluid Dynamics, e= tc. I pick > up these 11 benchmarks because compared to others, they have bigge= r memory > occupation and higher memory dirty rate. Thus most of them could n= ot converge > to stop-and-copy using the default migration speed (32MB/s). > 2. kernel compilation > 3. idle VM=20 > 4. Apache web server which serves static content >=20 > (the above workloads are all running in VM with 1 vcpu and 1GB memory= , and the=20 > migration speed is the default 32MB/s) >=20 > 5. Memcached. The VM has 6 cpu cores and 6GB memory, and 4GB are used= as the cache. > After filling up the 4GB cache, a client writes the cache at a con= stant speed > during migration. This time, migration speed has no limit, and is = up to the=20 > capability of 1Gbps Ethernet. >=20 > Summarize the results first: (and you can read the precise number below= )=20 >=20 > 1. 4 of these 15 workloads have a big proportion (>60%, even >80% dur= ing some iterations)=20 > of false dirty pages out of all the dirty pages since iteration 2 = (and the big=20 > proportion lasts during the following iterations). They are cpu200= 6.zeusmp,=20 > cpu2006.bzip2, cpu2006.mcf, and memcached. > 2. 2 workloads (idle, webserver) spend most of the migration time on = iteration 1, even > though the proportion of false dirty pages is big since iteration = 2, the space to > optimize is small. > 3. 1 workload (kernel compilation) only have a big proportion during = iteration 2, not=20 > in the other iterations. > 4. 8 workloads (the other 8 benchmarks of cpu2006) have little propor= tion of false=20 > dirty pages since iteration 2. So the spaces to optimize for them = are small. >=20 > Now I want to talk a little more about the reasons why false dirty page= s are produced.=20 > The first reason is what we have discussed before---the mechanism to tr= ack the dirty=20 > pages. > And then I come up with another reason. Here is the situation: a write = operation to one=20 > memory page happens, but it doesn't change any content of the page. So = it's "write but=20 > not dirty", and kernel still marks it as dirty. One guy in our lab has = done some experiments > to figure out the proportion of "write but not dirty" operations, and h= e uses the cpu2006 > benchmark suit. According to his results, general workloads has a littl= e proportion (<10%)=20 > of "write but not dirty" out of all the write operations, while few wor= kloads have higher > proportion (one even as high as 50%). Now we are not sure why "write bu= t not dirty" would=20 > happen, it just happened. I think there are a few different reasons I can think of: a) You have a flag or mutex that's set and cleared; so it gets set (mar= ked dirty) and cleared around some operation. By the time we come to mig= rate it then it's back to cleared again. Similarly with other temporary data structures. b) Some system operation causes the page to be moved - e.g. swap or the= kernel reorganising memory. However, it's a shame I don't think you can tell in your experiment which= of the two cases we're hitting? I'd like to know if it's worth working on making the page sync mechanism better or if it's nore important to deal with the second reason you show. > So these two reasons contribute to the false dirty pages. To optimize, = I compute and store > the SHA1 hash before transferring each page. Next time, if one page nee= ds retransmission, its > SHA1 hash is computed again, and compared to the old hash. If the hash = is the same, it's a > false dirty page, and we just skip this page; Otherwise, the page is tr= ansferred, and the new > hash replaces the old one for next comparison.=20 > The reason to use SHA1 hash but not byte-by-byte comparison is the memo= ry overheads. One SHA1 > hash is 20 bytes. So we need extra 20/4096 (<1/200) memory space of the= whole VM memory, which > is relatively small.=20 > As far as I know, SHA1 hash is widely used in the scenes of deduplicati= on for backup systems.=20 > They have proven that the probability of hash collision is far smaller = than disk hardware fault, > so it's secure hash, that is, if the hashes of two chunks are the same,= the content must be the=20 > same. So I think the SHA1 hash could replace byte-to-byte comparison in= the VM memory scenery.=20 There was a proposal ( https://lists.gnu.org/archive/html/qemu-devel/2015= -11/msg05331.html ) to do a migration system where a copy of the migration RAM is stored on disc on the destination for case= s where similar VMs are migrated, and it used a checksum for each page to find the matching p= age in the cache; that originally used a smaller hash, I think in the end the= y used a SHA-256. (Hash based checks still make me nervous for intentional collisions but t= hat's probably me being paranoid?) > Then I do the same migration experiments using the SHA1 hash. For the 4= workloads which have=20 > big proportions of false dirty pages, the improvement is remarkable. Wi= thout optimization,=20 > they either can not converge to stop-and-copy, or take a very long time= to complete. With the=20 > SHA1 hash method, all of them now complete in a relatively short time.=20 > For the reason I have talked above, the other workloads don't get notab= le improvements from the=20 > optimization. So below, I only show the exact number after optimization= for the 4 workloads with > remarkable improvements. >=20 > Any comments or suggestions?=20 You might be able to save some of the CPU time; we've got a test that checks if a page is all-zero; if you're doing the SHA calculation you could avoid doing the all-zero check and replace it by comparing hte output of the SHA. >=20 > Below is the experiments data: > ( > "dup" means zero page, this kind of pages takes very little migration t= ime and network=20 > resources, so they are always not regard as dirty pages in my numbers; > "rd" means really dirty pages; > "fd" means false dirty pages; > The numbers refer to the quantities of pages. > ) >=20 > ------------------The 4 workloads with remarkable improvements (both th= e results of original precopy and with optimization are shown)-----------= -------- >=20 > 1. memcached >=20 > ----- original pre-copy (can not converge): ----- > Iteration 1, duration: 42111 ms , transferred pages: 1568788 (dup: = 416239, rd: 1152549, fd: 0) , new dirty pages: 499015 , remai= ning dirty pages: 507397 > Iteration 2, duration: 17208 ms , transferred pages: 498946 (dup: = 5456, rd: 160206, fd: 333284) , new dirty pages: 261237 , remai= ning dirty pages: 269688 > Iteration 3, duration: 9134 ms , transferred pages: 262377 (dup: = 519, rd: 111900, fd: 149958) , new dirty pages: 170281 , remai= ning dirty pages: 177592 > Iteration 4, duration: 5920 ms , transferred pages: 169966 (dup: = 87, rd: 82487, fd: 87392) , new dirty pages: 121154 , remai= ning dirty pages: 128780 > Iteration 5, duration: 4239 ms , transferred pages: 121551 (dup: = 81, rd: 64120, fd: 57350) , new dirty pages: 100976 , remai= ning dirty pages: 108205 > Iteration 6, duration: 3495 ms , transferred pages: 100353 (dup: = 90, rd: 56021, fd: 44242) , new dirty pages: 74547 , remai= ning dirty pages: 82399 > Iteration 7, duration: 2583 ms , transferred pages: 74160 (dup: = 56, rd: 38016, fd: 36088) , new dirty pages: 58209 , remai= ning dirty pages: 66448 > Iteration 8, duration: 2039 ms , transferred pages: 58534 (dup: = 81, rd: 26885, fd: 31568) , new dirty pages: 43511 , remai= ning dirty pages: 51425 > Iteration 9, duration: 1513 ms , transferred pages: 43484 (dup: = 55, rd: 26641, fd: 16788) , new dirty pages: 43722 , remai= ning dirty pages: 51663 > Iteration 10, duration: 1521 ms , transferred pages: 43676 (dup: = 62, rd: 26463, fd: 17151) , new dirty pages: 35347 , remai= ning dirty pages: 43334 > Iteration 11, duration: 1230 ms , transferred pages: 35287 (dup: = 0, rd: 21293, fd: 13994) , new dirty pages: 28851 , remai= ning dirty pages: 36898 > Iteration 12, duration: 1031 ms , transferred pages: 29651 (dup: = 82, rd: 18143, fd: 11426) , new dirty pages: 27062 , remai= ning dirty pages: 34309 > Iteration 13, duration: 917 ms , transferred pages: 26385 (dup: = 56, rd: 14149, fd: 12180) , new dirty pages: 22723 , remai= ning dirty pages: 30647 > Iteration 14, duration: 762 ms , transferred pages: 21902 (dup: = 55, rd: 16355, fd: 5492) , new dirty pages: 18208 , remai= ning dirty pages: 26953 > Iteration 15, duration: 650 ms , transferred pages: 18636 (dup: = 0, rd: 11943, fd: 6693) , new dirty pages: 16085 , remai= ning dirty pages: 24402 > Iteration 16, duration: 554 ms , transferred pages: 15946 (dup: = 56, rd: 9527, fd: 6363) , new dirty pages: 14766 , remai= ning dirty pages: 23222 > Iteration 17, duration: 538 ms , transferred pages: 15434 (dup: = 0, rd: 9779, fd: 5655) , new dirty pages: 13381 , remai= ning dirty pages: 21169 > Iteration 18, duration: 487 ms , transferred pages: 14089 (dup: = 81, rd: 7737, fd: 6271) , new dirty pages: 13325 , remai= ning dirty pages: 20405 > Iteration 19, duration: 428 ms , transferred pages: 12232 (dup: = 0, rd: 8488, fd: 3744) , new dirty pages: 10274 , remai= ning dirty pages: 18447 > Iteration 20, duration: 377 ms , transferred pages: 10887 (dup: = 56, rd: 6362, fd: 4469) , new dirty pages: 9708 , remai= ning dirty pages: 17268 > Iteration 21, duration: 320 ms , transferred pages: 9222 (dup: = 0, rd: 5789, fd: 3433) , new dirty pages: 8015 , remai= ning dirty pages: 16061 > Iteration 22, duration: 268 ms , transferred pages: 7621 (dup: = 0, rd: 6204, fd: 1417) , new dirty pages: 7227 , remai= ning dirty pages: 15667 > Iteration 23, duration: 269 ms , transferred pages: 7813 (dup: = 56, rd: 4410, fd: 3347) , new dirty pages: 7591 , remai= ning dirty pages: 15445 > Iteration 24, duration: 271 ms , transferred pages: 7749 (dup: = 0, rd: 4565, fd: 3184) , new dirty pages: 15126 , remai= ning dirty pages: 22822 > Iteration 25, duration: 549 ms , transferred pages: 15818 (dup: = 60, rd: 10545, fd: 5213) , new dirty pages: 14559 , remai= ning dirty pages: 21563 > Iteration 26, duration: 499 ms , transferred pages: 14281 (dup: = 3, rd: 8760, fd: 5518) , new dirty pages: 11947 , remai= ning dirty pages: 19229 > Iteration 27, duration: 376 ms , transferred pages: 10823 (dup: = 25, rd: 6550, fd: 4248) , new dirty pages: 8561 , remai= ning dirty pages: 16967 > Iteration 28, duration: 324 ms , transferred pages: 9350 (dup: = 31, rd: 5292, fd: 4027) , new dirty pages: 8655 , remai= ning dirty pages: 16272 > Iteration 29, duration: 274 ms , transferred pages: 7813 (dup: = 0, rd: 6088, fd: 1725) , new dirty pages: 6300 , remai= ning dirty pages: 14759 > Iteration 30, duration: 218 ms , transferred pages: 6340 (dup: = 45, rd: 3196, fd: 3099) , new dirty pages: 5143 , remai= ning dirty pages: 13562 >=20 > ----- after optimization: ----- > Iteration 1, duration: 40664 ms , transferred pages: 1569037 (dup: = 405940, rd: 1163097) , new dirty pages: 506846 , remaining dirty pag= es: 514979 > Iteration 2, duration: 8032 ms , transferred pages: 161130 (dup: = 4007, rd: 157123) , new dirty pages: 153479 , remaining dirty pag= es: 153479 Big difference. > Iteration 3, duration: 2620 ms , transferred pages: 65260 (dup: = 20, rd: 65240) , new dirty pages: 64014 , remaining dirty pag= es: 67100 > Iteration 4, duration: 1160 ms , transferred pages: 30227 (dup: = 60, rd: 30167) , new dirty pages: 34031 , remaining dirty pag= es: 41414 > Iteration 5, duration: 648 ms , transferred pages: 18700 (dup: = 56, rd: 18644) , new dirty pages: 18375 , remaining dirty pag= es: 25536 > Iteration 6, duration: 389 ms , transferred pages: 11399 (dup: = 55, rd: 11344) , new dirty pages: 12536 , remaining dirty pag= es: 17516 > Iteration 7, duration: 292 ms , transferred pages: 8197 (dup: = 0, rd: 8197) , new dirty pages: 8387 , remaining dirty pag= es: 16802 > Iteration 8, duration: 171 ms , transferred pages: 4931 (dup: = 39, rd: 4892) , new dirty pages: 6182 , remaining dirty pag= es: 14060 > Iteration 9, duration: 163 ms , transferred pages: 4355 (dup: = 16, rd: 4339) , new dirty pages: 5530 , remaining dirty pag= es: 11973 > Iteration 10, duration: 104 ms , transferred pages: 3266 (dup: = 0, rd: 3266) , new dirty pages: 2893 , remaining dirty pag= es: 11014 > Iteration 11, duration: 52 ms , transferred pages: 1153 (dup: = 0, rd: 1153) , new dirty pages: 1586 , remaining dirty pag= es: 10516 > Iteration 12, duration: 52 ms , transferred pages: 1921 (dup: = 39, rd: 1882) , new dirty pages: 1619 , remaining dirty pag= es: 8842 > Iteration 13, duration: 62 ms , transferred pages: 1537 (dup: = 0, rd: 1537) , new dirty pages: 2052 , remaining dirty pag= es: 8871 > Iteration 14, duration: 58 ms , transferred pages: 1665 (dup: = 0, rd: 1665) , new dirty pages: 1947 , remaining dirty pag= es: 7989 > Iteration 15, duration: 2 ms , transferred pages: 0 (dup: = 0, rd: 0) , new dirty pages: 0 , remaining dirty pag= es: 7989 > total time: 54693 milliseconds Very nice. Dave > 2. cpu2006.zeusmp >=20 > ----- original pre-copy (can not converge): ----- > Iteration 1, duration: 21112 ms , transferred pages: 266450 (dup: = 93385, rd: 173065, fd: 0) , new dirty pages: 127866 , remai= ning dirty pages: 127866 > Iteration 2, duration: 6192 ms , transferred pages: 125662 (dup: = 75762, rd: 17389, fd: 32511) , new dirty pages: 131655 , remai= ning dirty pages: 133859 > Iteration 3, duration: 6699 ms , transferred pages: 131937 (dup: = 77298, rd: 20320, fd: 34319) , new dirty pages: 121027 , remai= ning dirty pages: 122949 > Iteration 4, duration: 5999 ms , transferred pages: 122512 (dup: = 73588, rd: 17236, fd: 31688) , new dirty pages: 122759 , remai= ning dirty pages: 123196 > Iteration 5, duration: 5804 ms , transferred pages: 122717 (dup: = 75436, rd: 19016, fd: 28265) , new dirty pages: 123697 , remai= ning dirty pages: 124176 > Iteration 6, duration: 5698 ms , transferred pages: 123708 (dup: = 77249, rd: 18022, fd: 28437) , new dirty pages: 121838 , remai= ning dirty pages: 122306 > Iteration 7, duration: 5515 ms , transferred pages: 122306 (dup: = 76727, rd: 14819, fd: 30760) , new dirty pages: 122382 , remai= ning dirty pages: 122382 > Iteration 8, duration: 6086 ms , transferred pages: 120825 (dup: = 71834, rd: 15987, fd: 33004) , new dirty pages: 121587 , remai= ning dirty pages: 123144 > Iteration 9, duration: 5899 ms , transferred pages: 120964 (dup: = 72860, rd: 18191, fd: 29913) , new dirty pages: 120391 , remai= ning dirty pages: 122571 > Iteration 10, duration: 5801 ms , transferred pages: 121425 (dup: = 74140, rd: 20722, fd: 26563) , new dirty pages: 122302 , remai= ning dirty pages: 123448 > Iteration 11, duration: 5909 ms , transferred pages: 123448 (dup: = 74735, rd: 19678, fd: 29035) , new dirty pages: 123258 , remai= ning dirty pages: 123258 > Iteration 12, duration: 6293 ms , transferred pages: 121211 (dup: = 70442, rd: 18128, fd: 32641) , new dirty pages: 123623 , remai= ning dirty pages: 125670 > Iteration 13, duration: 6398 ms , transferred pages: 124897 (dup: = 72701, rd: 21134, fd: 31062) , new dirty pages: 122355 , remai= ning dirty pages: 123128 > Iteration 14, duration: 6301 ms , transferred pages: 121893 (dup: = 70514, rd: 23470, fd: 27909) , new dirty pages: 120980 , remai= ning dirty pages: 122215 > Iteration 15, duration: 6304 ms , transferred pages: 121389 (dup: = 70005, rd: 21731, fd: 29653) , new dirty pages: 121628 , remai= ning dirty pages: 122454 > Iteration 16, duration: 6398 ms , transferred pages: 122164 (dup: = 69962, rd: 24376, fd: 27826) , new dirty pages: 122246 , remai= ning dirty pages: 122536 > Iteration 17, duration: 6201 ms , transferred pages: 121548 (dup: = 70984, rd: 23915, fd: 26649) , new dirty pages: 121460 , remai= ning dirty pages: 122448 > Iteration 18, duration: 6401 ms , transferred pages: 122272 (dup: = 70072, rd: 22261, fd: 29939) , new dirty pages: 123518 , remai= ning dirty pages: 123694 > Iteration 19, duration: 7003 ms , transferred pages: 121873 (dup: = 64754, rd: 27325, fd: 29794) , new dirty pages: 120568 , remai= ning dirty pages: 122389 > Iteration 20, duration: 6400 ms , transferred pages: 121422 (dup: = 69221, rd: 25300, fd: 26901) , new dirty pages: 121229 , remai= ning dirty pages: 122196 > Iteration 21, duration: 6703 ms , transferred pages: 119895 (dup: = 65232, rd: 25877, fd: 28786) , new dirty pages: 123284 , remai= ning dirty pages: 125585 > Iteration 22, duration: 6902 ms , transferred pages: 123884 (dup: = 67582, rd: 29020, fd: 27282) , new dirty pages: 122057 , remai= ning dirty pages: 123758 > Iteration 23, duration: 6800 ms , transferred pages: 122010 (dup: = 66529, rd: 30644, fd: 24837) , new dirty pages: 120916 , remai= ning dirty pages: 122664 > Iteration 24, duration: 7202 ms , transferred pages: 121951 (dup: = 63188, rd: 31105, fd: 27658) , new dirty pages: 122715 , remai= ning dirty pages: 123428 > Iteration 25, duration: 7202 ms , transferred pages: 122919 (dup: = 64161, rd: 32063, fd: 26695) , new dirty pages: 123180 , remai= ning dirty pages: 123689 > Iteration 26, duration: 7404 ms , transferred pages: 123092 (dup: = 62694, rd: 33459, fd: 26939) , new dirty pages: 122149 , remai= ning dirty pages: 122746 > Iteration 27, duration: 7205 ms , transferred pages: 120427 (dup: = 61664, rd: 34344, fd: 24419) , new dirty pages: 120299 , remai= ning dirty pages: 122618 > Iteration 28, duration: 7100 ms , transferred pages: 121074 (dup: = 63130, rd: 32403, fd: 25541) , new dirty pages: 122984 , remai= ning dirty pages: 124528 > Iteration 29, duration: 7904 ms , transferred pages: 124060 (dup: = 59564, rd: 35631, fd: 28865) , new dirty pages: 127080 , remai= ning dirty pages: 127548 > Iteration 30, duration: 7906 ms , transferred pages: 127518 (dup: = 63029, rd: 34416, fd: 30073) , new dirty pages: 125028 , remai= ning dirty pages: 125058 >=20 > ----- after optimization: ----- > Iteration 1, duration: 21601 ms , transferred pages: 266450 (dup: = 89731, rd: 176719) , new dirty pages: 139843 , remaining dirty pag= es: 139843 > Iteration 2, duration: 1747 ms , transferred pages: 92077 (dup: = 78364, rd: 13713) , new dirty pages: 90945 , remaining dirty pag= es: 90945 > Iteration 3, duration: 1592 ms , transferred pages: 62253 (dup: = 49435, rd: 12818) , new dirty pages: 76929 , remaining dirty pag= es: 76929 > Iteration 4, duration: 992 ms , transferred pages: 44837 (dup: = 37886, rd: 6951) , new dirty pages: 71331 , remaining dirty pag= es: 72916 > Iteration 5, duration: 998 ms , transferred pages: 55229 (dup: = 47150, rd: 8079) , new dirty pages: 21703 , remaining dirty pag= es: 23302 > Iteration 6, duration: 211 ms , transferred pages: 20337 (dup: = 18516, rd: 1821) , new dirty pages: 14500 , remaining dirty pag= es: 14500 > Iteration 7, duration: 31 ms , transferred pages: 12933 (dup: = 12627, rd: 306) , new dirty pages: 1520 , remaining dirty pag= es: 1520 > Iteration 8, duration: 30 ms , transferred pages: 0 (dup: = 0, rd: 0) , new dirty pages: 4 , remaining dirty pag= es: 1524 > total time: 27225 milliseconds >=20 > 3. cpu2006.bzip2 >=20 > ----- original pre-copy: ----- > Iteration 1, duration: 18306 ms , transferred pages: 266450 (dup: = 116569, rd: 149881, fd: 0) , new dirty pages: 106299 , remai= ning dirty pages: 106299 > Iteration 2, duration: 10694 ms , transferred pages: 104611 (dup: = 17550, rd: 10536, fd: 76525) , new dirty pages: 34394 , remai= ning dirty pages: 36082 > Iteration 3, duration: 2998 ms , transferred pages: 34442 (dup: = 9924, rd: 12254, fd: 12264) , new dirty pages: 6419 , remai= ning dirty pages: 8059 > Iteration 4, duration: 699 ms , transferred pages: 5748 (dup: = 22, rd: 2583, fd: 3143) , new dirty pages: 1226 , remai= ning dirty pages: 3537 > Iteration 5, duration: 200 ms , transferred pages: 1636 (dup: = 0, rd: 1194, fd: 442) , new dirty pages: 478 , remai= ning dirty pages: 2379 > Iteration 6, duration: 1 ms , transferred pages: 0 (dup: = 0, rd: 0, fd: 0) , new dirty pages: 0 , remai= ning dirty pages: 2379 >=20 > ----- after optimization: ----- > Iteration 1, duration: 13995 ms , transferred pages: 266314 (dup: = 152118, rd: 114196) , new dirty pages: 97009 , remaining dirty pag= es: 97145 > Iteration 2, duration: 1215 ms , transferred pages: 33400 (dup: = 26745, rd: 6655) , new dirty pages: 12866 , remaining dirty pag= es: 14017 > Iteration 3, duration: 701 ms , transferred pages: 5774 (dup: = 48, rd: 5726) , new dirty pages: 6342 , remaining dirty pag= es: 8761 > Iteration 4, duration: 500 ms , transferred pages: 4111 (dup: = 21, rd: 4090) , new dirty pages: 4311 , remaining dirty pag= es: 6485 > Iteration 5, duration: 400 ms , transferred pages: 3273 (dup: = 1, rd: 3272) , new dirty pages: 3034 , remaining dirty pag= es: 5431 > Iteration 6, duration: 301 ms , transferred pages: 2454 (dup: = 0, rd: 2454) , new dirty pages: 2094 , remaining dirty pag= es: 4472 > Iteration 7, duration: 299 ms , transferred pages: 2454 (dup: = 0, rd: 2454) , new dirty pages: 2066 , remaining dirty pag= es: 4082 > Iteration 8, duration: 202 ms , transferred pages: 1636 (dup: = 0, rd: 1636) , new dirty pages: 2881 , remaining dirty pag= es: 4648 > Iteration 9, duration: 300 ms , transferred pages: 2454 (dup: = 0, rd: 2454) , new dirty pages: 4775 , remaining dirty pag= es: 6778 > Iteration 10, duration: 400 ms , transferred pages: 3281 (dup: = 9, rd: 3272) , new dirty pages: 3757 , remaining dirty pag= es: 5576 > Iteration 11, duration: 401 ms , transferred pages: 3279 (dup: = 7, rd: 3272) , new dirty pages: 6980 , remaining dirty pag= es: 8906 > Iteration 12, duration: 500 ms , transferred pages: 7118 (dup: = 3035, rd: 4083) , new dirty pages: 10774 , remaining dirty pag= es: 11922 > Iteration 13, duration: 116 ms , transferred pages: 11706 (dup: = 10152, rd: 1554) , new dirty pages: 1326 , remaining dirty pag= es: 1326 > Iteration 14, duration: 117 ms , transferred pages: 0 (dup: = 0, rd: 0) , new dirty pages: 0 , remaining dirty pag= es: 1326 > total time: 19479 milliseconds >=20 > 4. cpu2006.mcf >=20 > ----- original pre-copy: ----- > Iteration 1, duration: 31711 ms , transferred pages: 266450 (dup: = 6925, rd: 259525, fd: 0) , new dirty pages: 244403 , remai= ning dirty pages: 244403 > Iteration 2, duration: 29603 ms , transferred pages: 242275 (dup: = 377, rd: 224001, fd: 17897) , new dirty pages: 227335 , remai= ning dirty pages: 229463 > Iteration 3, duration: 27806 ms , transferred pages: 227573 (dup: = 169, rd: 65681, fd: 161723) , new dirty pages: 195593 , remai= ning dirty pages: 197483 > Iteration 4, duration: 23907 ms , transferred pages: 195543 (dup: = 41, rd: 39838, fd: 155664) , new dirty pages: 215066 , remai= ning dirty pages: 217006 > Iteration 5, duration: 26305 ms , transferred pages: 215289 (dup: = 155, rd: 33082, fd: 182052) , new dirty pages: 111098 , remai= ning dirty pages: 112815 > Iteration 6, duration: 13502 ms , transferred pages: 110452 (dup: = 22, rd: 26793, fd: 83637) , new dirty pages: 161054 , remai= ning dirty pages: 163417 > Iteration 7, duration: 19705 ms , transferred pages: 161266 (dup: = 120, rd: 33818, fd: 127328) , new dirty pages: 220562 , remai= ning dirty pages: 222713 > Iteration 8, duration: 27003 ms , transferred pages: 220881 (dup: = 21, rd: 215721, fd: 5139) , new dirty pages: 219787 , remai= ning dirty pages: 221619 > Iteration 9, duration: 26802 ms , transferred pages: 219248 (dup: = 24, rd: 84648, fd: 134576) , new dirty pages: 207959 , remai= ning dirty pages: 210330 > Iteration 10, duration: 25411 ms , transferred pages: 207916 (dup: = 144, rd: 35842, fd: 171930) , new dirty pages: 144442 , remai= ning dirty pages: 146856 > Iteration 11, duration: 17714 ms , transferred pages: 144804 (dup: = 18, rd: 25414, fd: 119372) , new dirty pages: 205127 , remai= ning dirty pages: 207179 > Iteration 12, duration: 25112 ms , transferred pages: 205446 (dup: = 128, rd: 23197, fd: 182121) , new dirty pages: 167319 , remai= ning dirty pages: 169052 > Iteration 13, duration: 20411 ms , transferred pages: 166886 (dup: = 14, rd: 21960, fd: 144912) , new dirty pages: 221592 , remai= ning dirty pages: 223758 > Iteration 14, duration: 27126 ms , transferred pages: 221800 (dup: = 122, rd: 42368, fd: 179310) , new dirty pages: 233630 , remai= ning dirty pages: 235588 > Iteration 15, duration: 28517 ms , transferred pages: 233321 (dup: = 191, rd: 222528, fd: 10602) , new dirty pages: 224282 , remai= ning dirty pages: 226549 > Iteration 16, duration: 27422 ms , transferred pages: 224187 (dup: = 55, rd: 45773, fd: 178359) , new dirty pages: 209815 , remai= ning dirty pages: 212177 > Iteration 17, duration: 25723 ms , transferred pages: 210260 (dup: = 34, rd: 79405, fd: 130821) , new dirty pages: 220297 , remai= ning dirty pages: 222214 > Iteration 18, duration: 26920 ms , transferred pages: 220056 (dup: = 14, rd: 214128, fd: 5914) , new dirty pages: 192015 , remai= ning dirty pages: 194173 > Iteration 19, duration: 23520 ms , transferred pages: 192239 (dup: = 9, rd: 25140, fd: 167090) , new dirty pages: 96450 , remai= ning dirty pages: 98384 > Iteration 20, duration: 11805 ms , transferred pages: 96538 (dup: = 14, rd: 7424, fd: 89100) , new dirty pages: 6978 , remai= ning dirty pages: 8824 > Iteration 21, duration: 799 ms , transferred pages: 6545 (dup: = 1, rd: 1802, fd: 4742) , new dirty pages: 138 , remai= ning dirty pages: 2417 > Iteration 22, duration: 1 ms , transferred pages: 0 (dup: = 0, rd: 0, fd: 0) , new dirty pages: 0 , remai= ning dirty pages: 2417 >=20 > ----- after optimization: ----- > Iteration 1, duration: 31711 ms , transferred pages: 266450 (dup: = 6831, rd: 259619) , new dirty pages: 240209 , remaining dirty pag= es: 240209 > Iteration 2, duration: 6250 ms , transferred pages: 51244 (dup: = 211, rd: 51033) , new dirty pages: 226651 , remaining dirty pag= es: 228571 > Iteration 3, duration: 4395 ms , transferred pages: 36008 (dup: = 80, rd: 35928) , new dirty pages: 110719 , remaining dirty pag= es: 111478 > Iteration 4, duration: 3390 ms , transferred pages: 28068 (dup: = 28, rd: 28040) , new dirty pages: 185172 , remaining dirty pag= es: 185172 > Iteration 5, duration: 2986 ms , transferred pages: 23780 (dup: = 45, rd: 23735) , new dirty pages: 64357 , remaining dirty pag= es: 66305 > Iteration 6, duration: 2727 ms , transferred pages: 22800 (dup: = 12, rd: 22788) , new dirty pages: 61675 , remaining dirty pag= es: 61675 > Iteration 7, duration: 2372 ms , transferred pages: 18943 (dup: = 13, rd: 18930) , new dirty pages: 55144 , remaining dirty pag= es: 55265 > Iteration 8, duration: 2100 ms , transferred pages: 17189 (dup: = 11, rd: 17178) , new dirty pages: 55244 , remaining dirty pag= es: 55668 > Iteration 9, duration: 2003 ms , transferred pages: 16371 (dup: = 11, rd: 16360) , new dirty pages: 107058 , remaining dirty pag= es: 108014 > Iteration 10, duration: 2132 ms , transferred pages: 17825 (dup: = 24, rd: 17801) , new dirty pages: 126214 , remaining dirty pag= es: 126214 > Iteration 11, duration: 2229 ms , transferred pages: 18156 (dup: = 22, rd: 18134) , new dirty pages: 65725 , remaining dirty pag= es: 65725 > Iteration 12, duration: 2315 ms , transferred pages: 18651 (dup: = 21, rd: 18630) , new dirty pages: 52575 , remaining dirty pag= es: 53903 > Iteration 13, duration: 2147 ms , transferred pages: 17435 (dup: = 16, rd: 17419) , new dirty pages: 46652 , remaining dirty pag= es: 47260 > Iteration 14, duration: 2000 ms , transferred pages: 16371 (dup: = 11, rd: 16360) , new dirty pages: 42721 , remaining dirty pag= es: 43266 > Iteration 15, duration: 1901 ms , transferred pages: 15552 (dup: = 10, rd: 15542) , new dirty pages: 38593 , remaining dirty pag= es: 40792 > Iteration 16, duration: 1801 ms , transferred pages: 14735 (dup: = 11, rd: 14724) , new dirty pages: 54252 , remaining dirty pag= es: 55639 > Iteration 17, duration: 1708 ms , transferred pages: 13860 (dup: = 2, rd: 13858) , new dirty pages: 72379 , remaining dirty pag= es: 74170 > Iteration 18, duration: 1923 ms , transferred pages: 15442 (dup: = 12, rd: 15430) , new dirty pages: 101911 , remaining dirty pag= es: 103547 > Iteration 19, duration: 2311 ms , transferred pages: 18823 (dup: = 9, rd: 18814) , new dirty pages: 80534 , remaining dirty pag= es: 82521 > Iteration 20, duration: 2081 ms , transferred pages: 17156 (dup: = 34, rd: 17122) , new dirty pages: 36054 , remaining dirty pag= es: 36054 > Iteration 21, duration: 1665 ms , transferred pages: 13777 (dup: = 10, rd: 13767) , new dirty pages: 29624 , remaining dirty pag= es: 29624 > Iteration 22, duration: 1657 ms , transferred pages: 13290 (dup: = 7, rd: 13283) , new dirty pages: 25949 , remaining dirty pag= es: 28265 > Iteration 23, duration: 1599 ms , transferred pages: 13088 (dup: = 0, rd: 13088) , new dirty pages: 22356 , remaining dirty pag= es: 24813 > Iteration 24, duration: 1500 ms , transferred pages: 12280 (dup: = 10, rd: 12270) , new dirty pages: 21181 , remaining dirty pag= es: 22608 > Iteration 25, duration: 1400 ms , transferred pages: 11457 (dup: = 5, rd: 11452) , new dirty pages: 18657 , remaining dirty pag= es: 20311 > Iteration 26, duration: 1200 ms , transferred pages: 9822 (dup: = 6, rd: 9816) , new dirty pages: 15690 , remaining dirty pag= es: 17294 > Iteration 27, duration: 1201 ms , transferred pages: 9822 (dup: = 6, rd: 9816) , new dirty pages: 14810 , remaining dirty pag= es: 15936 > Iteration 28, duration: 1000 ms , transferred pages: 8183 (dup: = 3, rd: 8180) , new dirty pages: 15387 , remaining dirty pag= es: 16423 > Iteration 29, duration: 900 ms , transferred pages: 7372 (dup: = 10, rd: 7362) , new dirty pages: 13303 , remaining dirty pag= es: 15292 > Iteration 30, duration: 1000 ms , transferred pages: 8181 (dup: = 1, rd: 8180) , new dirty pages: 17879 , remaining dirty pag= es: 18457 > Iteration 31, duration: 951 ms , transferred pages: 8140 (dup: = 9, rd: 8131) , new dirty pages: 21738 , remaining dirty pag= es: 23304 > Iteration 32, duration: 946 ms , transferred pages: 6946 (dup: = 1, rd: 6945) , new dirty pages: 15815 , remaining dirty pag= es: 15815 > Iteration 33, duration: 747 ms , transferred pages: 6192 (dup: = 0, rd: 6192) , new dirty pages: 6249 , remaining dirty pag= es: 7670 > Iteration 34, duration: 501 ms , transferred pages: 4090 (dup: = 0, rd: 4090) , new dirty pages: 6163 , remaining dirty pag= es: 8422 > Iteration 35, duration: 600 ms , transferred pages: 4910 (dup: = 2, rd: 4908) , new dirty pages: 3673 , remaining dirty pag= es: 5222 > Iteration 36, duration: 300 ms , transferred pages: 2454 (dup: = 0, rd: 2454) , new dirty pages: 2132 , remaining dirty pag= es: 4337 > Iteration 37, duration: 200 ms , transferred pages: 1637 (dup: = 1, rd: 1636) , new dirty pages: 544 , remaining dirty pag= es: 2251 > Iteration 38, duration: 0 ms , transferred pages: 0 (dup: = 0, rd: 0) , new dirty pages: 0 , remaining dirty pag= es: 2251 > total time: 97919 milliseconds >=20 > ------------------The other 11 workloads without notable improvements (= only the result of original precopy is shown)------------------- >=20 > 5. idle >=20 > Iteration 1, duration: 14702 ms , transferred pages: 266450 (dup: = 146393, rd: 120057, fd: 0) , new dirty pages: 14595 , remai= ning dirty pages: 14595 > Iteration 2, duration: 1592 ms , transferred pages: 12412 (dup: = 103, rd: 3280, fd: 9029) , new dirty pages: 218 , remai= ning dirty pages: 2401 > Iteration 3, duration: 0 ms , transferred pages: 0 (dup: = 0, rd: 0, fd: 0) , new dirty pages: 0 , remai= ning dirty pages: 2401 >=20 > 6. kernel compilation (can not converge) >=20 > Iteration 1, duration: 20607 ms , transferred pages: 266450 (dup: = 97552, rd: 168898, fd: 0) , new dirty pages: 19293 , remai= ning dirty pages: 19293 > Iteration 2, duration: 2092 ms , transferred pages: 17176 (dup: = 597, rd: 8625, fd: 7954) , new dirty pages: 8318 , remai= ning dirty pages: 10435 > Iteration 3, duration: 1000 ms , transferred pages: 8484 (dup: = 304, rd: 6256, fd: 1924) , new dirty pages: 8736 , remai= ning dirty pages: 10687 > Iteration 4, duration: 1000 ms , transferred pages: 8435 (dup: = 255, rd: 7089, fd: 1091) , new dirty pages: 7627 , remai= ning dirty pages: 9879 > Iteration 5, duration: 900 ms , transferred pages: 7553 (dup: = 191, rd: 5602, fd: 1760) , new dirty pages: 7287 , remai= ning dirty pages: 9613 > Iteration 6, duration: 900 ms , transferred pages: 7620 (dup: = 258, rd: 5761, fd: 1601) , new dirty pages: 8958 , remai= ning dirty pages: 10951 > Iteration 7, duration: 1099 ms , transferred pages: 9309 (dup: = 311, rd: 8051, fd: 947) , new dirty pages: 7189 , remai= ning dirty pages: 8831 > Iteration 8, duration: 800 ms , transferred pages: 6832 (dup: = 288, rd: 5717, fd: 827) , new dirty pages: 5782 , remai= ning dirty pages: 7781 > Iteration 9, duration: 701 ms , transferred pages: 5875 (dup: = 149, rd: 4005, fd: 1721) , new dirty pages: 4587 , remai= ning dirty pages: 6493 > Iteration 10, duration: 500 ms , transferred pages: 4234 (dup: = 144, rd: 3057, fd: 1033) , new dirty pages: 7352 , remai= ning dirty pages: 9611 > Iteration 11, duration: 900 ms , transferred pages: 7759 (dup: = 397, rd: 6563, fd: 799) , new dirty pages: 6686 , remai= ning dirty pages: 8538 > Iteration 12, duration: 800 ms , transferred pages: 6808 (dup: = 264, rd: 6017, fd: 527) , new dirty pages: 6871 , remai= ning dirty pages: 8601 > Iteration 13, duration: 800 ms , transferred pages: 6775 (dup: = 231, rd: 5722, fd: 822) , new dirty pages: 7540 , remai= ning dirty pages: 9366 > Iteration 14, duration: 900 ms , transferred pages: 7507 (dup: = 145, rd: 5900, fd: 1462) , new dirty pages: 7581 , remai= ning dirty pages: 9440 > Iteration 15, duration: 900 ms , transferred pages: 7630 (dup: = 268, rd: 6211, fd: 1151) , new dirty pages: 7268 , remai= ning dirty pages: 9078 > Iteration 16, duration: 800 ms , transferred pages: 6759 (dup: = 215, rd: 5763, fd: 781) , new dirty pages: 6861 , remai= ning dirty pages: 9180 > Iteration 17, duration: 800 ms , transferred pages: 6838 (dup: = 294, rd: 6037, fd: 507) , new dirty pages: 6196 , remai= ning dirty pages: 8538 > Iteration 18, duration: 800 ms , transferred pages: 6852 (dup: = 308, rd: 4905, fd: 1639) , new dirty pages: 5947 , remai= ning dirty pages: 7633 > Iteration 19, duration: 700 ms , transferred pages: 5919 (dup: = 193, rd: 4853, fd: 873) , new dirty pages: 5861 , remai= ning dirty pages: 7575 > Iteration 20, duration: 600 ms , transferred pages: 5284 (dup: = 376, rd: 4408, fd: 500) , new dirty pages: 5206 , remai= ning dirty pages: 7497 > Iteration 21, duration: 600 ms , transferred pages: 5147 (dup: = 239, rd: 4308, fd: 600) , new dirty pages: 5031 , remai= ning dirty pages: 7381 > Iteration 22, duration: 599 ms , transferred pages: 5064 (dup: = 156, rd: 4026, fd: 882) , new dirty pages: 5601 , remai= ning dirty pages: 7918 > Iteration 23, duration: 702 ms , transferred pages: 5965 (dup: = 239, rd: 5028, fd: 698) , new dirty pages: 6079 , remai= ning dirty pages: 8032 > Iteration 24, duration: 700 ms , transferred pages: 6175 (dup: = 449, rd: 5146, fd: 580) , new dirty pages: 10932 , remai= ning dirty pages: 12789 > Iteration 25, duration: 1300 ms , transferred pages: 10936 (dup: = 302, rd: 6205, fd: 4429) , new dirty pages: 8713 , remai= ning dirty pages: 10566 > Iteration 26, duration: 1000 ms , transferred pages: 8282 (dup: = 102, rd: 5662, fd: 2518) , new dirty pages: 5119 , remai= ning dirty pages: 7403 > Iteration 27, duration: 600 ms , transferred pages: 5007 (dup: = 99, rd: 4099, fd: 809) , new dirty pages: 2226 , remai= ning dirty pages: 4622 > Iteration 28, duration: 300 ms , transferred pages: 2491 (dup: = 37, rd: 1794, fd: 660) , new dirty pages: 6746 , remai= ning dirty pages: 8877 > Iteration 29, duration: 800 ms , transferred pages: 6757 (dup: = 213, rd: 5532, fd: 1012) , new dirty pages: 6070 , remai= ning dirty pages: 8190 > Iteration 30, duration: 700 ms , transferred pages: 6052 (dup: = 326, rd: 5107, fd: 619) , new dirty pages: 5177 , remai= ning dirty pages: 7315 >=20 > 7. web server >=20 > Iteration 1, duration: 20902 ms , transferred pages: 266450 (dup: = 95497, rd: 170953, fd: 0) , new dirty pages: 8528 , remai= ning dirty pages: 8528 > Iteration 2, duration: 796 ms , transferred pages: 6472 (dup: = 131, rd: 1885, fd: 4456) , new dirty pages: 650 , remai= ning dirty pages: 2706 > Iteration 3, duration: 100 ms , transferred pages: 818 (dup: = 0, rd: 383, fd: 435) , new dirty pages: 328 , remai= ning dirty pages: 2216 > Iteration 4, duration: 0 ms , transferred pages: 0 (dup: = 0, rd: 0, fd: 0) , new dirty pages: 0 , remai= ning dirty pages: 2216 >=20 >=20 > 8. cpu2006.bwaves (can not converge) >=20 > Iteration 1, duration: 31715 ms , transferred pages: 266450 (dup: = 6766, rd: 259684, fd: 0) , new dirty pages: 242702 , remai= ning dirty pages: 242702 > Iteration 2, duration: 29397 ms , transferred pages: 240508 (dup: = 405, rd: 225588, fd: 14515) , new dirty pages: 230889 , remai= ning dirty pages: 233083 > Iteration 3, duration: 28205 ms , transferred pages: 230858 (dup: = 182, rd: 214596, fd: 16080) , new dirty pages: 226998 , remai= ning dirty pages: 229223 > Iteration 4, duration: 27805 ms , transferred pages: 227574 (dup: = 170, rd: 217045, fd: 10359) , new dirty pages: 227360 , remai= ning dirty pages: 229009 > Iteration 5, duration: 27703 ms , transferred pages: 226786 (dup: = 200, rd: 212130, fd: 14456) , new dirty pages: 225885 , remai= ning dirty pages: 228108 > Iteration 6, duration: 27600 ms , transferred pages: 225923 (dup: = 155, rd: 215503, fd: 10265) , new dirty pages: 223555 , remai= ning dirty pages: 225740 > Iteration 7, duration: 27309 ms , transferred pages: 223574 (dup: = 260, rd: 215641, fd: 7673) , new dirty pages: 231975 , remai= ning dirty pages: 234141 > Iteration 8, duration: 28403 ms , transferred pages: 232397 (dup: = 85, rd: 214086, fd: 18226) , new dirty pages: 222170 , remai= ning dirty pages: 223914 > Iteration 9, duration: 27105 ms , transferred pages: 221809 (dup: = 131, rd: 214988, fd: 6690) , new dirty pages: 230065 , remai= ning dirty pages: 232170 > Iteration 10, duration: 28104 ms , transferred pages: 230201 (dup: = 343, rd: 213531, fd: 16327) , new dirty pages: 227590 , remai= ning dirty pages: 229559 > Iteration 11, duration: 27801 ms , transferred pages: 227717 (dup: = 313, rd: 221408, fd: 5996) , new dirty pages: 228457 , remai= ning dirty pages: 230299 > Iteration 12, duration: 27916 ms , transferred pages: 228560 (dup: = 338, rd: 219660, fd: 8562) , new dirty pages: 238326 , remai= ning dirty pages: 240065 >=20 > 9. cpu2006.lbm (can not converge) > Iteration 1, duration: 31012 ms , transferred pages: 266450 (dup: = 12253, rd: 254197, fd: 0) , new dirty pages: 108960 , remai= ning dirty pages: 108960 > Iteration 2, duration: 13095 ms , transferred pages: 106522 (dup: = 3, rd: 102045, fd: 4474) , new dirty pages: 129292 , remai= ning dirty pages: 131730 > Iteration 3, duration: 15802 ms , transferred pages: 129688 (dup: = 444, rd: 110860, fd: 18384) , new dirty pages: 116682 , remai= ning dirty pages: 118724 > Iteration 4, duration: 14204 ms , transferred pages: 116316 (dup: = 160, rd: 104951, fd: 11205) , new dirty pages: 107246 , remai= ning dirty pages: 109654 > Iteration 5, duration: 13208 ms , transferred pages: 107977 (dup: = 1, rd: 101834, fd: 6142) , new dirty pages: 105371 , remai= ning dirty pages: 107048 > Iteration 6, duration: 12804 ms , transferred pages: 104705 (dup: = 1, rd: 99629, fd: 5075) , new dirty pages: 103841 , remai= ning dirty pages: 106184 > Iteration 7, duration: 12709 ms , transferred pages: 103891 (dup: = 5, rd: 99212, fd: 4674) , new dirty pages: 106692 , remai= ning dirty pages: 108985 > Iteration 8, duration: 13105 ms , transferred pages: 107169 (dup: = 11, rd: 100125, fd: 7033) , new dirty pages: 103132 , remai= ning dirty pages: 104948 > Iteration 9, duration: 12607 ms , transferred pages: 103068 (dup: = 0, rd: 99460, fd: 3608) , new dirty pages: 102511 , remai= ning dirty pages: 104391 > Iteration 10, duration: 12514 ms , transferred pages: 102250 (dup: = 0, rd: 99094, fd: 3156) , new dirty pages: 102888 , remai= ning dirty pages: 105029 >=20 > 10. cpu2006.astar (can not converge) >=20 > Iteration 1, duration: 28402 ms , transferred pages: 266450 (dup: = 33770, rd: 232680, fd: 0) , new dirty pages: 62078 , remai= ning dirty pages: 62078 > Iteration 2, duration: 7393 ms , transferred pages: 60107 (dup: = 10, rd: 51722, fd: 8375) , new dirty pages: 48854 , remai= ning dirty pages: 50825 > Iteration 3, duration: 6001 ms , transferred pages: 49094 (dup: = 14, rd: 46540, fd: 2540) , new dirty pages: 48137 , remai= ning dirty pages: 49868 > Iteration 4, duration: 5800 ms , transferred pages: 47444 (dup: = 0, rd: 45389, fd: 2055) , new dirty pages: 49147 , remai= ning dirty pages: 51571 > Iteration 5, duration: 6102 ms , transferred pages: 49912 (dup: = 14, rd: 46216, fd: 3682) , new dirty pages: 55606 , remai= ning dirty pages: 57265 > Iteration 6, duration: 6699 ms , transferred pages: 54949 (dup: = 143, rd: 20745, fd: 34061) , new dirty pages: 9166 , remai= ning dirty pages: 11482 > Iteration 7, duration: 1200 ms , transferred pages: 9830 (dup: = 14, rd: 7011, fd: 2805) , new dirty pages: 8294 , remai= ning dirty pages: 9946 > Iteration 8, duration: 1000 ms , transferred pages: 8194 (dup: = 14, rd: 7178, fd: 1002) , new dirty pages: 5475 , remai= ning dirty pages: 7227 > Iteration 9, duration: 600 ms , transferred pages: 4908 (dup: = 0, rd: 3470, fd: 1438) , new dirty pages: 4175 , remai= ning dirty pages: 6494 > Iteration 10, duration: 500 ms , transferred pages: 4090 (dup: = 0, rd: 3856, fd: 234) , new dirty pages: 4095 , remai= ning dirty pages: 6499 > Iteration 11, duration: 500 ms , transferred pages: 4090 (dup: = 0, rd: 3313, fd: 777) , new dirty pages: 3371 , remai= ning dirty pages: 5780 > Iteration 12, duration: 502 ms , transferred pages: 4090 (dup: = 0, rd: 3823, fd: 267) , new dirty pages: 7518 , remai= ning dirty pages: 9208 > Iteration 13, duration: 899 ms , transferred pages: 7376 (dup: = 14, rd: 6028, fd: 1334) , new dirty pages: 3931 , remai= ning dirty pages: 5763 > Iteration 14, duration: 500 ms , transferred pages: 4090 (dup: = 0, rd: 4078, fd: 12) , new dirty pages: 4346 , remai= ning dirty pages: 6019 > Iteration 15, duration: 502 ms , transferred pages: 4090 (dup: = 0, rd: 3817, fd: 273) , new dirty pages: 3054 , remai= ning dirty pages: 4983 > Iteration 16, duration: 400 ms , transferred pages: 3272 (dup: = 0, rd: 3138, fd: 134) , new dirty pages: 3874 , remai= ning dirty pages: 5585 > Iteration 17, duration: 399 ms , transferred pages: 3272 (dup: = 0, rd: 3248, fd: 24) , new dirty pages: 5285 , remai= ning dirty pages: 7598 > Iteration 18, duration: 701 ms , transferred pages: 5726 (dup: = 0, rd: 4385, fd: 1341) , new dirty pages: 8903 , remai= ning dirty pages: 10775 > Iteration 19, duration: 1101 ms , transferred pages: 9010 (dup: = 12, rd: 5597, fd: 3401) , new dirty pages: 4199 , remai= ning dirty pages: 5964 > Iteration 20, duration: 500 ms , transferred pages: 4090 (dup: = 0, rd: 4078, fd: 12) , new dirty pages: 3829 , remai= ning dirty pages: 5703 >=20 > 11. cpu2006.xalancbmk (can not converge) >=20 > Iteration 1, duration: 30407 ms , transferred pages: 266450 (dup: = 17700, rd: 248750, fd: 0) , new dirty pages: 96169 , remai= ning dirty pages: 96169 > Iteration 2, duration: 11495 ms , transferred pages: 94164 (dup: = 205, rd: 67068, fd: 26891) , new dirty pages: 61766 , remai= ning dirty pages: 63771 > Iteration 3, duration: 7501 ms , transferred pages: 61471 (dup: = 121, rd: 53587, fd: 7763) , new dirty pages: 56569 , remai= ning dirty pages: 58869 > Iteration 4, duration: 6902 ms , transferred pages: 56461 (dup: = 19, rd: 50553, fd: 5889) , new dirty pages: 52181 , remai= ning dirty pages: 54589 > Iteration 5, duration: 6402 ms , transferred pages: 52459 (dup: = 107, rd: 46986, fd: 5366) , new dirty pages: 54051 , remai= ning dirty pages: 56181 > Iteration 6, duration: 6601 ms , transferred pages: 54003 (dup: = 15, rd: 47566, fd: 6422) , new dirty pages: 50844 , remai= ning dirty pages: 53022 > Iteration 7, duration: 6202 ms , transferred pages: 50723 (dup: = 7, rd: 47143, fd: 3573) , new dirty pages: 64880 , remai= ning dirty pages: 67179 > Iteration 8, duration: 8001 ms , transferred pages: 65447 (dup: = 7, rd: 61159, fd: 4281) , new dirty pages: 67854 , remai= ning dirty pages: 69586 > Iteration 9, duration: 8202 ms , transferred pages: 67444 (dup: = 368, rd: 56357, fd: 10719) , new dirty pages: 65178 , remai= ning dirty pages: 67320 > Iteration 10, duration: 8000 ms , transferred pages: 65455 (dup: = 15, rd: 60581, fd: 4859) , new dirty pages: 52421 , remai= ning dirty pages: 54286 >=20 > 12. cpu2006.milc (can not converge) >=20 > Iteration 1, duration: 31410 ms , transferred pages: 266450 (dup: = 9454, rd: 256996, fd: 0) , new dirty pages: 158860 , remai= ning dirty pages: 158860 > Iteration 2, duration: 19193 ms , transferred pages: 157048 (dup: = 150, rd: 96807, fd: 60091) , new dirty pages: 102238 , remai= ning dirty pages: 104050 > Iteration 3, duration: 12504 ms , transferred pages: 102271 (dup: = 21, rd: 95107, fd: 7143) , new dirty pages: 97944 , remai= ning dirty pages: 99723 > Iteration 4, duration: 11905 ms , transferred pages: 97360 (dup: = 18, rd: 93610, fd: 3732) , new dirty pages: 99150 , remai= ning dirty pages: 101513 > Iteration 5, duration: 12105 ms , transferred pages: 99094 (dup: = 116, rd: 94125, fd: 4853) , new dirty pages: 98589 , remai= ning dirty pages: 101008 > Iteration 6, duration: 12101 ms , transferred pages: 98995 (dup: = 17, rd: 94069, fd: 4909) , new dirty pages: 147403 , remai= ning dirty pages: 149416 > Iteration 7, duration: 18001 ms , transferred pages: 147284 (dup: = 44, rd: 135691, fd: 11549) , new dirty pages: 136445 , remai= ning dirty pages: 138577 > Iteration 8, duration: 16702 ms , transferred pages: 136636 (dup: = 30, rd: 130805, fd: 5801) , new dirty pages: 145481 , remai= ning dirty pages: 147422 > Iteration 9, duration: 17800 ms , transferred pages: 145734 (dup: = 130, rd: 133239, fd: 12365) , new dirty pages: 98032 , remai= ning dirty pages: 99720 > Iteration 10, duration: 11902 ms , transferred pages: 97364 (dup: = 22, rd: 93096, fd: 4246) , new dirty pages: 95391 , remai= ning dirty pages: 97747 >=20 > 13. cpu2006.cactusADM (can not converge) >=20 > Iteration 1, duration: 23508 ms , transferred pages: 266450 (dup: = 73568, rd: 192882, fd: 0) , new dirty pages: 123869 , remai= ning dirty pages: 123869 > Iteration 2, duration: 13989 ms , transferred pages: 121594 (dup: = 7874, rd: 81653, fd: 32067) , new dirty pages: 112960 , remai= ning dirty pages: 115235 > Iteration 3, duration: 13605 ms , transferred pages: 113276 (dup: = 2028, rd: 83783, fd: 27465) , new dirty pages: 112314 , remai= ning dirty pages: 114273 > Iteration 4, duration: 13509 ms , transferred pages: 111935 (dup: = 1505, rd: 83535, fd: 26895) , new dirty pages: 114078 , remai= ning dirty pages: 116416 > Iteration 5, duration: 13810 ms , transferred pages: 114262 (dup: = 1378, rd: 84039, fd: 28845) , new dirty pages: 112271 , remai= ning dirty pages: 114425 > Iteration 6, duration: 13604 ms , transferred pages: 112664 (dup: = 1416, rd: 84300, fd: 26948) , new dirty pages: 112903 , remai= ning dirty pages: 114664 > Iteration 7, duration: 13604 ms , transferred pages: 112655 (dup: = 1407, rd: 84027, fd: 27221) , new dirty pages: 110943 , remai= ning dirty pages: 112952 > Iteration 8, duration: 13406 ms , transferred pages: 110720 (dup: = 1108, rd: 84075, fd: 25537) , new dirty pages: 109321 , remai= ning dirty pages: 111553 > Iteration 9, duration: 13306 ms , transferred pages: 109726 (dup: = 932, rd: 83652, fd: 25142) , new dirty pages: 113446 , remai= ning dirty pages: 115273 > Iteration 10, duration: 13705 ms , transferred pages: 113121 (dup: = 1055, rd: 84671, fd: 27395) , new dirty pages: 108776 , remai= ning dirty pages: 110928 >=20 > 14. cpu2006.GmesFDTD (can not converge) >=20 > Iteration 1, duration: 13303 ms , transferred pages: 266450 (dup: = 157809, rd: 108641, fd: 0) , new dirty pages: 226802 , remai= ning dirty pages: 226802 > Iteration 2, duration: 10797 ms , transferred pages: 226507 (dup: = 138637, rd: 61818, fd: 26052) , new dirty pages: 200769 , remai= ning dirty pages: 201064 > Iteration 3, duration: 8900 ms , transferred pages: 199717 (dup: = 127187, rd: 69340, fd: 3190) , new dirty pages: 203436 , remai= ning dirty pages: 204783 > Iteration 4, duration: 10904 ms , transferred pages: 204127 (dup: = 115211, rd: 85767, fd: 3149) , new dirty pages: 198407 , remai= ning dirty pages: 199063 > Iteration 5, duration: 12109 ms , transferred pages: 198206 (dup: = 99435, rd: 96956, fd: 1815) , new dirty pages: 213719 , remai= ning dirty pages: 214576 > Iteration 6, duration: 16307 ms , transferred pages: 213595 (dup: = 80422, rd: 116885, fd: 16288) , new dirty pages: 199637 , remai= ning dirty pages: 200618 > Iteration 7, duration: 16915 ms , transferred pages: 198289 (dup: = 60169, rd: 134208, fd: 3912) , new dirty pages: 199343 , remai= ning dirty pages: 201672 > Iteration 8, duration: 19518 ms , transferred pages: 200452 (dup: = 41014, rd: 156083, fd: 3355) , new dirty pages: 222927 , remai= ning dirty pages: 224147 >=20 > 15. cpu2006.wrf (can not converge) >=20 > Iteration 1, duration: 18499 ms , transferred pages: 266380 (dup: = 115285, rd: 151095, fd: 0) , new dirty pages: 112322 , remai= ning dirty pages: 112392 > Iteration 2, duration: 9802 ms , transferred pages: 110025 (dup: = 29917, rd: 65782, fd: 14326) , new dirty pages: 88855 , remai= ning dirty pages: 91222 > Iteration 3, duration: 8199 ms , transferred pages: 89761 (dup: = 22728, rd: 57262, fd: 9771) , new dirty pages: 58431 , remai= ning dirty pages: 59892 > Iteration 4, duration: 5603 ms , transferred pages: 58502 (dup: = 12716, rd: 41809, fd: 3977) , new dirty pages: 80556 , remai= ning dirty pages: 81946 > Iteration 5, duration: 7101 ms , transferred pages: 79778 (dup: = 21738, rd: 50896, fd: 7144) , new dirty pages: 62592 , remai= ning dirty pages: 64760 > Iteration 6, duration: 5702 ms , transferred pages: 63388 (dup: = 16793, rd: 42726, fd: 3869) , new dirty pages: 80747 , remai= ning dirty pages: 82119 > Iteration 7, duration: 7000 ms , transferred pages: 80868 (dup: = 23652, rd: 52194, fd: 5022) , new dirty pages: 84593 , remai= ning dirty pages: 85844 > Iteration 8, duration: 7099 ms , transferred pages: 83799 (dup: = 25769, rd: 51772, fd: 6258) , new dirty pages: 67951 , remai= ning dirty pages: 69996 > Iteration 9, duration: 6303 ms , transferred pages: 68478 (dup: = 16979, rd: 36490, fd: 15009) , new dirty pages: 81181 , remai= ning dirty pages: 82699 > Iteration 10, duration: 7000 ms , transferred pages: 80724 (dup: = 23503, rd: 52826, fd: 4395) , new dirty pages: 47930 , remai= ning dirty pages: 49905 >=20 >=20 >=20 > >=20 > > > So I think "booting" and "kernel compilation" should benefit a lot= from this > > > improvement. The reason of "kernel compilation" would benefit is th= at some=20 > > > iterations take around 600ms, and if they are halved into 300ms, th= en the precopy > > > may have the chance to step into stop and copy phase. > > >=20 > > > On the other hand, "idle" and "web server" would not benefit a lot,= because > > > most of the time are spent on the 1st iteration and little on the o= thers. > > >=20 > > > As to the "zeusmp" and "memcached", although the time spent on the = other iterations > > > but the 1st one may be halved, they still could not converge to sto= p and copy=20 > > > with the 300ms downtime. > > >=20 > > > --------------------1 vcpu, 1 GB ram, default bandwidth (32MB/s):--= ---------------- > > >=20 > > > 1. booting : begin to migrate when the VM is booting > > >=20 > > > Iteration 1, duration: 6997 ms , transferred pages: 266450 (n= : 57269, d: 209181 ) , new dirty pages: 56414 , remaining dirty p= ages: 56414 > > > Iteration 2, duration: 6497 ms , transferred pages: 54008 (n= : 52701, d: 1307 ) , new dirty pages: 48053 , remaining dirty p= ages: 50459 > > > Iteration 3, duration: 5800 ms , transferred pages: 48232 (n= : 47444, d: 788 ) , new dirty pages: 9129 , remaining dirty p= ages: 11356 > > > Iteration 4, duration: 1100 ms , transferred pages: 9091 (n= : 8998, d: 93 ) , new dirty pages: 165 , remaining dirty p= ages: 2430 > > > Iteration 5, duration: 1 ms , transferred pages: 0 (n= : 0, d: 0 ) , new dirty pages: 0 , remaining dirty p= ages: 2430 > > > (note: When the workload does converge, the output of the last iter= ation is "fake". It just indicates that the precopy steps into stop-copy = phase now. > > > "n" means "normal pages" and "d" means "duplicate (zero) pag= es".) > > >=20 > > > 2. idle > > >=20 > > > Iteration 1, duration: 14496 ms , transferred pages: 266450 (n= : 118980, d: 147470 ) , new dirty pages: 17398 , remaining dirty p= ages: 17398 > > > Iteration 2, duration: 1896 ms , transferred pages: 14953 (n= : 14854, d: 99 ) , new dirty pages: 1849 , remaining dirty p= ages: 4294 > > > Iteration 3, duration: 300 ms , transferred pages: 2454 (n= : 2454, d: 0 ) , new dirty pages: 9 , remaining dirty p= ages: 1849 > > > Iteration 4, duration: 1 ms , transferred pages: 0 (n= : 0, d: 0 ) , new dirty pages: 0 , remaining dirty p= ages: 1849 > > >=20 > > > 3. kernel compilation (can not converge) > > >=20 > > > Iteration 1, duration: 20700 ms , transferred pages: 266450 (n= : 169778, d: 96672 ) , new dirty pages: 40067 , remaining dirty p= ages: 40067 > > > Iteration 2, duration: 4696 ms , transferred pages: 38401 (n= : 37787, d: 614 ) , new dirty pages: 8852 , remaining dirty p= ages: 10518 > > > Iteration 3, duration: 1000 ms , transferred pages: 8642 (n= : 8180, d: 462 ) , new dirty pages: 6331 , remaining dirty p= ages: 8207 > > > Iteration 4, duration: 700 ms , transferred pages: 6110 (n= : 5726, d: 384 ) , new dirty pages: 5242 , remaining dirty p= ages: 7339 > > > Iteration 5, duration: 600 ms , transferred pages: 5007 (n= : 4908, d: 99 ) , new dirty pages: 4868 , remaining dirty p= ages: 7200 > > > Iteration 6, duration: 600 ms , transferred pages: 5226 (n= : 4908, d: 318 ) , new dirty pages: 6142 , remaining dirty p= ages: 8116 > > > Iteration 7, duration: 700 ms , transferred pages: 5985 (n= : 5726, d: 259 ) , new dirty pages: 5902 , remaining dirty p= ages: 8033 > > > Iteration 8, duration: 701 ms , transferred pages: 5893 (n= : 5726, d: 167 ) , new dirty pages: 7502 , remaining dirty p= ages: 9642 > > > Iteration 9, duration: 900 ms , transferred pages: 7623 (n= : 7362, d: 261 ) , new dirty pages: 6408 , remaining dirty p= ages: 8427 > > > Iteration 10, duration: 700 ms , transferred pages: 6008 (n= : 5726, d: 282 ) , new dirty pages: 8312 , remaining dirty p= ages: 10731 > > > Iteration 11, duration: 1000 ms , transferred pages: 8353 (n= : 8180, d: 173 ) , new dirty pages: 6874 , remaining dirty p= ages: 9252 > > > Iteration 12, duration: 899 ms , transferred pages: 7477 (n= : 7362, d: 115 ) , new dirty pages: 5573 , remaining dirty p= ages: 7348 > > > Iteration 13, duration: 601 ms , transferred pages: 5099 (n= : 4908, d: 191 ) , new dirty pages: 7671 , remaining dirty p= ages: 9920 > > > Iteration 14, duration: 900 ms , transferred pages: 7586 (n= : 7362, d: 224 ) , new dirty pages: 7359 , remaining dirty p= ages: 9693 > > > Iteration 15, duration: 900 ms , transferred pages: 7682 (n= : 7362, d: 320 ) , new dirty pages: 7371 , remaining dirty p= ages: 9382 > > >=20 > > > 4. cpu2006.zeusmp (can not converge) > > >=20 > > > Iteration 1, duration: 21603 ms , transferred pages: 266450 (n= : 176660, d: 89790 ) , new dirty pages: 145625 , remaining dirty p= ages: 145625 > > > Iteration 2, duration: 8696 ms , transferred pages: 144389 (n= : 70862, d: 73527 ) , new dirty pages: 125124 , remaining dirty p= ages: 126360 > > > Iteration 3, duration: 6301 ms , transferred pages: 124057 (n= : 51379, d: 72678 ) , new dirty pages: 122528 , remaining dirty p= ages: 124831 > > > Iteration 4, duration: 6400 ms , transferred pages: 124330 (n= : 52196, d: 72134 ) , new dirty pages: 124267 , remaining dirty p= ages: 124768 > > > Iteration 5, duration: 6703 ms , transferred pages: 124034 (n= : 54656, d: 69378 ) , new dirty pages: 124151 , remaining dirty p= ages: 124885 > > > Iteration 6, duration: 6703 ms , transferred pages: 124357 (n= : 54658, d: 69699 ) , new dirty pages: 124106 , remaining dirty p= ages: 124634 > > > Iteration 7, duration: 6602 ms , transferred pages: 124568 (n= : 53838, d: 70730 ) , new dirty pages: 133828 , remaining dirty p= ages: 133894 > > > Iteration 8, duration: 7600 ms , transferred pages: 133030 (n= : 62021, d: 71009 ) , new dirty pages: 126612 , remaining dirty p= ages: 127476 > > > Iteration 9, duration: 7299 ms , transferred pages: 126511 (n= : 59569, d: 66942 ) , new dirty pages: 122727 , remaining dirty p= ages: 123692 > > > Iteration 10, duration: 6609 ms , transferred pages: 123692 (n= : 54539, d: 69153 ) , new dirty pages: 122727 , remaining dirty p= ages: 122727 > > > Iteration 11, duration: 6995 ms , transferred pages: 120347 (n= : 56423, d: 63924 ) , new dirty pages: 121430 , remaining dirty p= ages: 123810 > > > Iteration 12, duration: 6703 ms , transferred pages: 123040 (n= : 54657, d: 68383 ) , new dirty pages: 122043 , remaining dirty p= ages: 122813 > > > Iteration 13, duration: 7006 ms , transferred pages: 122353 (n= : 57121, d: 65232 ) , new dirty pages: 133869 , remaining dirty p= ages: 134329 > > > Iteration 14, duration: 8209 ms , transferred pages: 132325 (n= : 66932, d: 65393 ) , new dirty pages: 126914 , remaining dirty p= ages: 128918 > > > Iteration 15, duration: 7802 ms , transferred pages: 126931 (n= : 63671, d: 63260 ) , new dirty pages: 122351 , remaining dirty p= ages: 124338 > > >=20 > > > 5. web server : An apache web server. The client is configured with= 50 concurrent connections. > > >=20 > > > Iteration 1, duration: 30697 ms , transferred pages: 266450 (n= : 251215, d: 15235 ) , new dirty pages: 30628 , remaining dirty p= ages: 30628 > > > Iteration 2, duration: 3496 ms , transferred pages: 28859 (n= : 28513, d: 346 ) , new dirty pages: 5805 , remaining dirty p= ages: 7574 > > > Iteration 3, duration: 701 ms , transferred pages: 5746 (n= : 5726, d: 20 ) , new dirty pages: 3433 , remaining dirty p= ages: 5261 > > > Iteration 4, duration: 400 ms , transferred pages: 3281 (n= : 3272, d: 9 ) , new dirty pages: 1539 , remaining dirty p= ages: 3519 > > > Iteration 5, duration: 199 ms , transferred pages: 1653 (n= : 1636, d: 17 ) , new dirty pages: 301 , remaining dirty p= ages: 2167 > > > Iteration 6, duration: 1 ms , transferred pages: 0 (n= : 0, d: 0 ) , new dirty pages: 0 , remaining dirty p= ages: 2167 > > >=20 > > > --------------------6 vcpu, 6 GB ram, max bandwidth (941.08 mbps):-= ----------------- > > >=20 > > > 6. memcached : 4 GB cache, memaslap: all write, concurrency =3D 5 = (can not converge) > > >=20 > > > Iteration 1, duration: 42486 ms , transferred pages: 1568087 (n= : 1216079, d: 352008 ) , new dirty pages: 571940 , remaining dirty p= ages: 581023 > > > Iteration 2, duration: 19774 ms , transferred pages: 571700 (n= : 567416, d: 4284 ) , new dirty pages: 331690 , remaining dirty p= ages: 341013 > > > Iteration 3, duration: 11589 ms , transferred pages: 332187 (n= : 332095, d: 92 ) , new dirty pages: 222725 , remaining dirty p= ages: 231551 > > > Iteration 4, duration: 7790 ms , transferred pages: 223571 (n= : 223499, d: 72 ) , new dirty pages: 157658 , remaining dirty p= ages: 165638 > > > Iteration 5, duration: 5518 ms , transferred pages: 158056 (n= : 157998, d: 58 ) , new dirty pages: 128130 , remaining dirty p= ages: 135712 > > > Iteration 6, duration: 4442 ms , transferred pages: 127764 (n= : 127701, d: 63 ) , new dirty pages: 104839 , remaining dirty p= ages: 112787 > > > Iteration 7, duration: 3649 ms , transferred pages: 104581 (n= : 104523, d: 58 ) , new dirty pages: 100736 , remaining dirty p= ages: 108942 > > > Iteration 8, duration: 3532 ms , transferred pages: 101379 (n= : 101315, d: 64 ) , new dirty pages: 87869 , remaining dirty p= ages: 95432 > > > Iteration 9, duration: 3030 ms , transferred pages: 86841 (n= : 86786, d: 55 ) , new dirty pages: 77505 , remaining dirty p= ages: 86096 > > > Iteration 10, duration: 2709 ms , transferred pages: 77875 (n= : 77814, d: 61 ) , new dirty pages: 77197 , remaining dirty p= ages: 85418 > > > Iteration 11, duration: 2696 ms , transferred pages: 77107 (n= : 77044, d: 63 ) , new dirty pages: 65010 , remaining dirty p= ages: 73321 > > > Iteration 12, duration: 2308 ms , transferred pages: 66540 (n= : 66484, d: 56 ) , new dirty pages: 64388 , remaining dirty p= ages: 71169 > > > Iteration 13, duration: 2198 ms , transferred pages: 62953 (n= : 62897, d: 56 ) , new dirty pages: 62773 , remaining dirty p= ages: 70989 > > > Iteration 14, duration: 2214 ms , transferred pages: 63466 (n= : 63411, d: 55 ) , new dirty pages: 67538 , remaining dirty p= ages: 75061 > > > Iteration 15, duration: 2329 ms , transferred pages: 66924 (n= : 66875, d: 49 ) , new dirty pages: 63580 , remaining dirty p= ages: 71717 > > > Iteration 16, duration: 2252 ms , transferred pages: 64554 (n= : 64539, d: 15 ) , new dirty pages: 63094 , remaining dirty p= ages: 70257 > > > Iteration 17, duration: 2188 ms , transferred pages: 62697 (n= : 62641, d: 56 ) , new dirty pages: 63016 , remaining dirty p= ages: 70576 > > > Iteration 18, duration: 2171 ms , transferred pages: 62377 (n= : 62322, d: 55 ) , new dirty pages: 56764 , remaining dirty p= ages: 64963 > > > Iteration 19, duration: 2003 ms , transferred pages: 57382 (n= : 57324, d: 58 ) , new dirty pages: 65307 , remaining dirty p= ages: 72888 > > > Iteration 20, duration: 2240 ms , transferred pages: 64426 (n= : 64364, d: 62 ) , new dirty pages: 61585 , remaining dirty p= ages: 70047 > > >=20 > > >=20 > > > -- > > > Chunguang Li, Ph.D. Candidate > > > Wuhan National Laboratory for Optoelectronics (WNLO) > > > Huazhong University of Science & Technology (HUST) > > > Wuhan, Hubei Prov., China > > >=20 > > >=20 > > >=20 > > -- > > Dr. David Alan Gilbert / dgilbert@redhat.com / Manchester, UK >=20 >=20 > -- > Chunguang Li, Ph.D. Candidate > Wuhan National Laboratory for Optoelectronics (WNLO) > Huazhong University of Science & Technology (HUST) > Wuhan, Hubei Prov., China >=20 >=20 >=20 -- Dr. David Alan Gilbert / dgilbert@redhat.com / Manchester, UK