From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([208.118.235.92]:59480) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1T8WRG-0004jn-Sx for qemu-devel@nongnu.org; Mon, 03 Sep 2012 09:11:45 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1T8WR5-0000lh-Je for qemu-devel@nongnu.org; Mon, 03 Sep 2012 09:11:38 -0400 Received: from mailpro.odiso.net ([89.248.209.98]:35411) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1T8WR5-0000lP-0b for qemu-devel@nongnu.org; Mon, 03 Sep 2012 09:11:27 -0400 Received: from localhost (localhost [127.0.0.1]) by mailpro.odiso.net (Postfix) with ESMTP id E1CBB1808C819 for ; Mon, 3 Sep 2012 15:11:04 +0200 (CEST) Received: from mailpro.odiso.net ([127.0.0.1]) by localhost (mailpro.odiso.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ua3YjU80REWP for ; Mon, 3 Sep 2012 15:10:56 +0200 (CEST) Received: from mailpro.odiso.net (mailpro.odiso.net [10.1.31.112]) by mailpro.odiso.net (Postfix) with ESMTP id 932A71808C809 for ; Mon, 3 Sep 2012 15:10:56 +0200 (CEST) Date: Mon, 03 Sep 2012 15:10:56 +0200 (CEST) From: Alexandre DERUMIER Message-ID: <36cdcec7-0411-4bcb-a6ea-b617fe6a8099@mailpro> In-Reply-To: <1346663926-20188-7-git-send-email-xiawenc@linux.vnet.ibm.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit MIME-Version: 1.0 Subject: [Qemu-devel] xbzrle migration cache size advise for high memory changes workload ? List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: qemu-devel@nongnu.org Hi, I'm trying to implement xbzrle live migration, But i'm having non finishing migration with high memory changes in guest. (simply playing a youtube video in the guest). At the end of the migration, the remaining memory to transfert goes up and down. I have tried to dynamicaly add memory to cache (max = guest memory), but it doesn't help. What is the best size recommendation for cache ? (percent of guest memory ?) Can I tune it based on some values ? (cachemiss, overflow ?) Can we desactivate xbzrle during the migration ? Some logs counters of the migration: Sep 03 15:00:32 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 15158 overflow 0 deltacachemiss 15158 Sep 03 15:00:34 migration status: active (transferred 119318244, remaining 1987846144), total 2114387968) Sep 03 15:00:34 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 29130 overflow 0 deltacachemiss 13972 Sep 03 15:00:36 migration status: active (transferred 156261310, remaining 1342005248), total 2114387968) Sep 03 15:00:36 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 38113 overflow 0 deltacachemiss 8983 Sep 03 15:00:38 migration status: active (transferred 195909631, remaining 786370560), total 2114387968) Sep 03 15:00:38 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 47762 overflow 0 deltacachemiss 9649 Sep 03 15:00:40 migration status: active (transferred 264583501, remaining 716410880), total 2114387968) Sep 03 15:00:40 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 64528 overflow 0 deltacachemiss 16766 Sep 03 15:00:42 migration status: active (transferred 336759138, remaining 644227072), total 2114387968) Sep 03 15:00:42 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 82149 overflow 0 deltacachemiss 17621 Sep 03 15:00:44 migration status: active (transferred 399641876, remaining 577712128), total 2114387968) Sep 03 15:00:44 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 97501 overflow 0 deltacachemiss 15352 Sep 03 15:00:46 migration status: active (transferred 446500707, remaining 528441344), total 2114387968) Sep 03 15:00:46 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 108941 overflow 0 deltacachemiss 11440 Sep 03 15:00:48 migration status: active (transferred 501567884, remaining 471134208), total 2114387968) Sep 03 15:00:48 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 122385 overflow 0 deltacachemiss 13444 Sep 03 15:00:50 migration status: active (transferred 566289154, remaining 404901888), total 2114387968) Sep 03 15:00:50 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 138186 overflow 0 deltacachemiss 15801 Sep 03 15:00:52 migration status: active (transferred 631297144, remaining 338370560), total 2114387968) Sep 03 15:00:52 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 154057 overflow 0 deltacachemiss 15871 Sep 03 15:00:54 migration status: active (transferred 695854441, remaining 272830464), total 2114387968) Sep 03 15:00:54 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 169818 overflow 0 deltacachemiss 15761 Sep 03 15:00:56 migration status: active (transferred 763447412, remaining 202059776), total 2114387968) Sep 03 15:00:56 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 186320 overflow 0 deltacachemiss 16502 Sep 03 15:00:58 migration status: active (transferred 828361066, remaining 136142848), total 2114387968) Sep 03 15:00:58 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 202168 overflow 0 deltacachemiss 15848 Sep 03 15:01:00 migration status: active (transferred 879799289, remaining 82030592), total 2114387968) Sep 03 15:01:00 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 214726 overflow 0 deltacachemiss 12558 Sep 03 15:01:02 migration status: active (transferred 940920124, remaining 19603456), total 2114387968) Sep 03 15:01:02 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 229648 overflow 0 deltacachemiss 14922 Sep 03 15:01:03 migration status: active (transferred 949001101, remaining 69087232), total 2114387968) Sep 03 15:01:03 migration xbzrle cachesize: 67108864 transferred 0 pages 0 cachemiss 231620 overflow 0 deltacachemiss 1972 Sep 03 15:01:03 migration status: active (transferred 959106075, remaining 58187776), total 2114387968) Sep 03 15:01:03 migration xbzrle cachesize: 67108864 transferred 100 pages 2 cachemiss 234087 overflow 0 deltacachemiss 2467 Sep 03 15:01:03 migration status: active (transferred 969236581, remaining 43577344), total 2114387968) Sep 03 15:01:03 migration xbzrle cachesize: 67108864 transferred 100 pages 2 cachemiss 236560 overflow 0 deltacachemiss 2473 Sep 03 15:01:04 migration status: active (transferred 979374186, remaining 33427456), total 2114387968) Sep 03 15:01:04 migration xbzrle cachesize: 67108864 transferred 100 pages 2 cachemiss 239035 overflow 0 deltacachemiss 2475 Sep 03 15:01:04 migration status: active (transferred 989479026, remaining 23302144), total 2114387968) Sep 03 15:01:04 migration xbzrle cachesize: 67108864 transferred 100 pages 2 cachemiss 241502 overflow 0 deltacachemiss 2467 Sep 03 15:01:04 migration status: active (transferred 999747708, remaining 28950528), total 2114387968) Sep 03 15:01:04 migration xbzrle cachesize: 67108864 transferred 100 pages 2 cachemiss 244009 overflow 0 deltacachemiss 2507 Sep 03 15:01:04 migration status: active (transferred 1006616716, remaining 22032384), total 2114387968) Sep 03 15:01:04 migration xbzrle cachesize: 67108864 transferred 100 pages 2 cachemiss 245686 overflow 0 deltacachemiss 1677 Sep 03 15:01:05 migration status: active (transferred 1020085038, remaining 18358272), total 2114387968) Sep 03 15:01:05 migration xbzrle cachesize: 67108864 transferred 1905397 pages 991 cachemiss 248381 overflow 128 deltacachemiss 2695 Sep 03 15:01:05 migration status: active (transferred 1030213871, remaining 14524416), total 2114387968) Sep 03 15:01:05 migration xbzrle cachesize: 67108864 transferred 6103206 pages 3227 cachemiss 249646 overflow 311 deltacachemiss 1265 Sep 03 15:01:05 migration status: active (transferred 1040306669, remaining 7348224), total 2114387968) Sep 03 15:01:05 migration xbzrle cachesize: 67108864 transferred 11579783 pages 6075 cachemiss 250496 overflow 588 deltacachemiss 850 Sep 03 15:01:06 migration status: active (transferred 1047695771, remaining 13287424), total 2114387968) Sep 03 15:01:06 migration xbzrle cachesize: 67108864 transferred 15286549 pages 9455 cachemiss 251271 overflow 712 deltacachemiss 775 Sep 03 15:01:06 migration status: active (transferred 1054790825, remaining 8896512), total 2114387968) Sep 03 15:01:06 migration xbzrle cachesize: 67108864 transferred 18600974 pages 12483 cachemiss 252020 overflow 886 deltacachemiss 749 Sep 03 15:01:06 migration status: active (transferred 1064883713, remaining 3870720), total 2114387968) Sep 03 15:01:06 migration xbzrle cachesize: 67108864 transferred 24180048 pages 15326 cachemiss 252856 overflow 1152 deltacachemiss 836 Sep 03 15:01:07 migration status: active (transferred 1073205318, remaining 13889536), total 2114387968) Sep 03 15:01:07 migration xbzrle cachesize: 67108864 transferred 28106603 pages 18135 cachemiss 253769 overflow 1312 deltacachemiss 913 Sep 03 15:01:07 migration status: active (transferred 1083269753, remaining 8450048), total 2114387968) Sep 03 15:01:07 migration xbzrle cachesize: 67108864 transferred 33685887 pages 20865 cachemiss 254445 overflow 1731 deltacachemiss 676 Sep 03 15:01:07 migration status: active (transferred 1093363118, remaining 13656064), total 2114387968) Sep 03 15:01:07 migration xbzrle cachesize: 67108864 transferred 39318685 pages 23895 cachemiss 255182 overflow 2083 deltacachemiss 737 Sep 03 15:01:08 migration status: active (transferred 1104228774, remaining 3948544), total 2114387968) Sep 03 15:01:08 migration xbzrle cachesize: 67108864 transferred 45621367 pages 27392 cachemiss 255988 overflow 2391 deltacachemiss 806 Sep 03 15:01:08 migration status: active (transferred 1112828342, remaining 4714496), total 2114387968) Sep 03 15:01:08 migration xbzrle cachesize: 67108864 transferred 50624630 pages 29895 cachemiss 256597 overflow 2660 deltacachemiss 609 Sep 03 15:01:08 migration status: active (transferred 1121646599, remaining 5951488), total 2114387968) Sep 03 15:01:08 migration xbzrle cachesize: 67108864 transferred 54638264 pages 32011 cachemiss 257423 overflow 3007 deltacachemiss 826 Sep 03 15:01:09 migration status: active (transferred 1131774276, remaining 14245888), total 2114387968) Sep 03 15:01:09 migration xbzrle cachesize: 67108864 transferred 59924446 pages 34904 cachemiss 258311 overflow 3301 deltacachemiss 888 Sep 03 15:01:09 migration status: active (transferred 1139357344, remaining 12529664), total 2114387968) Sep 03 15:01:09 migration xbzrle cachesize: 67108864 transferred 62850320 pages 39537 cachemiss 259385 overflow 3364 deltacachemiss 1074 Sep 03 15:01:09 migration status: active (transferred 1147848486, remaining 12972032), total 2114387968) Sep 03 15:01:09 migration xbzrle cachesize: 67108864 transferred 67237245 pages 43153 cachemiss 260229 overflow 3522 deltacachemiss 844 Sep 03 15:01:10 migration status: active (transferred 1157968777, remaining 7729152), total 2114387968) Sep 03 15:01:10 migration xbzrle cachesize: 67108864 transferred 72753611 pages 45998 cachemiss 260890 overflow 3985 deltacachemiss 661 Sep 03 15:01:10 migration status: active (transferred 1168065017, remaining 3137536), total 2114387968) Sep 03 15:01:10 migration xbzrle cachesize: 67108864 transferred 78000165 pages 48646 cachemiss 261660 overflow 4399 deltacachemiss 770 Sep 03 15:01:10 migration status: active (transferred 1176461216, remaining 5459968), total 2114387968) Sep 03 15:01:10 migration xbzrle cachesize: 67108864 transferred 81931708 pages 50605 cachemiss 262364 overflow 4785 deltacachemiss 704 Sep 03 15:01:11 migration status: active (transferred 1187721613, remaining 15183872), total 2114387968) Sep 03 15:01:11 migration xbzrle cachesize: 67108864 transferred 87588758 pages 53584 cachemiss 263313 overflow 5204 deltacachemiss 949 Sep 03 15:01:11 migration status: active (transferred 1196325449, remaining 15134720), total 2114387968) Sep 03 15:01:11 migration xbzrle cachesize: 67108864 transferred 92063809 pages 55810 cachemiss 263933 overflow 5592 deltacachemiss 620 Sep 03 15:01:11 migration status: active (transferred 1206419175, remaining 7557120), total 2114387968) Sep 03 15:01:11 migration xbzrle cachesize: 67108864 transferred 97500362 pages 58460 cachemiss 264676 overflow 5986 deltacachemiss 743 Sep 03 15:01:11 migration status: active (transferred 1216510694, remaining 15560704), total 2114387968) Sep 03 15:01:11 migration xbzrle cachesize: 67108864 transferred 102480030 pages 61212 cachemiss 265552 overflow 6358 deltacachemiss 876 Sep 03 15:01:12 migration status: active (transferred 1225162926, remaining 14811136), total 2114387968) Sep 03 15:01:12 migration xbzrle cachesize: 67108864 transferred 107155027 pages 63456 cachemiss 266234 overflow 6647 deltacachemiss 682 Sep 03 15:01:12 migration status: active (transferred 1235228927, remaining 12378112), total 2114387968) Sep 03 15:01:12 migration xbzrle cachesize: 67108864 transferred 112440978 pages 66311 cachemiss 267101 overflow 6947 deltacachemiss 867 Sep 03 15:01:12 migration status: active (transferred 1245060361, remaining 14848000), total 2114387968) Sep 03 15:01:12 migration xbzrle cachesize: 67108864 transferred 116886157 pages 68943 cachemiss 268239 overflow 7124 deltacachemiss 1138 Sep 03 15:01:13 migration status: active (transferred 1255151722, remaining 14151680), total 2114387968) Sep 03 15:01:13 migration xbzrle cachesize: 67108864 transferred 121058631 pages 71389 cachemiss 269475 overflow 7333 deltacachemiss 1236 Sep 03 15:01:13 migration status: active (transferred 1265145124, remaining 12636160), total 2114387968) Sep 03 15:01:13 migration xbzrle cachesize: 67108864 transferred 125804843 pages 74069 cachemiss 270559 overflow 7530 deltacachemiss 1084 Sep 03 15:01:13 migration status: active (transferred 1274160338, remaining 9003008), total 2114387968) Sep 03 15:01:13 migration xbzrle cachesize: 67108864 transferred 130109480 pages 76352 cachemiss 271460 overflow 7779 deltacachemiss 901 Sep 03 15:01:14 migration status: active (transferred 1285539796, remaining 12382208), total 2114387968) Sep 03 15:01:14 migration xbzrle cachesize: 67108864 transferred 136704693 pages 79967 cachemiss 272399 overflow 8008 deltacachemiss 939 Sep 03 15:01:14 migration status: active (transferred 1294465950, remaining 10989568), total 2114387968) Sep 03 15:01:14 migration xbzrle cachesize: 67108864 transferred 141522529 pages 82691 cachemiss 273221 overflow 8189 deltacachemiss 822 Sep 03 15:01:14 migration status: active (transferred 1304111247, remaining 12431360), total 2114387968) Sep 03 15:01:14 migration xbzrle cachesize: 67108864 transferred 146256619 pages 85117 cachemiss 274137 overflow 8472 deltacachemiss 916 Sep 03 15:01:15 migration status: active (transferred 1313714825, remaining 9031680), total 2114387968) Sep 03 15:01:15 migration xbzrle cachesize: 67108864 transferred 150961349 pages 87828 cachemiss 275101 overflow 8704 deltacachemiss 964 Sep 03 15:01:15 migration status: active (transferred 1321615036, remaining 8843264), total 2114387968) Sep 03 15:01:15 migration xbzrle cachesize: 67108864 transferred 155568345 pages 90258 cachemiss 275753 overflow 8856 deltacachemiss 652 Sep 03 15:01:15 migration status: active (transferred 1332266783, remaining 4997120), total 2114387968) Sep 03 15:01:15 migration xbzrle cachesize: 67108864 transferred 161419460 pages 93534 cachemiss 276690 overflow 9091 deltacachemiss 937 Sep 03 15:01:16 migration status: active (transferred 1340961412, remaining 4333568), total 2114387968) Sep 03 15:01:16 migration xbzrle cachesize: 67108864 transferred 165833625 pages 96166 cachemiss 277571 overflow 9255 deltacachemiss 881 Sep 03 15:01:16 migration status: active (transferred 1349569887, remaining 4313088), total 2114387968) Sep 03 15:01:16 migration xbzrle cachesize: 67108864 transferred 170194521 pages 98568 cachemiss 278366 overflow 9497 deltacachemiss 795 Sep 03 15:01:16 migration status: active (transferred 1357212762, remaining 5083136), total 2114387968) Sep 03 15:01:16 migration xbzrle cachesize: 67108864 transferred 173651067 pages 100693 cachemiss 279206 overflow 9679 deltacachemiss 840 Sep 03 15:01:16 migration status: active (transferred 1362924614, remaining 12259328), total 2114387968) Sep 03 15:01:16 migration xbzrle cachesize: 67108864 transferred 175983690 pages 102350 cachemiss 279936 overflow 9774 deltacachemiss 730 Sep 03 15:01:17 migration status: active (transferred 1369555421, remaining 17477632), total 2114387968) Sep 03 15:01:17 migration xbzrle cachesize: 67108864 transferred 178796811 pages 103929 cachemiss 280702 overflow 9940 deltacachemiss 766 Sep 03 15:01:17 migration status: active (transferred 1377394106, remaining 17633280), total 2114387968) Sep 03 15:01:17 migration xbzrle cachesize: 67108864 transferred 181986406 pages 106134 cachemiss 281646 overflow 10131 deltacachemiss 944 Sep 03 15:01:17 migration status: active (transferred 1383071812, remaining 5853184), total 2114387968) Sep 03 15:01:17 migration xbzrle cachesize: 67108864 transferred 184276689 pages 107825 cachemiss 282388 overflow 10216 deltacachemiss 742 Sep 03 15:01:18 migration status: active (transferred 1389248230, remaining 12910592), total 2114387968) Sep 03 15:01:18 migration xbzrle cachesize: 67108864 transferred 187049184 pages 109409 cachemiss 283037 overflow 10398 deltacachemiss 649 Sep 03 15:01:18 migration status: active (transferred 1395386430, remaining 20598784), total 2114387968) Sep 03 15:01:18 migration xbzrle cachesize: 67108864 transferred 189005134 pages 110884 cachemiss 283908 overflow 10548 deltacachemiss 871 Sep 03 15:01:18 migration status: active (transferred 1402994779, remaining 6443008), total 2114387968) Sep 03 15:01:18 migration xbzrle cachesize: 67108864 transferred 191456304 pages 112393 cachemiss 284917 overflow 10798 deltacachemiss 1009 Sep 03 15:01:19 migration status: active (transferred 1409267086, remaining 13611008), total 2114387968) Sep 03 15:01:19 migration xbzrle cachesize: 67108864 transferred 193247446 pages 113783 cachemiss 285846 overflow 10963 deltacachemiss 929 Sep 03 15:01:19 migration status: active (transferred 1420299927, remaining 6414336), total 2114387968) Sep 03 15:01:19 migration xbzrle cachesize: 67108864 transferred 197795949 pages 116951 cachemiss 287280 overflow 11112 deltacachemiss 1434 Sep 03 15:01:19 migration status: active (transferred 1430776107, remaining 9695232), total 2114387968) Sep 03 15:01:19 migration xbzrle cachesize: 67108864 transferred 202680859 pages 120761 cachemiss 288557 overflow 11200 deltacachemiss 1277 Sep 03 15:01:20 migration status: active (transferred 1440821167, remaining 2637824), total 2114387968) Sep 03 15:01:20 migration xbzrle cachesize: 67108864 transferred 208318417 pages 125073 cachemiss 289534 overflow 11299 deltacachemiss 977 Sep 03 15:01:20 migration status: active (transferred 1447117251, remaining 12091392), total 2114387968) Sep 03 15:01:20 migration xbzrle cachesize: 67108864 transferred 211300697 pages 127309 cachemiss 290244 overflow 11398 deltacachemiss 710 Sep 03 15:01:20 migration status: active (transferred 1456026090, remaining 12906496), total 2114387968) Sep 03 15:01:20 migration xbzrle cachesize: 67108864 transferred 216105094 pages 131039 cachemiss 291149 overflow 11495 deltacachemiss 905 Sep 03 15:01:21 migration status: active (transferred 1463954394, remaining 2822144), total 2114387968) Sep 03 15:01:21 migration xbzrle cachesize: 67108864 transferred 220531007 pages 134323 cachemiss 291906 overflow 11593 deltacachemiss 757 Sep 03 15:01:21 migration status: active (transferred 1470931218, remaining 11534336), total 2114387968) Sep 03 15:01:21 migration xbzrle cachesize: 67108864 transferred 223866256 pages 137986 cachemiss 292723 overflow 11665 deltacachemiss 817 Sep 03 15:01:21 migration status: active (transferred 1477743090, remaining 10235904), total 2114387968) Sep 03 15:01:21 migration xbzrle cachesize: 67108864 transferred 227683667 pages 141111 cachemiss 293368 overflow 11751 deltacachemiss 645 Sep 03 15:01:21 migration status: active (transferred 1486951605, remaining 10551296), total 2114387968) Sep 03 15:01:21 migration xbzrle cachesize: 67108864 transferred 232771294 pages 145280 cachemiss 294269 overflow 11856 deltacachemiss 901 Sep 03 15:01:22 migration status: active (transferred 1493416356, remaining 14299136), total 2114387968) Sep 03 15:01:22 migration xbzrle cachesize: 67108864 transferred 235959068 pages 148181 cachemiss 294953 overflow 11972 deltacachemiss 684 Sep 03 15:01:22 migration status: active (transferred 1502498989, remaining 10592256), total 2114387968) Sep 03 15:01:22 migration xbzrle cachesize: 67108864 transferred 240400566 pages 151598 cachemiss 295980 overflow 12078 deltacachemiss 1027 Sep 03 15:01:22 migration status: active (transferred 1511006667, remaining 10240000), total 2114387968) Sep 03 15:01:22 migration xbzrle cachesize: 67108864 transferred 244648073 pages 155655 cachemiss 296923 overflow 12175 deltacachemiss 943 Sep 03 15:01:23 migration status: active (transferred 1521022229, remaining 10424320), total 2114387968) Sep 03 15:01:23 migration xbzrle cachesize: 67108864 transferred 250362498 pages 159932 cachemiss 297842 overflow 12306 deltacachemiss 919 Sep 03 15:01:23 migration status: active (transferred 1530294933, remaining 9367552), total 2114387968) Sep 03 15:01:23 migration xbzrle cachesize: 67108864 transferred 255219350 pages 163947 cachemiss 298815 overflow 12411 deltacachemiss 973 Sep 03 15:01:23 migration status: active (transferred 1540134732, remaining 9908224), total 2114387968) Sep 03 15:01:23 migration xbzrle cachesize: 67108864 transferred 260909578 pages 168294 cachemiss 299727 overflow 12512 deltacachemiss 912 Sep 03 15:01:24 migration status: active (transferred 1547801099, remaining 2134016), total 2114387968) Sep 03 15:01:24 migration xbzrle cachesize: 67108864 transferred 263844849 pages 171252 cachemiss 300772 overflow 12622 deltacachemiss 1045 Sep 03 15:01:24 migration status: active (transferred 1554064971, remaining 12468224), total 2114387968) Sep 03 15:01:24 migration xbzrle cachesize: 67108864 transferred 267032335 pages 173533 cachemiss 301438 overflow 12707 deltacachemiss 666 Sep 03 15:01:24 migration status: active (transferred 1565158149, remaining 11444224), total 2114387968) Sep 03 15:01:24 migration xbzrle cachesize: 67108864 transferred 273009204 pages 178082 cachemiss 302561 overflow 12833 deltacachemiss 1123 Sep 03 15:01:25 migration status: active (transferred 1574725942, remaining 11866112), total 2114387968) Sep 03 15:01:25 migration xbzrle cachesize: 67108864 transferred 278128445 pages 182505 cachemiss 303555 overflow 12925 deltacachemiss 994 Sep 03 15:01:25 migration status: active (transferred 1584030411, remaining 10473472), total 2114387968) Sep 03 15:01:25 migration xbzrle cachesize: 67108864 transferred 282722425 pages 187028 cachemiss 304611 overflow 13019 deltacachemiss 1056 Sep 03 15:01:25 migration status: active (transferred 1592843701, remaining 2134016), total 2114387968) Sep 03 15:01:25 migration xbzrle cachesize: 67108864 transferred 287443772 pages 192031 cachemiss 305549 overflow 13080 deltacachemiss 938 Sep 03 15:01:26 migration status: active (transferred 1601793792, remaining 6676480), total 2114387968) Sep 03 15:01:26 migration xbzrle cachesize: 67108864 transferred 292445279 pages 196112 cachemiss 306407 overflow 13186 deltacachemiss 858 Sep 03 15:01:26 migration status: active (transferred 1609953585, remaining 12259328), total 2114387968) Sep 03 15:01:26 migration xbzrle cachesize: 67108864 transferred 296742516 pages 199610 cachemiss 307294 overflow 13242 deltacachemiss 887 Sep 03 15:01:26 migration status: active (transferred 1618150798, remaining 4358144), total 2114387968) Sep 03 15:01:26 migration xbzrle cachesize: 67108864 transferred 301634218 pages 203248 cachemiss 308022 overflow 13321 deltacachemiss 728 Sep 03 15:01:26 migration status: active (transferred 1625047015, remaining 11665408), total 2114387968) Sep 03 15:01:26 migration xbzrle cachesize: 67108864 transferred 305642729 pages 206530 cachemiss 308695 overflow 13353 deltacachemiss 673 Sep 03 15:01:27 migration status: active (transferred 1631583544, remaining 8450048), total 2114387968) Sep 03 15:01:27 migration xbzrle cachesize: 67108864 transferred 309520928 pages 209601 cachemiss 309308 overflow 13389 deltacachemiss 613 Sep 03 15:01:27 migration status: active (transferred 1637654847, remaining 7917568), total 2114387968) Sep 03 15:01:27 migration xbzrle cachesize: 67108864 transferred 313118229 pages 212178 cachemiss 309876 overflow 13425 deltacachemiss 568 Sep 03 15:01:27 migration status: active (transferred 1644608997, remaining 6324224), total 2114387968) Sep 03 15:01:27 migration xbzrle cachesize: 67108864 transferred 317303461 pages 215070 cachemiss 310504 overflow 13473 deltacachemiss 628 Sep 03 15:01:28 migration status: active (transferred 1652796103, remaining 4423680), total 2114387968) Sep 03 15:01:28 migration xbzrle cachesize: 67108864 transferred 321243002 pages 218055 cachemiss 311465 overflow 13549 deltacachemiss 961 Sep 03 15:01:28 migration status: active (transferred 1662238886, remaining 12513280), total 2114387968) Sep 03 15:01:28 migration xbzrle cachesize: 67108864 transferred 326180167 pages 221148 cachemiss 312524 overflow 13590 deltacachemiss 1059 Sep 03 15:01:28 migration status: active (transferred 1670338088, remaining 5959680), total 2114387968) Sep 03 15:01:28 migration xbzrle cachesize: 67108864 transferred 330945203 pages 224318 cachemiss 313295 overflow 13633 deltacachemiss 771 Sep 03 15:01:29 migration status: active (transferred 1682607732, remaining 5373952), total 2114387968) Sep 03 15:01:29 migration xbzrle cachesize: 67108864 transferred 339032796 pages 228942 cachemiss 314248 overflow 13701 deltacachemiss 953 Sep 03 15:01:29 migration status: active (transferred 1691288677, remaining 5660672), total 2114387968) Sep 03 15:01:29 migration xbzrle cachesize: 67108864 transferred 344379577 pages 232454 cachemiss 315033 overflow 13730 deltacachemiss 785 Sep 03 15:01:29 migration status: active (transferred 1699318970, remaining 13336576), total 2114387968) Sep 03 15:01:29 migration xbzrle cachesize: 67108864 transferred 349546739 pages 235705 cachemiss 315700 overflow 13762 deltacachemiss 667 Sep 03 15:01:30 migration status: active (transferred 1709411503, remaining 7815168), total 2114387968) Sep 03 15:01:30 migration xbzrle cachesize: 67108864 transferred 355408081 pages 238683 cachemiss 316531 overflow 13964 deltacachemiss 831 Sep 03 15:01:30 migration status: active (transferred 1719503532, remaining 12898304), total 2114387968) Sep 03 15:01:30 migration xbzrle cachesize: 67108864 transferred 361350845 pages 241661 cachemiss 317275 overflow 14233 deltacachemiss 744 Sep 03 15:01:30 migration status: active (transferred 1728857886, remaining 6778880), total 2114387968) Sep 03 15:01:30 migration xbzrle cachesize: 67108864 transferred 366736158 pages 244405 cachemiss 317948 overflow 14529 deltacachemiss 673 Sep 03 15:01:31 migration status: active (transferred 1738122997, remaining 2527232), total 2114387968) Sep 03 15:01:31 migration xbzrle cachesize: 67108864 transferred 372220641 pages 246999 cachemiss 318550 overflow 14850 deltacachemiss 602 Sep 03 15:01:31 migration status: active (transferred 1745051297, remaining 2850816), total 2114387968) Sep 03 15:01:31 migration xbzrle cachesize: 67108864 transferred 376056452 pages 248933 cachemiss 319032 overflow 15123 deltacachemiss 482 Sep 03 15:01:31 migration status: active (transferred 1754719918, remaining 12759040), total 2114387968) Sep 03 15:01:31 migration xbzrle cachesize: 67108864 transferred 381239933 pages 251517 cachemiss 319744 overflow 15506 deltacachemiss 712 Sep 03 15:01:32 migration status: active (transferred 1763103223, remaining 9637888), total 2114387968) Sep 03 15:01:32 migration xbzrle cachesize: 67108864 transferred 385265065 pages 254298 cachemiss 320538 overflow 15776 deltacachemiss 794 Sep 03 15:01:32 migration status: active (transferred 1771003331, remaining 3596288), total 2114387968) Sep 03 15:01:32 migration xbzrle cachesize: 67108864 transferred 388708690 pages 257558 cachemiss 321498 overflow 15904 deltacachemiss 960 Sep 03 15:01:32 migration status: active (transferred 1778157089, remaining 12443648), total 2114387968) Sep 03 15:01:32 migration xbzrle cachesize: 67108864 transferred 392561052 pages 260534 cachemiss 322166 overflow 16042 deltacachemiss 668 Sep 03 15:01:33 migration status: active (transferred 1788495031, remaining 10276864), total 2114387968) Sep 03 15:01:33 migration xbzrle cachesize: 67108864 transferred 398295061 pages 264848 cachemiss 323101 overflow 16231 deltacachemiss 935 Sep 03 15:01:33 migration status: active (transferred 1794009984, remaining 11046912), total 2114387968) Sep 03 15:01:33 migration xbzrle cachesize: 67108864 transferred 400795337 pages 266649 cachemiss 323687 overflow 16381 deltacachemiss 586 Sep 03 15:01:33 migration status: active (transferred 1802929181, remaining 5738496), total 2114387968) Sep 03 15:01:33 migration xbzrle cachesize: 67108864 transferred 406032198 pages 269339 cachemiss 324245 overflow 16722 deltacachemiss 558 Sep 03 15:01:33 migration status: active (transferred 1813019717, remaining 13381632), total 2114387968) Sep 03 15:01:33 migration xbzrle cachesize: 67108864 transferred 412084058 pages 272447 cachemiss 324891 overflow 17062 deltacachemiss 646 Sep 03 15:01:34 migration status: active (transferred 1822507168, remaining 3809280), total 2114387968) Sep 03 15:01:34 migration xbzrle cachesize: 67108864 transferred 416672658 pages 275640 cachemiss 325836 overflow 17313 deltacachemiss 945 Sep 03 15:01:34 migration status: active (transferred 1829060930, remaining 10371072), total 2114387968) Sep 03 15:01:34 migration xbzrle cachesize: 67108864 transferred 418147336 pages 279826 cachemiss 327002 overflow 17387 deltacachemiss 1166 Sep 03 15:01:34 migration status: active (transferred 1835035082, remaining 11374592), total 2114387968) Sep 03 15:01:34 migration xbzrle cachesize: 67108864 transferred 419374185 pages 284812 cachemiss 328106 overflow 17442 deltacachemiss 1104 Sep 03 15:01:35 migration status: active (transferred 1840925069, remaining 11190272), total 2114387968) Sep 03 15:01:35 migration xbzrle cachesize: 67108864 transferred 420520965 pages 289916 cachemiss 329221 overflow 17485 deltacachemiss 1115 Sep 03 15:01:35 migration status: active (transferred 1846770014, remaining 9371648), total 2114387968) Sep 03 15:01:35 migration xbzrle cachesize: 67108864 transferred 421458853 pages 294580 cachemiss 330372 overflow 17532 deltacachemiss 1151 Sep 03 15:01:35 migration status: active (transferred 1853314839, remaining 2514944), total 2114387968) Sep 03 15:01:35 migration xbzrle cachesize: 67108864 transferred 423964993 pages 298173 cachemiss 331222 overflow 17668 deltacachemiss 850 Sep 03 15:01:36 migration status: active (transferred 1862231519, remaining 15454208), total 2114387968) Sep 03 15:01:36 migration xbzrle cachesize: 67108864 transferred 428937200 pages 301153 cachemiss 331999 overflow 17854 deltacachemiss 777 Sep 03 15:01:36 migration status: active (transferred 1870584409, remaining 11419648), total 2114387968) Sep 03 15:01:36 migration xbzrle cachesize: 67108864 transferred 431326236 pages 304655 cachemiss 333333 overflow 17976 deltacachemiss 1334 Sep 03 15:01:36 migration status: active (transferred 1878153329, remaining 4648960), total 2114387968) Sep 03 15:01:36 migration xbzrle cachesize: 67108864 transferred 434057751 pages 307541 cachemiss 334375 overflow 18115 deltacachemiss 1042 Sep 03 15:01:37 migration status: active (transferred 1885289154, remaining 12533760), total 2114387968) Sep 03 15:01:37 migration xbzrle cachesize: 67108864 transferred 438228048 pages 310420 cachemiss 334915 overflow 18299 deltacachemiss 540 Sep 03 15:01:37 migration status: active (transferred 1892622878, remaining 4374528), total 2114387968) Sep 03 15:01:37 migration xbzrle cachesize: 67108864 transferred 441490323 pages 313985 cachemiss 335735 overflow 18473 deltacachemiss 820 Sep 03 15:01:37 migration status: active (transferred 1901073971, remaining 13205504), total 2114387968) Sep 03 15:01:37 migration xbzrle cachesize: 67108864 transferred 446529428 pages 316687 cachemiss 336305 overflow 18736 deltacachemiss 570 Sep 03 15:01:38 migration status: active (transferred 1910878152, remaining 9048064), total 2114387968) Sep 03 15:01:38 migration xbzrle cachesize: 67108864 transferred 451586319 pages 319720 cachemiss 337190 overflow 19010 deltacachemiss 885 Sep 03 15:01:38 migration status: active (transferred 1918738540, remaining 10661888), total 2114387968) Sep 03 15:01:38 migration xbzrle cachesize: 67108864 transferred 455338404 pages 321664 cachemiss 337933 overflow 19270 deltacachemiss 743 Sep 03 15:01:38 migration status: active (transferred 1928827689, remaining 6860800), total 2114387968) Sep 03 15:01:38 migration xbzrle cachesize: 67108864 transferred 460549198 pages 324277 cachemiss 338738 overflow 19656 deltacachemiss 805 Sep 03 15:01:38 migration status: active (transferred 1937151384, remaining 3428352), total 2114387968) Sep 03 15:01:38 migration xbzrle cachesize: 67108864 transferred 465043115 pages 326494 cachemiss 339336 overflow 19993 deltacachemiss 598 Sep 03 15:01:39 migration status: active (transferred 1946239164, remaining 13590528), total 2114387968) Sep 03 15:01:39 migration xbzrle cachesize: 67108864 transferred 469952951 pages 328931 cachemiss 339977 overflow 20372 deltacachemiss 641 Sep 03 15:01:39 migration status: active (transferred 1955868111, remaining 2822144), total 2114387968) Sep 03 15:01:39 migration xbzrle cachesize: 67108864 transferred 474850991 pages 332609 cachemiss 340857 overflow 20647 deltacachemiss 880 Sep 03 15:01:39 migration status: active (transferred 1965033342, remaining 7884800), total 2114387968) Sep 03 15:01:39 migration xbzrle cachesize: 67108864 transferred 479064122 pages 336578 cachemiss 341853 overflow 20860 deltacachemiss 996 Sep 03 15:01:40 migration status: active (transferred 1972991062, remaining 8335360), total 2114387968) Sep 03 15:01:40 migration xbzrle cachesize: 67108864 transferred 482389235 pages 340369 cachemiss 342906 overflow 20938 deltacachemiss 1053 Sep 03 15:01:40 migration status: active (transferred 1978818556, remaining 10371072), total 2114387968) Sep 03 15:01:40 migration xbzrle cachesize: 67108864 transferred 483760246 pages 344727 cachemiss 343955 overflow 20977 deltacachemiss 1049 Sep 03 15:01:40 migration status: active (transferred 1984832873, remaining 2367488), total 2114387968) Sep 03 15:01:40 migration xbzrle cachesize: 67108864 transferred 485600711 pages 348240 cachemiss 344922 overflow 21029 deltacachemiss 967 Sep 03 15:01:41 migration status: active (transferred 1992114731, remaining 4120576), total 2114387968) Sep 03 15:01:41 migration xbzrle cachesize: 67108864 transferred 489704053 pages 351282 cachemiss 345551 overflow 21176 deltacachemiss 629 Sep 03 15:01:41 migration status: active (transferred 2001071596, remaining 12619776), total 2114387968) Sep 03 15:01:41 migration xbzrle cachesize: 67108864 transferred 495339032 pages 354218 cachemiss 346153 overflow 21385 deltacachemiss 602 Sep 03 15:01:41 migration status: active (transferred 2011152290, remaining 5206016), total 2114387968) Sep 03 15:01:41 migration xbzrle cachesize: 67108864 transferred 501454775 pages 357298 cachemiss 346854 overflow 21652 deltacachemiss 701 Sep 03 15:01:42 migration status: active (transferred 2019787845, remaining 4804608), total 2114387968) Sep 03 15:01:42 migration xbzrle cachesize: 67108864 transferred 505945161 pages 359691 cachemiss 347502 overflow 22016 deltacachemiss 648 Sep 03 15:01:42 migration status: active (transferred 2029872444, remaining 12754944), total 2114387968) Sep 03 15:01:42 migration xbzrle cachesize: 67108864 transferred 510999852 pages 362419 cachemiss 348359 overflow 22387 deltacachemiss 857 Sep 03 15:01:42 migration status: active (transferred 2039963167, remaining 5341184), total 2114387968) Sep 03 15:01:42 migration xbzrle cachesize: 67108864 transferred 516535788 pages 365431 cachemiss 349089 overflow 22769 deltacachemiss 730 Sep 03 15:01:42 migration status: active (transferred 2046790518, remaining 13049856), total 2114387968) Sep 03 15:01:42 migration xbzrle cachesize: 67108864 transferred 519742235 pages 368455 cachemiss 349752 overflow 22990 deltacachemiss 663 Sep 03 15:01:43 migration status: active (transferred 2056576433, remaining 6127616), total 2114387968) Sep 03 15:01:43 migration xbzrle cachesize: 67108864 transferred 524764472 pages 371518 cachemiss 350495 overflow 23410 deltacachemiss 743 Sep 03 15:01:43 migration status: active (transferred 2070030632, remaining 5545984), total 2114387968) Sep 03 15:01:43 migration xbzrle cachesize: 67108864 transferred 532054161 pages 375458 cachemiss 351436 overflow 23974 deltacachemiss 941 Sep 03 15:01:43 migration status: active (transferred 2080122845, remaining 16842752), total 2114387968) Sep 03 15:01:43 migration xbzrle cachesize: 67108864 transferred 537186091 pages 378300 cachemiss 352183 overflow 24438 deltacachemiss 747 Sep 03 15:01:44 migration status: active (transferred 2089596231, remaining 19959808), total 2114387968) Sep 03 15:01:44 migration xbzrle cachesize: 67108864 transferred 541281406 pages 380898 cachemiss 353159 overflow 24775 deltacachemiss 976 Sep 03 15:01:44 migration status: active (transferred 2098744287, remaining 3334144), total 2114387968) Sep 03 15:01:44 migration xbzrle cachesize: 67108864 transferred 544596639 pages 382825 cachemiss 354171 overflow 25187 deltacachemiss 1012 Sep 03 15:01:44 migration status: active (transferred 2107347747, remaining 8888320), total 2114387968) Sep 03 15:01:44 migration xbzrle cachesize: 67108864 transferred 547735772 pages 384605 cachemiss 355136 overflow 25556 deltacachemiss 965 Sep 03 15:01:45 migration status: active (transferred 2117427470, remaining 6184960), total 2114387968) Sep 03 15:01:45 migration xbzrle cachesize: 67108864 transferred 551515759 pages 386875 cachemiss 356245 overflow 25985 deltacachemiss 1109 Sep 03 15:01:45 migration status: active (transferred 2127522180, remaining 6643712), total 2114387968) Sep 03 15:01:45 migration xbzrle cachesize: 67108864 transferred 555519519 pages 389206 cachemiss 357355 overflow 26362 deltacachemiss 1110 Sep 03 15:01:45 migration status: active (transferred 2137180181, remaining 6840320), total 2114387968) Sep 03 15:01:45 migration xbzrle cachesize: 67108864 transferred 559197228 pages 391393 cachemiss 358357 overflow 26820 deltacachemiss 1002 Sep 03 15:01:46 migration status: active (transferred 2146653892, remaining 7704576), total 2114387968) Sep 03 15:01:46 migration xbzrle cachesize: 67108864 transferred 563133130 pages 393677 cachemiss 359363 overflow 27166 deltacachemiss 1006 Sep 03 15:01:46 migration status: active (transferred 2156170786, remaining 8384512), total 2114387968) Sep 03 15:01:46 migration xbzrle cachesize: 67108864 transferred 566870481 pages 395661 cachemiss 360401 overflow 27539 deltacachemiss 1038 Sep 03 15:01:46 migration status: active (transferred 2162116052, remaining 18784256), total 2114387968) Sep 03 15:01:46 migration xbzrle cachesize: 67108864 transferred 569030821 pages 396971 cachemiss 361078 overflow 27786 deltacachemiss 677 Sep 03 15:01:47 migration status: active (transferred 2167440600, remaining 10747904), total 2114387968) Sep 03 15:01:47 migration xbzrle cachesize: 67108864 transferred 570951584 pages 397932 cachemiss 361557 overflow 28138 deltacachemiss 479 Sep 03 15:01:47 migration status: active (transferred 2173189492, remaining 25628672), total 2114387968) Sep 03 15:01:47 migration xbzrle cachesize: 67108864 transferred 572772376 pages 399193 cachemiss 362323 overflow 28331 deltacachemiss 766 Sep 03 15:01:47 migration status: active (transferred 2181582500, remaining 8200192), total 2114387968) Sep 03 15:01:47 migration xbzrle cachesize: 67108864 transferred 575605975 pages 400618 cachemiss 363152 overflow 28859 deltacachemiss 829 Sep 03 15:01:47 migration status: active (transferred 2189847788, remaining 11202560), total 2114387968) Sep 03 15:01:47 migration xbzrle cachesize: 67108864 transferred 578513648 pages 402362 cachemiss 364245 overflow 29074 deltacachemiss 1093 Sep 03 15:01:48 migration status: active (transferred 2195877255, remaining 14094336), total 2114387968) Sep 03 15:01:48 migration xbzrle cachesize: 67108864 transferred 580246400 pages 404116 cachemiss 365082 overflow 29286 deltacachemiss 837 Sep 03 15:01:48 migration status: active (transferred 2202598243, remaining 12357632), total 2114387968) Sep 03 15:01:48 migration xbzrle cachesize: 67108864 transferred 581462307 pages 407577 cachemiss 366385 overflow 29327 deltacachemiss 1303 Sep 03 15:01:48 migration status: active (transferred 2210798256, remaining 2859008), total 2114387968) Sep 03 15:01:48 migration xbzrle cachesize: 67108864 transferred 583350325 pages 413084 cachemiss 367860 overflow 29393 deltacachemiss 1475 Sep 03 15:01:49 migration status: active (transferred 2217322581, remaining 7753728), total 2114387968) Sep 03 15:01:49 migration xbzrle cachesize: 67108864 transferred 586159554 pages 415753 cachemiss 368500 overflow 29660 deltacachemiss 640 Sep 03 15:01:49 migration status: active (transferred 2222843364, remaining 10366976), total 2114387968) Sep 03 15:01:49 migration xbzrle cachesize: 67108864 transferred 589009723 pages 417307 cachemiss 368910 overflow 29902 deltacachemiss 410 Sep 03 15:01:49 migration status: active (transferred 2229668707, remaining 12546048), total 2114387968) Sep 03 15:01:49 migration xbzrle cachesize: 67108864 transferred 592545964 pages 419113 cachemiss 369404 overflow 30211 deltacachemiss 494 Sep 03 15:01:50 migration status: active (transferred 2238229988, remaining 13078528), total 2114387968)