From mboxrd@z Thu Jan 1 00:00:00 1970 From: Andre Przywara Subject: Re: Hypervisor crash(!) on xl cpupool-numa-split Date: Wed, 9 Feb 2011 14:51:21 +0100 Message-ID: <4D529BD9.5050200@amd.com> References: <4D41FD3A.5090506@amd.com> <201102021539.06664.stephan.diestelhorst@amd.com> <4D4974D1.1080503@ts.fujitsu.com> <201102021701.05665.stephan.diestelhorst@amd.com> <4D4A43B7.5040707@ts.fujitsu.com> <4D4A72D8.3020502@ts.fujitsu.com> <4D4C08B6.30600@amd.com> <4D4FE7E2.9070605@amd.com> <4D4FF452.6060508@ts.fujitsu.com> <4D50D80F.9000007@ts.fujitsu.com> <4D517051.10402@amd.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="------------040200050103050605050904" Return-path: In-Reply-To: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: George Dunlap Cc: Juergen Gross , "xen-devel@lists.xensource.com" , "Diestelhorst, Stephan" List-Id: xen-devel@lists.xenproject.org --------------040200050103050605050904 Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit George Dunlap wrote: > wrote: >> On Tue, Feb 8, 2011 at 4:33 PM, Andre Przywara wrote: >>> (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 24 >>> (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 24 >>> (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 24 >>> (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 25 >>> (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 25 >>> (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 25 >>> (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 26 >>> (XEN) cpu_disable_scheduler: Migrating d0v32 from cpu 26 >>> (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 26 >>> (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 27 >>> (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 27 >>> (XEN) cpu_disable_scheduler: Migrating d0v32 from cpu 27 >>> (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 27 >>> (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 28 >>> (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 28 >>> (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 28 >>> (XEN) cpu_disable_scheduler: Migrating d0v32 from cpu 28 >>> (XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 28 >>> (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 29 >> Interesting -- what seems to happen here is that as cpus are disabled, >> vcpus are "shovelled" in an accumulative fashion from one cpu to the >> next: >> * v18,34,42 start on cpu 24. >> * When 24 is brought down, they're all migrated to 25; then when 25 is >> brougth down, to 26, then to 27 >> * v24 is running on cpu 27, so when 27 is brought down, v24 is added to the mix >> * v3 is running on cpu 28, so all of them plus v3 are shoveled onto cpu 29. >> >> While that behavior may not be ideal, it should certainly be bug-free. >> >> Another interesting thing to note is that the bug happened on pcpu 32, >> but there were no advertised migrations from that cpu. >> >> Andre, can you fold the attached patch into your testing? Sorry, but that bug (and its output) didn't trigger on two tries. Instead I now saw two occasions of the "migration failed, must retry later" message. Interestingly enough is does not seem to be fatal. The first time it triggers, the numa-split even completes, then after I roll it back and repeat it it shows again, but crashes later on that old BUG_ON(). See the attached log for more details. Thanks for the try, anyway. Regards, Andre. >> >> Thanks for all your work on this. I am glad for all your help. I only start to really understand the scheduler, so your support is much appreciated. >> >> -George >> -- Andre Przywara AMD-Operating System Research Center (OSRC), Dresden, Germany --------------040200050103050605050904 Content-Type: text/plain; name="george_2_debug.log" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="george_2_debug.log" Content-Description: george_2_debug.log root@dosorca:/data/images# sh numasplit.sh create Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 6 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 7 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 7 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 8 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 8 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 9 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 10 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 11 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node1 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 12 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 12 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 13 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 13 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 14 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 14 (XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 15 (XEN) Migration failed, must retry later. (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 15 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 15 (XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 17 (XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 17 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 17 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 17 (XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 17 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node2 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 18 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 19 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 19 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 20 (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 20 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 20 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 21 (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 21 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 21 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 22 (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 22 (XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 22 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 23 (XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 23 (XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 23 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node3 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v12 from cpu 24 (XEN) cpu_disable_scheduler: Migrating d0v30 from cpu 24 (XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 25 (XEN) cpu_disable_scheduler: Migrating d0v30 from cpu 25 (XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 29 (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 29 (XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 29 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 29 (XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 29 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node4 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 30 (XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 30 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 31 (XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 31 (XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 31 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 32 (XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 32 (XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 32 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 33 (XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 33 (XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 33 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 34 (XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 34 (XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 34 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 35 (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 35 (XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 35 (XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 35 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node5 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 36 (XEN) cpu_disable_scheduler: Migrating d0v45 from cpu 36 (XEN) cpu_disable_scheduler: Migrating d0v5 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v45 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v3 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v20 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 41 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node6 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 42 (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 42 (XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 42 (XEN) cpu_disable_scheduler: Migrating d0v46 from cpu 42 (XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 43 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 43 (XEN) cpu_disable_scheduler: Migrating d0v12 from cpu 43 (XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 43 (XEN) cpu_disable_scheduler: Migrating d0v25 from cpu 43 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 43 (XEN) cpu_disable_scheduler: Migrating d0v43 from cpu 43 (XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 44 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 44 (XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 44 (XEN) cpu_disable_scheduler: Migrating d0v23 from cpu 44 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 44 (XEN) cpu_disable_scheduler: Migrating d0v40 from cpu 44 (XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 45 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 45 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 45 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 45 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 45 (XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 45 (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 45 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 46 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 46 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 46 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 46 (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 46 (XEN) cpu_disable_scheduler: Migrating d0v12 from cpu 47 (XEN) cpu_disable_scheduler: Migrating d0v16 from cpu 47 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 47 (XEN) cpu_disable_scheduler: Migrating d0v33 from cpu 47 (XEN) cpu_disable_scheduler: Migrating d0v42 from cpu 47 (XEN) cpu_disable_scheduler: Migrating d0v43 from cpu 47 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node7 scheduler: credit number of cpus: 1 Populating new pool root@dosorca:/data/images# sh numasplit.sh create revert Destroying Pool 1 adding freed CPUs to pool 0 Destroying Pool 2 adding freed CPUs to pool 0 Destroying Pool 3 adding freed CPUs to pool 0 Destroying Pool 4 adding freed CPUs to pool 0 Destroying Pool 5 adding freed CPUs to pool 0 Destroying Pool 6 adding freed CPUs to pool 0 Destroying Pool 7 adding freed CPUs to pool 0 root@dosorca:/data/images# sh numasplit.sh create Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 6 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 6 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 7 (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 7 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 7 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 8 (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 8 (XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 8 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 8 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 9 (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 9 (XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 9 (XEN) cpu_disable_scheduler: Migrating d0v31 from cpu 9 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 10 (XEN) cpu_disable_scheduler: Migrating d0v22 from cpu 10 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 10 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 11 (XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 11 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 11 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node1 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 12 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 12 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 13 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 13 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 13 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 14 (XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 14 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 14 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 14 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 15 (XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 15 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 15 (XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 15 (XEN) cpu_disable_scheduler: Migrating d0v41 from cpu 15 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 16 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 17 (XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 17 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 17 (XEN) cpu_disable_scheduler: Migrating d0v37 from cpu 17 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node2 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 18 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 18 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 19 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 19 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 20 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 20 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 20 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 21 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 21 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 21 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 22 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 22 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 22 (XEN) cpu_disable_scheduler: Migrating d0v6 from cpu 23 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 23 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 23 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node3 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 24 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 25 (XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 25 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 25 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v29 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v43 from cpu 26 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 27 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 28 (XEN) cpu_disable_scheduler: Migrating d0v7 from cpu 29 (XEN) cpu_disable_scheduler: Migrating d0v17 from cpu 29 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 29 (XEN) cpu_disable_scheduler: Migrating d0v38 from cpu 29 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node4 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 31 (XEN) cpu_disable_scheduler: Migrating d0v21 from cpu 32 (XEN) cpu_disable_scheduler: Migrating d0v46 from cpu 32 (XEN) Migration failed, must retry later. (XEN) cpu_disable_scheduler: Migrating d0v14 from cpu 33 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 34 (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 34 (XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 34 (XEN) cpu_disable_scheduler: Migrating d0v4 from cpu 35 (XEN) cpu_disable_scheduler: Migrating d0v18 from cpu 35 (XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 35 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node5 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 36 (XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 36 (XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 36 (XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 36 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 37 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v15 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v35 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v44 from cpu 38 (XEN) cpu_disable_scheduler: Migrating d0v1 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v28 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 39 (XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v24 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v39 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v47 from cpu 40 (XEN) cpu_disable_scheduler: Migrating d0v0 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v8 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v13 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v19 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v26 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v34 from cpu 41 (XEN) cpu_disable_scheduler: Migrating d0v45 from cpu 41 Rewriting config file Creating new pool Using config file "cpupool.test" cpupool name: Pool-node6 scheduler: credit number of cpus: 1 Populating new pool Removing CPUs from Pool 0 (XEN) Xen BUG at sched_credit.c:998 (XEN) ----[ Xen-4.1.0-rc3-pre x86_64 debug=y Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: e008:[] csched_acct+0x11f/0x41c (XEN) RFLAGS: 0000000000010006 CONTEXT: hypervisor (XEN) rax: 0000000000000010 rbx: 0000000000000f00 rcx: 0000000000000100 (XEN) rdx: 0000000000001000 rsi: ffff830437ffa600 rdi: 0000000000000010 (XEN) rbp: ffff82c480297e38 rsp: ffff82c480297da8 r8: 0000000000000100 (XEN) r9: 0000000000000007 r10: ffff82c4802cbfe0 r11: 0000009d467684b5 (XEN) r12: ffff830437ffa5e0 r13: ffff82c48011802e r14: ffff830433af2018 (XEN) r15: ffff830434321ec0 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) cr3: 00000008067e3000 cr2: 00007f5a56dce590 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e010 cs: e008 (XEN) Xen stack trace from rsp=ffff82c480297da8: (XEN) ffff82c480297dc8 fffffed480153c5e ffff830400000eff ffff830437ffa5e0 (XEN) ffff830437ffa5e8 ffff82c480153ced ffff830437ffa5e0 0000000000000292 (XEN) ffff830437ffa5e8 00000e1034322000 00000f0000000f00 0000000000000000 (XEN) ffff82c400000000 ffff82c4802d3f80 ffff830437ffa5e0 ffff82c48011802e (XEN) ffff830433af2018 ffff830433af2010 ffff82c480297e68 ffff82c480125fc4 (XEN) 0000000000000002 ffff830437ffa600 ffff82c4802d3f80 0000009d44e55c65 (XEN) ffff82c480297eb8 ffff82c4801262e9 0000000000000001 ffff82c4802d3f80 (XEN) ffff830433af2010 0000000000000000 0000000000000000 ffff82c4802b0880 (XEN) ffff82c480297f18 ffffffffffffffff ffff82c480297ef8 ffff82c4801233b7 (XEN) ffff82c480297ed8 ffff8300c7e0a000 ffff88007ce88f40 ffff8817a7c47000 (XEN) 0000000000000001 000000000000002c ffff82c480297f08 ffff82c480123432 (XEN) 00007d3b7fd680c7 ffff82c480207d16 000000000000002c 0000000000000001 (XEN) ffff8817a7c47000 ffff88007ce88f40 ffff88179f9ffce8 ffff8817a84df000 (XEN) 0000000000000286 000000000000000f ffff88179f9ffcf8 ffff88007ce898c0 (XEN) 0000000000000000 ffffffff8100940a ffff88007ce75000 00000000deadbeef (XEN) 00000000deadbeef 0000010000000000 ffffffff8100940a 000000000000e033 (XEN) 0000000000000286 ffff88179f9ffca0 000000000000e02b 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) ffff8300c7e0a000 0000000000000000 0000000000000000 (XEN) Xen call trace: (XEN) [] csched_acct+0x11f/0x41c (XEN) [] execute_timer+0x4e/0x6c (XEN) [] timer_softirq_action+0xf2/0x245 (XEN) [] __do_softirq+0x88/0x99 (XEN) [] do_softirq+0x6a/0x7a (XEN) (XEN) (XEN) **************************************** (XEN) Panic on CPU 0: (XEN) Xen BUG at sched_credit.c:998 (XEN) **************************************** (XEN) (XEN) Reboot in five seconds... (XEN) Resetting with ACPI MEMORY or I/O RESET_REG. --------------040200050103050605050904 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel --------------040200050103050605050904--