From mboxrd@z Thu Jan 1 00:00:00 1970 From: Elena Ufimtseva Subject: Re: Regression introduced by "xen: properly account for _PAGE_NUMA during xen pte translations" (a9c8e4beeeb64c22b84c803747487857fe424b68) Date: Thu, 27 Feb 2014 22:18:04 -0500 Message-ID: References: <20140228022532.GC7114@localhost.localdomain> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5251542664070070604==" Return-path: Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1WJDxh-0003Ja-Gy for xen-devel@lists.xenproject.org; Fri, 28 Feb 2014 03:18:10 +0000 Received: by mail-qc0-f175.google.com with SMTP id e16so145661qcx.34 for ; Thu, 27 Feb 2014 19:18:04 -0800 (PST) In-Reply-To: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Steven Noonan Cc: David Vrabel , xen-devel , Andrew Morton , Linus Torvalds , Boris Ostrovsky , Mel Gorman List-Id: xen-devel@lists.xenproject.org --===============5251542664070070604== Content-Type: multipart/alternative; boundary=001a113330b2d35e8804f36ee2a8 --001a113330b2d35e8804f36ee2a8 Content-Type: text/plain; charset=ISO-8859-1 On Thu, Feb 27, 2014 at 9:48 PM, Steven Noonan wrote: > For the issue fixed by a9c8e4be, it was possible to trigger it using a > small test case. Does that same test work if you run it after > migrating the instance? > > #include > #include > #include > #include > > void die(const char *what) > { > perror(what); > exit(1); > } > > int main(int arg, char **argv) > { > void *p = mmap(NULL, 4096, PROT_READ | PROT_WRITE, MAP_PRIVATE > | MAP_ANONYMOUS, -1, 0); > > if (p == MAP_FAILED) > die("mmap"); > > /* Tickle the page. */ > ((char *)p)[0] = 0; > > if (mprotect(p, 4096, PROT_NONE) != 0) > die("mprotect"); > > if (mprotect(p, 4096, PROT_READ) != 0) > die("mprotect"); > > if (munmap(p, 4096) != 0) > die("munmap"); > > return 0; > } > > On Thu, Feb 27, 2014 at 6:25 PM, Konrad Rzeszutek Wilk > wrote: > > > > This only shows up when using the Linux kernel as a 64-bit PV guest and > > when I have migrated and I am running iscsid and I poweroff the guest. > > Note: I can also reproduce this if I kill 'iscsid'. > > > > If I revert the above mentioned commit the problem disappears. > > > > The page flags it shows are bogus - this guest is running from RAM > > and has no swap. > > > > Here is what the console says (ignore the first BUG please): > > > > [ 42.268060] xen:grant_table: Grant tables using version 1 layout > > [ 42.268060] BUG: sleeping function called from invalid context at > /home/konrad/ssd/konrad/linux/kernel/locking/mutex.c:96 > > [ 42.268060] in_atomic(): 1, irqs_disabled(): 1, pid: 9, name: > migration/0 > > [ 42.268060] CPU: 0 PID: 9 Comm: migration/0 Not tainted > 3.14.0-rc4upstream #1 > > [ 42.268060] 0000000000000002 ffff88003cc0dcd8 ffffffff816f0e59 > ffff88003cc02630 > > [ 42.268060] ffffffff81c6df80 ffff88003cc0dce8 ffffffff810cdfce > ffff88003cc0dd08 > > [ 42.268060] ffffffff816f3bdf ffff88003cc0dd08 0000000000000017 > ffff88003cc0dd38 > > [ 42.268060] Call Trace: > > [ 42.268060] [] dump_stack+0x51/0x6b > > [ 42.268060] [] __might_sleep+0xce/0xf0 > > [ 42.268060] [] mutex_lock+0x1f/0x40 > > [ 42.268060] [] rebind_evtchn_irq+0x3b/0xb0 > > [ 42.268060] [] xen_console_resume+0x5c/0x60 > > [ 42.268060] [] xen_suspend+0x8a/0xb0 > > [ 42.268060] [] multi_cpu_stop+0xbb/0xe0 > > [ 42.268060] [] ? irq_cpu_stop_queue_work+0x30/0x30 > > [ 42.268060] [] cpu_stopper_thread+0x4a/0x180 > > [ 42.268060] [] ? __schedule+0x381/0x7e0 > > [ 42.268060] [] ? smpboot_create_threads+0x80/0x80 > > [ 42.268060] [] ? > _raw_spin_unlock_irqrestore+0x1b/0x70 > > [ 42.268060] [] smpboot_thread_fn+0x148/0x1e0 > > [ 42.268060] [] ? smpboot_create_threads+0x80/0x80 > > [ 42.268060] [] kthread+0xce/0xf0 > > [ 42.268060] [] ? > kthread_freezable_should_stop+0x80/0x80 > > [ 42.268060] [] ret_from_fork+0x7c/0xb0 > > [ 42.268060] [] ? > kthread_freezable_should_stop+0x80/0x80 > > [ 42.268060] PM: noirq restore of devices complete after 0.251 msecs > > [ 42.268645] PM: early restore of devices complete after 0.151 msecs > > > > # > > # [ 42.281199] switch: port 1(eth0) entered disabled state > > [ 42.282591] PM: restore of devices complete after 11.656 msecs > > [ 42.307965] switch: port 1(eth0) entered forwarding state > > [ 42.307990] switch: port 1(eth0) entered forwarding state > > > > # > > # > > # [ 57.312124] switch: port 1(eth0) entered forwarding state > > lspci > > # lsscsi > > # ifconfig > > eth0 Link encap:Ethernet HWaddr 00:0F:4B:00:00:68 > > inet6 addr: fe80::20f:4bff:fe00:68/64 Scope:Link > > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > > RX packets:99 errors:0 dropped:0 overruns:0 frame:0 > > TX packets:86 errors:0 dropped:0 overruns:0 carrier:0 > > collisions:0 txqueuelen:1000 > > RX bytes:8722 (8.5 KiB) TX bytes:8709 (8.5 KiB) > > > > lo Link encap:Local Loopback > > inet addr:127.0.0.1 Mask:255.0.0.0 > > inet6 addr: ::1/128 Scope:Host > > UP LOOPBACK RUNNING MTU:65536 Metric:1 > > RX packets:4 errors:0 dropped:0 overruns:0 frame:0 > > TX packets:4 errors:0 dropped:0 overruns:0 carrier:0 > > collisions:0 txqueuelen:0 > > RX bytes:260 (260.0 b) TX bytes:260 (260.0 b) > > > > switch Link encap:Ethernet HWaddr 00:0F:4B:00:00:68 > > inet addr:192.168.102.68 Bcast:192.168.102.255 > Mask:255.255.255.0 > > inet6 addr: fe80::20f:4bff:fe00:68/64 Scope:Link > > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > > RX packets:96 errors:0 dropped:0 overruns:0 frame:0 > > TX packets:75 errors:0 dropped:0 overruns:0 carrier:0 > > collisions:0 txqueuelen:0 > > RX bytes:8506 (8.3 KiB) TX bytes:7755 (7.5 KiB) > > > > # ping 1 8.8.8.8 > > PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. > > 64 bytes from 8.8.8.8: icmp_seq=1 ttl=45 time=57.0 ms > > 64 bytes from 8.8.8.8: icmp_seq=2 ttl=45 time=51.4 ms > > 64 bytes from 8.8.8.8: icmp_seq=3 ttl=45 time=51.8 ms > > ^C > > --- 8.8.8.8 ping statistics --- > > 3 packets transmitted, 3 received, 0% packet loss, time 2130ms > > rtt min/avg/max/mdev = 51.421/53.420/57.008/2.556 ms > > # poweroff > > Feb 28 02:05:30 g-pvops init: starting pid 2386, tty '': > '/etc/init.d/halt' > > > > # Usage: /etc/init.d/halt {start} > > > > The system is going down NOW! > > > > Sent SIGTERM to all processes > > Feb 28 02:05:30 g-pvops exiting on signal 15 > > > > [ 71.195552] BUG: Bad page map in process iscsid pte:39b22120 > pmd:06953067 > > [ 71.195569] page:ffffea0000c9ef70 count:1 mapcount:-1 > mapping:ffff88003a536490 index:0x1c8 > > [ 71.195576] page flags: > 0x100000000080078(uptodate|dirty|lru|active|swapbacked) > > [ 71.195585] page dumped because: bad pte > > [ 71.195589] addr:00007fb105d37000 vm_flags:00000070 anon_vma: > (null) mapping:ffff880032006970 index:c > > [ 71.195598] vma->vm_ops->fault: shmem_fault+0x0/0x70 > > [ 71.195603] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x30 > > [ 71.195613] CPU: 0 PID: 2296 Comm: iscsid Not tainted > 3.14.0-rc4upstream #1 > > [ 71.195618] 00007fb105d37000 ffff880030ff3c28 ffffffff816f0e59 > 0000000000000000 > > [ 71.195627] ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b > ffff880030ff3c58 > > [ 71.195634] ffffffff8117f6e1 ffff880030ff3c58 00007fb105d37000 > ffff8800069539b8 > > [ 71.195642] Call Trace: > > [ 71.195649] [] dump_stack+0x51/0x6b > > [ 71.195657] [] print_bad_pte+0x1bb/0x280 > > [ 71.195663] [] ? activate_page+0xb1/0xe0 > > [ 71.195669] [] unmap_single_vma+0x8c8/0x910 > > [ 71.195676] [] ? xen_pte_unlock+0x9/0x10 > > [ 71.195680] [] unmap_vmas+0x4c/0xa0 > > [ 71.195688] [] exit_mmap+0x90/0x160 > > [ 71.195694] [] ? _raw_spin_lock_irqsave+0x13/0x60 > > [ 71.195702] [] mmput+0x52/0x100 > > [ 71.195707] [] do_exit+0x29c/0xb90 > > [ 71.195712] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.195719] [] do_group_exit+0x51/0x130 > > [ 71.195724] [] SyS_exit_group+0x12/0x20 > > [ 71.195732] [] system_call_fastpath+0x16/0x1b > > [ 71.195736] Disabling lock debugging due to kernel taint > > [ 71.195740] BUG: Bad page map in process iscsid pte:39b23120 > pmd:06953067 > > [ 71.195744] page:ffffea0000c9efa8 count:2 mapcount:-1 > mapping:ffff88003a536490 index:0x1c9 > > [ 71.195751] page flags: > 0x100000000080038(uptodate|dirty|lru|swapbacked) > > [ 71.195759] page dumped because: bad pte > > [ 71.195764] addr:00007fb105d38000 vm_flags:00000070 anon_vma: > (null) mapping:ffff880032006970 index:d > > [ 71.195770] vma->vm_ops->fault: shmem_fault+0x0/0x70 > > [ 71.195774] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x30 > > [ 71.195778] CPU: 0 PID: 2296 Comm: iscsid Tainted: G B > 3.14.0-rc4upstream #1 > > [ 71.195783] 00007fb105d38000 ffff880030ff3c28 ffffffff816f0e59 > 0000000000000000 > > [ 71.195791] ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b > 0000000000000575 > > [ 71.195798] 0720072007200720 ffff880030ff3c58 00007fb105d38000 > ffff8800069539c0 > > [ 71.195806] Call Trace: > > [ 71.195810] [] dump_stack+0x51/0x6b > > [ 71.195816] [] print_bad_pte+0x1bb/0x280 > > [ 71.195820] [] unmap_single_vma+0x8c8/0x910 > > [ 71.195827] [] ? xen_pte_unlock+0x9/0x10 > > [ 71.195832] [] unmap_vmas+0x4c/0xa0 > > [ 71.195839] [] exit_mmap+0x90/0x160 > > [ 71.195843] [] ? _raw_spin_lock_irqsave+0x13/0x60 > > [ 71.195849] [] mmput+0x52/0x100 > > [ 71.195854] [] do_exit+0x29c/0xb90 > > [ 71.195858] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.195863] [] do_group_exit+0x51/0x130 > > [ 71.195870] [] SyS_exit_group+0x12/0x20 > > [ 71.195875] [] system_call_fastpath+0x16/0x1b > > [ 71.195880] BUG: Bad page map in process iscsid pte:39b24120 > pmd:06953067 > > [ 71.195884] page:ffffea0000c9efe0 count:2 mapcount:-1 > mapping:ffff88003a536490 index:0x1ca > > [ 71.195888] page flags: > 0x100000000080038(uptodate|dirty|lru|swapbacked) > > [ 71.195895] page dumped because: bad pte > > [ 71.195898] addr:00007fb105d39000 vm_flags:00000070 anon_vma: > (null) mapping:ffff880032006970 index:e > > [ 71.195904] vma->vm_ops->fault: shmem_fault+0x0/0x70 > > [ 71.195908] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x30 > > [ 71.195912] CPU: 0 PID: 2296 Comm: iscsid Tainted: G B > 3.14.0-rc4upstream #1 > > [ 71.195916] 00007fb105d39000 ffff880030ff3c28 ffffffff816f0e59 > 0000000000000000 > > [ 71.195923] ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b > 000000000000058e > > [ 71.195929] 0720072007200720 ffff880030ff3c58 00007fb105d39000 > ffff8800069539c8 > > [ 71.195935] Call Trace: > > [ 71.195939] [] dump_stack+0x51/0x6b > > [ 71.195944] [] print_bad_pte+0x1bb/0x280 > > [ 71.195948] [] unmap_single_vma+0x8c8/0x910 > > [ 71.195953] [] ? xen_pte_unlock+0x9/0x10 > > [ 71.195958] [] unmap_vmas+0x4c/0xa0 > > [ 71.195963] [] exit_mmap+0x90/0x160 > > [ 71.195967] [] ? _raw_spin_lock_irqsave+0x13/0x60 > > [ 71.195973] [] mmput+0x52/0x100 > > [ 71.195977] [] do_exit+0x29c/0xb90 > > [ 71.195982] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.195987] [] do_group_exit+0x51/0x130 > > [ 71.195992] [] SyS_exit_group+0x12/0x20 > > [ 71.195997] [] system_call_fastpath+0x16/0x1b > > [ 71.196001] BUG: Bad page map in process iscsid pte:39b25120 > pmd:06953067 > > [ 71.196005] page:ffffea0000c9f018 count:2 mapcount:-1 > mapping:ffff88003a536490 index:0x1cb > > [ 71.362165] page flags: > 0x100000000080038(uptodate|dirty|lru|swapbacked) > > [ 71.362172] page dumped because: bad pte > > [ 71.362175] addr:00007fb105d3a000 vm_flags:00000070 anon_vma: > (null) mapping:ffff880032006970 index:f > > [ 71.362181] vma->vm_ops->fault: shmem_fault+0x0/0x70 > > [ 71.362185] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x30 > > [ 71.362193] CPU: 0 PID: 2296 Comm: iscsid Tainted: G B > 3.14.0-rc4upstream #1 > > [ 71.362197] 00007fb105d3a000 ffff880030ff3c28 ffffffff816f0e59 > 0000000000000000 > > [ 71.362206] ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b > 00000000000005a7 > > [ 71.362212] 0720072007200720 ffff880030ff3c58 00007fb105d3a000 > ffff8800069539d0 > > [ 71.362221] Call Trace: > > [ 71.362225] [] dump_stack+0x51/0x6b > > [ 71.362230] [] print_bad_pte+0x1bb/0x280 > > [ 71.362241] [] unmap_single_vma+0x8c8/0x910 > > [ 71.362247] [] ? xen_pte_unlock+0x9/0x10 > > [ 71.362254] [] unmap_vmas+0x4c/0xa0 > > [ 71.362258] [] exit_mmap+0x90/0x160 > > [ 71.362263] [] ? _raw_spin_lock_irqsave+0x13/0x60 > > [ 71.362270] [] mmput+0x52/0x100 > > [ 71.362276] [] do_exit+0x29c/0xb90 > > [ 71.362282] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.362287] [] do_group_exit+0x51/0x130 > > [ 71.362292] [] SyS_exit_group+0x12/0x20 > > [ 71.362297] [] system_call_fastpath+0x16/0x1b > > [ 71.364639] BUG: Bad page state in process iscsid pfn:39b25 > > [ 71.364651] page:ffffea0000c9f018 count:0 mapcount:-1 > mapping:ffff88003a536490 index:0x1cb > > [ 71.364656] page flags: 0x100000000080018(uptodate|dirty|swapbacked) > > [ 71.364663] page dumped because: non-NULL mapping > > [ 71.364666] Modules linked in: dm_multipath dm_mod xen_evtchn > iscsi_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi > scsi_mod libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm > drm_kms_helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt > sysfillrect syscopyarea xen_kbdfront xenfs xen_privcmd > > [ 71.364706] CPU: 0 PID: 2296 Comm: iscsid Tainted: G B > 3.14.0-rc4upstream #1 > > [ 71.364711] ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59 > ffffffff8197f00f > > [ 71.364718] ffffea0000c9f018 ffff880030ff3be8 ffffffff811751a0 > ffff880030ff3c48 > > [ 71.364724] 0000000000000001 ffffea0000c9f018 0000000000000000 > ffff880030ff3c48 > > [ 71.364733] Call Trace: > > [ 71.364739] [] dump_stack+0x51/0x6b > > [ 71.364748] [] bad_page+0xd0/0x120 > > [ 71.364753] [] free_pages_prepare+0x145/0x160 > > [ 71.364760] [] ? xen_pte_val+0x32/0x40 > > [ 71.364768] [] free_hot_cold_page+0x3b/0x150 > > [ 71.364773] [] free_hot_cold_page_list+0x47/0xb0 > > [ 71.364780] [] release_pages+0x7d/0x230 > > [ 71.364785] [] free_pages_and_swap_cache+0xb4/0xe0 > > [ 71.364791] [] ? flush_tlb_mm_range+0x57/0x1b0 > > [ 71.364798] [] tlb_flush_mmu+0x57/0xa0 > > [ 71.364803] [] tlb_finish_mmu+0xf/0x40 > > [ 71.364810] [] exit_mmap+0xb7/0x160 > > [ 71.364815] [] ? _raw_spin_lock_irqsave+0x12/0x60 > > [ 71.364820] [] mmput+0x52/0x100 > > [ 71.364825] [] do_exit+0x29c/0xb90 > > [ 71.364830] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.364835] [] do_group_exit+0x51/0x130 > > [ 71.364842] [] SyS_exit_group+0x12/0x20 > > [ 71.364848] [] system_call_fastpath+0x16/0x1b > > [ 71.364854] BUG: Bad page state in process iscsid pfn:39b24 > > [ 71.364858] page:ffffea0000c9efe0 count:0 mapcount:-1 > mapping:ffff88003a536490 index:0x1ca > > [ 71.364863] page flags: 0x100000000080018(uptodate|dirty|swapbacked) > > [ 71.364871] page dumped because: non-NULL mapping > > [ 71.364874] Modules linked in: dm_multipath dm_mod xen_evtchn > iscsi_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi > scsi_mod libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm > drm_kms_helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt > sysfillrect syscopyarea xen_kbdfront xenfs xen_privcmd > > [ 71.364906] CPU: 0 PID: 2296 Comm: iscsid Tainted: G B > 3.14.0-rc4upstream #1 > > [ 71.364913] ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59 > ffffffff8197f00f > > [ 71.364919] ffffea0000c9efe0 ffff880030ff3be8 ffffffff811751a0 > ffff880030ff3c48 > > [ 71.364925] 0000000000000001 ffffea0000c9efe0 0000000000000000 > ffff880030ff3c48 > > [ 71.364933] Call Trace: > > [ 71.364938] [] dump_stack+0x51/0x6b > > [ 71.364945] [] bad_page+0xd0/0x120 > > [ 71.364950] [] free_pages_prepare+0x145/0x160 > > [ 71.364955] [] ? xen_pte_val+0x32/0x40 > > [ 71.364960] [] free_hot_cold_page+0x3b/0x150 > > [ 71.364965] [] free_hot_cold_page_list+0x47/0xb0 > > [ 71.364970] [] release_pages+0x7d/0x230 > > [ 71.364975] [] free_pages_and_swap_cache+0xb4/0xe0 > > [ 71.364982] [] ? flush_tlb_mm_range+0x57/0x1b0 > > [ 71.364987] [] tlb_flush_mmu+0x57/0xa0 > > [ 71.364994] [] tlb_finish_mmu+0xf/0x40 > > [ 71.364999] [] exit_mmap+0xb7/0x160 > > [ 71.365004] [] ? _raw_spin_lock_irqsave+0x12/0x60 > > [ 71.365009] [] mmput+0x52/0x100 > > [ 71.365015] [] do_exit+0x29c/0xb90 > > [ 71.365020] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.365025] [] do_group_exit+0x51/0x130 > > [ 71.365030] [] SyS_exit_group+0x12/0x20 > > [ 71.365035] [] system_call_fastpath+0x16/0x1b > > [ 71.365039] BUG: Bad page state in process iscsid pfn:39b23 > > [ 71.365043] page:ffffea0000c9efa8 count:0 mapcount:-1 > mapping:ffff88003a536490 index:0x1c9 > > [ 71.365047] page flags: 0x100000000080018(uptodate|dirty|swapbacked) > > [ 71.365074] page dumped because: non-NULL mapping > > [ 71.365077] Modules linked in: dm_multipath dm_mod xen_evtchn > iscsi_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi > scsi_mod libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm > drm_kms_helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt > sysfillrect syscopyarea xen_kbdfront xenfs xen_privcmd > > [ 71.365104] CPU: 0 PID: 2296 Comm: iscsid Tainted: G B > 3.14.0-rc4upstream #1 > > [ 71.365109] ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59 > ffffffff8197f00f > > [ 71.365115] ffffea0000c9efa8 ffff880030ff3be8 ffffffff811751a0 > ffff880030ff3c48 > > [ 71.365121] 0000000000000001 ffffea0000c9efa8 0000000000000000 > ffff880030ff3c48 > > [ 71.365127] Call Trace: > > [ 71.365131] [] dump_stack+0x51/0x6b > > [ 71.365136] [] bad_page+0xd0/0x120 > > [ 71.365141] [] free_pages_prepare+0x145/0x160 > > [ 71.365146] [] ? xen_pte_val+0x32/0x40 > > [ 71.365151] [] free_hot_cold_page+0x3b/0x150 > > [ 71.365155] [] free_hot_cold_page_list+0x47/0xb0 > > [ 71.365160] [] release_pages+0x7d/0x230 > > [ 71.365165] [] free_pages_and_swap_cache+0xb4/0xe0 > > [ 71.365170] [] ? flush_tlb_mm_range+0x57/0x1b0 > > [ 71.365175] [] tlb_flush_mmu+0x57/0xa0 > > [ 71.365180] [] tlb_finish_mmu+0xf/0x40 > > [ 71.562344] [] exit_mmap+0xb7/0x160 > > [ 71.562349] [] ? _raw_spin_lock_irqsave+0x12/0x60 > > [ 71.562354] [] mmput+0x52/0x100 > > [ 71.562359] [] do_exit+0x29c/0xb90 > > [ 71.562364] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.562369] [] do_group_exit+0x51/0x130 > > [ 71.562379] [] SyS_exit_group+0x12/0x20 > > [ 71.562387] [] system_call_fastpath+0x16/0x1b > > [ 71.562391] BUG: Bad page state in process iscsid pfn:39b22 > > [ 71.562395] page:ffffea0000c9ef70 count:0 mapcount:-1 > mapping:ffff88003a536490 index:0x1c8 > > [ 71.562399] page flags: 0x100000000080018(uptodate|dirty|swapbacked) > > [ 71.562413] page dumped because: non-NULL mapping > > [ 71.562420] Modules linked in: dm_multipath dm_mod xen_evtchn > iscsi_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi > scsi_mod libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm > drm_kms_helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt > sysfillrect syscopyarea xen_kbdfront xenfs xen_privcmd > > [ 71.562456] CPU: 0 PID: 2296 Comm: iscsid Tainted: G B > 3.14.0-rc4upstream #1 > > [ 71.562461] ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59 > ffffffff8197f00f > > [ 71.562467] ffffea0000c9ef70 ffff880030ff3be8 ffffffff811751a0 > ffff880030ff3c48 > > [ 71.562476] 0000000000000001 ffffea0000c9ef70 0000000000000000 > ffff880030ff3c48 > > [ 71.562486] Call Trace: > > [ 71.562490] [] dump_stack+0x51/0x6b > > [ 71.562495] [] bad_page+0xd0/0x120 > > [ 71.562500] [] free_pages_prepare+0x145/0x160 > > [ 71.562515] [] ? xen_pte_val+0x32/0x40 > > [ 71.562520] [] free_hot_cold_page+0x3b/0x150 > > [ 71.562525] [] free_hot_cold_page_list+0x47/0xb0 > > [ 71.562535] [] release_pages+0x7d/0x230 > > [ 71.562544] [] free_pages_and_swap_cache+0xb4/0xe0 > > [ 71.562550] [] ? flush_tlb_mm_range+0x57/0x1b0 > > [ 71.562555] [] tlb_flush_mmu+0x57/0xa0 > > [ 71.562561] [] tlb_finish_mmu+0xf/0x40 > > [ 71.562568] [] exit_mmap+0xb7/0x160 > > [ 71.562579] [] ? _raw_spin_lock_irqsave+0x12/0x60 > > [ 71.562584] [] mmput+0x52/0x100 > > [ 71.562594] [] do_exit+0x29c/0xb90 > > [ 71.562603] [] ? SyS_wait4+0xa9/0xf0 > > [ 71.562608] [] do_group_exit+0x51/0x130 > > [ 71.562613] [] SyS_exit_group+0x12/0x20 > > [ 71.562617] [] system_call_fastpath+0x16/0x1b > > > > Sent SIGKILL to all processes > > > > Requesting system poweroff > > [ 73.375423] reboot: System halted > Nice, I will also look at this. I have not tested the above mentioned patch with migration though. -- Elena --001a113330b2d35e8804f36ee2a8 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable



On Thu, Feb 27, 2014 at 9:48 PM, Steven Noonan &l= t;steven@uplinkl= abs.net> wrote:
For the issue fixed by a9c8e4be, it was possible to trigge= r it using a
small test case. Does that same test work if you run it after
migrating the instance?

=A0 =A0 #include <errno.h>
=A0 =A0 #include <stdio.h>
=A0 =A0 #include <stdlib.h>
=A0 =A0 #include <sys/mman.h>

=A0 =A0 void die(const char *what)
=A0 =A0 {
=A0 =A0 =A0 =A0 perror(what);
=A0 =A0 =A0 =A0 exit(1);
=A0 =A0 }

=A0 =A0 int main(int arg, char **argv)
=A0 =A0 {
=A0 =A0 =A0 =A0 void *p =3D mmap(NULL, 4096, PROT_READ | PROT_WRITE, MAP_PR= IVATE
| MAP_ANONYMOUS, -1, 0);

=A0 =A0 =A0 =A0 if (p =3D=3D MAP_FAILED)
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 die("mmap");

=A0 =A0 =A0 =A0 /* Tickle the page. */
=A0 =A0 =A0 =A0 ((char *)p)[0] =3D 0;

=A0 =A0 =A0 =A0 if (mprotect(p, 4096, PROT_NONE) !=3D 0)
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 die("mprotect");

=A0 =A0 =A0 =A0 if (mprotect(p, 4096, PROT_READ) !=3D 0)
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 die("mprotect");

=A0 =A0 =A0 =A0 if (munmap(p, 4096) !=3D 0)
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 die("munmap");

=A0 =A0 =A0 =A0 return 0;
=A0 =A0 }

On Thu, Feb 27, 2014 at 6:25 PM, Konrad Rzeszutek Wilk
<konrad.wilk@oracle.com>= ; wrote:
>
> This only shows up when using the Linux kernel as a 64-bit PV guest an= d
> when I have migrated and I am running iscsid and I poweroff the guest.=
> Note: I can also reproduce this if I kill 'iscsid'.
>
> If I revert the above mentioned commit the problem disappears.
>
> The page flags it shows are bogus - this guest is running from RAM
> and has no swap.
>
> Here is what the console says (ignore the first BUG please):
>
> [ =A0 42.268060] xen:grant_table: Grant tables using version 1 layout<= br> > [ =A0 42.268060] BUG: sleeping function called from invalid context at= /home/konrad/ssd/konrad/linux/kernel/locking/mutex.c:96
> [ =A0 42.268060] in_atomic(): 1, irqs_disabled(): 1, pid: 9, name: mig= ration/0
> [ =A0 42.268060] CPU: 0 PID: 9 Comm: migration/0 Not tainted 3.14.0-rc= 4upstream #1
> [ =A0 42.268060] =A00000000000000002 ffff88003cc0dcd8 ffffffff816f0e59= ffff88003cc02630
> [ =A0 42.268060] =A0ffffffff81c6df80 ffff88003cc0dce8 ffffffff810cdfce= ffff88003cc0dd08
> [ =A0 42.268060] =A0ffffffff816f3bdf ffff88003cc0dd08 0000000000000017= ffff88003cc0dd38
> [ =A0 42.268060] Call Trace:
> [ =A0 42.268060] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 42.268060] =A0[<ffffffff810cdfce>] __might_sleep+0xce/0xf0=
> [ =A0 42.268060] =A0[<ffffffff816f3bdf>] mutex_lock+0x1f/0x40 > [ =A0 42.268060] =A0[<ffffffff813f49fb>] rebind_evtchn_irq+0x3b/= 0xb0
> [ =A0 42.268060] =A0[<ffffffff81428bdc>] xen_console_resume+0x5c= /0x60
> [ =A0 42.268060] =A0[<ffffffff813f3c0a>] xen_suspend+0x8a/0xb0 > [ =A0 42.268060] =A0[<ffffffff811265db>] multi_cpu_stop+0xbb/0xe= 0
> [ =A0 42.268060] =A0[<ffffffff81126520>] ? irq_cpu_stop_queue_wo= rk+0x30/0x30
> [ =A0 42.268060] =A0[<ffffffff81126bfa>] cpu_stopper_thread+0x4a= /0x180
> [ =A0 42.268060] =A0[<ffffffff816f1a01>] ? __schedule+0x381/0x7e= 0
> [ =A0 42.268060] =A0[<ffffffff810cbf10>] ? smpboot_create_thread= s+0x80/0x80
> [ =A0 42.268060] =A0[<ffffffff816f612b>] ? _raw_spin_unlock_irqr= estore+0x1b/0x70
> [ =A0 42.268060] =A0[<ffffffff810cc058>] smpboot_thread_fn+0x148= /0x1e0
> [ =A0 42.268060] =A0[<ffffffff810cbf10>] ? smpboot_create_thread= s+0x80/0x80
> [ =A0 42.268060] =A0[<ffffffff810c490e>] kthread+0xce/0xf0
> [ =A0 42.268060] =A0[<ffffffff810c4840>] ? kthread_freezable_sho= uld_stop+0x80/0x80
> [ =A0 42.268060] =A0[<ffffffff816fe74c>] ret_from_fork+0x7c/0xb0=
> [ =A0 42.268060] =A0[<ffffffff810c4840>] ? kthread_freezable_sho= uld_stop+0x80/0x80
> [ =A0 42.268060] PM: noirq restore of devices complete after 0.251 mse= cs
> [ =A0 42.268645] PM: early restore of devices complete after 0.151 mse= cs
>
> #
> # [ =A0 42.281199] switch: port 1(eth0) entered disabled state
> [ =A0 42.282591] PM: restore of devices complete after 11.656 msecs > [ =A0 42.307965] switch: port 1(eth0) entered forwarding state
> [ =A0 42.307990] switch: port 1(eth0) entered forwarding state
>
> #
> #
> # [ =A0 57.312124] switch: port 1(eth0) entered forwarding state
> lspci
> # lsscsi
> # ifconfig
> eth0 =A0 =A0 =A0Link encap:Ethernet =A0HWaddr 00:0F:4B:00:00:68
> =A0 =A0 =A0 =A0 =A0 inet6 addr: fe80::20f:4bff:fe00:68/64 Scope:Link > =A0 =A0 =A0 =A0 =A0 UP BROADCAST RUNNING MULTICAST =A0MTU:1500 =A0Metr= ic:1
> =A0 =A0 =A0 =A0 =A0 RX packets:99 errors:0 dropped:0 overruns:0 frame:= 0
> =A0 =A0 =A0 =A0 =A0 TX packets:86 errors:0 dropped:0 overruns:0 carrie= r:0
> =A0 =A0 =A0 =A0 =A0 collisions:0 txqueuelen:1000
> =A0 =A0 =A0 =A0 =A0 RX bytes:8722 (8.5 KiB) =A0TX bytes:8709 (8.5 KiB)=
>
> lo =A0 =A0 =A0 =A0Link encap:Local Loopback
> =A0 =A0 =A0 =A0 =A0 inet addr:127.0.0.1 =A0Mask:255.0.0.0
> =A0 =A0 =A0 =A0 =A0 inet6 addr: ::1/128 Scope:Host
> =A0 =A0 =A0 =A0 =A0 UP LOOPBACK RUNNING =A0MTU:65536 =A0Metric:1
> =A0 =A0 =A0 =A0 =A0 RX packets:4 errors:0 dropped:0 overruns:0 frame:0=
> =A0 =A0 =A0 =A0 =A0 TX packets:4 errors:0 dropped:0 overruns:0 carrier= :0
> =A0 =A0 =A0 =A0 =A0 collisions:0 txqueuelen:0
> =A0 =A0 =A0 =A0 =A0 RX bytes:260 (260.0 b) =A0TX bytes:260 (260.0 b) >
> switch =A0 =A0Link encap:Ethernet =A0HWaddr 00:0F:4B:00:00:68
> =A0 =A0 =A0 =A0 =A0 inet addr:192.168.102.68 =A0Bcast:192.168.102.255 = =A0Mask:255.255.255.0
> =A0 =A0 =A0 =A0 =A0 inet6 addr: fe80::20f:4bff:fe00:68/64 Scope:Link > =A0 =A0 =A0 =A0 =A0 UP BROADCAST RUNNING MULTICAST =A0MTU:1500 =A0Metr= ic:1
> =A0 =A0 =A0 =A0 =A0 RX packets:96 errors:0 dropped:0 overruns:0 frame:= 0
> =A0 =A0 =A0 =A0 =A0 TX packets:75 errors:0 dropped:0 overruns:0 carrie= r:0
> =A0 =A0 =A0 =A0 =A0 collisions:0 txqueuelen:0
> =A0 =A0 =A0 =A0 =A0 RX bytes:8506 (8.3 KiB) =A0TX bytes:7755 (7.5 KiB)=
>
> # ping 1 =A0 8.8.8.8
> PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data.
> 64 bytes from 8.8.8.8= : icmp_seq=3D1 ttl=3D45 time=3D57.0 ms
> 64 bytes from 8.8.8.8= : icmp_seq=3D2 ttl=3D45 time=3D51.4 ms
> 64 bytes from 8.8.8.8= : icmp_seq=3D3 ttl=3D45 time=3D51.8 ms
> ^C
> --- 8.8.8.8 ping statistics ---
> 3 packets transmitted, 3 received, 0% packet loss, time 2130ms
> rtt min/avg/max/mdev =3D 51.421/53.420/57.008/2.556 ms
> # poweroff
> Feb 28 02:05:30 g-pvops init: starting pid 2386, tty '': '= /etc/init.d/halt'
>
> # Usage: /etc/init.d/halt {start}
>
> The system is going down NOW!
>
> Sent SIGTERM to all processes
> Feb 28 02:05:30 g-pvops exiting on signal 15
>
> [ =A0 71.195552] BUG: Bad page map in process iscsid =A0pte:39b22120 p= md:06953067
> [ =A0 71.195569] page:ffffea0000c9ef70 count:1 mapcount:-1 mapping:fff= f88003a536490 index:0x1c8
> [ =A0 71.195576] page flags: 0x100000000080078(uptodate|dirty|lru|acti= ve|swapbacked)
> [ =A0 71.195585] page dumped because: bad pte
> [ =A0 71.195589] addr:00007fb105d37000 vm_flags:00000070 anon_vma: =A0= =A0 =A0 =A0 =A0(null) mapping:ffff880032006970 index:c
> [ =A0 71.195598] vma->vm_ops->fault: shmem_fault+0x0/0x70
> [ =A0 71.195603] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x3= 0
> [ =A0 71.195613] CPU: 0 PID: 2296 Comm: iscsid Not tainted 3.14.0-rc4u= pstream #1
> [ =A0 71.195618] =A000007fb105d37000 ffff880030ff3c28 ffffffff816f0e59= 0000000000000000
> [ =A0 71.195627] =A0ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b= ffff880030ff3c58
> [ =A0 71.195634] =A0ffffffff8117f6e1 ffff880030ff3c58 00007fb105d37000= ffff8800069539b8
> [ =A0 71.195642] Call Trace:
> [ =A0 71.195649] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.195657] =A0[<ffffffff81199a5b>] print_bad_pte+0x1bb/0x2= 80
> [ =A0 71.195663] =A0[<ffffffff8117f6e1>] ? activate_page+0xb1/0x= e0
> [ =A0 71.195669] =A0[<ffffffff8119ad68>] unmap_single_vma+0x8c8/= 0x910
> [ =A0 71.195676] =A0[<ffffffff81040a69>] ? xen_pte_unlock+0x9/0x= 10
> [ =A0 71.195680] =A0[<ffffffff8119adfc>] unmap_vmas+0x4c/0xa0 > [ =A0 71.195688] =A0[<ffffffff811a2920>] exit_mmap+0x90/0x160 > [ =A0 71.195694] =A0[<ffffffff816f5f13>] ? _raw_spin_lock_irqsav= e+0x13/0x60
> [ =A0 71.195702] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.195707] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.195712] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.195719] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.195724] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.195732] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
> [ =A0 71.195736] Disabling lock debugging due to kernel taint
> [ =A0 71.195740] BUG: Bad page map in process iscsid =A0pte:39b23120 p= md:06953067
> [ =A0 71.195744] page:ffffea0000c9efa8 count:2 mapcount:-1 mapping:fff= f88003a536490 index:0x1c9
> [ =A0 71.195751] page flags: 0x100000000080038(uptodate|dirty|lru|swap= backed)
> [ =A0 71.195759] page dumped because: bad pte
> [ =A0 71.195764] addr:00007fb105d38000 vm_flags:00000070 anon_vma: =A0= =A0 =A0 =A0 =A0(null) mapping:ffff880032006970 index:d
> [ =A0 71.195770] vma->vm_ops->fault: shmem_fault+0x0/0x70
> [ =A0 71.195774] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x3= 0
> [ =A0 71.195778] CPU: 0 PID: 2296 Comm: iscsid Tainted: G =A0 =A0B =A0= =A0 =A0 =A03.14.0-rc4upstream #1
> [ =A0 71.195783] =A000007fb105d38000 ffff880030ff3c28 ffffffff816f0e59= 0000000000000000
> [ =A0 71.195791] =A0ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b= 0000000000000575
> [ =A0 71.195798] =A00720072007200720 ffff880030ff3c58 00007fb105d38000= ffff8800069539c0
> [ =A0 71.195806] Call Trace:
> [ =A0 71.195810] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.195816] =A0[<ffffffff81199a5b>] print_bad_pte+0x1bb/0x2= 80
> [ =A0 71.195820] =A0[<ffffffff8119ad68>] unmap_single_vma+0x8c8/= 0x910
> [ =A0 71.195827] =A0[<ffffffff81040a69>] ? xen_pte_unlock+0x9/0x= 10
> [ =A0 71.195832] =A0[<ffffffff8119adfc>] unmap_vmas+0x4c/0xa0 > [ =A0 71.195839] =A0[<ffffffff811a2920>] exit_mmap+0x90/0x160 > [ =A0 71.195843] =A0[<ffffffff816f5f13>] ? _raw_spin_lock_irqsav= e+0x13/0x60
> [ =A0 71.195849] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.195854] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.195858] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.195863] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.195870] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.195875] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
> [ =A0 71.195880] BUG: Bad page map in process iscsid =A0pte:39b24120 p= md:06953067
> [ =A0 71.195884] page:ffffea0000c9efe0 count:2 mapcount:-1 mapping:fff= f88003a536490 index:0x1ca
> [ =A0 71.195888] page flags: 0x100000000080038(uptodate|dirty|lru|swap= backed)
> [ =A0 71.195895] page dumped because: bad pte
> [ =A0 71.195898] addr:00007fb105d39000 vm_flags:00000070 anon_vma: =A0= =A0 =A0 =A0 =A0(null) mapping:ffff880032006970 index:e
> [ =A0 71.195904] vma->vm_ops->fault: shmem_fault+0x0/0x70
> [ =A0 71.195908] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x3= 0
> [ =A0 71.195912] CPU: 0 PID: 2296 Comm: iscsid Tainted: G =A0 =A0B =A0= =A0 =A0 =A03.14.0-rc4upstream #1
> [ =A0 71.195916] =A000007fb105d39000 ffff880030ff3c28 ffffffff816f0e59= 0000000000000000
> [ =A0 71.195923] =A0ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b= 000000000000058e
> [ =A0 71.195929] =A00720072007200720 ffff880030ff3c58 00007fb105d39000= ffff8800069539c8
> [ =A0 71.195935] Call Trace:
> [ =A0 71.195939] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.195944] =A0[<ffffffff81199a5b>] print_bad_pte+0x1bb/0x2= 80
> [ =A0 71.195948] =A0[<ffffffff8119ad68>] unmap_single_vma+0x8c8/= 0x910
> [ =A0 71.195953] =A0[<ffffffff81040a69>] ? xen_pte_unlock+0x9/0x= 10
> [ =A0 71.195958] =A0[<ffffffff8119adfc>] unmap_vmas+0x4c/0xa0 > [ =A0 71.195963] =A0[<ffffffff811a2920>] exit_mmap+0x90/0x160 > [ =A0 71.195967] =A0[<ffffffff816f5f13>] ? _raw_spin_lock_irqsav= e+0x13/0x60
> [ =A0 71.195973] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.195977] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.195982] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.195987] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.195992] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.195997] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
> [ =A0 71.196001] BUG: Bad page map in process iscsid =A0pte:39b25120 p= md:06953067
> [ =A0 71.196005] page:ffffea0000c9f018 count:2 mapcount:-1 mapping:fff= f88003a536490 index:0x1cb
> [ =A0 71.362165] page flags: 0x100000000080038(uptodate|dirty|lru|swap= backed)
> [ =A0 71.362172] page dumped because: bad pte
> [ =A0 71.362175] addr:00007fb105d3a000 vm_flags:00000070 anon_vma: =A0= =A0 =A0 =A0 =A0(null) mapping:ffff880032006970 index:f
> [ =A0 71.362181] vma->vm_ops->fault: shmem_fault+0x0/0x70
> [ =A0 71.362185] vma->vm_file->f_op->mmap: shmem_mmap+0x0/0x3= 0
> [ =A0 71.362193] CPU: 0 PID: 2296 Comm: iscsid Tainted: G =A0 =A0B =A0= =A0 =A0 =A03.14.0-rc4upstream #1
> [ =A0 71.362197] =A000007fb105d3a000 ffff880030ff3c28 ffffffff816f0e59= 0000000000000000
> [ =A0 71.362206] =A0ffff8800302f8378 ffff880030ff3c78 ffffffff81199a5b= 00000000000005a7
> [ =A0 71.362212] =A00720072007200720 ffff880030ff3c58 00007fb105d3a000= ffff8800069539d0
> [ =A0 71.362221] Call Trace:
> [ =A0 71.362225] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.362230] =A0[<ffffffff81199a5b>] print_bad_pte+0x1bb/0x2= 80
> [ =A0 71.362241] =A0[<ffffffff8119ad68>] unmap_single_vma+0x8c8/= 0x910
> [ =A0 71.362247] =A0[<ffffffff81040a69>] ? xen_pte_unlock+0x9/0x= 10
> [ =A0 71.362254] =A0[<ffffffff8119adfc>] unmap_vmas+0x4c/0xa0 > [ =A0 71.362258] =A0[<ffffffff811a2920>] exit_mmap+0x90/0x160 > [ =A0 71.362263] =A0[<ffffffff816f5f13>] ? _raw_spin_lock_irqsav= e+0x13/0x60
> [ =A0 71.362270] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.362276] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.362282] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.362287] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.362292] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.362297] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
> [ =A0 71.364639] BUG: Bad page state in process iscsid =A0pfn:39b25 > [ =A0 71.364651] page:ffffea0000c9f018 count:0 mapcount:-1 mapping:fff= f88003a536490 index:0x1cb
> [ =A0 71.364656] page flags: 0x100000000080018(uptodate|dirty|swapback= ed)
> [ =A0 71.364663] page dumped because: non-NULL mapping
> [ =A0 71.364666] Modules linked in: dm_multipath dm_mod xen_evtchn isc= si_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi scsi_mod= libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm drm_kms= _helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt sysfill= rect syscopyarea xen_kbdfront xenfs xen_privcmd
> [ =A0 71.364706] CPU: 0 PID: 2296 Comm: iscsid Tainted: G =A0 =A0B =A0= =A0 =A0 =A03.14.0-rc4upstream #1
> [ =A0 71.364711] =A0ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59= ffffffff8197f00f
> [ =A0 71.364718] =A0ffffea0000c9f018 ffff880030ff3be8 ffffffff811751a0= ffff880030ff3c48
> [ =A0 71.364724] =A00000000000000001 ffffea0000c9f018 0000000000000000= ffff880030ff3c48
> [ =A0 71.364733] Call Trace:
> [ =A0 71.364739] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.364748] =A0[<ffffffff811751a0>] bad_page+0xd0/0x120
> [ =A0 71.364753] =A0[<ffffffff81175335>] free_pages_prepare+0x14= 5/0x160
> [ =A0 71.364760] =A0[<ffffffff81041642>] ? xen_pte_val+0x32/0x40=
> [ =A0 71.364768] =A0[<ffffffff8117993b>] free_hot_cold_page+0x3b= /0x150
> [ =A0 71.364773] =A0[<ffffffff81179fc7>] free_hot_cold_page_list= +0x47/0xb0
> [ =A0 71.364780] =A0[<ffffffff8117e3ad>] release_pages+0x7d/0x23= 0
> [ =A0 71.364785] =A0[<ffffffff811b04c4>] free_pages_and_swap_cac= he+0xb4/0xe0
> [ =A0 71.364791] =A0[<ffffffff81099507>] ? flush_tlb_mm_range+0x= 57/0x1b0
> [ =A0 71.364798] =A0[<ffffffff81199cb7>] tlb_flush_mmu+0x57/0xa0=
> [ =A0 71.364803] =A0[<ffffffff81199d0f>] tlb_finish_mmu+0xf/0x40=
> [ =A0 71.364810] =A0[<ffffffff811a2947>] exit_mmap+0xb7/0x160 > [ =A0 71.364815] =A0[<ffffffff816f5f12>] ? _raw_spin_lock_irqsav= e+0x12/0x60
> [ =A0 71.364820] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.364825] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.364830] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.364835] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.364842] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.364848] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
> [ =A0 71.364854] BUG: Bad page state in process iscsid =A0pfn:39b24 > [ =A0 71.364858] page:ffffea0000c9efe0 count:0 mapcount:-1 mapping:fff= f88003a536490 index:0x1ca
> [ =A0 71.364863] page flags: 0x100000000080018(uptodate|dirty|swapback= ed)
> [ =A0 71.364871] page dumped because: non-NULL mapping
> [ =A0 71.364874] Modules linked in: dm_multipath dm_mod xen_evtchn isc= si_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi scsi_mod= libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm drm_kms= _helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt sysfill= rect syscopyarea xen_kbdfront xenfs xen_privcmd
> [ =A0 71.364906] CPU: 0 PID: 2296 Comm: iscsid Tainted: G =A0 =A0B =A0= =A0 =A0 =A03.14.0-rc4upstream #1
> [ =A0 71.364913] =A0ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59= ffffffff8197f00f
> [ =A0 71.364919] =A0ffffea0000c9efe0 ffff880030ff3be8 ffffffff811751a0= ffff880030ff3c48
> [ =A0 71.364925] =A00000000000000001 ffffea0000c9efe0 0000000000000000= ffff880030ff3c48
> [ =A0 71.364933] Call Trace:
> [ =A0 71.364938] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.364945] =A0[<ffffffff811751a0>] bad_page+0xd0/0x120
> [ =A0 71.364950] =A0[<ffffffff81175335>] free_pages_prepare+0x14= 5/0x160
> [ =A0 71.364955] =A0[<ffffffff81041642>] ? xen_pte_val+0x32/0x40=
> [ =A0 71.364960] =A0[<ffffffff8117993b>] free_hot_cold_page+0x3b= /0x150
> [ =A0 71.364965] =A0[<ffffffff81179fc7>] free_hot_cold_page_list= +0x47/0xb0
> [ =A0 71.364970] =A0[<ffffffff8117e3ad>] release_pages+0x7d/0x23= 0
> [ =A0 71.364975] =A0[<ffffffff811b04c4>] free_pages_and_swap_cac= he+0xb4/0xe0
> [ =A0 71.364982] =A0[<ffffffff81099507>] ? flush_tlb_mm_range+0x= 57/0x1b0
> [ =A0 71.364987] =A0[<ffffffff81199cb7>] tlb_flush_mmu+0x57/0xa0=
> [ =A0 71.364994] =A0[<ffffffff81199d0f>] tlb_finish_mmu+0xf/0x40=
> [ =A0 71.364999] =A0[<ffffffff811a2947>] exit_mmap+0xb7/0x160 > [ =A0 71.365004] =A0[<ffffffff816f5f12>] ? _raw_spin_lock_irqsav= e+0x12/0x60
> [ =A0 71.365009] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.365015] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.365020] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.365025] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.365030] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.365035] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
> [ =A0 71.365039] BUG: Bad page state in process iscsid =A0pfn:39b23 > [ =A0 71.365043] page:ffffea0000c9efa8 count:0 mapcount:-1 mapping:fff= f88003a536490 index:0x1c9
> [ =A0 71.365047] page flags: 0x100000000080018(uptodate|dirty|swapback= ed)
> [ =A0 71.365074] page dumped because: non-NULL mapping
> [ =A0 71.365077] Modules linked in: dm_multipath dm_mod xen_evtchn isc= si_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi scsi_mod= libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm drm_kms= _helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt sysfill= rect syscopyarea xen_kbdfront xenfs xen_privcmd
> [ =A0 71.365104] CPU: 0 PID: 2296 Comm: iscsid Tainted: G =A0 =A0B =A0= =A0 =A0 =A03.14.0-rc4upstream #1
> [ =A0 71.365109] =A0ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59= ffffffff8197f00f
> [ =A0 71.365115] =A0ffffea0000c9efa8 ffff880030ff3be8 ffffffff811751a0= ffff880030ff3c48
> [ =A0 71.365121] =A00000000000000001 ffffea0000c9efa8 0000000000000000= ffff880030ff3c48
> [ =A0 71.365127] Call Trace:
> [ =A0 71.365131] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.365136] =A0[<ffffffff811751a0>] bad_page+0xd0/0x120
> [ =A0 71.365141] =A0[<ffffffff81175335>] free_pages_prepare+0x14= 5/0x160
> [ =A0 71.365146] =A0[<ffffffff81041642>] ? xen_pte_val+0x32/0x40=
> [ =A0 71.365151] =A0[<ffffffff8117993b>] free_hot_cold_page+0x3b= /0x150
> [ =A0 71.365155] =A0[<ffffffff81179fc7>] free_hot_cold_page_list= +0x47/0xb0
> [ =A0 71.365160] =A0[<ffffffff8117e3ad>] release_pages+0x7d/0x23= 0
> [ =A0 71.365165] =A0[<ffffffff811b04c4>] free_pages_and_swap_cac= he+0xb4/0xe0
> [ =A0 71.365170] =A0[<ffffffff81099507>] ? flush_tlb_mm_range+0x= 57/0x1b0
> [ =A0 71.365175] =A0[<ffffffff81199cb7>] tlb_flush_mmu+0x57/0xa0=
> [ =A0 71.365180] =A0[<ffffffff81199d0f>] tlb_finish_mmu+0xf/0x40=
> [ =A0 71.562344] =A0[<ffffffff811a2947>] exit_mmap+0xb7/0x160 > [ =A0 71.562349] =A0[<ffffffff816f5f12>] ? _raw_spin_lock_irqsav= e+0x12/0x60
> [ =A0 71.562354] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.562359] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.562364] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.562369] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.562379] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.562387] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
> [ =A0 71.562391] BUG: Bad page state in process iscsid =A0pfn:39b22 > [ =A0 71.562395] page:ffffea0000c9ef70 count:0 mapcount:-1 mapping:fff= f88003a536490 index:0x1c8
> [ =A0 71.562399] page flags: 0x100000000080018(uptodate|dirty|swapback= ed)
> [ =A0 71.562413] page dumped because: non-NULL mapping
> [ =A0 71.562420] Modules linked in: dm_multipath dm_mod xen_evtchn isc= si_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi scsi_mod= libcrc32c crc32c fbcon tileblit font radeon bitblit softcursor ttm drm_kms= _helper xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt sysfill= rect syscopyarea xen_kbdfront xenfs xen_privcmd
> [ =A0 71.562456] CPU: 0 PID: 2296 Comm: iscsid Tainted: G =A0 =A0B =A0= =A0 =A0 =A03.14.0-rc4upstream #1
> [ =A0 71.562461] =A0ffffffff8197f00f ffff880030ff3bb8 ffffffff816f0e59= ffffffff8197f00f
> [ =A0 71.562467] =A0ffffea0000c9ef70 ffff880030ff3be8 ffffffff811751a0= ffff880030ff3c48
> [ =A0 71.562476] =A00000000000000001 ffffea0000c9ef70 0000000000000000= ffff880030ff3c48
> [ =A0 71.562486] Call Trace:
> [ =A0 71.562490] =A0[<ffffffff816f0e59>] dump_stack+0x51/0x6b > [ =A0 71.562495] =A0[<ffffffff811751a0>] bad_page+0xd0/0x120
> [ =A0 71.562500] =A0[<ffffffff81175335>] free_pages_prepare+0x14= 5/0x160
> [ =A0 71.562515] =A0[<ffffffff81041642>] ? xen_pte_val+0x32/0x40=
> [ =A0 71.562520] =A0[<ffffffff8117993b>] free_hot_cold_page+0x3b= /0x150
> [ =A0 71.562525] =A0[<ffffffff81179fc7>] free_hot_cold_page_list= +0x47/0xb0
> [ =A0 71.562535] =A0[<ffffffff8117e3ad>] release_pages+0x7d/0x23= 0
> [ =A0 71.562544] =A0[<ffffffff811b04c4>] free_pages_and_swap_cac= he+0xb4/0xe0
> [ =A0 71.562550] =A0[<ffffffff81099507>] ? flush_tlb_mm_range+0x= 57/0x1b0
> [ =A0 71.562555] =A0[<ffffffff81199cb7>] tlb_flush_mmu+0x57/0xa0=
> [ =A0 71.562561] =A0[<ffffffff81199d0f>] tlb_finish_mmu+0xf/0x40=
> [ =A0 71.562568] =A0[<ffffffff811a2947>] exit_mmap+0xb7/0x160 > [ =A0 71.562579] =A0[<ffffffff816f5f12>] ? _raw_spin_lock_irqsav= e+0x12/0x60
> [ =A0 71.562584] =A0[<ffffffff8109d672>] mmput+0x52/0x100
> [ =A0 71.562594] =A0[<ffffffff810a186c>] do_exit+0x29c/0xb90
> [ =A0 71.562603] =A0[<ffffffff810a3349>] ? SyS_wait4+0xa9/0xf0 > [ =A0 71.562608] =A0[<ffffffff810a2271>] do_group_exit+0x51/0x13= 0
> [ =A0 71.562613] =A0[<ffffffff810a2362>] SyS_exit_group+0x12/0x2= 0
> [ =A0 71.562617] =A0[<ffffffff816fe7f9>] system_call_fastpath+0x= 16/0x1b
>
> Sent SIGKILL to all processes
>
> Requesting system poweroff
> [ =A0 73.375423] reboot: System halted


Nice, I will also look at this. I ha= ve not tested the above mentioned patch with migration though.

--
Elena
--001a113330b2d35e8804f36ee2a8-- --===============5251542664070070604== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============5251542664070070604==--