From mboxrd@z Thu Jan 1 00:00:00 1970 From: Boris Derzhavets Subject: Re: Re: 2.6.37-rc1 mainline domU - BUG: unable to handle kernel paging request Date: Thu, 11 Nov 2010 08:46:46 -0800 (PST) Message-ID: <300656.39981.qm@web56102.mail.re3.yahoo.com> References: <20101111160924.GA28059@dumpdata.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1100428607==" Return-path: In-Reply-To: <20101111160924.GA28059@dumpdata.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: Konrad Rzeszutek Wilk Cc: Jeremy Fitzhardinge , xen-devel@lists.xensource.com, Bruce Edge List-Id: xen-devel@lists.xenproject.org --===============1100428607== Content-Type: multipart/alternative; boundary="0-338107063-1289494006=:39981" --0-338107063-1289494006=:39981 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable This time to reproduce crash=A0 `ls -l` was not enough , but similar stack = trace comes up sooner or later : root@boris-HVM-domU:~# mount=A0 192.168.1.9:/home/boris=A0=A0=A0=A0 /mnt/tm= p . . . . . .=20 CRASH :- root@boris-HVM-domU:~# cp /mnt/tmp/*.iso . BUG: unable to handle kernel paging request at ffff88006f3824f0 IP: [] do_wp_page+0x597/0x6fa PGD 1a04067 PUD f57b067 PMD f6f5067 PTE 801000006f382065 Oops: 0003 [#1] SMP=20 last sysfs file: /sys/devices/virtual/bdi/0:22/uevent CPU 0=20 Modules linked in: nfs fscache parport_pc ppdev nfsd lockd nfs_acl auth_rpc= gss sunrpc exportfs ipv6 lp parport Pid: 3533, comm: bash Not tainted 2.6.37-rc1 #1 / RIP: e030:[]=A0 [] do_wp_page+0x597/0x6= fa RSP: e02b:ffff880077b25cd8=A0 EFLAGS: 00010246 RAX: 0000000000000000 RBX: ffffea000034dcf8 RCX: 0000000000000001 RDX: 8000000162e88065 RSI: ffffffff81c3d050 RDI: ffff88006d3e6100 RBP: ffff880077b25d68 R08: 0000000000000100 R09: 0000000000000041 R10: ffff880077b25a78 R11: ffff88006d3e6100 R12: ffffea0000277030 R13: ffff88006f3824f0 R14: ffff88006d3e6100 R15: ffff88006f0b34d8 FS:=A0 00007fc18508b700(0000) GS:ffff88007ffbd000(0000) knlGS:0000000000000= 000 CS:=A0 e033 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffff88006f3824f0 CR3: 000000007a103000 CR4: 0000000000002660 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process bash (pid: 3533, threadinfo ffff880077b24000, task ffff88006f0ee2c0= ) Stack: =A0ffff880077b25cf8 ffffffff81007c31 ffffea0001854480 0000000000000000 =A001ff880077b25d48 ffffea0001854480 8000000162e88067 00007fc18509e9a8 =A000007fc18508b9d0 ffff88006f0b34d8 ffff88006f3a2140 ffff88006d3e6100 Call Trace: =A0[] ? __spin_time_accum+0x21/0x37 =A0[] handle_mm_fault+0x9b1/0xa05 =A0[] do_page_fault+0x387/0x3a9 =A0[] ? xen_restore_fl_direct_end+0x0/0x1 =A0[] ? xen_mc_flush+0x1cd/0x1f2 =A0[] ? xen_clts+0x33/0x59 =A0[] ? xen_spin_unlock+0x11/0x30 =A0[] ? finish_task_switch+0x4f/0xc5 =A0[] ? __might_sleep+0x23/0xea =A0[] page_fault+0x25/0x30 Code: 48 c1 e7 0c 48 09 c7 ff 14 25 28 28 a1 81 48 89 c2 48 83 c8 42 49 8b = 3f 48 83 ca 40 41 f6 47 30 02 48 0f 44 c2 48 89 45 a0 31 c0 <49> 87 45 00 4= 8 8b 75 a8 4c 89 ea 0f 1f 80 00 00 00 00 48 8b 75=20 RIP=A0 [] do_wp_page+0x597/0x6fa =A0RSP CR2: ffff88006f3824f0 ---[ end trace 69a76296779698ff ]--- Boris. --- On Thu, 11/11/10, Konrad Rzeszutek Wilk wrote: From: Konrad Rzeszutek Wilk Subject: Re: [Xen-devel] Re: 2.6.37-rc1 mainline domU - BUG: unable to hand= le kernel paging request To: "Boris Derzhavets" Cc: "Jeremy Fitzhardinge" , xen-devel@lists.xensource.com,= "Bruce Edge" Date: Thursday, November 11, 2010, 11:09 AM On Thu, Nov 11, 2010 at 04:08:03AM -0800, Boris Derzhavets wrote: > Now reproduced :- >=20 > root@boris-HVM-domU:~# scp=A0 1.log 192.168.1.12:/home/boris/ubuntu > BUG: unable to handle kernel paging request at ffff88000e676930 > IP: [] xen_set_pmd+0x24/0x44 > PGD 1a04067 PUD 1a08067 PMD ee73067 PTE 801000000e676065 > Oops: 0003 [#1] SMP=20 > last sysfs file: /sys/devices/virtual/bdi/0:22/uevent > CPU 0=20 > Modules linked in: nfs fscache parport_pc ppdev nfsd lockd nfs_acl auth_r= pcgss sunrpc exportfs ipv6 lp parport >=20 > Pid: 3534, comm: scp Not tainted 2.6.37-rc1 #1 / Yikes. So no PCI passthrough, just a normal PV DomU. Boris, what version of Linux kernel worked for you as PV DomU? 2.6.36? 2.6.= 35? > RIP: e030:[]=A0 [] xen_set_pmd+0x24/0= x44 > RSP: e02b:ffff88006e697b18=A0 EFLAGS: 00010246 > RAX: 0000000000000000 RBX: ffff88000e676930 RCX: ffffc00000000f98 > RDX: ffffea0000000000 RSI: 0000000000000000 RDI: ffff88000e676930 > RBP: ffff88006e697b28 R08: 00007fff9d120000 R09: ffff88007ffc80a0 > R10: 0000000000000000 R11: ffff88006e697ae8 R12: 0000000000000000 > R13: ffff88007ffcb140 R14: ffff88000e676930 R15: ffff88006f08d7f8 > FS:=A0 00007fa525896700(0000) GS:ffff88007ffbd000(0000) knlGS:00000000000= 00000 > CS:=A0 e033 DS: 0000 ES: 0000 CR0: 000000008005003b > CR2: ffff88000e676930 CR3: 0000000077b0f000 CR4: 0000000000002660 > DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 > DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 > Process scp (pid: 3534, threadinfo ffff88006e696000, task ffff88007a32c2c= 0) > Stack: > =A000007fa524e00000 00007fa525b37000 ffff88006e697be8 ffffffff810dc4a4 > =A0ffff88007a26ac88 ffff88006e690298 ffff88007a26ac78 00007fa524a00000 > =A000007f8000000000 00007fff80000000 00007fa525b36fff 00007fa525b36fff > Call Trace: > =A0[] free_pgd_range+0x213/0x397 > =A0[] free_pgtables+0xa4/0xc7 > =A0[] exit_mmap+0xf2/0x12a > =A0[] mmput+0x5e/0xd1 > =A0[] flush_old_exec+0x526/0x600 > =A0[] load_elf_binary+0x2dc/0x1752 > =A0[] ? load_misc_binary+0x6e/0x367 > =A0[] ? ima_must_measure+0x21/0x2b > =A0[] ? process_measurement+0x56/0xe4 > =A0[] search_binary_handler+0xbb/0x24d > =A0[] ? load_elf_binary+0x0/0x1752 > =A0[] do_execve+0x1c1/0x2ae > =A0[] sys_execve+0x3e/0x55 > =A0[] stub_execve+0x6c/0xc0 > Code: 48 83 c4 18 5b c9 c3 55 48 89 e5 41 54 49 89 f4 53 48 89 fb e8 b5 e= 4 ff ff 48 89 df ff 05 3e 55 c3 00 e8 d5 dd ff ff 84 c0 75 05 <4c> 89 23 eb= 16 e8 99 e4 ff ff 4c 89 e6 48 89 df ff 05 23 55 c3=20 > RIP=A0 [] xen_set_pmd+0x24/0x44 > =A0RSP > CR2: ffff88000e676930 > ---[ end trace 073da74f4ce02315 ]--- > lost connection _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel =0A=0A=0A --0-338107063-1289494006=:39981 Content-Type: text/html; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable
This time to reproduce crash  `ls -l` wa= s not enough , but similar stack trace comes up sooner or later :

ro= ot@boris-HVM-domU:~# mount  192.168.1.9:/home/boris   &= nbsp; /mnt/tmp
. . . . . .

CRASH :-

root@boris-HVM-domU:~= # cp /mnt/tmp/*.iso .
BUG: unable to handle kernel paging request at fff= f88006f3824f0
IP: [<ffffffff810dd0c3>] do_wp_page+0x597/0x6fa
P= GD 1a04067 PUD f57b067 PMD f6f5067 PTE 801000006f382065
Oops: 0003 [#1] = SMP
last sysfs file: /sys/devices/virtual/bdi/0:22/uevent
CPU 0
= Modules linked in: nfs fscache parport_pc ppdev nfsd lockd nfs_acl auth_rpc= gss sunrpc exportfs ipv6 lp parport

Pid: 3533, comm: bash Not tainte= d 2.6.37-rc1 #1 /
RIP: e030:[<ffffffff810dd0c3>]  [<ffffff= ff810dd0c3>] do_wp_page+0x597/0x6fa
RSP: e02b:ffff880077b25cd8  EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffffea000034dcf8 RCX: 00000= 00000000001
RDX: 8000000162e88065 RSI: ffffffff81c3d050 RDI: ffff88006d3= e6100
RBP: ffff880077b25d68 R08: 0000000000000100 R09: 0000000000000041<= br>R10: ffff880077b25a78 R11: ffff88006d3e6100 R12: ffffea0000277030
R13= : ffff88006f3824f0 R14: ffff88006d3e6100 R15: ffff88006f0b34d8
FS: = 00007fc18508b700(0000) GS:ffff88007ffbd000(0000) knlGS:0000000000000000CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffff88006f3= 824f0 CR3: 000000007a103000 CR4: 0000000000002660
DR0: 0000000000000000 = DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 0= 0000000ffff0ff0 DR7: 0000000000000400
Process bash (pid: 3533, threadinf= o ffff880077b24000, task ffff88006f0ee2c0)
Stack:
 ffff880077b25= cf8 ffffffff81007c31 ffffea0001854480 0000000000000000
 01ff880077b= 25d48 ffffea0001854480 8000000162e88067 00007fc18509e9a8
 00007fc18508b9d0 ffff88006f0b34d8 ffff88006f3a21= 40 ffff88006d3e6100
Call Trace:
 [<ffffffff81007c31>] ? __= spin_time_accum+0x21/0x37
 [<ffffffff810ddbd7>] handle_mm_fau= lt+0x9b1/0xa05
 [<ffffffff8145665a>] do_page_fault+0x387/0x3a= 9
 [<ffffffff810072af>] ? xen_restore_fl_direct_end+0x0/0x1 [<ffffffff81004274>] ? xen_mc_flush+0x1cd/0x1f2
 [<= ;ffffffff81003e5f>] ? xen_clts+0x33/0x59
 [<ffffffff81007bf1&= gt;] ? xen_spin_unlock+0x11/0x30
 [<ffffffff81045a6f>] ? fini= sh_task_switch+0x4f/0xc5
 [<ffffffff8103d0a9>] ? __might_slee= p+0x23/0xea
 [<ffffffff81453715>] page_fault+0x25/0x30
Cod= e: 48 c1 e7 0c 48 09 c7 ff 14 25 28 28 a1 81 48 89 c2 48 83 c8 42 49 8b 3f = 48 83 ca 40 41 f6 47 30 02 48 0f 44 c2 48 89 45 a0 31 c0 <49> 87 45 0= 0 48 8b 75 a8 4c 89 ea 0f 1f 80 00 00 00 00 48 8b 75
RIP  [<ffffffff810dd0c3>] do_wp_page+0x597/0x6fa
 RSP <ffff880= 077b25cd8>
CR2: ffff88006f3824f0
---[ end trace 69a76296779698ff ]= ---

Boris.

--- On Thu, 11/11/10, Konrad Rzeszutek Wilk = <konrad.wilk@oracle.com> wrote:
<= br>From: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Subject: R= e: [Xen-devel] Re: 2.6.37-rc1 mainline domU - BUG: unable to handle kernel = paging request
To: "Boris Derzhavets" <bderzhavets@yahoo.com>
C= c: "Jeremy Fitzhardinge" <jeremy@goop.org>, xen-devel@lists.xensource= .com, "Bruce Edge" <bruce.edge@gmail.com>
Date: Thursday, November= 11, 2010, 11:09 AM

On Thu, Nov 11, 2010 at= 04:08:03AM -0800, Boris Derzhavets wrote:
> Now reproduced :-
>= ;
> root@boris-HVM-domU:~# scp  1.log 192.168.1.12:/home/boris/ubuntu
> BUG: unable to handle kernel pagin= g request at ffff88000e676930
> IP: [<ffffffff810069c3>] xen_se= t_pmd+0x24/0x44
> PGD 1a04067 PUD 1a08067 PMD ee73067 PTE 801000000e6= 76065
> Oops: 0003 [#1] SMP
> last sysfs file: /sys/devices/vi= rtual/bdi/0:22/uevent
> CPU 0
> Modules linked in: nfs fscache= parport_pc ppdev nfsd lockd nfs_acl auth_rpcgss sunrpc exportfs ipv6 lp pa= rport
>
> Pid: 3534, comm: scp Not tainted 2.6.37-rc1 #1 /
=
Yikes. So no PCI passthrough, just a normal PV DomU.

Boris, what= version of Linux kernel worked for you as PV DomU? 2.6.36? 2.6.35?

= > RIP: e030:[<ffffffff810069c3>]  [<ffffffff810069c3>] = xen_set_pmd+0x24/0x44
> RSP: e02b:ffff88006e697b18  EFLAGS: 0001= 0246
> RAX: 0000000000000000 RBX: ffff88000e676930 RCX: ffffc00000000= f98
> RDX: ffffea0000000000 RSI: 0000000000000000 RDI: ffff88000e676930
> RBP: ffff88006e697b28 R08: 00007fff9d120000 R09: = ffff88007ffc80a0
> R10: 0000000000000000 R11: ffff88006e697ae8 R12: 0= 000000000000000
> R13: ffff88007ffcb140 R14: ffff88000e676930 R15: ff= ff88006f08d7f8
> FS:  00007fa525896700(0000) GS:ffff88007ffbd000= (0000) knlGS:0000000000000000
> CS:  e033 DS: 0000 ES: 0000 CR0:= 000000008005003b
> CR2: ffff88000e676930 CR3: 0000000077b0f000 CR4: = 0000000000002660
> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0= 000000000000000
> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 00= 00000000000400
> Process scp (pid: 3534, threadinfo ffff88006e696000,= task ffff88007a32c2c0)
> Stack:
>  00007fa524e00000 00007= fa525b37000 ffff88006e697be8 ffffffff810dc4a4
>  ffff88007a26ac8= 8 ffff88006e690298 ffff88007a26ac78 00007fa524a00000
>  00007f80= 00000000 00007fff80000000 00007fa525b36fff 00007fa525b36fff
> Call Trace:
>  [<ffffffff810dc4a4>] free_pgd_range+0x213/= 0x397
>  [<ffffffff810dc6cc>] free_pgtables+0xa4/0xc7
&= gt;  [<ffffffff810dfd82>] exit_mmap+0xf2/0x12a
>  [&l= t;ffffffff8104a7c5>] mmput+0x5e/0xd1
>  [<ffffffff8110694b= >] flush_old_exec+0x526/0x600
>  [<ffffffff8113e006>] l= oad_elf_binary+0x2dc/0x1752
>  [<ffffffff8113b687>] ? load= _misc_binary+0x6e/0x367
>  [<ffffffff811dcee4>] ? ima_must= _measure+0x21/0x2b
>  [<ffffffff811dc7d6>] ? process_measu= rement+0x56/0xe4
>  [<ffffffff81106195>] search_binary_han= dler+0xbb/0x24d
>  [<ffffffff8113dd2a>] ? load_elf_binary+= 0x0/0x1752
>  [<ffffffff8110785d>] do_execve+0x1c1/0x2ae>  [<ffffffff810119e5>] sys_execve+0x3e/0x55
>  = [<ffffffff8100af9c>] stub_execve+0x6c/0xc0
> Code: 48 83 c4 18 5b c9 c3 55 48 89 e5 41 54 49 89 f4 53 48 89 fb e8 b5 e4 ff ff 48 89= df ff 05 3e 55 c3 00 e8 d5 dd ff ff 84 c0 75 05 <4c> 89 23 eb 16 e8 = 99 e4 ff ff 4c 89 e6 48 89 df ff 05 23 55 c3
> RIP  [<ffffff= ff810069c3>] xen_set_pmd+0x24/0x44
>  RSP <ffff88006e697b1= 8>
> CR2: ffff88000e676930
> ---[ end trace 073da74f4ce02315= ]---
> lost connection

______________________________________= _________
Xen-devel mailing list
Xen= -devel@lists.xensource.com
http://lists.xensource.com/xen-devel

=0A=0A=0A=0A=0A=0A=0A=0A --0-338107063-1289494006=:39981-- --===============1100428607== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel --===============1100428607==--