From: Yinghai Lu <yinghai@kernel.org> To: Sasha Levin <levinsasha928@gmail.com> Cc: Tejun Heo <tj@kernel.org>, Andrew Morton <akpm@linux-foundation.org>, David Miller <davem@davemloft.net>, hpa@linux.intel.com, linux-mm <linux-mm@kvack.org>, "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org> Subject: Re: Early boot panic on machine with lots of memory Date: Thu, 14 Jun 2012 16:57:18 -0700 [thread overview] Message-ID: <CAE9FiQVXxnjccSErjrZ9B-APGf5ZpKNovJwr5vNBMr1G2f8Y4Q@mail.gmail.com> (raw) In-Reply-To: <1339709672.3321.11.camel@lappy> On Thu, Jun 14, 2012 at 2:34 PM, Sasha Levin <levinsasha928@gmail.com> wrote: > On Thu, 2012-06-14 at 13:56 -0700, Yinghai Lu wrote: >> On Thu, Jun 14, 2012 at 2:50 AM, Sasha Levin <levinsasha928@gmail.com> wrote: >> > On Thu, 2012-06-14 at 12:20 +0900, Tejun Heo wrote: >> >> On Wed, Jun 13, 2012 at 11:38:55PM +0200, Sasha Levin wrote: >> >> > Hi all, >> >> > >> >> > I'm seeing the following when booting a KVM guest with 65gb of RAM, on latest linux-next. >> >> > >> >> > Note that it happens with numa=off. >> >> > >> >> > [ 0.000000] BUG: unable to handle kernel paging request at ffff88102febd948 >> >> > [ 0.000000] IP: [<ffffffff836a6f37>] __next_free_mem_range+0x9b/0x155 >> >> >> >> Can you map it back to the source line please? >> > >> > mm/memblock.c:583 >> > >> > phys_addr_t r_start = ri ? r[-1].base + r[-1].size : 0; >> > 97: 85 d2 test %edx,%edx >> > 99: 74 08 je a3 <__next_free_mem_range+0xa3> >> > 9b: 49 8b 48 f0 mov -0x10(%r8),%rcx >> > 9f: 49 03 48 e8 add -0x18(%r8),%rcx >> > >> > It's the deref on 9b (r8=ffff88102febd958). >> >> that reserved.region is allocated by memblock. >> >> can you boot with "memblock=debug debug ignore_loglevel" and post >> whole boot log? > > Attached below. I've also noticed it doesn't always happen, but > increasing the vcpu count (to something around 254) makes it happen > almost every time. > ... [ 0.000000] memblock: reserved array is doubled to 512 at [0x102febc080-0x102febf07f] [ 0.000000] memblock_free: [0x0000102febf080-0x0000102fec0880] memblock_double_array+0x1b0/0x1e2 [ 0.000000] memblock_reserve: [0x0000102febc080-0x0000102febf080] memblock_double_array+0x1c5/0x1e2 the reserved regions get double two times to 512. .... > [ 0.000000] memblock_free: [0x0000102febc080-0x0000102febf080] memblock_free_reserved_regions+0x37/0x39 > [ 0.000000] BUG: unable to handle kernel paging request at ffff88102febd948 > [ 0.000000] IP: [<ffffffff836a5774>] __next_free_mem_range+0x9b/0x155 > [ 0.000000] PGD 4826063 PUD cf67a067 PMD cf7fa067 PTE 800000102febd160 that page table for them is [ 0.000000] kernel direct mapping tables up to 0x102fffffff @ [mem 0xc7e3e000-0xcfffffff] [ 0.000000] memblock_reserve: [0x000000c7e3e000-0x000000cf7fb000] native_pagetable_reserve+0xc/0xe only near by allocation is swiotlb. [ 0.000000] __ex_table already sorted, skipping sort [ 0.000000] memblock_reserve: [0x000000c3e3e000-0x000000c7e3e000] __alloc_memory_core_early+0x5c/0x73 ... [ 0.000000] memblock_reserve: [0x000000cfff8000-0x000000d0000000] __alloc_memory_core_early+0x5c/0x73 [ 0.000000] Checking aperture... so the memblock allocation is ok... can you please boot with "memtest" to see if there is any memory problem? Thanks Yinghai
WARNING: multiple messages have this Message-ID (diff)
From: Yinghai Lu <yinghai@kernel.org> To: Sasha Levin <levinsasha928@gmail.com> Cc: Tejun Heo <tj@kernel.org>, Andrew Morton <akpm@linux-foundation.org>, David Miller <davem@davemloft.net>, hpa@linux.intel.com, linux-mm <linux-mm@kvack.org>, "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org> Subject: Re: Early boot panic on machine with lots of memory Date: Thu, 14 Jun 2012 16:57:18 -0700 [thread overview] Message-ID: <CAE9FiQVXxnjccSErjrZ9B-APGf5ZpKNovJwr5vNBMr1G2f8Y4Q@mail.gmail.com> (raw) In-Reply-To: <1339709672.3321.11.camel@lappy> On Thu, Jun 14, 2012 at 2:34 PM, Sasha Levin <levinsasha928@gmail.com> wrote: > On Thu, 2012-06-14 at 13:56 -0700, Yinghai Lu wrote: >> On Thu, Jun 14, 2012 at 2:50 AM, Sasha Levin <levinsasha928@gmail.com> wrote: >> > On Thu, 2012-06-14 at 12:20 +0900, Tejun Heo wrote: >> >> On Wed, Jun 13, 2012 at 11:38:55PM +0200, Sasha Levin wrote: >> >> > Hi all, >> >> > >> >> > I'm seeing the following when booting a KVM guest with 65gb of RAM, on latest linux-next. >> >> > >> >> > Note that it happens with numa=off. >> >> > >> >> > [ 0.000000] BUG: unable to handle kernel paging request at ffff88102febd948 >> >> > [ 0.000000] IP: [<ffffffff836a6f37>] __next_free_mem_range+0x9b/0x155 >> >> >> >> Can you map it back to the source line please? >> > >> > mm/memblock.c:583 >> > >> > phys_addr_t r_start = ri ? r[-1].base + r[-1].size : 0; >> > 97: 85 d2 test %edx,%edx >> > 99: 74 08 je a3 <__next_free_mem_range+0xa3> >> > 9b: 49 8b 48 f0 mov -0x10(%r8),%rcx >> > 9f: 49 03 48 e8 add -0x18(%r8),%rcx >> > >> > It's the deref on 9b (r8=ffff88102febd958). >> >> that reserved.region is allocated by memblock. >> >> can you boot with "memblock=debug debug ignore_loglevel" and post >> whole boot log? > > Attached below. I've also noticed it doesn't always happen, but > increasing the vcpu count (to something around 254) makes it happen > almost every time. > ... [ 0.000000] memblock: reserved array is doubled to 512 at [0x102febc080-0x102febf07f] [ 0.000000] memblock_free: [0x0000102febf080-0x0000102fec0880] memblock_double_array+0x1b0/0x1e2 [ 0.000000] memblock_reserve: [0x0000102febc080-0x0000102febf080] memblock_double_array+0x1c5/0x1e2 the reserved regions get double two times to 512. .... > [ 0.000000] memblock_free: [0x0000102febc080-0x0000102febf080] memblock_free_reserved_regions+0x37/0x39 > [ 0.000000] BUG: unable to handle kernel paging request at ffff88102febd948 > [ 0.000000] IP: [<ffffffff836a5774>] __next_free_mem_range+0x9b/0x155 > [ 0.000000] PGD 4826063 PUD cf67a067 PMD cf7fa067 PTE 800000102febd160 that page table for them is [ 0.000000] kernel direct mapping tables up to 0x102fffffff @ [mem 0xc7e3e000-0xcfffffff] [ 0.000000] memblock_reserve: [0x000000c7e3e000-0x000000cf7fb000] native_pagetable_reserve+0xc/0xe only near by allocation is swiotlb. [ 0.000000] __ex_table already sorted, skipping sort [ 0.000000] memblock_reserve: [0x000000c3e3e000-0x000000c7e3e000] __alloc_memory_core_early+0x5c/0x73 ... [ 0.000000] memblock_reserve: [0x000000cfff8000-0x000000d0000000] __alloc_memory_core_early+0x5c/0x73 [ 0.000000] Checking aperture... so the memblock allocation is ok... can you please boot with "memtest" to see if there is any memory problem? Thanks Yinghai -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2012-06-14 23:57 UTC|newest] Thread overview: 71+ messages / expand[flat|nested] mbox.gz Atom feed top 2012-06-13 21:38 Early boot panic on machine with lots of memory Sasha Levin 2012-06-14 3:20 ` Tejun Heo 2012-06-14 3:20 ` Tejun Heo 2012-06-14 9:50 ` Sasha Levin 2012-06-14 9:50 ` Sasha Levin 2012-06-14 20:56 ` Yinghai Lu 2012-06-14 20:56 ` Yinghai Lu 2012-06-14 21:34 ` Sasha Levin 2012-06-14 21:34 ` Sasha Levin 2012-06-14 23:57 ` Yinghai Lu [this message] 2012-06-14 23:57 ` Yinghai Lu 2012-06-15 0:59 ` Sasha Levin 2012-06-15 0:59 ` Sasha Levin 2012-06-15 0:59 ` Sasha Levin 2012-06-15 2:21 ` Yinghai Lu 2012-06-15 2:21 ` Yinghai Lu 2012-06-15 7:41 ` Sasha Levin 2012-06-15 7:41 ` Sasha Levin 2012-06-18 22:32 ` Tejun Heo 2012-06-18 22:32 ` Tejun Heo 2012-06-18 22:50 ` Sasha Levin 2012-06-18 22:50 ` Sasha Levin 2012-06-19 4:11 ` Gavin Shan 2012-06-19 4:11 ` Gavin Shan 2012-06-19 5:43 ` Yinghai Lu 2012-06-19 5:43 ` Yinghai Lu 2012-06-19 6:09 ` Gavin Shan 2012-06-19 6:09 ` Gavin Shan 2012-06-19 18:12 ` Yinghai Lu 2012-06-19 18:12 ` Yinghai Lu 2012-06-19 21:20 ` Tejun Heo 2012-06-19 21:20 ` Tejun Heo 2012-06-19 21:26 ` Tejun Heo 2012-06-19 21:26 ` Tejun Heo 2012-06-20 2:57 ` Yinghai Lu 2012-06-21 20:17 ` Tejun Heo 2012-06-21 20:17 ` Tejun Heo 2012-06-22 1:47 ` Yinghai Lu 2012-06-22 1:58 ` Yinghai Lu 2012-06-22 18:51 ` Tejun Heo 2012-06-22 18:51 ` Tejun Heo 2012-06-22 19:23 ` Yinghai Lu 2012-06-22 19:23 ` Yinghai Lu 2012-06-22 19:29 ` Tejun Heo 2012-06-22 19:29 ` Tejun Heo 2012-06-22 20:01 ` Yinghai Lu 2012-06-22 20:01 ` Yinghai Lu 2012-06-22 20:14 ` Tejun Heo 2012-06-22 20:14 ` Tejun Heo 2012-06-22 20:23 ` Yinghai Lu 2012-06-22 20:23 ` Yinghai Lu 2012-06-23 2:14 ` Yinghai Lu 2012-06-27 18:13 ` Tejun Heo 2012-06-27 18:13 ` Tejun Heo 2012-06-27 19:22 ` Yinghai Lu 2012-06-27 19:22 ` Yinghai Lu 2012-06-27 19:26 ` Tejun Heo 2012-06-27 19:26 ` Tejun Heo 2012-06-27 21:15 ` Yinghai Lu 2012-06-29 18:27 ` [PATCH for -3.5] memblock: free allocated memblock_reserved_regions later Yinghai Lu 2012-06-29 18:27 ` Yinghai Lu 2012-06-29 18:32 ` Tejun Heo 2012-06-29 18:32 ` Tejun Heo 2012-06-29 18:38 ` Yinghai Lu 2012-06-29 18:38 ` Yinghai Lu 2012-06-21 20:19 ` Early boot panic on machine with lots of memory Tejun Heo 2012-06-21 20:19 ` Tejun Heo 2012-06-22 10:29 ` Sasha Levin 2012-06-22 10:29 ` Sasha Levin 2012-06-22 18:15 ` Yinghai Lu 2012-06-22 18:15 ` Yinghai Lu
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=CAE9FiQVXxnjccSErjrZ9B-APGf5ZpKNovJwr5vNBMr1G2f8Y4Q@mail.gmail.com \ --to=yinghai@kernel.org \ --cc=akpm@linux-foundation.org \ --cc=davem@davemloft.net \ --cc=hpa@linux.intel.com \ --cc=levinsasha928@gmail.com \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-mm@kvack.org \ --cc=tj@kernel.org \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.