All of lore.kernel.org
 help / color / mirror / Atom feed
From: Yinghai Lu <yhlu.kernel@gmail.com>
To: Jack Steiner <steiner@sgi.com>
Cc: David Rientjes <rientjes@google.com>,
	"H. Peter Anvin" <hpa@zytor.com>, Ingo Molnar <mingo@elte.hu>,
	Thomas Gleixner <tglx@linutronix.de>,
	Andrew Morton <akpm@linux-foundation.org>,
	Andi Kleen <andi@firstfloor.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH 3/3] x86: fix node_possible_map logic -v2
Date: Tue, 12 May 2009 14:31:33 -0700	[thread overview]
Message-ID: <86802c440905121431q682e8924l427a5257da01c370@mail.gmail.com> (raw)
In-Reply-To: <20090512180349.GA1479@sgi.com>

On Tue, May 12, 2009 at 11:03 AM, Jack Steiner <steiner@sgi.com> wrote:
> On Tue, May 12, 2009 at 09:40:52AM -0700, Yinghai Lu wrote:
>> On Tue, May 12, 2009 at 9:16 AM, Jack Steiner <steiner@sgi.com> wrote:
>> > On Tue, May 12, 2009 at 08:10:18AM -0700, Yinghai Lu wrote:
>> >> jack,
>> >>
>> >> can you confirm:
>> >> 1. without this patch, your system still have problem?
>> >> 2. does current tip/master work for you?
>> >
>> > The current tip/master fails with or without the patch. AFAICT, the
>> > failure is identical in both cases.
>>
>> ok, can you try attach patch to check cpu_to_node mapping?
>
> The boot messages are somewhat inconsistent:
>
> Earlier in boot:
>
>        <6>Setting APIC routing to cluster x2apic.
>        <6>SRAT: PXM 0 -> APIC 0 -> Node 0
>        <6>SRAT: PXM 1 -> APIC 128 -> Node 1
>        <6>SRAT: Node 1 PXM 1 0-fff6c000
>
>
> but at the point of your debug messages:
>
>        <6>cpu 0 -> apicid 0x0 -> node 1
>        <6>cpu 1 -> apicid 0x80 -> node 1

that mean cpu0 is mapping to node1, because node0 doesn't memory installed.

>
>
>
>
>
> BIOS log:
>
>        PROM>> Build ACPI tables
>        PROM>>   RSDP at 0x00000000000e0200
>        PROM>>   XSDT at 0x00000000000e0240
>        PROM>>   DSDT at 0x00000000000e02a0
>        PROM>>   MADT at 0x00000000000e02e0 (0xa0)
>        PROM>>     sapic: cpu 0, socket 0, lcpu 0, proc_id 0x0, id 0x00, eid 0x00, apicid 0x0000,
>        PROM>>     sapic: cpu 1, socket 1, lcpu 0, proc_id 0x1, id 0x00, eid 0x80, apicid 0x0080,
>        PROM>>     io_apic: id 8, base 0, entries 24, prq 0, arb 0
>        PROM>>     io_apic: id 9, base 24, entries 24, prq 1, arb 9
>        PROM>>     lapic_nmi: acpi_id 0, flags 0x5, lint 1
>        PROM>>     lapic_nmi: acpi_id 1, flags 0x5, lint 1
>        PROM>>     int_src_ovr: bus 0, bus_irq 0, global_irq 2, flags 5
>        PROM>>     int_src_ovr: bus 0, bus_irq 9, global_irq 9, flags 13
>        PROM>>   SRAT at 0x00000000000e0380
>        PROM>>     Memory:
>        PROM>>       blade 1, soc 1: paddr 0x0 - 0xfff6c000 (3GB + 1023MB + 442368), pxm 1
>        PROM>>     Processor at 00000000000e03d8:
>        PROM>>       soc 0, lcpu 0: sapicid 0x0000, pxm 0
>        PROM>>       soc 1, lcpu 0: sapicid 0x0080, pxm 1
>        PROM>>   SLIT at 0x00000000000e05e0, dim 2
>        PROM>>       10  21
>        PROM>>       21  10
>        PROM>>   FADT at 0x00000000000e06a0
>        PROM>>   FACS at 0x00000000000e07a0
>        PROM>>   DMAR at 0x00000000000e0860
>
> Kernel log:
>        <6>Initializing cgroup subsys cpuset
>        <6>Initializing cgroup subsys cpu
>        <5>Linux version 2.6.30-rc5-next-20090512-medusa (steiner@alcatraz.americas.sgi.com) (gcc version 4.2.4) #4 SMP Tue May 12 12:55:26 CDT 2009
>        <6>Command line: root=/dev/hda2 init=/bin/bash console=ttyS0,38400n8 fprom lpj=10000 nohpet loglevel=8 iommu=off dma32_size=4096
>        <6>KERNEL supported cpus:
>        <6>  Intel GenuineIntel
>        <6>  AMD AuthenticAMD
>        <6>  Centaur CentaurHauls
>        <6>BIOS-provided physical RAM map:
>        <6> BIOS-e820: 0000000000000000 - 0000000000006000 (usable)
>        <6> BIOS-e820: 0000000000006000 - 0000000000200000 (reserved)
>        <6> BIOS-e820: 0000000000200000 - 0000000010000000 (usable)
>        <6> BIOS-e820: 0000000080000000 - 0000000090000000 (reserved)
>        <6> BIOS-e820: 00000000f0000000 - 00000000fc000000 (reserved)
>        <6> BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
>        <6> BIOS-e820: 00000000fff60000 - 00000000fff6c000 (reserved)
>        <6> BIOS-e820: 00000fe000000000 - 00000fe018000000 (reserved)
>        <6>EFI v1.00 by SGI
>        <6> ACPI 2.0=0xe0200  UVsystab=0xe08c0
>        <6>EFI: mem00: type=7, attr=0x8, range=[0x0000000000000000-0x0000000000006000) (0MB)
>        <6>EFI: mem01: type=5, attr=0x8000000000001000, range=[0x0000000000006000-0x00000000000b0000) (0MB)
>        <6>EFI: mem02: type=6, attr=0x8000000000000008, range=[0x00000000000b0000-0x0000000000200000) (1MB)
>        <6>EFI: mem03: type=7, attr=0x8, range=[0x0000000000200000-0x0000000010000000) (254MB)
>        <6>EFI: mem04: type=6, attr=0x8000000000000001, range=[0x0000000080000000-0x0000000090000000) (256MB)
>        <6>EFI: mem05: type=6, attr=0x8000000000000001, range=[0x00000000f0000000-0x00000000fc000000) (192MB)
>        <6>EFI: mem06: type=6, attr=0x8000000000000001, range=[0x00000000fed1c000-0x00000000fed20000) (0MB)
>        <6>EFI: mem07: type=6, attr=0x8000000000000001, range=[0x00000000fff60000-0x00000000fff6c000) (0MB)
>        <6>EFI: mem08: type=11, attr=0x8000000000000001, range=[0x00000fe000000000-0x00000fe018000000) (384MB)
>        <6>DMI not present or invalid.
>        <6>last_pfn = 0x10000 max_arch_pfn = 0x100000000
>        <7>MTRR default type: write-back
>        <7>MTRR fixed ranges enabled:
>        <7>  00000-FFFFF write-back
>        <7>MTRR variable ranges enabled:
>        <7>  0 base 0   F0000000 mask FFF F0000000 uncachable
>        <7>  1 base E0  00000000 mask FF0 00000000 uncachable
>        <7>  2 base F0  00000000 mask FF0 00000000 uncachable
>        <7>  3 base F00 00000000 mask FF0000000000 uncachable
>        <7>  4 disabled
>        <7>  5 disabled
>        <7>  6 disabled
>        <7>  7 disabled
>        <6>x86 PAT enabled: cpu 0, old 0x606060606060606, new 0x7010600070106
>        <6>x2apic enabled by BIOS, switching to x2apic ops
>        <6>init_memory_mapping: 0000000000000000-0000000010000000
>        <7> 0000000000 - 0010000000 page 2M
>        <7>kernel direct mapping tables up to 10000000 @ 93a000-93c000
>        <4>ACPI: RSDP 00000000000e0200 00024 (v02       )
>        <4>ACPI: XSDT 00000000000e0240 00054 (v01    SGI      UVX 00010001 FPRM 00000001)
>        <4>ACPI: APIC 00000000000e02e0 00086 (v01    SGI      UVX 00010001 FPRM 00000001)
>        <4>ACPI: SRAT 00000000000e0380 00078 (v01    SGI      UVX 00010001 FPRM 00000001)
>        <4>ACPI: SLIT 00000000000e05e0 00030 (v01    SGI      UVX 00010001 FPRM 00000001)
>        <4>ACPI: MCFG 00000000000e0640 0004C (v01    SGI      UVX 00010001 FPRM 00000001)
>        <4>ACPI: FACP 00000000000e06a0 000F4 (v03    SGI      UVX 00030001 FPRM 00000001)
>        <4>ACPI: DSDT 00000000000e02a0 00030 (v01    SGI      UVX 00010001 FPRM 00000001)
>        <4>ACPI: FACS 00000000000e07a0 00040
>        <4>ACPI: DMAR 00000000000e0860 0004C (v01    SGI      UVX 00010001 FPRM 00000001)
>        <7>ACPI: Local APIC address 0xfee00000
>        <6>Setting APIC routing to cluster x2apic.
>        <6>SRAT: PXM 0 -> APIC 0 -> Node 0
>        <6>SRAT: PXM 1 -> APIC 128 -> Node 1
>        <6>SRAT: Node 1 PXM 1 0-fff6c000
>        <7>NUMA: Using 63 for the hash shift.
>        <6>Bootmem setup node 1 0000000000000000-0000000010000000
>        <6>  NODE_DATA [0000000000939a80 - 000000000096da7f]
>        <6>  bootmap [000000000096e000 -  000000000096ffff] pages 2
>        <6>(7 early reservations) ==> bootmem [0000000000 - 0010000000]
>        <6>  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
>        <6>  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
>        <6>  #2 [0000200000 - 0000939a5c]    TEXT DATA BSS ==> [0000200000 - 0000939a5c]
>        <6>  #3 [000009f000 - 00000e0900]    BIOS reserved ==> [000009f000 - 00000e0900]
>        <6>  #4 [00000e0a68 - 0000100000]    BIOS reserved ==> [00000e0a68 - 0000100000]
>        <6>  #5 [00000e0900 - 00000e0a68]       EFI memmap ==> [00000e0900 - 00000e0a68]
>        <6>  #6 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
>        <7> [ffffe20000000000-ffffe200003fffff] PMD -> [ffff880001200000-ffff8800015fffff] on node 1
>        <4>Zone PFN ranges:
>        <4>  DMA      0x00000000 -> 0x00001000
>        <4>  DMA32    0x00001000 -> 0x00100000
>        <4>  Normal   0x00100000 -> 0x00100000
>        <4>Movable zone start PFN for each node
>        <4>early_node_map[2] active PFN ranges
>        <4>    1: 0x00000000 -> 0x00000006
>        <4>    1: 0x00000200 -> 0x00010000
>        <7>On node 1 totalpages: 65030
>        <7>  DMA zone: 56 pages used for memmap
>        <7>  DMA zone: 1948 pages reserved
>        <7>  DMA zone: 1586 pages, LIFO batch:0
>        <7>  DMA32 zone: 840 pages used for memmap
>        <7>  DMA32 zone: 60600 pages, LIFO batch:15
>        <6>ACPI: PM-Timer IO Port: 0x1008
>        <7>ACPI: Local APIC address 0xfee00000
>        <6>Setting APIC routing to cluster x2apic.

x2apic related?

can you disable x2apic in kernel?

YH

  reply	other threads:[~2009-05-12 21:31 UTC|newest]

Thread overview: 102+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-05-09  6:45 [PATCH 1/3] x86: remove MEMORY_HOTPLUG_RESERVE related code Yinghai Lu
2009-05-09  6:48 ` [PATCH 2/3] x86: add numa_move_cpus_to_node Yinghai Lu
2009-05-09  7:05   ` Justin P. Mattock
2009-05-12  1:27   ` Christoph Lameter
2009-05-11 21:53     ` Yinghai Lu
2009-05-12 20:59       ` Christoph Lameter
2009-05-12 17:16         ` Yinghai Lu
2009-05-12 21:21           ` Christoph Lameter
2009-05-13  5:39             ` Yinghai Lu
2009-05-14 19:34               ` Christoph Lameter
2009-05-14 20:58                 ` Yinghai Lu
2009-05-09  6:50 ` [PATCH 3/3] x86: fix node_possible_map logic -v2 Yinghai Lu
2009-05-11 17:53   ` Jack Steiner
2009-05-11 19:15     ` Yinghai Lu
2009-05-11 19:36       ` Yinghai Lu
2009-05-11 19:27     ` David Rientjes
2009-05-11 21:12       ` H. Peter Anvin
2009-05-11 21:26         ` Alan Cox
2009-05-11 22:25         ` David Rientjes
2009-05-12 15:06           ` Jack Steiner
2009-05-12 15:10             ` Yinghai Lu
2009-05-12 16:16               ` Jack Steiner
2009-05-12 16:40                 ` Yinghai Lu
2009-05-12 18:03                   ` Jack Steiner
2009-05-12 21:31                     ` Yinghai Lu [this message]
2009-05-12 21:58                       ` Jack Steiner
2009-05-12 23:13                         ` Yinghai Lu
2009-05-12 23:26                           ` Yinghai Lu
2009-05-12 15:43             ` Andi Kleen
2009-05-13  1:34             ` [PATCH] x86: fix system without memory on node0 Yinghai Lu
2009-05-13  8:00               ` Andi Kleen
2009-05-13 15:58                 ` Yinghai Lu
2009-05-13 13:35               ` Ingo Molnar
2009-05-13 16:52               ` Jack Steiner
2009-05-13 17:43                 ` Yinghai Lu
2009-05-13 18:08                 ` Yinghai Lu
2009-05-12  7:15         ` [PATCH 3/3] x86: fix node_possible_map logic -v2 Andi Kleen
2009-05-11 21:33       ` Jack Steiner
2009-05-11 22:56         ` David Rientjes
2009-05-11 23:00           ` Yinghai Lu
2009-05-12  7:09       ` Andi Kleen
2009-05-12  1:02 ` [PATCH 1/3] x86: remove MEMORY_HOTPLUG_RESERVE related code Christoph Lameter
2009-05-12 11:16 ` Mel Gorman
2009-05-13  5:29   ` Yinghai Lu
2009-05-13  9:55     ` Mel Gorman
2009-05-13  6:13   ` [PATCH] x86: remove MEMORY_HOTPLUG_RESERVE related code -v2 Yinghai Lu
2009-05-13 14:59     ` Mel Gorman
2009-05-14 16:38       ` [PATCH 1/5] " Yinghai Lu
2009-05-14 16:40         ` [PATCH 2/5] x86: add numa_move_cpus_to_node Yinghai Lu
2009-05-14 16:41         ` [PATCH 3/5] x86: fix node_possible_map logic -v2 Yinghai Lu
2009-05-18  7:40           ` [tip:x86/mm] x86, mm: Fix node_possible_map logic tip-bot for Yinghai Lu
2009-05-14 16:42         ` [PATCH 4/5] x86: fix system without memory on node0 -v2 Yinghai Lu
2009-05-18  7:40           ` [tip:x86/mm] x86: fix system without memory on node0 tip-bot for Yinghai Lu
2009-05-14 16:43         ` [PATCH 5/5] mm: clear N_HIGH_MEMORY map before se set it again -v2 Yinghai Lu
2009-05-14 16:54           ` Andrew Morton
2009-05-14 17:05             ` Yinghai Lu
2009-05-14 17:25               ` Andrew Morton
2009-05-14 17:34                 ` Yinghai Lu
2009-05-14 19:44                   ` Christoph Lameter
2009-06-04  5:16                   ` [RESEND PATCH] " Yinghai Lu
2009-06-04 16:38                     ` Christoph Lameter
2009-06-04 16:48                       ` Yinghai Lu
2009-06-04 17:11                         ` Christoph Lameter
2009-06-04 17:26                           ` [PATCH] mm: clear N_HIGH_MEMORY map before se set it again -v4 Yinghai Lu
2009-06-19  6:42                             ` Nathan Lynch
2009-06-19  8:18                               ` Yinghai Lu
     [not found]                                 ` <4A3B49BA.40100-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2009-06-19  8:43                                   ` Nathan Lynch
2009-06-19  8:43                                 ` Nathan Lynch
2009-06-19 16:16                                   ` Yinghai Lu
     [not found]                                   ` <m3prd0havh.fsf-e+AXbWqSrlAAvxtiuMwx3w@public.gmane.org>
2009-06-19 16:16                                     ` Yinghai Lu
2009-06-20 23:43                                     ` Yinghai Lu
2009-06-20 23:43                                       ` Yinghai Lu
     [not found]                                       ` <4A3D7419.8040305-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2009-06-22  4:39                                         ` Nathan Lynch
2009-06-22  4:39                                       ` Nathan Lynch
2009-06-22 15:38                                         ` [PATCH] x86: only clear node_states for 64bit Yinghai Lu
     [not found]                                           ` <4A3FA58A.3010909-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2009-06-26 20:54                                             ` Andrew Morton
2009-06-26 20:54                                           ` Andrew Morton
2009-06-26 21:09                                             ` Yinghai Lu
     [not found]                                               ` <4A4538FE.2090101-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2009-06-27 17:17                                                 ` Ingo Molnar
2009-06-27 17:17                                                   ` Ingo Molnar
     [not found]                                                   ` <20090627171714.GD21595-X9Un+BFzKDI@public.gmane.org>
2009-06-27 20:40                                                     ` Yinghai Lu
2009-06-27 20:40                                                       ` Yinghai Lu
     [not found]                                                       ` <4A4683B2.106-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2009-06-29  7:39                                                         ` Yinghai Lu
2009-06-29  7:39                                                           ` Yinghai Lu
     [not found]                                             ` <20090626135428.d8f88a70.akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org>
2009-06-26 21:09                                               ` Yinghai Lu
     [not found]                                         ` <m3my807ug3.fsf-e+AXbWqSrlAAvxtiuMwx3w@public.gmane.org>
2009-06-22 15:38                                           ` Yinghai Lu
     [not found]                               ` <m3bpokiv0u.fsf-e+AXbWqSrlAAvxtiuMwx3w@public.gmane.org>
2009-06-19  8:18                                 ` [PATCH] mm: clear N_HIGH_MEMORY map before se set it again -v4 Yinghai Lu
     [not found]                             ` <4A2803D1.4070001-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2009-06-19  6:42                               ` Nathan Lynch
2009-05-18  7:39         ` [tip:x86/mm] mm, x86: remove MEMORY_HOTPLUG_RESERVE related code tip-bot for Yinghai Lu
     [not found] ` <20090511095022.GA23121@elte.hu>
     [not found]   ` <20090511163158.c4e4d334.akpm@linux-foundation.org>
     [not found]     ` <20090512090704.GC18004@elte.hu>
     [not found]       ` <4A0A6700.3070100@kernel.org>
     [not found]         ` <20090513133635.GB7384@elte.hu>
     [not found]           ` <4A0AFA6E.5050200@kernel.org>
     [not found]             ` <20090515173521.GA29647@elte.hu>
2009-05-15 21:38               ` tip: patches in git for irq and numa Yinghai Lu
2009-05-18  7:29                 ` Ingo Molnar
2009-05-18 13:50                   ` Peter Zijlstra
2009-05-18 13:56                     ` Ingo Molnar
2009-05-18 15:03                     ` Yinghai Lu
2009-05-18 15:09                       ` Ingo Molnar
2009-05-18 15:11                       ` Peter Zijlstra
2009-05-18 17:23                         ` Yinghai Lu
2009-05-19  9:37                           ` Ingo Molnar
2009-05-19 10:31                             ` Peter Zijlstra
2009-05-19 12:26                               ` Ingo Molnar
2009-05-19  9:39                           ` [tip:irq/numa] x86, io-apic: Don't mark pin_programmed early tip-bot for Yinghai Lu
2009-05-19 12:30                           ` tip-bot for Yinghai Lu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=86802c440905121431q682e8924l427a5257da01c370@mail.gmail.com \
    --to=yhlu.kernel@gmail.com \
    --cc=akpm@linux-foundation.org \
    --cc=andi@firstfloor.org \
    --cc=hpa@zytor.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mingo@elte.hu \
    --cc=rientjes@google.com \
    --cc=steiner@sgi.com \
    --cc=tglx@linutronix.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.