From: Baoquan He <bhe@redhat.com>
To: Mike Rapoport <rppt@kernel.org>
Cc: Rich Felker <dalias@libc.org>,
linux-ia64@vger.kernel.org, linux-doc@vger.kernel.org,
Catalin Marinas <catalin.marinas@arm.com>,
Heiko Carstens <heiko.carstens@de.ibm.com>,
Michal Hocko <mhocko@kernel.org>,
"James E.J. Bottomley" <James.Bottomley@hansenpartnership.com>,
Max Filippov <jcmvbkbc@gmail.com>, Guo Ren <guoren@kernel.org>,
linux-csky@vger.kernel.org, linux-parisc@vger.kernel.org,
sparclinux@vger.kernel.org, linux-hexagon@vger.kernel.org,
linux-riscv@lists.infradead.org,
Greg Ungerer <gerg@linux-m68k.org>,
linux-arch@vger.kernel.org, linux-s390@vger.kernel.org,
linux-snps-arc@lists.infradead.org, linux-c6x-dev@linux-c6x.org,
Brian Cain <bcain@codeaurora.org>,
Jonathan Corbet <corbet@lwn.net>,
linux-sh@vger.kernel.org, Michael Ellerman <mpe@ellerman.id.au>,
Helge Deller <deller@gmx.de>,
x86@kernel.org, Russell King <linux@armlinux.org.uk>,
Ley Foon Tan <ley.foon.>
Subject: Re: [PATCH 03/21] mm: remove CONFIG_HAVE_MEMBLOCK_NODE_MAP option
Date: Tue, 21 Apr 2020 17:45:30 +0800 [thread overview]
Message-ID: <20200421094530.GB29658@MiWiFi-R3L-srv> (raw)
In-Reply-To: <20200421090908.GC14260@kernel.org>
On 04/21/20 at 12:09pm, Mike Rapoport wrote:
> > > diff --git a/mm/memory_hotplug.c b/mm/memory_hotplug.c
> > > index fc0aad0bc1f5..e67dc501576a 100644
> > > --- a/mm/memory_hotplug.c
> > > +++ b/mm/memory_hotplug.c
> > > @@ -1372,11 +1372,7 @@ check_pages_isolated_cb(unsigned long start_pfn, unsigned long nr_pages,
> > >
> > > static int __init cmdline_parse_movable_node(char *p)
> > > {
> > > -#ifdef CONFIG_HAVE_MEMBLOCK_NODE_MAP
> > > movable_node_enabled = true;
> > > -#else
> > > - pr_warn("movable_node parameter depends on CONFIG_HAVE_MEMBLOCK_NODE_MAP to work properly\n");
> > > -#endif
> >
> > Wondering if this change will impact anything. Before, those ARCHes with
> > CONFIG_HAVE_MEMBLOCK_NODE_MAP support movable_node. With this patch
> > applied, those ARCHes which don't support CONFIG_HAVE_MEMBLOCK_NODE_MAP
> > can also have 'movable_node' specified in kernel cmdline.
> >
> > > return 0;
> > > }
> > > early_param("movable_node", cmdline_parse_movable_node);
> > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c
> > > index 1ac775bfc9cf..4530e9cfd9f7 100644
> > > --- a/mm/page_alloc.c
> > > +++ b/mm/page_alloc.c
> > > @@ -335,7 +335,6 @@ static unsigned long nr_kernel_pages __initdata;
> > > static unsigned long nr_all_pages __initdata;
> > > static unsigned long dma_reserve __initdata;
> > >
> > > -#ifdef CONFIG_HAVE_MEMBLOCK_NODE_MAP
> > > static unsigned long arch_zone_lowest_possible_pfn[MAX_NR_ZONES] __initdata;
> > > static unsigned long arch_zone_highest_possible_pfn[MAX_NR_ZONES] __initdata;
> > > static unsigned long required_kernelcore __initdata;
> >
> > Does it mean those ARCHes which don't support
> > CONFIG_HAVE_MEMBLOCK_NODE_MAP before, will have 'kernelcore=' and
> > 'movablecore=' now, and will have MOVABLE zone?
>
> I hesitated a lot about whether to hide the kernelcore/movablecore and
> related code behind an #ifdef.
> In the end I've decided to keep the code compiled unconditionally as it
> is anyway __init and no sane person would pass "kernelcore=" to the
> kernel on a UMA system.
I see. Then maybe can do something if someone complains about it
in the future, e.g warn out with a message in
cmdline_parse_movable_node(), cmdline_parse_kernelcore().
>
> > > @@ -348,7 +347,6 @@ static bool mirrored_kernelcore __meminitdata;
> > > /* movable_zone is the "real" zone pages in ZONE_MOVABLE are taken from */
> > > int movable_zone;
> > > EXPORT_SYMBOL(movable_zone);
> > > -#endif /* CONFIG_HAVE_MEMBLOCK_NODE_MAP */
> > >
> > > #if MAX_NUMNODES > 1
> > > unsigned int nr_node_ids __read_mostly = MAX_NUMNODES;
> > > @@ -1499,8 +1497,7 @@ void __free_pages_core(struct page *page, unsigned int order)
> > > __free_pages(page, order);
> > > }
> > >
> > > -#if defined(CONFIG_HAVE_ARCH_EARLY_PFN_TO_NID) || \
> > > - defined(CONFIG_HAVE_MEMBLOCK_NODE_MAP)
> > > +#ifdef CONFIG_NEED_MULTIPLE_NODES
> > >
> > > static struct mminit_pfnnid_cache early_pfnnid_cache __meminitdata;
> > >
> > > @@ -1542,7 +1539,7 @@ int __meminit early_pfn_to_nid(unsigned long pfn)
> > >
> > > return nid;
> > > }
> > > -#endif
> > > +#endif /* CONFIG_NEED_MULTIPLE_NODES */
> > >
> > > #ifdef CONFIG_NODES_SPAN_OTHER_NODES
> > > /* Only safe to use early in boot when initialisation is single-threaded */
> > > @@ -5924,7 +5921,6 @@ void __ref build_all_zonelists(pg_data_t *pgdat)
> > > static bool __meminit
> > > overlap_memmap_init(unsigned long zone, unsigned long *pfn)
> > > {
> > > -#ifdef CONFIG_HAVE_MEMBLOCK_NODE_MAP
> > > static struct memblock_region *r;
> > >
> > > if (mirrored_kernelcore && zone == ZONE_MOVABLE) {
> > > @@ -5940,7 +5936,6 @@ overlap_memmap_init(unsigned long zone, unsigned long *pfn)
> > > return true;
> > > }
> > > }
> > > -#endif
> > > return false;
> > > }
> > >
> > > @@ -6573,8 +6568,7 @@ static unsigned long __init zone_absent_pages_in_node(int nid,
> > > return nr_absent;
> > > }
> > >
> > > -#else /* CONFIG_HAVE_MEMBLOCK_NODE_MAP */
> > > -static inline unsigned long __init zone_spanned_pages_in_node(int nid,
> > > +static inline unsigned long __init compat_zone_spanned_pages_in_node(int nid,
> >
> > Is it compact zone which has continuous memory region, and the
> > compat here is typo? Or it's compatible zone? The name seems a little
> > confusing, or I miss something.
>
> It's 'compat' from 'compatibility'. This is kinda "the old way" and the
> version that was defined when CONFIG_HAVE_MEMBLOCK_NODE_MAP=y is the
> "new way", so I picked 'compat' for backwards compatibility.
> Anyway, it will go away later in pacth 19.
Got it, thanks for telling.
>
> > > unsigned long zone_type,
> > > unsigned long node_start_pfn,
> > > unsigned long node_end_pfn,
> > > @@ -6593,7 +6587,7 @@ static inline unsigned long __init zone_spanned_pages_in_node(int nid,
> > > return zones_size[zone_type];
> > > }
> > >
> > > -static inline unsigned long __init zone_absent_pages_in_node(int nid,
> > > +static inline unsigned long __init compat_zone_absent_pages_in_node(int nid,
> > > unsigned long zone_type,
> > > unsigned long node_start_pfn,
> > > unsigned long node_end_pfn,
> > > @@ -6605,13 +6599,12 @@ static inline unsigned long __init zone_absent_pages_in_node(int nid,
> > > return zholes_size[zone_type];
> > > }
> > >
> > > -#endif /* CONFIG_HAVE_MEMBLOCK_NODE_MAP */
> > > -
> > > static void __init calculate_node_totalpages(struct pglist_data *pgdat,
> > > unsigned long node_start_pfn,
> > > unsigned long node_end_pfn,
> > > unsigned long *zones_size,
> > > - unsigned long *zholes_size)
> > > + unsigned long *zholes_size,
> > > + bool compat)
> > > {
> > > unsigned long realtotalpages = 0, totalpages = 0;
> > > enum zone_type i;
> > > @@ -6619,17 +6612,38 @@ static void __init calculate_node_totalpages(struct pglist_data *pgdat,
> > > for (i = 0; i < MAX_NR_ZONES; i++) {
> > > struct zone *zone = pgdat->node_zones + i;
> > > unsigned long zone_start_pfn, zone_end_pfn;
> > > + unsigned long spanned, absent;
> > > unsigned long size, real_size;
> > >
> > > - size = zone_spanned_pages_in_node(pgdat->node_id, i,
> > > - node_start_pfn,
> > > - node_end_pfn,
> > > - &zone_start_pfn,
> > > - &zone_end_pfn,
> > > - zones_size);
> > > - real_size = size - zone_absent_pages_in_node(pgdat->node_id, i,
> > > - node_start_pfn, node_end_pfn,
> > > - zholes_size);
> > > + if (compat) {
> > > + spanned = compat_zone_spanned_pages_in_node(
> > > + pgdat->node_id, i,
> > > + node_start_pfn,
> > > + node_end_pfn,
> > > + &zone_start_pfn,
> > > + &zone_end_pfn,
> > > + zones_size);
> > > + absent = compat_zone_absent_pages_in_node(
> > > + pgdat->node_id, i,
> > > + node_start_pfn,
> > > + node_end_pfn,
> > > + zholes_size);
> > > + } else {
> > > + spanned = zone_spanned_pages_in_node(pgdat->node_id, i,
> > > + node_start_pfn,
> > > + node_end_pfn,
> > > + &zone_start_pfn,
> > > + &zone_end_pfn,
> > > + zones_size);
> > > + absent = zone_absent_pages_in_node(pgdat->node_id, i,
> > > + node_start_pfn,
> > > + node_end_pfn,
> > > + zholes_size);
> > > + }
> > > +
> > > + size = spanned;
> > > + real_size = size - absent;
> > > +
> > > if (size)
> > > zone->zone_start_pfn = zone_start_pfn;
> > > else
> > > @@ -6929,10 +6943,8 @@ static void __ref alloc_node_mem_map(struct pglist_data *pgdat)
> > > */
> > > if (pgdat == NODE_DATA(0)) {
> > > mem_map = NODE_DATA(0)->node_mem_map;
> > > -#if defined(CONFIG_HAVE_MEMBLOCK_NODE_MAP) || defined(CONFIG_FLATMEM)
> > > if (page_to_pfn(mem_map) != pgdat->node_start_pfn)
> > > mem_map -= offset;
> > > -#endif /* CONFIG_HAVE_MEMBLOCK_NODE_MAP */
> > > }
> > > #endif
> > > }
> > > @@ -6949,9 +6961,10 @@ static inline void pgdat_set_deferred_range(pg_data_t *pgdat)
> > > static inline void pgdat_set_deferred_range(pg_data_t *pgdat) {}
> > > #endif
> > >
> > > -void __init free_area_init_node(int nid, unsigned long *zones_size,
> > > - unsigned long node_start_pfn,
> > > - unsigned long *zholes_size)
> > > +static void __init __free_area_init_node(int nid, unsigned long *zones_size,
> > > + unsigned long node_start_pfn,
> > > + unsigned long *zholes_size,
> > > + bool compat)
> > > {
> > > pg_data_t *pgdat = NODE_DATA(nid);
> > > unsigned long start_pfn = 0;
> > > @@ -6963,16 +6976,16 @@ void __init free_area_init_node(int nid, unsigned long *zones_size,
> > > pgdat->node_id = nid;
> > > pgdat->node_start_pfn = node_start_pfn;
> > > pgdat->per_cpu_nodestats = NULL;
> > > -#ifdef CONFIG_HAVE_MEMBLOCK_NODE_MAP
> > > - get_pfn_range_for_nid(nid, &start_pfn, &end_pfn);
> > > - pr_info("Initmem setup node %d [mem %#018Lx-%#018Lx]\n", nid,
> > > - (u64)start_pfn << PAGE_SHIFT,
> > > - end_pfn ? ((u64)end_pfn << PAGE_SHIFT) - 1 : 0);
> > > -#else
> > > - start_pfn = node_start_pfn;
> > > -#endif
> > > + if (!compat) {
> > > + get_pfn_range_for_nid(nid, &start_pfn, &end_pfn);
> > > + pr_info("Initmem setup node %d [mem %#018Lx-%#018Lx]\n", nid,
> > > + (u64)start_pfn << PAGE_SHIFT,
> > > + end_pfn ? ((u64)end_pfn << PAGE_SHIFT) - 1 : 0);
> > > + } else {
> > > + start_pfn = node_start_pfn;
> > > + }
> > > calculate_node_totalpages(pgdat, start_pfn, end_pfn,
> > > - zones_size, zholes_size);
> > > + zones_size, zholes_size, compat);
> > >
> > > alloc_node_mem_map(pgdat);
> > > pgdat_set_deferred_range(pgdat);
> > > @@ -6980,6 +6993,14 @@ void __init free_area_init_node(int nid, unsigned long *zones_size,
> > > free_area_init_core(pgdat);
> > > }
> > >
> > > +void __init free_area_init_node(int nid, unsigned long *zones_size,
> > > + unsigned long node_start_pfn,
> > > + unsigned long *zholes_size)
> > > +{
> > > + __free_area_init_node(nid, zones_size, node_start_pfn, zholes_size,
> > > + true);
> > > +}
> > > +
> > > #if !defined(CONFIG_FLAT_NODE_MEM_MAP)
> > > /*
> > > * Initialize all valid struct pages in the range [spfn, epfn) and mark them
> > > @@ -7063,8 +7084,6 @@ static inline void __init init_unavailable_mem(void)
> > > }
> > > #endif /* !CONFIG_FLAT_NODE_MEM_MAP */
> > >
> > > -#ifdef CONFIG_HAVE_MEMBLOCK_NODE_MAP
> > > -
> > > #if MAX_NUMNODES > 1
> > > /*
> > > * Figure out the number of possible node ids.
> > > @@ -7493,8 +7512,8 @@ void __init free_area_init_nodes(unsigned long *max_zone_pfn)
> > > init_unavailable_mem();
> > > for_each_online_node(nid) {
> > > pg_data_t *pgdat = NODE_DATA(nid);
> > > - free_area_init_node(nid, NULL,
> > > - find_min_pfn_for_node(nid), NULL);
> > > + __free_area_init_node(nid, NULL,
> > > + find_min_pfn_for_node(nid), NULL, false);
> > >
> > > /* Any memory on that node */
> > > if (pgdat->node_present_pages)
> > > @@ -7559,8 +7578,6 @@ static int __init cmdline_parse_movablecore(char *p)
> > > early_param("kernelcore", cmdline_parse_kernelcore);
> > > early_param("movablecore", cmdline_parse_movablecore);
> > >
> > > -#endif /* CONFIG_HAVE_MEMBLOCK_NODE_MAP */
> > > -
> > > void adjust_managed_page_count(struct page *page, long count)
> > > {
> > > atomic_long_add(count, &page_zone(page)->managed_pages);
> > > --
> > > 2.25.1
> > >
> >
>
> --
> Sincerely yours,
> Mike.
>
next prev parent reply other threads:[~2020-04-21 9:45 UTC|newest]
Thread overview: 56+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-04-12 19:48 [PATCH 00/21] mm: rework free_area_init*() funcitons Mike Rapoport
2020-04-12 19:48 ` [PATCH 01/21] mm: memblock: replace dereferences of memblock_region.nid with API calls Mike Rapoport
2020-04-21 2:06 ` Baoquan He
2020-04-12 19:48 ` [PATCH 02/21] mm: make early_pfn_to_nid() and related defintions close to each other Mike Rapoport
2020-04-21 2:24 ` Baoquan He
2020-04-21 8:49 ` Mike Rapoport
2020-04-21 8:49 ` Mike Rapoport
2020-04-21 9:33 ` Baoquan He
2020-04-21 3:31 ` Baoquan He
2020-04-21 8:39 ` Mike Rapoport
2020-04-21 8:39 ` Mike Rapoport
2020-04-12 19:48 ` [PATCH 03/21] mm: remove CONFIG_HAVE_MEMBLOCK_NODE_MAP option Mike Rapoport
2020-04-21 4:23 ` Baoquan He
2020-04-21 9:09 ` Mike Rapoport
2020-04-21 9:09 ` Mike Rapoport
2020-04-21 9:45 ` Baoquan He [this message]
2020-04-12 19:48 ` [PATCH 04/21] mm: free_area_init: use maximal zone PFNs rather than zone sizes Mike Rapoport
2020-04-22 23:41 ` Baoquan He
2020-06-15 3:53 ` Greg Ungerer
2020-06-15 6:22 ` Mike Rapoport
2020-06-15 6:22 ` Mike Rapoport
2020-06-15 7:17 ` Greg Ungerer
2020-04-12 19:48 ` [PATCH 05/21] mm: use free_area_init() instead of free_area_init_nodes() Mike Rapoport
2020-04-23 0:02 ` Baoquan He
2020-04-12 19:48 ` [PATCH 06/21] alpha: simplify detection of memory zone boundaries Mike Rapoport
2020-04-12 19:48 ` [PATCH 07/21] arm: " Mike Rapoport
2020-04-12 19:48 ` [PATCH 08/21] arm64: simplify detection of memory zone boundaries for UMA configs Mike Rapoport
2020-04-12 19:48 ` [PATCH 09/21] csky: simplify detection of memory zone boundaries Mike Rapoport
2020-04-12 19:48 ` [PATCH 10/21] m68k: mm: " Mike Rapoport
2020-04-12 19:48 ` [PATCH 11/21] parisc: " Mike Rapoport
2020-04-12 19:48 ` [PATCH 12/21] sparc32: " Mike Rapoport
2020-04-12 19:48 ` [PATCH 13/21] unicore32: " Mike Rapoport
2020-04-12 19:48 ` [PATCH 14/21] xtensa: " Mike Rapoport
2020-04-12 19:48 ` [PATCH 15/21] mm: memmap_init: iterate over memblock regions rather that check each PFN Mike Rapoport
2020-04-20 14:26 ` Qian Cai
2020-04-24 7:22 ` David Hildenbrand
2020-04-25 16:49 ` Mike Rapoport
2020-04-25 16:49 ` Mike Rapoport
2020-04-12 19:48 ` [PATCH 16/21] mm: remove early_pfn_in_nid() and CONFIG_NODES_SPAN_OTHER_NODES Mike Rapoport
2020-04-23 1:13 ` Baoquan He
2020-04-23 5:50 ` Mike Rapoport
2020-04-23 5:50 ` Mike Rapoport
2020-05-18 21:38 ` Hoan Tran
2020-04-12 19:48 ` [PATCH 17/21] mm: free_area_init: allow defining max_zone_pfn in descending order Mike Rapoport
2020-04-23 2:53 ` Baoquan He
2020-04-23 2:57 ` Baoquan He
2020-04-23 5:55 ` Mike Rapoport
2020-04-23 5:55 ` Mike Rapoport
2020-04-24 0:33 ` Baoquan He
2020-04-12 19:48 ` [PATCH 18/21] mm: rename free_area_init_node() to free_area_init_memoryless_node() Mike Rapoport
2020-04-23 3:14 ` Baoquan He
2020-04-23 6:18 ` Mike Rapoport
2020-04-23 6:18 ` Mike Rapoport
2020-04-12 19:48 ` [PATCH 19/21] mm: clean up free_area_init_node() and its helpers Mike Rapoport
2020-04-12 19:48 ` [PATCH 20/21] mm: simplify find_min_pfn_with_active_regions() Mike Rapoport
2020-04-12 19:48 ` [PATCH 21/21] docs/vm: update memory-models documentation Mike Rapoport
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200421094530.GB29658@MiWiFi-R3L-srv \
--to=bhe@redhat.com \
--cc=James.Bottomley@hansenpartnership.com \
--cc=bcain@codeaurora.org \
--cc=catalin.marinas@arm.com \
--cc=corbet@lwn.net \
--cc=dalias@libc.org \
--cc=deller@gmx.de \
--cc=gerg@linux-m68k.org \
--cc=guoren@kernel.org \
--cc=heiko.carstens@de.ibm.com \
--cc=jcmvbkbc@gmail.com \
--cc=linux-arch@vger.kernel.org \
--cc=linux-c6x-dev@linux-c6x.org \
--cc=linux-csky@vger.kernel.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-hexagon@vger.kernel.org \
--cc=linux-ia64@vger.kernel.org \
--cc=linux-parisc@vger.kernel.org \
--cc=linux-riscv@lists.infradead.org \
--cc=linux-s390@vger.kernel.org \
--cc=linux-sh@vger.kernel.org \
--cc=linux-snps-arc@lists.infradead.org \
--cc=linux@armlinux.org.uk \
--cc=mhocko@kernel.org \
--cc=mpe@ellerman.id.au \
--cc=rppt@kernel.org \
--cc=sparclinux@vger.kernel.org \
--cc=x86@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).