From: Yang Shi <shy828301@gmail.com>
To: Oscar Salvador <osalvador@suse.de>
Cc: Dave Hansen <dave.hansen@linux.intel.com>,
Linux MM <linux-mm@kvack.org>,
Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
Yang Shi <yang.shi@linux.alibaba.com>,
weixugc@google.com, Huang Ying <ying.huang@intel.com>,
Dan Williams <dan.j.williams@intel.com>,
David Hildenbrand <david@redhat.com>
Subject: Re: [PATCH 04/10] mm/migrate: make migrate_pages() return nr_succeeded
Date: Thu, 8 Apr 2021 10:26:54 -0700 [thread overview]
Message-ID: <CAHbLzkqoaSnuBJMAe_heQt01FuPWODYQHJ955gaJNNojwbUjrw@mail.gmail.com> (raw)
In-Reply-To: <YG7XjTG9tiK29y1j@localhost.localdomain>
On Thu, Apr 8, 2021 at 3:14 AM Oscar Salvador <osalvador@suse.de> wrote:
>
> On Thu, Apr 01, 2021 at 11:32:23AM -0700, Dave Hansen wrote:
> >
> > From: Yang Shi <yang.shi@linux.alibaba.com>
> >
> > The migrate_pages() returns the number of pages that were not migrated,
> > or an error code. When returning an error code, there is no way to know
> > how many pages were migrated or not migrated.
> >
> > In the following patch, migrate_pages() is used to demote pages to PMEM
> > node, we need account how many pages are reclaimed (demoted) since page
> > reclaim behavior depends on this. Add *nr_succeeded parameter to make
> > migrate_pages() return how many pages are demoted successfully for all
> > cases.
> >
> > Signed-off-by: Yang Shi <yang.shi@linux.alibaba.com>
> > Signed-off-by: Dave Hansen <dave.hansen@linux.intel.com>
> > Reviewed-by: Yang Shi <shy828301@gmail.com>
> > Cc: Wei Xu <weixugc@google.com>
> > Cc: Huang Ying <ying.huang@intel.com>
> > Cc: Dan Williams <dan.j.williams@intel.com>
> > Cc: David Hildenbrand <david@redhat.com>
> > Cc: osalvador <osalvador@suse.de>
> >
>
> ...
> > int migrate_pages(struct list_head *from, new_page_t get_new_page,
> > free_page_t put_new_page, unsigned long private,
> > - enum migrate_mode mode, int reason)
> > + enum migrate_mode mode, int reason, unsigned int *nr_succeeded)
> > {
> > int retry = 1;
> > int thp_retry = 1;
> > int nr_failed = 0;
> > - int nr_succeeded = 0;
> > int nr_thp_succeeded = 0;
> > int nr_thp_failed = 0;
> > int nr_thp_split = 0;
> > @@ -1611,10 +1611,10 @@ retry:
> > case MIGRATEPAGE_SUCCESS:
> > if (is_thp) {
> > nr_thp_succeeded++;
> > - nr_succeeded += nr_subpages;
> > + *nr_succeeded += nr_subpages;
> > break;
> > }
> > - nr_succeeded++;
> > + (*nr_succeeded)++;
> > break;
> > default:
> > /*
> > @@ -1643,12 +1643,12 @@ out:
> > */
> > list_splice(&ret_pages, from);
> >
> > - count_vm_events(PGMIGRATE_SUCCESS, nr_succeeded);
> > + count_vm_events(PGMIGRATE_SUCCESS, *nr_succeeded);
> > count_vm_events(PGMIGRATE_FAIL, nr_failed);
> > count_vm_events(THP_MIGRATION_SUCCESS, nr_thp_succeeded);
> > count_vm_events(THP_MIGRATION_FAIL, nr_thp_failed);
> > count_vm_events(THP_MIGRATION_SPLIT, nr_thp_split);
> > - trace_mm_migrate_pages(nr_succeeded, nr_failed, nr_thp_succeeded,
> > + trace_mm_migrate_pages(*nr_succeeded, nr_failed, nr_thp_succeeded,
> > nr_thp_failed, nr_thp_split, mode, reason);
>
> It seems that reclaiming is the only user who cared about how many pages
> could we migrated, could not do the following instead:
>
> diff --git a/mm/migrate.c b/mm/migrate.c
> index 695a594e5860..d4170b7ea2fe 100644
> --- a/mm/migrate.c
> +++ b/mm/migrate.c
> @@ -1503,7 +1503,7 @@ static inline int try_split_thp(struct page *page, struct page **page2,
> */
> int migrate_pages(struct list_head *from, new_page_t get_new_page,
> free_page_t put_new_page, unsigned long private,
> - enum migrate_mode mode, int reason)
> + enum migrate_mode mode, int reason, unsigned int *ret_succeeded)
> {
> int retry = 1;
> int thp_retry = 1;
> @@ -1654,6 +1654,9 @@ int migrate_pages(struct list_head *from, new_page_t get_new_page,
> if (!swapwrite)
> current->flags &= ~PF_SWAPWRITE;
>
> + if (ret_succedded)
> + *ret_succedded = nr_succedded;
> +
> return rc;
> }
>
> And pass only a valid pointer from demote_page_list() and NULL from all
> the others?
> I was just wondered after all those "unsigned int nr_succedded" in all
> other functions.
> This would also solve the "be careful to initialize nr_succedded"
> problem?
Thanks, Oscar. Yes, kind of. But we have to remember to initialize
"nr_succedded" pointer properly for every migrate_pages() callsite,
right? And it doesn't prevent from returning wrong value if
migrate_pages() is called multiple times by one caller although there
might be not such case (calls migrate_pages() multiple times and care
about nr_succeded) for now.
So IMHO I do prefer Wei's suggestion to have migrate_pages()
initialize nr_succeeded. This seems simpler.
>
>
> --
> Oscar Salvador
> SUSE L3
next prev parent reply other threads:[~2021-04-08 17:27 UTC|newest]
Thread overview: 64+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-04-01 18:32 [PATCH 00/10] [v7][RESEND] Migrate Pages in lieu of discard Dave Hansen
2021-04-01 18:32 ` [PATCH 01/10] mm/numa: node demotion data structure and lookup Dave Hansen
2021-04-08 8:03 ` Oscar Salvador
2021-04-08 21:29 ` Dave Hansen
2021-04-09 5:32 ` Wei Xu
2021-04-01 18:32 ` [PATCH 02/10] mm/numa: automatically generate node migration order Dave Hansen
2021-04-08 8:26 ` Oscar Salvador
2021-04-08 21:51 ` Dave Hansen
2021-04-09 8:17 ` Oscar Salvador
2021-04-10 3:07 ` Wei Xu
2021-04-14 8:08 ` Oscar Salvador
2021-04-14 8:11 ` Oscar Salvador
2021-04-14 8:12 ` David Hildenbrand
2021-04-14 8:14 ` Oscar Salvador
2021-04-14 8:20 ` David Hildenbrand
2021-04-15 4:07 ` Wei Xu
2021-04-15 15:35 ` Dave Hansen
2021-04-15 20:25 ` Wei Xu
2021-04-01 18:32 ` [PATCH 03/10] mm/migrate: update node demotion order during on hotplug events Dave Hansen
2021-04-08 9:52 ` Oscar Salvador
2021-04-09 10:14 ` Oscar Salvador
2021-04-09 10:15 ` Oscar Salvador
2021-04-09 18:59 ` David Hildenbrand
2021-04-12 7:19 ` Oscar Salvador
2021-04-12 9:19 ` David Hildenbrand
2021-04-01 18:32 ` [PATCH 04/10] mm/migrate: make migrate_pages() return nr_succeeded Dave Hansen
2021-04-01 22:39 ` Wei Xu
[not found] ` <CAAPL-u-o-M2T25xBtSoipYjUnu+3aJNcJ9uS84yKaAnbrXpefw@mail.gmail.com>
2021-04-01 23:21 ` Dave Hansen
2021-04-08 10:14 ` Oscar Salvador
2021-04-08 17:26 ` Yang Shi [this message]
2021-04-08 18:17 ` Oscar Salvador
2021-04-08 18:21 ` Oscar Salvador
2021-04-08 20:40 ` Yang Shi
2021-04-09 5:06 ` Oscar Salvador
2021-04-09 5:43 ` Wei Xu
2021-04-09 15:43 ` Yang Shi
2021-04-09 15:50 ` Dave Hansen
2021-04-09 18:47 ` Wei Xu
2021-04-09 20:10 ` Yang Shi
2021-04-01 18:32 ` [PATCH 05/10] mm/migrate: demote pages during reclaim Dave Hansen
2021-04-01 20:01 ` Yang Shi
2021-04-01 22:58 ` Dave Hansen
2021-04-08 10:47 ` Oscar Salvador
2021-04-10 3:35 ` Wei Xu
2021-04-01 18:32 ` [PATCH 06/10] mm/vmscan: add page demotion counter Dave Hansen
2021-04-10 3:40 ` Wei Xu
2021-04-01 18:32 ` [PATCH 07/10] mm/vmscan: add helper for querying ability to age anonymous pages Dave Hansen
2021-04-07 18:40 ` Wei Xu
2021-04-09 8:31 ` Oscar Salvador
2021-04-01 18:32 ` [PATCH 08/10] mm/vmscan: Consider anonymous pages without swap Dave Hansen
2021-04-02 0:55 ` Wei Xu
2021-04-01 18:32 ` [PATCH 09/10] mm/vmscan: never demote for memcg reclaim Dave Hansen
2021-04-02 0:18 ` Wei Xu
2021-04-01 18:32 ` [PATCH 10/10] mm/migrate: new zone_reclaim_mode to enable reclaim migration Dave Hansen
2021-04-01 20:06 ` Yang Shi
2021-04-10 4:10 ` Wei Xu
2021-04-16 12:35 ` [PATCH 00/10] [v7][RESEND] Migrate Pages in lieu of discard Michal Hocko
2021-04-16 14:26 ` Dave Hansen
2021-04-16 15:02 ` Michal Hocko
2021-04-21 2:39 ` Huang, Ying
2021-05-07 6:14 ` Huang, Ying
2021-06-11 5:50 ` Huang, Ying
-- strict thread matches above, loose matches on Subject: below --
2021-03-04 23:59 [PATCH 00/10] [v6] " Dave Hansen
2021-03-04 23:59 ` [PATCH 04/10] mm/migrate: make migrate_pages() return nr_succeeded Dave Hansen
2021-03-09 0:05 ` Yang Shi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAHbLzkqoaSnuBJMAe_heQt01FuPWODYQHJ955gaJNNojwbUjrw@mail.gmail.com \
--to=shy828301@gmail.com \
--cc=dan.j.williams@intel.com \
--cc=dave.hansen@linux.intel.com \
--cc=david@redhat.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=osalvador@suse.de \
--cc=weixugc@google.com \
--cc=yang.shi@linux.alibaba.com \
--cc=ying.huang@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).