All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Huang\, Ying" <ying.huang@intel.com>
To: Daniel Jordan <daniel.m.jordan@oracle.com>
Cc: Andrew Morton <akpm@linux-foundation.org>, <linux-mm@kvack.org>,
	<linux-kernel@vger.kernel.org>,
	"Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Michal Hocko <mhocko@kernel.org>,
	Johannes Weiner <hannes@cmpxchg.org>,
	Shaohua Li <shli@kernel.org>, Hugh Dickins <hughd@google.com>,
	Minchan Kim <minchan@kernel.org>, Rik van Riel <riel@redhat.com>,
	Dave Hansen <dave.hansen@linux.intel.com>,
	Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>,
	Zi Yan <zi.yan@cs.rutgers.edu>
Subject: Re: [PATCH -V5 RESEND 03/21] swap: Support PMD swap mapping in swap_duplicate()
Date: Wed, 26 Sep 2018 20:55:59 +0800	[thread overview]
Message-ID: <874lecifj4.fsf@yhuang-dev.intel.com> (raw)
In-Reply-To: <20180925191953.4ped5ki7u3ymafmd@ca-dmjordan1.us.oracle.com> (Daniel Jordan's message of "Tue, 25 Sep 2018 12:19:53 -0700")

Daniel Jordan <daniel.m.jordan@oracle.com> writes:

> On Tue, Sep 25, 2018 at 03:13:30PM +0800, Huang Ying wrote:
>> @@ -3487,35 +3521,66 @@ static int __swap_duplicate_locked(struct swap_info_struct *p,
>>  }
>>  
>>  /*
>> - * Verify that a swap entry is valid and increment its swap map count.
>> + * Verify that the swap entries from *entry is valid and increment their
>> + * PMD/PTE swap mapping count.
>>   *
>>   * Returns error code in following case.
>>   * - success -> 0
>>   * - swp_entry is invalid -> EINVAL
>> - * - swp_entry is migration entry -> EINVAL
>
> I'm assuming it wasn't possible to hit this error before this patch, and you're
> just removing it now since you're in the area?

Yes.

>>   * - swap-cache reference is requested but there is already one. -> EEXIST
>>   * - swap-cache reference is requested but the entry is not used. -> ENOENT
>>   * - swap-mapped reference requested but needs continued swap count. -> ENOMEM
>> + * - the huge swap cluster has been split. -> ENOTDIR
>
> Strangely intuitive choice of error code :)

Thanks!  It doesn't match the error exactly, but I have no better choice
now.  Matthew Wilcox have suggested to use an swap specific enum
instead.  I think that is good in general, but we need only one extra
error code, and we need to change the interface of several swap
functions.  So I think that should be in a separate patchset if
necessary.

>>  /*
>>   * Increase reference count of swap entry by 1.
>> - * Returns 0 for success, or -ENOMEM if a swap_count_continuation is required
>> - * but could not be atomically allocated.  Returns 0, just as if it succeeded,
>> - * if __swap_duplicate() fails for another reason (-EINVAL or -ENOENT), which
>> - * might occur if a page table entry has got corrupted.
>> + *
>> + * Return error code in following case.
>> + * - success -> 0
>> + * - swap_count_continuation is required but could not be atomically allocated.
>> + *   *entry is used to return swap entry to call add_swap_count_continuation().
>> + *								      -> ENOMEM
>> + * - otherwise same as __swap_duplicate()
>>   */
>> -int swap_duplicate(swp_entry_t entry)
>> +int swap_duplicate(swp_entry_t *entry, int entry_size)
>>  {
>>  	int err = 0;
>>  
>> -	while (!err && __swap_duplicate(entry, 1) == -ENOMEM)
>> -		err = add_swap_count_continuation(entry, GFP_ATOMIC);
>> +	while (!err &&
>> +	       (err = __swap_duplicate(entry, entry_size, 1)) == -ENOMEM)
>> +		err = add_swap_count_continuation(*entry, GFP_ATOMIC);
>>  	return err;
>
> Now we're returning any error we get from __swap_duplicate, apparently to
> accommodate ENOTDIR later in the series, which is a change from the behavior
> introduced in 570a335b8e22 ("swap_info: swap count continuations").  This might
> belong in a separate patch given its potential for side effects.

I have checked all the calls of the function and found there will be no
bad effect.  Do you have any side effect?

> Although, I don't understand why 570a335b8e22 ignored errors other than -ENOMEM
> when both swap_duplicate callers _seem_ from a quick read to be able to respond
> gracefully to any error.

Before 570a335b8e22, all errors are ignored in swap_duplicate() (its
type is void).  If my understanding were correct, all errors except
-ENOMEM are impossible before changes in this patchset.  So they are
ignored.

Best Regards,
Huang, Ying

WARNING: multiple messages have this Message-ID (diff)
From: "Huang\, Ying" <ying.huang@intel.com>
To: Daniel Jordan <daniel.m.jordan@oracle.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	"Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Michal Hocko <mhocko@kernel.org>,
	Johannes Weiner <hannes@cmpxchg.org>,
	Shaohua Li <shli@kernel.org>, Hugh Dickins <hughd@google.com>,
	Minchan Kim <minchan@kernel.org>, Rik van Riel <riel@redhat.com>,
	Dave Hansen <dave.hansen@linux.intel.com>,
	Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>,
	Zi Yan <zi.yan@cs.rutgers.edu>
Subject: Re: [PATCH -V5 RESEND 03/21] swap: Support PMD swap mapping in swap_duplicate()
Date: Wed, 26 Sep 2018 20:55:59 +0800	[thread overview]
Message-ID: <874lecifj4.fsf@yhuang-dev.intel.com> (raw)
In-Reply-To: <20180925191953.4ped5ki7u3ymafmd@ca-dmjordan1.us.oracle.com> (Daniel Jordan's message of "Tue, 25 Sep 2018 12:19:53 -0700")

Daniel Jordan <daniel.m.jordan@oracle.com> writes:

> On Tue, Sep 25, 2018 at 03:13:30PM +0800, Huang Ying wrote:
>> @@ -3487,35 +3521,66 @@ static int __swap_duplicate_locked(struct swap_info_struct *p,
>>  }
>>  
>>  /*
>> - * Verify that a swap entry is valid and increment its swap map count.
>> + * Verify that the swap entries from *entry is valid and increment their
>> + * PMD/PTE swap mapping count.
>>   *
>>   * Returns error code in following case.
>>   * - success -> 0
>>   * - swp_entry is invalid -> EINVAL
>> - * - swp_entry is migration entry -> EINVAL
>
> I'm assuming it wasn't possible to hit this error before this patch, and you're
> just removing it now since you're in the area?

Yes.

>>   * - swap-cache reference is requested but there is already one. -> EEXIST
>>   * - swap-cache reference is requested but the entry is not used. -> ENOENT
>>   * - swap-mapped reference requested but needs continued swap count. -> ENOMEM
>> + * - the huge swap cluster has been split. -> ENOTDIR
>
> Strangely intuitive choice of error code :)

Thanks!  It doesn't match the error exactly, but I have no better choice
now.  Matthew Wilcox have suggested to use an swap specific enum
instead.  I think that is good in general, but we need only one extra
error code, and we need to change the interface of several swap
functions.  So I think that should be in a separate patchset if
necessary.

>>  /*
>>   * Increase reference count of swap entry by 1.
>> - * Returns 0 for success, or -ENOMEM if a swap_count_continuation is required
>> - * but could not be atomically allocated.  Returns 0, just as if it succeeded,
>> - * if __swap_duplicate() fails for another reason (-EINVAL or -ENOENT), which
>> - * might occur if a page table entry has got corrupted.
>> + *
>> + * Return error code in following case.
>> + * - success -> 0
>> + * - swap_count_continuation is required but could not be atomically allocated.
>> + *   *entry is used to return swap entry to call add_swap_count_continuation().
>> + *								      -> ENOMEM
>> + * - otherwise same as __swap_duplicate()
>>   */
>> -int swap_duplicate(swp_entry_t entry)
>> +int swap_duplicate(swp_entry_t *entry, int entry_size)
>>  {
>>  	int err = 0;
>>  
>> -	while (!err && __swap_duplicate(entry, 1) == -ENOMEM)
>> -		err = add_swap_count_continuation(entry, GFP_ATOMIC);
>> +	while (!err &&
>> +	       (err = __swap_duplicate(entry, entry_size, 1)) == -ENOMEM)
>> +		err = add_swap_count_continuation(*entry, GFP_ATOMIC);
>>  	return err;
>
> Now we're returning any error we get from __swap_duplicate, apparently to
> accommodate ENOTDIR later in the series, which is a change from the behavior
> introduced in 570a335b8e22 ("swap_info: swap count continuations").  This might
> belong in a separate patch given its potential for side effects.

I have checked all the calls of the function and found there will be no
bad effect.  Do you have any side effect?

> Although, I don't understand why 570a335b8e22 ignored errors other than -ENOMEM
> when both swap_duplicate callers _seem_ from a quick read to be able to respond
> gracefully to any error.

Before 570a335b8e22, all errors are ignored in swap_duplicate() (its
type is void).  If my understanding were correct, all errors except
-ENOMEM are impossible before changes in this patchset.  So they are
ignored.

Best Regards,
Huang, Ying

  reply	other threads:[~2018-09-26 12:56 UTC|newest]

Thread overview: 37+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-09-25  7:13 [PATCH -V5 RESEND 00/21] swap: Swapout/swapin THP in one piece Huang Ying
2018-09-25  7:13 ` Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 01/21] swap: Enable PMD swap operations for CONFIG_THP_SWAP Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 02/21] swap: Add __swap_duplicate_locked() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 03/21] swap: Support PMD swap mapping in swap_duplicate() Huang Ying
2018-09-25 19:19   ` Daniel Jordan
2018-09-26 12:55     ` Huang, Ying [this message]
2018-09-26 12:55       ` Huang, Ying
2018-09-26 14:51       ` Daniel Jordan
2018-09-27  1:34         ` Huang, Ying
2018-09-27  1:34           ` Huang, Ying
2018-09-27 21:12           ` Daniel Jordan
2018-09-28  8:19             ` Huang, Ying
2018-09-28  8:19               ` Huang, Ying
2018-09-28 21:32               ` Daniel Jordan
2018-09-29  0:50                 ` Huang, Ying
2018-09-29  0:50                   ` Huang, Ying
2018-10-01 17:21                   ` Daniel Jordan
2018-09-25  7:13 ` [PATCH -V5 RESEND 04/21] swap: Support PMD swap mapping in put_swap_page() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 05/21] swap: Support PMD swap mapping in free_swap_and_cache()/swap_free() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 06/21] swap: Support PMD swap mapping when splitting huge PMD Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 07/21] swap: Support PMD swap mapping in split_swap_cluster() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 08/21] swap: Support to read a huge swap cluster for swapin a THP Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 09/21] swap: Swapin a THP in one piece Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 10/21] swap: Support to count THP swapin and its fallback Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 11/21] swap: Add sysfs interface to configure THP swapin Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 12/21] swap: Support PMD swap mapping in swapoff Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 13/21] swap: Support PMD swap mapping in madvise_free() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 14/21] swap: Support to move swap account for PMD swap mapping Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 15/21] swap: Support to copy PMD swap mapping when fork() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 16/21] swap: Free PMD swap mapping when zap_huge_pmd() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 17/21] swap: Support PMD swap mapping for MADV_WILLNEED Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 18/21] swap: Support PMD swap mapping in mincore() Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 19/21] swap: Support PMD swap mapping in common path Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 20/21] swap: create PMD swap mapping when unmap the THP Huang Ying
2018-09-25  7:13 ` [PATCH -V5 RESEND 21/21] swap: Update help of CONFIG_THP_SWAP Huang Ying
  -- strict thread matches above, loose matches on Subject: below --
2018-09-12  0:43 [PATCH -V5 RESEND 00/21] swap: Swapout/swapin THP in one piece Huang Ying
2018-09-12  0:43 ` [PATCH -V5 RESEND 03/21] swap: Support PMD swap mapping in swap_duplicate() Huang Ying

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=874lecifj4.fsf@yhuang-dev.intel.com \
    --to=ying.huang@intel.com \
    --cc=aarcange@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=daniel.m.jordan@oracle.com \
    --cc=dave.hansen@linux.intel.com \
    --cc=hannes@cmpxchg.org \
    --cc=hughd@google.com \
    --cc=kirill.shutemov@linux.intel.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mhocko@kernel.org \
    --cc=minchan@kernel.org \
    --cc=n-horiguchi@ah.jp.nec.com \
    --cc=riel@redhat.com \
    --cc=shli@kernel.org \
    --cc=zi.yan@cs.rutgers.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.