From: "Huang, Ying" <ying.huang@intel.com>
To: Nadav Amit <namit@vmware.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
"linux-mm@kvack.org" <linux-mm@kvack.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
kernel test robot <yujie.liu@intel.com>,
"Mel Gorman" <mgorman@techsingularity.net>,
Hugh Dickins <hughd@google.com>,
Matthew Wilcox <willy@infradead.org>,
David Hildenbrand <david@redhat.com>
Subject: Re: [PATCH] mm,unmap: avoid flushing TLB in batch if PTE is inaccessible
Date: Wed, 12 Apr 2023 09:50:40 +0800 [thread overview]
Message-ID: <87sfd5zx5b.fsf@yhuang6-desk2.ccr.corp.intel.com> (raw)
In-Reply-To: <D432368D-7E3F-47C8-8BE3-A0D11BC6EA2D@vmware.com> (Nadav Amit's message of "Tue, 11 Apr 2023 17:52:02 +0000")
Nadav Amit <namit@vmware.com> writes:
>> On Apr 10, 2023, at 6:31 PM, Huang, Ying <ying.huang@intel.com> wrote:
>>
>> !! External Email
>>
>> Hi, Amit,
>>
>> Thank you very much for review!
>>
>> Nadav Amit <namit@vmware.com> writes:
>>
>>>> On Apr 10, 2023, at 12:52 AM, Huang Ying <ying.huang@intel.com> wrote:
>>>>
>>>> 0Day/LKP reported a performance regression for commit
>>>> 7e12beb8ca2a ("migrate_pages: batch flushing TLB"). In the commit, the
>>>> TLB flushing during page migration is batched. So, in
>>>> try_to_migrate_one(), ptep_clear_flush() is replaced with
>>>> set_tlb_ubc_flush_pending(). In further investigation, it is found
>>>> that the TLB flushing can be avoided in ptep_clear_flush() if the PTE
>>>> is inaccessible. In fact, we can optimize in similar way for the
>>>> batched TLB flushing too to improve the performance.
>>>>
>>>> So in this patch, we check pte_accessible() before
>>>> set_tlb_ubc_flush_pending() in try_to_unmap/migrate_one(). Tests show
>>>> that the benchmark score of the anon-cow-rand-mt test case of
>>>> vm-scalability test suite can improve up to 2.1% with the patch on a
>>>> Intel server machine. The TLB flushing IPI can reduce up to 44.3%.
>>>
>>> LGTM.
>>
>> Thanks!
>>
>>> I know it’s meaningless for x86 (but perhaps ARM would use this infra
>>> too): do we need smp_mb__after_atomic() after ptep_get_and_clear() and
>>> before pte_accessible()?
>>
>> Why do we need the memory barrier? IIUC, the PTL is locked, so PTE
>> value will not be changed under us. Anything else?
>
> I was thinking about the ordering with respect to
> atomic_read(&mm->tlb_flush_pending), which is not protected by the PTL.
> I guess you can correctly argue that because of other control-flow
> dependencies, the barrier is not necessary.
For ordering between ptep_get_and_clear() and
atomic_read(&mm->tlb_flush_pending), I think PTL has provided the
necessary protection already. The code path to write
mm->tlb_flush_pending is,
tlb_gather_mmu
inc_tlb_flush_pending a)
lock PTL
change PTE b)
unlock PTL
tlb_finish_mmu
dec_tlb_flush_pending c)
While code path of try_to_unmap/migrate_one is,
lock PTL
read and change PTE d)
read mm->tlb_flush_pending e)
unlock PTL
Even if e) occurs before d), they cannot occur at the same time of b).
Do I miss anything?
Best Regards,
Huang, Ying
[snip]
next prev parent reply other threads:[~2023-04-12 1:51 UTC|newest]
Thread overview: 10+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-04-10 7:52 [PATCH] mm,unmap: avoid flushing TLB in batch if PTE is inaccessible Huang Ying
2023-04-10 19:47 ` Nadav Amit
2023-04-11 1:31 ` Huang, Ying
2023-04-11 17:52 ` Nadav Amit
2023-04-12 1:50 ` Huang, Ying [this message]
2023-04-12 17:00 ` Nadav Amit
2023-04-18 3:17 ` Huang, Ying
2023-04-19 22:58 ` Nadav Amit
2023-04-20 7:44 ` haoxin
2023-04-20 8:38 ` Huang, Ying
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87sfd5zx5b.fsf@yhuang6-desk2.ccr.corp.intel.com \
--to=ying.huang@intel.com \
--cc=akpm@linux-foundation.org \
--cc=david@redhat.com \
--cc=hughd@google.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mgorman@techsingularity.net \
--cc=namit@vmware.com \
--cc=willy@infradead.org \
--cc=yujie.liu@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).