* [tip:x86/mm] x86/mm/cpa: Avoid wbinvd() for PREEMPT
@ 2017-01-30 14:36 tip-bot for John Ogness
2017-01-30 16:13 ` Ingo Molnar
0 siblings, 1 reply; 2+ messages in thread
From: tip-bot for John Ogness @ 2017-01-30 14:36 UTC (permalink / raw)
To: linux-tip-commits
Cc: peterz, tglx, john.ogness, mingo, linux-rt-users, hpa, bigeasy
Commit-ID: 459fbe00693449fade2d1bc802791b081c94edcf
Gitweb: http://git.kernel.org/tip/459fbe00693449fade2d1bc802791b081c94edcf
Author: John Ogness <john.ogness@linutronix.de>
AuthorDate: Mon, 30 Jan 2017 09:41:21 +0100
Committer: Thomas Gleixner <tglx@linutronix.de>
CommitDate: Mon, 30 Jan 2017 15:33:52 +0100
x86/mm/cpa: Avoid wbinvd() for PREEMPT
Although wbinvd() is faster than flushing many individual pages, it blocks
the memory bus for "long" periods of time (>100us), thus directly causing
unusually large latencies on all CPUs, regardless of any CPU isolation
features that may be active. This is an unpriviledged operatation as it is
exposed to user space via the graphics subsystem.
For 1024 pages, flushing those pages individually can take up to 2200us,
but the task remains fully preemptible during that time.
Signed-off-by: John Ogness <john.ogness@linutronix.de>
Acked-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Cc: Sebastian Siewior <bigeasy@linutronix.de>
Cc: linux-rt-users <linux-rt-users@vger.kernel.org>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
---
arch/x86/mm/pageattr.c | 13 +++++++++++++
1 file changed, 13 insertions(+)
diff --git a/arch/x86/mm/pageattr.c b/arch/x86/mm/pageattr.c
index 5a287e5..28d4213 100644
--- a/arch/x86/mm/pageattr.c
+++ b/arch/x86/mm/pageattr.c
@@ -214,7 +214,20 @@ static void cpa_flush_array(unsigned long *start, int numpages, int cache,
int in_flags, struct page **pages)
{
unsigned int i, level;
+#ifdef CONFIG_PREEMPT
+ /*
+ * Avoid wbinvd() because it causes latencies on all CPUs,
+ * regardless of any CPU isolation that may be in effect.
+ *
+ * This should be extended for CAT enabled systems independent of
+ * PREEMPT because wbinvd() does not respect the CAT partitions and
+ * this is exposed to unpriviledged users through the graphics
+ * subsystem.
+ */
+ unsigned long do_wbinvd = 0;
+#else
unsigned long do_wbinvd = cache && numpages >= 1024; /* 4M threshold */
+#endif
BUG_ON(irqs_disabled());
^ permalink raw reply related [flat|nested] 2+ messages in thread
* Re: [tip:x86/mm] x86/mm/cpa: Avoid wbinvd() for PREEMPT
2017-01-30 14:36 [tip:x86/mm] x86/mm/cpa: Avoid wbinvd() for PREEMPT tip-bot for John Ogness
@ 2017-01-30 16:13 ` Ingo Molnar
0 siblings, 0 replies; 2+ messages in thread
From: Ingo Molnar @ 2017-01-30 16:13 UTC (permalink / raw)
To: linux-kernel, tglx, linux-rt-users, john.ogness, peterz, bigeasy, hpa
Cc: linux-tip-commits
* tip-bot for John Ogness <tipbot@zytor.com> wrote:
> Commit-ID: 459fbe00693449fade2d1bc802791b081c94edcf
> Gitweb: http://git.kernel.org/tip/459fbe00693449fade2d1bc802791b081c94edcf
> Author: John Ogness <john.ogness@linutronix.de>
> AuthorDate: Mon, 30 Jan 2017 09:41:21 +0100
> Committer: Thomas Gleixner <tglx@linutronix.de>
> CommitDate: Mon, 30 Jan 2017 15:33:52 +0100
>
> x86/mm/cpa: Avoid wbinvd() for PREEMPT
>
> Although wbinvd() is faster than flushing many individual pages, it blocks
> the memory bus for "long" periods of time (>100us), thus directly causing
> unusually large latencies on all CPUs, regardless of any CPU isolation
> features that may be active. This is an unpriviledged operatation as it is
> exposed to user space via the graphics subsystem.
s/unpriviledged
/unprivileged
>
> For 1024 pages, flushing those pages individually can take up to 2200us,
> but the task remains fully preemptible during that time.
>
> Signed-off-by: John Ogness <john.ogness@linutronix.de>
> Acked-by: Peter Zijlstra (Intel) <peterz@infradead.org>
> Cc: Sebastian Siewior <bigeasy@linutronix.de>
> Cc: linux-rt-users <linux-rt-users@vger.kernel.org>
> Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
>
> ---
> arch/x86/mm/pageattr.c | 13 +++++++++++++
> 1 file changed, 13 insertions(+)
>
> diff --git a/arch/x86/mm/pageattr.c b/arch/x86/mm/pageattr.c
> index 5a287e5..28d4213 100644
> --- a/arch/x86/mm/pageattr.c
> +++ b/arch/x86/mm/pageattr.c
> @@ -214,7 +214,20 @@ static void cpa_flush_array(unsigned long *start, int numpages, int cache,
> int in_flags, struct page **pages)
> {
> unsigned int i, level;
> +#ifdef CONFIG_PREEMPT
> + /*
> + * Avoid wbinvd() because it causes latencies on all CPUs,
> + * regardless of any CPU isolation that may be in effect.
> + *
> + * This should be extended for CAT enabled systems independent of
> + * PREEMPT because wbinvd() does not respect the CAT partitions and
> + * this is exposed to unpriviledged users through the graphics
> + * subsystem.
s/unpriviledged
/unprivileged
> +#else
> unsigned long do_wbinvd = cache && numpages >= 1024; /* 4M threshold */
> +#endif
... and while at it:
s/4M/4MB?
Thanks,
Ingo
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2017-01-30 16:46 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-01-30 14:36 [tip:x86/mm] x86/mm/cpa: Avoid wbinvd() for PREEMPT tip-bot for John Ogness
2017-01-30 16:13 ` Ingo Molnar
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.