From: Marcelo Tosatti <mtosatti@redhat.com>
To: Thomas Gleixner <tglx@linutronix.de>
Cc: LKML <linux-kernel@vger.kernel.org>,
Anna-Maria Behnsen <anna-maria@linutronix.de>,
Peter Zijlstra <peterz@infradead.org>,
Frederic Weisbecker <frederic@kernel.org>,
Peter Xu <peterx@redhat.com>,
Nitesh Narayan Lal <nitesh@redhat.com>,
Alex Belits <abelits@marvell.com>,
"Rafael J. Wysocki" <rjw@rjwysocki.net>,
John Stultz <john.stultz@linaro.org>
Subject: Re: [patch V2 8/8] hrtimer: Avoid more SMP function calls in clock_was_set()
Date: Fri, 30 Apr 2021 13:49:33 -0300 [thread overview]
Message-ID: <20210430164933.GA73701@fuller.cnet> (raw)
In-Reply-To: <87a6pgfdps.ffs@nanos.tec.linutronix.de>
On Fri, Apr 30, 2021 at 09:12:15AM +0200, Thomas Gleixner wrote:
> By unconditionally updating the offsets there are more indicators
> whether the SMP function calls on clock_was_set() can be avoided:
>
> - When the offset update already happened on the remote CPU then the
> remote update attempt will yield the same seqeuence number and no
> IPI is required.
>
> - When the remote CPU is currently handling hrtimer_interrupt(). In
> that case the remote CPU will reevaluate the timer bases before
> reprogramming anyway, so nothing to do.
>
> - After updating it can be checked whether the first expiring timer in
> the affected clock bases moves before the first expiring (softirq)
> timer of the CPU. If that's not the case then sending the IPI is not
> required.
>
> Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
> ---
> V2: Fix the in_hrtirq thinko (Marcelo)
> Add the missing masking (reported by 0day)
>
> P.S.: The git branch is updated as well
>
> ---
> kernel/time/hrtimer.c | 74 +++++++++++++++++++++++++++++++++++++++++++-------
> 1 file changed, 65 insertions(+), 9 deletions(-)
>
> --- a/kernel/time/hrtimer.c
> +++ b/kernel/time/hrtimer.c
> @@ -880,6 +880,68 @@ static void hrtimer_reprogram(struct hrt
> tick_program_event(expires, 1);
> }
>
> +static bool update_needs_ipi(struct hrtimer_cpu_base *cpu_base,
> + unsigned int active)
> +{
> + struct hrtimer_clock_base *base;
> + unsigned int seq;
> + ktime_t expires;
> +
> + /*
> + * Update the base offsets unconditionally so the following
> + * checks whether the SMP function call is required works.
> + *
> + * The update is safe even when the remote CPU is in the hrtimer
> + * interrupt or the hrtimer soft interrupt and expiring affected
> + * bases. Either it will see the update before handling a base or
> + * it will see it when it finishes the processing and reevaluates
> + * the next expiring timer.
> + */
> + seq = cpu_base->clock_was_set_seq;
> + hrtimer_update_base(cpu_base);
> +
> + /*
> + * If the sequence did not change over the update then the
> + * remote CPU already handled it.
> + */
> + if (seq == cpu_base->clock_was_set_seq)
> + return false;
> +
> + /*
> + * If the remote CPU is currently handling an hrtimer interrupt, it
> + * will reevaluate the first expiring timer of all clock bases
> + * before reprogramming. Nothing to do here.
> + */
> + if (cpu_base->in_hrtirq)
> + return false;
Looks good, thanks.
> +
> + /*
> + * Walk the affected clock bases and check whether the first expiring
> + * timer in a clock base is moving ahead of the first expiring timer of
> + * @cpu_base. If so, the IPI must be invoked because per CPU clock
> + * event devices cannot be remotely reprogrammed.
> + */
> + active &= cpu_base->active_bases;
> +
> + for_each_active_base(base, cpu_base, active) {
> + struct timerqueue_node *next;
> +
> + next = timerqueue_getnext(&base->active);
> + expires = ktime_sub(next->expires, base->offset);
> + if (expires < cpu_base->expires_next)
> + return true;
> +
> + /* Extra check for softirq clock bases */
> + if (base->clockid < HRTIMER_BASE_MONOTONIC_SOFT)
> + continue;
> + if (cpu_base->softirq_activated)
> + continue;
> + if (expires < cpu_base->softirq_expires_next)
> + return true;
> + }
> + return false;
> +}
> +
> /*
> * Clock was set. This might affect CLOCK_REALTIME, CLOCK_TAI and
> * CLOCK_BOOTTIME (for late sleep time injection).
> @@ -914,16 +976,10 @@ void clock_was_set(unsigned int bases)
> unsigned long flags;
>
> raw_spin_lock_irqsave(&cpu_base->lock, flags);
> - /*
> - * Only send the IPI when there are timers queued in one of
> - * the affected clock bases. Otherwise update the base
> - * remote to ensure that the next enqueue of a timer on
> - * such a clock base will see the correct offsets.
> - */
> - if (cpu_base->active_bases & bases)
> +
> + if (update_needs_ipi(cpu_base, bases))
> cpumask_set_cpu(cpu, mask);
> - else
> - hrtimer_update_base(cpu_base);
> +
> raw_spin_unlock_irqrestore(&cpu_base->lock, flags);
> }
>
>
>
next prev parent reply other threads:[~2021-04-30 16:50 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-04-27 8:25 [patch 0/8] hrtimers: Overhaul the clock_was_set() logic Thomas Gleixner
2021-04-27 8:25 ` [patch 1/8] hrtimer: Ensure timerfd notification for HIGHRES=n Thomas Gleixner
2021-04-27 8:25 ` [patch 2/8] hrtimer: Force clock_was_set() handling for the HIGHRES=n, NOHZ=y case Thomas Gleixner
2021-05-12 14:59 ` Peter Zijlstra
2021-05-12 16:40 ` Thomas Gleixner
2021-04-27 8:25 ` [patch 3/8] timerfd: Provide timerfd_resume() Thomas Gleixner
2021-04-27 8:25 ` [patch 4/8] timekeeping: Distangle resume and clock-was-set events Thomas Gleixner
2021-04-27 8:25 ` [patch 5/8] time/timekeeping: Avoid invoking clock_was_set() twice Thomas Gleixner
2021-04-27 8:25 ` [patch 6/8] hrtimer: Add bases argument to clock_was_set() Thomas Gleixner
2021-04-27 8:25 ` [patch 7/8] hrtimer: Avoid unnecessary SMP function calls in clock_was_set() Thomas Gleixner
2021-05-13 14:59 ` Peter Zijlstra
2021-05-14 18:52 ` Thomas Gleixner
2021-05-14 23:28 ` Peter Zijlstra
2021-05-15 0:24 ` Thomas Gleixner
2021-04-27 8:25 ` [patch 8/8] hrtimer: Avoid more " Thomas Gleixner
2021-04-27 15:11 ` Marcelo Tosatti
2021-04-27 19:59 ` Thomas Gleixner
2021-04-30 7:12 ` [patch V2 " Thomas Gleixner
2021-04-30 16:49 ` Marcelo Tosatti [this message]
2021-05-13 7:47 ` Peter Zijlstra
2021-05-14 19:08 ` Thomas Gleixner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20210430164933.GA73701@fuller.cnet \
--to=mtosatti@redhat.com \
--cc=abelits@marvell.com \
--cc=anna-maria@linutronix.de \
--cc=frederic@kernel.org \
--cc=john.stultz@linaro.org \
--cc=linux-kernel@vger.kernel.org \
--cc=nitesh@redhat.com \
--cc=peterx@redhat.com \
--cc=peterz@infradead.org \
--cc=rjw@rjwysocki.net \
--cc=tglx@linutronix.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).