From: Vincent Guittot <vincent.guittot@linaro.org>
To: peterz@infradead.org, mingo@kernel.org,
linux-kernel@vger.kernel.org, rjw@rjwysocki.net
Cc: juri.lelli@redhat.com, dietmar.eggemann@arm.com,
Morten.Rasmussen@arm.com, viresh.kumar@linaro.org,
valentin.schneider@arm.com, quentin.perret@arm.com,
Vincent Guittot <vincent.guittot@linaro.org>
Subject: [PATCH v5 00/10] track CPU utilization
Date: Fri, 25 May 2018 15:12:21 +0200 [thread overview]
Message-ID: <1527253951-22709-1-git-send-email-vincent.guittot@linaro.org> (raw)
This patchset initially tracked only the utilization of RT rq. During
OSPM summit, it has been discussed the opportunity to extend it in order
to get an estimate of the utilization of the CPU.
- Patches 1-3 correspond to the content of patchset v4 and add utilization
tracking for rt_rq.
When both cfs and rt tasks compete to run on a CPU, we can see some frequency
drops with schedutil governor. In such case, the cfs_rq's utilization doesn't
reflect anymore the utilization of cfs tasks but only the remaining part that
is not used by rt tasks. We should monitor the stolen utilization and take
it into account when selecting OPP. This patchset doesn't change the OPP
selection policy for RT tasks but only for CFS tasks
A rt-app use case which creates an always running cfs thread and a rt threads
that wakes up periodically with both threads pinned on same CPU, show lot of
frequency switches of the CPU whereas the CPU never goes idles during the
test. I can share the json file that I used for the test if someone is
interested in.
For a 15 seconds long test on a hikey 6220 (octo core cortex A53 platfrom),
the cpufreq statistics outputs (stats are reset just before the test) :
$ cat /sys/devices/system/cpu/cpufreq/policy0/stats/total_trans
without patchset : 1230
with patchset : 14
If we replace the cfs thread of rt-app by a sysbench cpu test, we can see
performance improvements:
- Without patchset :
Test execution summary:
total time: 15.0009s
total number of events: 4903
total time taken by event execution: 14.9972
per-request statistics:
min: 1.23ms
avg: 3.06ms
max: 13.16ms
approx. 95 percentile: 12.73ms
Threads fairness:
events (avg/stddev): 4903.0000/0.00
execution time (avg/stddev): 14.9972/0.00
- With patchset:
Test execution summary:
total time: 15.0014s
total number of events: 7694
total time taken by event execution: 14.9979
per-request statistics:
min: 1.23ms
avg: 1.95ms
max: 10.49ms
approx. 95 percentile: 10.39ms
Threads fairness:
events (avg/stddev): 7694.0000/0.00
execution time (avg/stddev): 14.9979/0.00
The performance improvement is 56% for this use case.
- Patches 4-5 add utilization tracking for dl_rq in order to solve similar
problem as with rt_rq
- Patches 6 uses dl and rt utilization in the scale_rt_capacity() and remove
dl and rt from sched_rt_avg_update
- Patches 7-8 add utilization tracking for interrupt and use it select OPP
A test with iperf on hikey 6220 gives:
w/o patchset w/ patchset
Tx 276 Mbits/sec 304 Mbits/sec +10%
Rx 299 Mbits/sec 328 Mbits/sec +09%
8 iterations of iperf -c server_address -r -t 5
stdev is lower than 1%
Only WFI idle state is enable (shallowest arm idle state)
- Patches 9 removes the unused sched_avg_update code
- Patch 10 removes the unused sched_time_avg_ms
Change since v3:
- add support of periodic update of blocked utilization
- rebase on lastest tip/sched/core
Change since v2:
- move pelt code into a dedicated pelt.c file
- rebase on load tracking changes
Change since v1:
- Only a rebase. I have addressed the comments on previous version in
patch 1/2
Vincent Guittot (10):
sched/pelt: Move pelt related code in a dedicated file
sched/rt: add rt_rq utilization tracking
cpufreq/schedutil: add rt utilization tracking
sched/dl: add dl_rq utilization tracking
cpufreq/schedutil: get max utilization
sched: remove rt and dl from sched_avg
sched/irq: add irq utilization tracking
cpufreq/schedutil: take into account interrupt
sched: remove rt_avg code
proc/sched: remove unused sched_time_avg_ms
include/linux/sched/sysctl.h | 1 -
kernel/sched/Makefile | 2 +-
kernel/sched/core.c | 38 +---
kernel/sched/cpufreq_schedutil.c | 24 ++-
kernel/sched/deadline.c | 7 +-
kernel/sched/fair.c | 381 +++----------------------------------
kernel/sched/pelt.c | 395 +++++++++++++++++++++++++++++++++++++++
kernel/sched/pelt.h | 63 +++++++
kernel/sched/rt.c | 10 +-
kernel/sched/sched.h | 57 ++++--
kernel/sysctl.c | 8 -
11 files changed, 563 insertions(+), 423 deletions(-)
create mode 100644 kernel/sched/pelt.c
create mode 100644 kernel/sched/pelt.h
--
2.7.4
next reply other threads:[~2018-05-25 13:12 UTC|newest]
Thread overview: 99+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-05-25 13:12 Vincent Guittot [this message]
2018-05-25 13:12 ` [PATCH v5 01/10] sched/pelt: Move pelt related code in a dedicated file Vincent Guittot
2018-05-25 14:26 ` Quentin Perret
2018-05-25 16:14 ` Peter Zijlstra
2018-05-29 8:21 ` Quentin Perret
2018-05-25 18:04 ` Patrick Bellasi
2018-05-29 14:55 ` Quentin Perret
2018-05-29 15:02 ` Vincent Guittot
2018-05-29 15:04 ` Quentin Perret
2018-05-25 13:12 ` [PATCH v5 02/10] sched/rt: add rt_rq utilization tracking Vincent Guittot
2018-05-25 15:54 ` Patrick Bellasi
2018-05-29 13:29 ` Vincent Guittot
2018-05-30 9:32 ` Patrick Bellasi
2018-05-30 10:06 ` Vincent Guittot
2018-05-30 11:01 ` Patrick Bellasi
2018-05-30 14:39 ` Vincent Guittot
2018-05-25 13:12 ` [PATCH v5 03/10] cpufreq/schedutil: add rt " Vincent Guittot
2018-05-30 7:03 ` Viresh Kumar
2018-05-30 8:23 ` Vincent Guittot
2018-05-30 9:40 ` Patrick Bellasi
2018-05-30 9:53 ` Vincent Guittot
2018-05-30 16:46 ` Quentin Perret
2018-05-31 8:46 ` Juri Lelli
2018-06-01 16:23 ` Peter Zijlstra
2018-06-01 17:23 ` Patrick Bellasi
2018-06-04 10:17 ` Quentin Perret
2018-06-04 15:16 ` Patrick Bellasi
2018-05-25 13:12 ` [PATCH v5 04/10] sched/dl: add dl_rq " Vincent Guittot
2018-05-30 10:50 ` Patrick Bellasi
2018-05-30 11:51 ` Vincent Guittot
2018-05-25 13:12 ` [PATCH v5 05/10] cpufreq/schedutil: get max utilization Vincent Guittot
2018-05-28 10:12 ` Juri Lelli
2018-05-28 14:57 ` Vincent Guittot
2018-05-28 15:22 ` Juri Lelli
2018-05-28 16:34 ` Vincent Guittot
2018-05-31 10:27 ` Patrick Bellasi
2018-05-31 13:02 ` Vincent Guittot
2018-06-01 13:53 ` Vincent Guittot
2018-06-01 17:45 ` Joel Fernandes
2018-06-04 6:41 ` Vincent Guittot
2018-06-04 7:04 ` Juri Lelli
2018-06-04 7:14 ` Vincent Guittot
2018-06-04 10:12 ` Juri Lelli
2018-06-04 12:35 ` Vincent Guittot
2018-05-29 5:08 ` Joel Fernandes
2018-05-29 6:31 ` Juri Lelli
2018-05-29 6:48 ` Vincent Guittot
2018-05-29 9:47 ` Juri Lelli
2018-05-29 8:40 ` Quentin Perret
2018-05-29 9:52 ` Juri Lelli
2018-05-30 8:37 ` Quentin Perret
2018-05-30 8:51 ` Juri Lelli
2018-05-25 13:12 ` [PATCH v5 06/10] sched: remove rt and dl from sched_avg Vincent Guittot
2018-05-25 13:12 ` [PATCH v5 07/10] sched/irq: add irq utilization tracking Vincent Guittot
2018-05-30 15:55 ` Dietmar Eggemann
2018-05-30 18:45 ` Vincent Guittot
2018-05-31 16:54 ` Dietmar Eggemann
2018-06-06 16:06 ` Vincent Guittot
2018-06-07 8:29 ` Dietmar Eggemann
2018-06-07 8:44 ` Vincent Guittot
2018-06-07 9:06 ` Dietmar Eggemann
2018-05-25 13:12 ` [PATCH v5 08/10] cpufreq/schedutil: take into account interrupt Vincent Guittot
2018-05-28 10:41 ` Juri Lelli
2018-05-28 12:06 ` Vincent Guittot
2018-05-28 12:37 ` Juri Lelli
2018-05-25 13:12 ` [PATCH v5 09/10] sched: remove rt_avg code Vincent Guittot
2018-05-25 13:12 ` [PATCH v5 10/10] proc/sched: remove unused sched_time_avg_ms Vincent Guittot
2018-06-04 16:50 ` [PATCH v5 00/10] track CPU utilization Peter Zijlstra
2018-06-04 17:13 ` Quentin Perret
2018-06-04 18:08 ` Vincent Guittot
2018-06-05 14:18 ` Peter Zijlstra
2018-06-05 15:03 ` Juri Lelli
2018-06-05 15:38 ` Patrick Bellasi
2018-06-05 22:27 ` Peter Zijlstra
2018-06-06 9:44 ` Quentin Perret
2018-06-06 9:59 ` Vincent Guittot
2018-06-06 10:02 ` Vincent Guittot
2018-06-06 10:12 ` Quentin Perret
2018-06-05 8:36 ` Vincent Guittot
2018-06-05 10:57 ` Quentin Perret
2018-06-05 11:59 ` Vincent Guittot
2018-06-05 13:12 ` Quentin Perret
2018-06-05 13:18 ` Vincent Guittot
2018-06-05 13:52 ` Quentin Perret
2018-06-05 13:55 ` Vincent Guittot
2018-06-05 14:09 ` Quentin Perret
2018-06-05 14:21 ` Quentin Perret
2018-06-05 12:11 ` Juri Lelli
2018-06-05 13:05 ` Quentin Perret
2018-06-05 13:15 ` Juri Lelli
2018-06-05 14:01 ` Quentin Perret
2018-06-05 14:13 ` Juri Lelli
2018-06-06 13:05 ` Claudio Scordino
2018-06-06 13:20 ` Quentin Perret
2018-06-06 13:53 ` Claudio Scordino
2018-06-06 14:10 ` Quentin Perret
2018-06-06 21:05 ` luca abeni
2018-06-07 8:25 ` Quentin Perret
2018-06-06 20:53 ` luca abeni
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1527253951-22709-1-git-send-email-vincent.guittot@linaro.org \
--to=vincent.guittot@linaro.org \
--cc=Morten.Rasmussen@arm.com \
--cc=dietmar.eggemann@arm.com \
--cc=juri.lelli@redhat.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@kernel.org \
--cc=peterz@infradead.org \
--cc=quentin.perret@arm.com \
--cc=rjw@rjwysocki.net \
--cc=valentin.schneider@arm.com \
--cc=viresh.kumar@linaro.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).