From: Leonard Foerster <foersleo@amazon.com>
To: SeongJae Park <sjpark@amazon.com>
Cc: akpm@linux-foundation.org, SeongJae Park <sjpark@amazon.de>,
Jonathan.Cameron@Huawei.com, aarcange@redhat.com,
acme@kernel.org, alexander.shishkin@linux.intel.com,
amit@kernel.org, benh@kernel.crashing.org,
brendan.d.gregg@gmail.com, brendanhiggins@google.com, cai@lca.pw,
colin.king@canonical.com, corbet@lwn.net, dwmw@amazon.com,
irogers@google.com, jolsa@redhat.com, kirill@shutemov.name,
mark.rutland@arm.com, mgorman@suse.de, minchan@kernel.org,
mingo@redhat.com, namhyung@kernel.org, peterz@infradead.org,
rdunlap@infradead.org, riel@surriel.com, rientjes@google.com,
rostedt@goodmis.org, sblbir@amazon.com, shakeelb@google.com,
shuah@kernel.org, sj38.park@gmail.com, snu@amazon.de,
vbabka@suse.cz, vdavydov.dev@gmail.com,
yang.shi@linux.alibaba.com, ying.huang@intel.com,
linux-damon@amazon.com, linux-mm@kvack.org,
linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH v13 05/15] mm/damon: Adaptively adjust regions
Date: Wed, 27 May 2020 13:23:56 +0200 [thread overview]
Message-ID: <1590578636-27155-1-git-send-email-foersleo@amazon.com> (raw)
In-Reply-To: <20200525091512.30391-6-sjpark@amazon.com>
On 2020-05-25T11:15:02+02:00 SeongJae Park <sjpark@amazon.com> wrote:
> From: SeongJae Park <sjpark@amazon.de>
>
> At the beginning of the monitoring, DAMON constructs the initial regions
> by evenly splitting the memory mapped address space of the process into
> the user-specified minimal number of regions. In this initial state,
> the assumption of the regions (pages in same region have similar access
> frequencies) is normally not kept and thus the monitoring quality could
> be low. To keep the assumption as much as possible, DAMON adaptively
> merges and splits each region.
>
> For each ``aggregation interval``, it compares the access frequencies of
> adjacent regions and merges those if the frequency difference is small.
> Then, after it reports and clears the aggregated access frequency of
> each region, it splits each region into two regions if the total number
> of regions is smaller than the half of the user-specified maximum number
> of regions.
>
> In this way, DAMON provides its best-effort quality and minimal overhead
> while keeping the bounds users set for their trade-off.
>
> Signed-off-by: SeongJae Park <sjpark@amazon.de>
> ---
> [...]
> +/*
> + * splits every target region into two randomly-sized regions
> + *
> + * This function splits every target region into two random-sized regions if
> + * current total number of the regions is equal or smaller than half of the
> + * user-specified maximum number of regions. This is for maximizing the
> + * monitoring accuracy under the dynamically changeable access patterns. If a
> + * split was unnecessarily made, later 'kdamond_merge_regions()' will revert
> + * it.
> + */
> +static void kdamond_split_regions(struct damon_ctx *ctx)
> +{
> + struct damon_task *t;
> + unsigned int nr_regions = 0;
> + static unsigned int last_nr_regions;
> + int nr_subregions = 2;
> +
> + damon_for_each_task(t, ctx)
> + nr_regions += nr_damon_regions(t);
> +
> + if (nr_regions > ctx->max_nr_regions / 2)
> + return;
> +
> + /* If number of regions is not changed, we are maybe in corner case */
> + if (last_nr_regions == nr_regions &&
> + nr_regions < ctx->max_nr_regions / 3)
> + nr_subregions = 3;
> +
> + damon_for_each_task(t, ctx)
> + damon_split_regions_of(ctx, t, nr_subregions);
> +
> + if (!last_nr_regions)
> + last_nr_regions = nr_regions;
So we are only setting last_nr_regions once when we first come along
here (when last_nr_regions == 0). Thus we are checking from now on if
nr_regions is the same as nr_regions was before the first ever split. So
we are doing the three-way split whenever nr_regions has come to the
initial number of regions. Is this actually what we want? The naming
suggests that we want to check against the number before the last split
to detect if we have moved into a spot where we are splitting and
merging back and forth between two states (this is the corner case we
are talking about?).
Or am I misunderstanding the intention here?
Leonard
next prev parent reply other threads:[~2020-05-27 11:24 UTC|newest]
Thread overview: 29+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-05-25 9:14 [PATCH v13 00/15] Introduce Data Access MONitor (DAMON) SeongJae Park
2020-05-25 9:14 ` [PATCH v13 01/15] scripts/spelling: Add a few more typos SeongJae Park
2020-05-27 11:24 ` Singh, Balbir
2020-05-27 12:39 ` SeongJae Park
2020-05-25 9:14 ` [PATCH v13 02/15] mm/page_ext: Export lookup_page_ext() to GPL modules SeongJae Park
2020-05-27 11:21 ` Leonard Foerster
2020-05-25 9:15 ` [PATCH v13 03/15] mm: Introduce Data Access MONitor (DAMON) SeongJae Park
2020-05-27 11:23 ` Leonard Foerster
2020-05-27 12:40 ` SeongJae Park
2020-05-25 9:15 ` [PATCH v13 04/15] mm/damon: Implement region based sampling SeongJae Park
2020-05-27 11:23 ` Leonard Foerster
2020-05-25 9:15 ` [PATCH v13 05/15] mm/damon: Adaptively adjust regions SeongJae Park
2020-05-27 11:23 ` Leonard Foerster [this message]
2020-05-27 12:46 ` SeongJae Park
2020-05-25 9:15 ` [PATCH v13 06/15] mm/damon: Apply dynamic memory mapping changes SeongJae Park
2020-05-27 11:24 ` Leonard Foerster
2020-05-25 9:15 ` [PATCH v13 07/15] mm/damon: Implement callbacks SeongJae Park
2020-05-27 11:24 ` Leonard Foerster
2020-05-25 9:15 ` [PATCH v13 08/15] mm/damon: Implement access pattern recording SeongJae Park
2020-05-27 11:24 ` Leonard Foerster
2020-05-25 9:15 ` [PATCH v13 09/15] mm/damon: Add debugfs interface SeongJae Park
2020-05-27 11:24 ` Leonard Foerster
2020-05-25 9:15 ` [PATCH v13 10/15] mm/damon: Add tracepoints SeongJae Park
2020-05-27 11:25 ` Leonard Foerster
2020-05-25 9:27 ` [PATCH v13 11/15] tools: Add a minimal user-space tool for DAMON SeongJae Park
2020-05-25 9:28 ` [PATCH v13 12/15] Documentation/admin-guide/mm: Add a document " SeongJae Park
2020-05-25 9:29 ` [PATCH v13 13/15] mm/damon: Add kunit tests SeongJae Park
2020-05-25 9:30 ` [PATCH v13 14/15] mm/damon: Add user space selftests SeongJae Park
2020-05-25 9:31 ` [PATCH v13 15/15] MAINTAINERS: Update for DAMON SeongJae Park
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1590578636-27155-1-git-send-email-foersleo@amazon.com \
--to=foersleo@amazon.com \
--cc=Jonathan.Cameron@Huawei.com \
--cc=aarcange@redhat.com \
--cc=acme@kernel.org \
--cc=akpm@linux-foundation.org \
--cc=alexander.shishkin@linux.intel.com \
--cc=amit@kernel.org \
--cc=benh@kernel.crashing.org \
--cc=brendan.d.gregg@gmail.com \
--cc=brendanhiggins@google.com \
--cc=cai@lca.pw \
--cc=colin.king@canonical.com \
--cc=corbet@lwn.net \
--cc=dwmw@amazon.com \
--cc=irogers@google.com \
--cc=jolsa@redhat.com \
--cc=kirill@shutemov.name \
--cc=linux-damon@amazon.com \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mark.rutland@arm.com \
--cc=mgorman@suse.de \
--cc=minchan@kernel.org \
--cc=mingo@redhat.com \
--cc=namhyung@kernel.org \
--cc=peterz@infradead.org \
--cc=rdunlap@infradead.org \
--cc=riel@surriel.com \
--cc=rientjes@google.com \
--cc=rostedt@goodmis.org \
--cc=sblbir@amazon.com \
--cc=shakeelb@google.com \
--cc=shuah@kernel.org \
--cc=sj38.park@gmail.com \
--cc=sjpark@amazon.com \
--cc=sjpark@amazon.de \
--cc=snu@amazon.de \
--cc=vbabka@suse.cz \
--cc=vdavydov.dev@gmail.com \
--cc=yang.shi@linux.alibaba.com \
--cc=ying.huang@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).