All of lore.kernel.org
 help / color / mirror / Atom feed
From: Michael Stapelberg <stapelberg+linux@google.com>
To: Jan Kara <jack@suse.cz>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	linux-fsdevel@vger.kernel.org, linux-mm <linux-mm@kvack.org>
Subject: Re: [PATCH 0/5] writeback: Fix bandwidth estimates
Date: Fri, 9 Jul 2021 15:19:17 +0200	[thread overview]
Message-ID: <CAH9Oa-ba0Y4BxzM6=7fDN09zmetd3EUSfSPNu3EcFbdGV+KDvg@mail.gmail.com> (raw)
In-Reply-To: <20210705161610.19406-1-jack@suse.cz>

Thanks for sending this patch series!

I have used the mmap.c reproducer as before, with the following parameters:
* mkdir /tmp/mnt
* fusermount -u /tmp/mnt; /root/fuse-2.9.9/example/fusexmp_fh -f /tmp/mnt
* dd if=/dev/urandom of=/tmp/was bs=1M count=99
* while :; do grep ^Bdi /sys/kernel/debug/bdi/0:44/stats; sleep 0.1; done
* while :; do time WORKAROUND=1 ~/mmap /tmp/was
/tmp/mnt/tmp/stapelberg.1; sleep 5; done

Previously, after a few iterations, the BdiWriteBandwidth measure
would gradually approach 0.

With your patch series applied, the BdiWriteBandwidth is updated much
more quickly, and converges to ≈16000 kBps.
When I start copying more quickly, the bandwidth measure rises quickly.

As far as I understand, this should fix the problem (provided 16000
kBps is an okay value).
Certainly, I don’t see the downward spiral either with your patches :)


On Mon, 5 Jul 2021 at 18:23, Jan Kara <jack@suse.cz> wrote:
>
> Hello,
>
> this patch series fixes estimate of writeback throughput when device is not
> fully busy doing writeback. Michael Stapelberg has reported that such
> workload (e.g. generated by linking) tends to push estimated throughput down
> to 0 and as a result writeback on the device is practically stalled.
>
> The first three patches fix the reported issue, the remaining two patches
> are unrelated cleanups of problems I've noticed when reading the code.
>
> Michael, can you try whether these patches fix the problems you've observed?
> I cannot trigger the "bandwidth going down" spiral with them anymore.
>
>                                                                 Honza

  parent reply	other threads:[~2021-07-09 13:19 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-07-05 16:23 [PATCH 0/5] writeback: Fix bandwidth estimates Jan Kara
2021-07-05 16:23 ` [PATCH 1/5] writeback: Track number of inodes under writeback Jan Kara
2021-07-05 16:23 ` [PATCH 2/5] writeback: Reliably update bandwidth estimation Jan Kara
2021-07-05 16:23 ` [PATCH 3/5] writeback: Fix bandwidth estimate for spiky workload Jan Kara
2021-07-07  7:40   ` Hillf Danton
2021-07-07  9:51     ` Jan Kara
2021-07-08 12:17       ` Hillf Danton
2021-07-08 16:43         ` Jan Kara
2021-07-09  8:01           ` Hillf Danton
2021-07-05 16:23 ` [PATCH 4/5] writeback: Rename domain_update_bandwidth() Jan Kara
2021-07-05 16:23 ` [PATCH 5/5] writeback: Use READ_ONCE for unlocked reads of writeback stats Jan Kara
2021-07-09 13:19 ` Michael Stapelberg [this message]
2021-07-09 13:19   ` [PATCH 0/5] writeback: Fix bandwidth estimates Michael Stapelberg
2021-07-12 16:27   ` Jan Kara
2021-07-13  8:15     ` Michael Stapelberg

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='CAH9Oa-ba0Y4BxzM6=7fDN09zmetd3EUSfSPNu3EcFbdGV+KDvg@mail.gmail.com' \
    --to=stapelberg+linux@google.com \
    --cc=akpm@linux-foundation.org \
    --cc=jack@suse.cz \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.