From: Dan Streetman <ddstreet@ieee.org>
To: Minchan Kim <minchan@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
linux-kernel <linux-kernel@vger.kernel.org>,
Linux-MM <linux-mm@kvack.org>, Hugh Dickins <hughd@google.com>,
Shaohua Li <shli@kernel.org>,
Jerome Marchand <jmarchan@redhat.com>,
Sergey Senozhatsky <sergey.senozhatsky@gmail.com>,
Nitin Gupta <ngupta@vflare.org>,
Luigi Semenzato <semenzato@google.com>,
juno.choi@lge.com
Subject: Re: [PATCH v1 3/5] mm: VM can be aware of zram fullness
Date: Wed, 24 Sep 2014 10:12:18 -0400 [thread overview]
Message-ID: <CALZtOND9YOXPQ0vNKFVrs+yhnkbWkKg8FD78cHmqJWhLyo89Gw@mail.gmail.com> (raw)
In-Reply-To: <1411344191-2842-4-git-send-email-minchan@kernel.org>
On Sun, Sep 21, 2014 at 8:03 PM, Minchan Kim <minchan@kernel.org> wrote:
> VM uses nr_swap_pages to throttle amount of swap when it reclaims
> anonymous pages because the nr_swap_pages means freeable space
> of swap disk.
>
> However, it's a problem for zram because zram can limit memory
> usage by knob(ie, mem_limit) so that swap out can fail although
> VM can see lots of free space from zram disk but no more free
> space in zram by the limit. If it happens, VM should notice it
> and stop reclaimaing until zram can obtain more free space but
> we don't have a way to communicate between VM and zram.
>
> This patch adds new hint SWAP_FULL so that zram can say to VM
> "I'm full" from now on. Then VM cannot reclaim annoymous page
> any more. If VM notice swap is full, it can remove swap_info_struct
> from swap_avail_head and substract remained freeable space from
> nr_swap_pages so that VM can think swap is full until VM frees a
> swap and increase nr_swap_pages again.
>
> Signed-off-by: Minchan Kim <minchan@kernel.org>
> ---
> include/linux/blkdev.h | 1 +
> mm/swapfile.c | 44 ++++++++++++++++++++++++++++++++++++++------
> 2 files changed, 39 insertions(+), 6 deletions(-)
>
> diff --git a/include/linux/blkdev.h b/include/linux/blkdev.h
> index c7220409456c..39f074e0acd7 100644
> --- a/include/linux/blkdev.h
> +++ b/include/linux/blkdev.h
> @@ -1611,6 +1611,7 @@ static inline bool blk_integrity_is_initialized(struct gendisk *g)
>
> enum swap_blk_hint {
> SWAP_FREE,
> + SWAP_FULL,
> };
>
> struct block_device_operations {
> diff --git a/mm/swapfile.c b/mm/swapfile.c
> index 209112cf8b83..71e3df0431b6 100644
> --- a/mm/swapfile.c
> +++ b/mm/swapfile.c
> @@ -493,6 +493,29 @@ static unsigned long scan_swap_map(struct swap_info_struct *si,
> int latency_ration = LATENCY_LIMIT;
>
> /*
> + * If zram is full, we don't need to scan and want to stop swap.
> + * For it, we removes si from swap_avail_head and decreases
> + * nr_swap_pages to prevent further anonymous reclaim so that
> + * VM can restart swap out if zram has a free space.
> + * Look at swap_entry_free.
> + */
> + if (si->flags & SWP_BLKDEV) {
> + struct gendisk *disk = si->bdev->bd_disk;
> +
> + if (disk->fops->swap_hint && disk->fops->swap_hint(
> + si->bdev, SWAP_FULL, NULL)) {
> + spin_lock(&swap_avail_lock);
> + WARN_ON(plist_node_empty(&si->avail_list));
> + plist_del(&si->avail_list, &swap_avail_head);
> + spin_unlock(&swap_avail_lock);
> + atomic_long_sub(si->pages - si->inuse_pages,
> + &nr_swap_pages);
> + si->full = true;
> + return 0;
> + }
> + }
> +
> + /*
> * We try to cluster swap pages by allocating them sequentially
> * in swap. Once we've allocated SWAPFILE_CLUSTER pages this
> * way, however, we resort to first-free allocation, starting
> @@ -798,6 +821,14 @@ static unsigned char swap_entry_free(struct swap_info_struct *p,
> /* free if no reference */
> if (!usage) {
> bool was_full;
> + struct gendisk *virt_swap = NULL;
> +
> + /* Check virtual swap */
> + if (p->flags & SWP_BLKDEV) {
> + virt_swap = p->bdev->bd_disk;
> + if (!virt_swap->fops->swap_hint)
not a big deal, but can't you just combine these two if's to simplify this?
> + virt_swap = NULL;
> + }
>
> dec_cluster_info_page(p, p->cluster_info, offset);
> if (offset < p->lowest_bit)
> @@ -814,17 +845,18 @@ static unsigned char swap_entry_free(struct swap_info_struct *p,
> &swap_avail_head);
> spin_unlock(&swap_avail_lock);
> p->full = false;
> + if (virt_swap)
> + atomic_long_add(p->pages -
> + p->inuse_pages,
> + &nr_swap_pages);
a comment here might be good, to clarify it relies on the check at the
top of scan_swap_map previously subtracting the same number of pages.
> }
>
> atomic_long_inc(&nr_swap_pages);
> p->inuse_pages--;
> frontswap_invalidate_page(p->type, offset);
> - if (p->flags & SWP_BLKDEV) {
> - struct gendisk *disk = p->bdev->bd_disk;
> - if (disk->fops->swap_hint)
> - disk->fops->swap_hint(p->bdev,
> - SWAP_FREE, (void *)offset);
> - }
> + if (virt_swap)
> + virt_swap->fops->swap_hint(p->bdev,
> + SWAP_FREE, (void *)offset);
> }
>
> return usage;
> --
> 2.0.0
>
next prev parent reply other threads:[~2014-09-24 14:12 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-09-22 0:03 [PATCH v1 0/5] stop anon reclaim when zram is full Minchan Kim
2014-09-22 0:03 ` [PATCH v1 1/5] zram: generalize swap_slot_free_notify Minchan Kim
2014-09-22 20:41 ` Andrew Morton
2014-09-23 4:45 ` Minchan Kim
2014-09-22 0:03 ` [PATCH v1 2/5] mm: add full variable in swap_info_struct Minchan Kim
2014-09-22 20:45 ` Andrew Morton
2014-09-23 4:45 ` Minchan Kim
2014-09-24 2:53 ` Dan Streetman
2014-09-24 7:57 ` Minchan Kim
2014-09-22 0:03 ` [PATCH v1 3/5] mm: VM can be aware of zram fullness Minchan Kim
2014-09-24 14:12 ` Dan Streetman [this message]
2014-09-25 1:06 ` Minchan Kim
2014-09-25 1:31 ` Dan Streetman
2014-09-22 0:03 ` [PATCH v1 4/5] zram: add swap full hint Minchan Kim
2014-09-22 21:11 ` Andrew Morton
2014-09-23 4:56 ` Minchan Kim
2014-09-23 21:17 ` Andrew Morton
2014-09-24 7:57 ` Minchan Kim
2014-09-24 15:10 ` Jerome Marchand
2014-09-25 1:07 ` Minchan Kim
2014-09-24 14:01 ` Dan Streetman
2014-09-25 1:02 ` Minchan Kim
2014-09-25 15:52 ` Dan Streetman
2014-10-06 23:36 ` Minchan Kim
2014-10-06 23:46 ` Minchan Kim
2014-10-08 18:29 ` Dan Streetman
2014-09-22 0:03 ` [PATCH v1 5/5] zram: add fullness knob to control swap full Minchan Kim
2014-09-22 21:17 ` Andrew Morton
2014-09-23 4:57 ` Minchan Kim
2014-12-02 3:04 ` [PATCH v1 0/5] stop anon reclaim when zram is full Minchan Kim
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CALZtOND9YOXPQ0vNKFVrs+yhnkbWkKg8FD78cHmqJWhLyo89Gw@mail.gmail.com \
--to=ddstreet@ieee.org \
--cc=akpm@linux-foundation.org \
--cc=hughd@google.com \
--cc=jmarchan@redhat.com \
--cc=juno.choi@lge.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=minchan@kernel.org \
--cc=ngupta@vflare.org \
--cc=semenzato@google.com \
--cc=sergey.senozhatsky@gmail.com \
--cc=shli@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).