All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Rafael Aquini <aquini@redhat.com>
Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	virtualization@lists.linux-foundation.org,
	Rusty Russell <rusty@rustcorp.com.au>,
	Rik van Riel <riel@redhat.com>, Mel Gorman <mel@csn.ul.ie>,
	Andi Kleen <andi@firstfloor.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>,
	Minchan Kim <minchan@kernel.org>
Subject: Re: [PATCH v8 1/5] mm: introduce a common interface for balloon pages mobility
Date: Wed, 22 Aug 2012 03:06:51 +0300	[thread overview]
Message-ID: <20120822000651.GH9027@redhat.com> (raw)
In-Reply-To: <20120821193438.GE12294@t510.redhat.com>

On Tue, Aug 21, 2012 at 04:34:39PM -0300, Rafael Aquini wrote:
> On Tue, Aug 21, 2012 at 10:16:12PM +0300, Michael S. Tsirkin wrote:
> > On Tue, Aug 21, 2012 at 02:55:03PM -0300, Rafael Aquini wrote:
> > > On Tue, Aug 21, 2012 at 04:52:23PM +0300, Michael S. Tsirkin wrote:
> > > > > + * address_space_operations utilized methods for ballooned pages:
> > > > > + *   .migratepage    - used to perform balloon's page migration (as is)
> > > > > + *   .launder_page   - used to isolate a page from balloon's page list
> > > > > + *   .freepage       - used to reinsert an isolated page to balloon's page list
> > > > > + */
> > > > 
> > > > It would be a good idea to document the assumptions here.
> > > > Looks like .launder_page and .freepage are called in rcu critical
> > > > section.
> > > > But migratepage isn't - why is that safe?
> > > > 
> > > 
> > > The migratepage callback for virtio_balloon can sleep, and IIUC we cannot sleep
> > > within a RCU critical section. 
> > > 
> > > Also, The migratepage callback is called at inner migration's circle function
> > > move_to_new_page(), and I don't think embedding it in a RCU critical section
> > > would be a good idea, for the same understanding aforementioned.
> > 
> > Yes but this means it is still exposed to the module unloading
> > races that RCU was supposed to fix.
> > So need to either rework that code so it won't sleep
> > or switch to some other synchronization.
> >
> Can you refactor tell_host() to not sleep? Or, can I get rid of calling it at
> virtballoon_migratepage()? If 'no' is the answer for both questions, that's the
> way that code has to remain, even if we find a way around to hack the
> migratepage callback and have it embedded into a RCU crit section.
> 
> That's why I believe once the balloon driver is commanded to unload, we must
> flag virtballoon_migratepage to skip it's work. By doing this, the thread
> performing memory compaction will have to recur to the 'putback' path which is
> RCU protected. (IMHO).
> 
> As the module will not uload utill it leaks all pages on its list, that unload
> race you pointed before will be covered.


It can not be: nothing callback does can prevent it from
running after module unload: you must have some synchronization
in the calling code.

-- 
MST

WARNING: multiple messages have this Message-ID (diff)
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Rafael Aquini <aquini@redhat.com>
Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	virtualization@lists.linux-foundation.org,
	Rusty Russell <rusty@rustcorp.com.au>,
	Rik van Riel <riel@redhat.com>, Mel Gorman <mel@csn.ul.ie>,
	Andi Kleen <andi@firstfloor.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>,
	Minchan Kim <minchan@kernel.org>
Subject: Re: [PATCH v8 1/5] mm: introduce a common interface for balloon pages mobility
Date: Wed, 22 Aug 2012 03:06:51 +0300	[thread overview]
Message-ID: <20120822000651.GH9027@redhat.com> (raw)
In-Reply-To: <20120821193438.GE12294@t510.redhat.com>

On Tue, Aug 21, 2012 at 04:34:39PM -0300, Rafael Aquini wrote:
> On Tue, Aug 21, 2012 at 10:16:12PM +0300, Michael S. Tsirkin wrote:
> > On Tue, Aug 21, 2012 at 02:55:03PM -0300, Rafael Aquini wrote:
> > > On Tue, Aug 21, 2012 at 04:52:23PM +0300, Michael S. Tsirkin wrote:
> > > > > + * address_space_operations utilized methods for ballooned pages:
> > > > > + *   .migratepage    - used to perform balloon's page migration (as is)
> > > > > + *   .launder_page   - used to isolate a page from balloon's page list
> > > > > + *   .freepage       - used to reinsert an isolated page to balloon's page list
> > > > > + */
> > > > 
> > > > It would be a good idea to document the assumptions here.
> > > > Looks like .launder_page and .freepage are called in rcu critical
> > > > section.
> > > > But migratepage isn't - why is that safe?
> > > > 
> > > 
> > > The migratepage callback for virtio_balloon can sleep, and IIUC we cannot sleep
> > > within a RCU critical section. 
> > > 
> > > Also, The migratepage callback is called at inner migration's circle function
> > > move_to_new_page(), and I don't think embedding it in a RCU critical section
> > > would be a good idea, for the same understanding aforementioned.
> > 
> > Yes but this means it is still exposed to the module unloading
> > races that RCU was supposed to fix.
> > So need to either rework that code so it won't sleep
> > or switch to some other synchronization.
> >
> Can you refactor tell_host() to not sleep? Or, can I get rid of calling it at
> virtballoon_migratepage()? If 'no' is the answer for both questions, that's the
> way that code has to remain, even if we find a way around to hack the
> migratepage callback and have it embedded into a RCU crit section.
> 
> That's why I believe once the balloon driver is commanded to unload, we must
> flag virtballoon_migratepage to skip it's work. By doing this, the thread
> performing memory compaction will have to recur to the 'putback' path which is
> RCU protected. (IMHO).
> 
> As the module will not uload utill it leaks all pages on its list, that unload
> race you pointed before will be covered.


It can not be: nothing callback does can prevent it from
running after module unload: you must have some synchronization
in the calling code.

-- 
MST

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2012-08-22  0:06 UTC|newest]

Thread overview: 155+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-08-21 12:47 [PATCH v8 0/5] make balloon pages movable by compaction Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47 ` [PATCH v8 1/5] mm: introduce a common interface for balloon pages mobility Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 13:52   ` Michael S. Tsirkin
2012-08-21 13:52   ` Michael S. Tsirkin
2012-08-21 13:52     ` Michael S. Tsirkin
2012-08-21 14:25     ` Michael S. Tsirkin
2012-08-21 14:25       ` Michael S. Tsirkin
2012-08-21 14:25     ` Michael S. Tsirkin
2012-08-21 15:16     ` Peter Zijlstra
2012-08-21 15:16       ` Peter Zijlstra
2012-08-21 15:41       ` Michael S. Tsirkin
2012-08-21 15:41       ` Michael S. Tsirkin
2012-08-21 15:41         ` Michael S. Tsirkin
2012-08-21 17:42         ` Rafael Aquini
2012-08-21 17:42         ` Rafael Aquini
2012-08-21 17:42           ` Rafael Aquini
2012-08-21 19:28           ` Michael S. Tsirkin
2012-08-21 19:28             ` Michael S. Tsirkin
2012-08-21 19:28             ` Michael S. Tsirkin
2012-08-21 15:16     ` Peter Zijlstra
2012-08-21 17:55     ` Rafael Aquini
2012-08-21 17:55     ` Rafael Aquini
2012-08-21 17:55       ` Rafael Aquini
2012-08-21 19:16       ` Michael S. Tsirkin
2012-08-21 19:16       ` Michael S. Tsirkin
2012-08-21 19:16         ` Michael S. Tsirkin
2012-08-21 19:34         ` Rafael Aquini
2012-08-21 19:34           ` Rafael Aquini
2012-08-21 19:34           ` Rafael Aquini
2012-08-22  0:06           ` Michael S. Tsirkin [this message]
2012-08-22  0:06             ` Michael S. Tsirkin
2012-08-22  0:06           ` Michael S. Tsirkin
2012-08-21 15:20   ` Peter Zijlstra
2012-08-21 15:20     ` Peter Zijlstra
2012-08-21 16:24     ` Paul E. McKenney
2012-08-21 16:24       ` Paul E. McKenney
2012-08-21 16:24       ` Paul E. McKenney
2012-08-21 17:28       ` Rafael Aquini
2012-08-21 17:28       ` Rafael Aquini
2012-08-21 17:28         ` Rafael Aquini
2012-08-21 19:13         ` Michael S. Tsirkin
2012-08-21 19:13           ` Michael S. Tsirkin
2012-08-21 19:13           ` Michael S. Tsirkin
2012-08-21 19:23           ` Rafael Aquini
2012-08-21 19:23           ` Rafael Aquini
2012-08-21 19:23             ` Rafael Aquini
2012-08-21 19:30             ` Michael S. Tsirkin
2012-08-21 19:30               ` Michael S. Tsirkin
2012-08-21 19:30               ` Michael S. Tsirkin
2012-08-21 20:45               ` Rafael Aquini
2012-08-21 20:45                 ` Rafael Aquini
2012-08-22  0:07                 ` Michael S. Tsirkin
2012-08-22  0:07                 ` Michael S. Tsirkin
2012-08-22  0:07                   ` Michael S. Tsirkin
2012-08-22  1:19                   ` Rafael Aquini
2012-08-22  1:19                   ` Rafael Aquini
2012-08-22  1:19                     ` Rafael Aquini
2012-08-22  9:33                     ` Michael S. Tsirkin
2012-08-22  9:33                     ` Michael S. Tsirkin
2012-08-22  9:33                       ` Michael S. Tsirkin
2012-08-23  2:19                       ` Rafael Aquini
2012-08-23  2:19                       ` Rafael Aquini
2012-08-23  2:19                         ` Rafael Aquini
2012-08-23 10:01                         ` Michael S. Tsirkin
2012-08-23 10:01                         ` Michael S. Tsirkin
2012-08-23 10:01                           ` Michael S. Tsirkin
2012-08-23 12:13                           ` Rafael Aquini
2012-08-23 12:13                             ` Rafael Aquini
2012-08-23 12:34                             ` Michael S. Tsirkin
2012-08-23 12:34                               ` Michael S. Tsirkin
2012-08-23 13:06                               ` Rafael Aquini
2012-08-23 13:06                               ` Rafael Aquini
2012-08-23 13:06                                 ` Rafael Aquini
2012-08-23 13:53                                 ` Michael S. Tsirkin
2012-08-23 13:53                                   ` Michael S. Tsirkin
2012-08-23 15:21                                   ` Rafael Aquini
2012-08-23 15:21                                     ` Rafael Aquini
2012-08-23 15:54                                     ` Michael S. Tsirkin
2012-08-23 15:54                                       ` Michael S. Tsirkin
2012-08-23 16:03                                       ` Rik van Riel
2012-08-23 16:03                                       ` Rik van Riel
2012-08-23 16:03                                         ` Rik van Riel
2012-08-23 16:06                                         ` Rafael Aquini
2012-08-23 16:06                                         ` Rafael Aquini
2012-08-23 16:06                                           ` Rafael Aquini
2012-08-23 16:10                                           ` Michael S. Tsirkin
2012-08-23 16:10                                           ` Michael S. Tsirkin
2012-08-23 16:10                                             ` Michael S. Tsirkin
2012-08-23 15:54                                     ` Michael S. Tsirkin
2012-08-23 15:21                                   ` Rafael Aquini
2012-08-23 16:25                                   ` Michael S. Tsirkin
2012-08-23 16:25                                   ` Michael S. Tsirkin
2012-08-23 16:25                                     ` Michael S. Tsirkin
2012-08-23 17:28                                     ` Rafael Aquini
2012-08-23 17:28                                     ` Rafael Aquini
2012-08-23 17:28                                       ` Rafael Aquini
2012-08-23 17:59                                       ` Rik van Riel
2012-08-23 17:59                                       ` Rik van Riel
2012-08-23 17:59                                         ` Rik van Riel
2012-08-23 23:36                                       ` Michael S. Tsirkin
2012-08-23 23:36                                         ` Michael S. Tsirkin
2012-08-24  0:26                                         ` Rafael Aquini
2012-08-24  0:26                                         ` Rafael Aquini
2012-08-24  0:26                                           ` Rafael Aquini
2012-08-24  0:33                                         ` Rafael Aquini
2012-08-24  0:33                                         ` Rafael Aquini
2012-08-24  0:33                                           ` Rafael Aquini
2012-08-24  0:38                                           ` Rafael Aquini
2012-08-24  0:38                                           ` Rafael Aquini
2012-08-24  0:38                                             ` Rafael Aquini
2012-08-24  0:49                                             ` Rafael Aquini
2012-08-24  0:49                                               ` Rafael Aquini
2012-08-24  0:49                                             ` Rafael Aquini
2012-08-24  3:12                                         ` Rik van Riel
2012-08-24  3:12                                           ` Rik van Riel
2012-08-24  8:03                                           ` Michael S. Tsirkin
2012-08-24  8:03                                           ` Michael S. Tsirkin
2012-08-24  8:03                                             ` Michael S. Tsirkin
2012-08-24  3:12                                         ` Rik van Riel
2012-08-23 23:36                                       ` Michael S. Tsirkin
2012-08-23 13:53                                 ` Michael S. Tsirkin
2012-08-23 12:34                             ` Michael S. Tsirkin
2012-08-23 12:13                           ` Rafael Aquini
2012-08-21 20:45               ` Rafael Aquini
2012-08-21 15:20   ` Peter Zijlstra
2012-08-21 12:47 ` [PATCH v8 2/5] mm: introduce compaction and migration for ballooned pages Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 12:47 ` [PATCH v8 3/5] virtio_balloon: introduce migration primitives to balloon pages Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 14:40   ` Michael S. Tsirkin
2012-08-21 14:40     ` Michael S. Tsirkin
2012-08-21 15:34     ` Peter Zijlstra
2012-08-21 15:34       ` Peter Zijlstra
2012-08-21 15:34     ` Peter Zijlstra
2012-08-21 15:37     ` Peter Zijlstra
2012-08-21 15:37     ` Peter Zijlstra
2012-08-21 15:37       ` Peter Zijlstra
2012-08-21 14:40   ` Michael S. Tsirkin
2012-08-21 14:57   ` Michael S. Tsirkin
2012-08-21 14:57     ` Michael S. Tsirkin
2012-08-21 14:57   ` Michael S. Tsirkin
2012-08-21 12:47 ` [PATCH v8 4/5] mm: introduce putback_movable_pages() Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 14:42   ` Michael S. Tsirkin
2012-08-21 14:42   ` Michael S. Tsirkin
2012-08-21 14:42     ` Michael S. Tsirkin
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47 ` [PATCH v8 5/5] mm: add vm event counters for balloon pages compaction Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20120822000651.GH9027@redhat.com \
    --to=mst@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=andi@firstfloor.org \
    --cc=aquini@redhat.com \
    --cc=konrad.wilk@oracle.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mel@csn.ul.ie \
    --cc=minchan@kernel.org \
    --cc=riel@redhat.com \
    --cc=rusty@rustcorp.com.au \
    --cc=virtualization@lists.linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.