From mboxrd@z Thu Jan 1 00:00:00 1970 From: James Bottomley Subject: Re: [CRIU] Introspecting userns relationships to other namespaces? Date: Thu, 07 Jul 2016 20:20:05 -0700 Message-ID: <1467948005.2322.84.camel@HansenPartnership.com> References: <87r3b7pxja.fsf@x220.int.ebiederm.org> <20160706141348.GB20728@mail.hallyn.com> <20160707133631.GA2994@mail.hallyn.com> <1467903712.2347.16.camel@HansenPartnership.com> <1467919055.2322.36.camel@HansenPartnership.com> <20160708021617.GB10512@outlook.office365.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: In-Reply-To: <20160708021617.GB10512-1ViLX0X+lBJGNQ1M2rI3KwRV3xvJKrda@public.gmane.org> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: containers-bounces-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org Errors-To: containers-bounces-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org To: Andrew Vagin Cc: criu-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org, Linux API , Containers , lkml , mtk.manpages-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org List-Id: containers.vger.kernel.org On Thu, 2016-07-07 at 19:16 -0700, Andrew Vagin wrote: > On Thu, Jul 07, 2016 at 12:17:35PM -0700, James Bottomley wrote: > > On Thu, 2016-07-07 at 20:21 +0200, Michael Kerrisk (man-pages) > > wrote: > > > On 7 July 2016 at 17:01, James Bottomley > > > wrote: > > [Serge already answered the parenting issue] > > > > On Thu, 2016-07-07 at 08:36 -0500, Serge E. Hallyn wrote: > > > > > Hm. Probably best-effort based on the process hierarchy. So > > > > > yeah you could probably get a tree into a state that would be > > > > > wrongly recreated. Create a new netns, bind mount it, exit; > > > > > Have > > > > > another task create a new user_ns, bind mount it, exit; > > > > > Third > > > > > task setns()s first to the new netns then to the new user_ns. > > > > > I > > > > > suspect criu will recreate that wrongly. > > > > > > > > This is a bit pathological, and you have to be root to do it: > > > > so > > > > root can set up a nesting hierarchy, bind it and destroy the > > > > pids > > > > but I know of no current orchestration system which does this. > > > > > > > > Actually, I have to back pedal a bit: the way I currently set > > > > up > > > > architecture emulation containers does precisely this: I set up > > > > the > > > > namespaces unprivileged with child mount namespaces, but then I > > > > ask > > > > root to bind the userns and kill the process that created it so > > > > I > > > > have a permanent handle to enter the namespace by, so I suspect > > > > that when our current orchestration systems get more > > > > sophisticated, > > > > they might eventually want to do something like this as well. > > > > > > > > In theory, we could get nsfs to show this information as an > > > > option > > > > (just add a show_options entry to the superblock ops), but the > > > > problem is that although each namespace has a parent user_ns, > > > > there's no way to get it without digging in the namespace > > > > specific > > > > structure. Probably we should restructure to move it into > > > > ns_common, then we could display it (and enforce all namespaces > > > > having owning user_ns) but it would be a > > > > > > I'm missing something here. Is it not already the case that all > > > namespaces have an owning user_ns? > > > > Um, yes, I don't believe I said they don't. The problem I thought > > you > > were having is that there's no way of seeing what it is. > > > > nsfs is the Namespace fileystem where bound namespaces appear to a > > cat > > of /proc/self/mounts. It can display any information that's in > > ns_common (the common core of namespaces) but the owning user_ns > > pointer currently isn't in this structure. Every user namespace > > has a > > pointer to it, but they're all privately embedded in the individual > > namespace specific structures. What I was proposing was that since > > every current namespace has a pointer somewhere to the owning user > > namespace, we could abstract this out into ns_common so it's now > > accessible to be displayed by nsfs, probably as a mount option. > > James, I am not sure that I understood you correctly. We have one > file system for all namespace files, how we can show per-file > properties in mount options. We have two ways of getting information. For a namespace that only exists as a bind mount we only have what the mount/mountinfo shows, so you see something like this: jejb@jarvis:~> mount|grep nsfs nsfs on /run/build-container/userns type nsfs (rw) nsfs on /run/build-container/ppc64 type nsfs (rw) the (rw) are the mount options. We could add the ability to add other mount options to this via the superblock .show_options callback. We could make it show the type and parent user namespace. > I think we can show all required information in fdinfo. We open a > namespaces file (/proc/pid/ns/N) and then read /proc/pid/fdinfo/X for > it. Not if we don't have an extant process in the namespace, we can't use these files because they don't exist, plus fdinfo on the /proc//ns/X doesn't tell you what the parent user_ns of X is (again, we could add this information somewhere ... not sure where yet). James From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754062AbcGHDUU (ORCPT ); Thu, 7 Jul 2016 23:20:20 -0400 Received: from bedivere.hansenpartnership.com ([66.63.167.143]:49666 "EHLO bedivere.hansenpartnership.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754001AbcGHDUO (ORCPT ); Thu, 7 Jul 2016 23:20:14 -0400 Message-ID: <1467948005.2322.84.camel@HansenPartnership.com> Subject: Re: [CRIU] Introspecting userns relationships to other namespaces? From: James Bottomley To: Andrew Vagin Cc: Linux API , Containers , lkml , criu@openvz.org, mtk.manpages@gmail.com Date: Thu, 07 Jul 2016 20:20:05 -0700 In-Reply-To: <20160708021617.GB10512@outlook.office365.com> References: <87r3b7pxja.fsf@x220.int.ebiederm.org> <20160706141348.GB20728@mail.hallyn.com> <20160707133631.GA2994@mail.hallyn.com> <1467903712.2347.16.camel@HansenPartnership.com> <1467919055.2322.36.camel@HansenPartnership.com> <20160708021617.GB10512@outlook.office365.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.16.5 Mime-Version: 1.0 Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, 2016-07-07 at 19:16 -0700, Andrew Vagin wrote: > On Thu, Jul 07, 2016 at 12:17:35PM -0700, James Bottomley wrote: > > On Thu, 2016-07-07 at 20:21 +0200, Michael Kerrisk (man-pages) > > wrote: > > > On 7 July 2016 at 17:01, James Bottomley > > > wrote: > > [Serge already answered the parenting issue] > > > > On Thu, 2016-07-07 at 08:36 -0500, Serge E. Hallyn wrote: > > > > > Hm. Probably best-effort based on the process hierarchy. So > > > > > yeah you could probably get a tree into a state that would be > > > > > wrongly recreated. Create a new netns, bind mount it, exit; > > > > > Have > > > > > another task create a new user_ns, bind mount it, exit; > > > > > Third > > > > > task setns()s first to the new netns then to the new user_ns. > > > > > I > > > > > suspect criu will recreate that wrongly. > > > > > > > > This is a bit pathological, and you have to be root to do it: > > > > so > > > > root can set up a nesting hierarchy, bind it and destroy the > > > > pids > > > > but I know of no current orchestration system which does this. > > > > > > > > Actually, I have to back pedal a bit: the way I currently set > > > > up > > > > architecture emulation containers does precisely this: I set up > > > > the > > > > namespaces unprivileged with child mount namespaces, but then I > > > > ask > > > > root to bind the userns and kill the process that created it so > > > > I > > > > have a permanent handle to enter the namespace by, so I suspect > > > > that when our current orchestration systems get more > > > > sophisticated, > > > > they might eventually want to do something like this as well. > > > > > > > > In theory, we could get nsfs to show this information as an > > > > option > > > > (just add a show_options entry to the superblock ops), but the > > > > problem is that although each namespace has a parent user_ns, > > > > there's no way to get it without digging in the namespace > > > > specific > > > > structure. Probably we should restructure to move it into > > > > ns_common, then we could display it (and enforce all namespaces > > > > having owning user_ns) but it would be a > > > > > > I'm missing something here. Is it not already the case that all > > > namespaces have an owning user_ns? > > > > Um, yes, I don't believe I said they don't. The problem I thought > > you > > were having is that there's no way of seeing what it is. > > > > nsfs is the Namespace fileystem where bound namespaces appear to a > > cat > > of /proc/self/mounts. It can display any information that's in > > ns_common (the common core of namespaces) but the owning user_ns > > pointer currently isn't in this structure. Every user namespace > > has a > > pointer to it, but they're all privately embedded in the individual > > namespace specific structures. What I was proposing was that since > > every current namespace has a pointer somewhere to the owning user > > namespace, we could abstract this out into ns_common so it's now > > accessible to be displayed by nsfs, probably as a mount option. > > James, I am not sure that I understood you correctly. We have one > file system for all namespace files, how we can show per-file > properties in mount options. We have two ways of getting information. For a namespace that only exists as a bind mount we only have what the mount/mountinfo shows, so you see something like this: jejb@jarvis:~> mount|grep nsfs nsfs on /run/build-container/userns type nsfs (rw) nsfs on /run/build-container/ppc64 type nsfs (rw) the (rw) are the mount options. We could add the ability to add other mount options to this via the superblock .show_options callback. We could make it show the type and parent user namespace. > I think we can show all required information in fdinfo. We open a > namespaces file (/proc/pid/ns/N) and then read /proc/pid/fdinfo/X for > it. Not if we don't have an extant process in the namespace, we can't use these files because they don't exist, plus fdinfo on the /proc//ns/X doesn't tell you what the parent user_ns of X is (again, we could add this information somewhere ... not sure where yet). James