From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 018F2C2D0CE for ; Tue, 21 Jan 2020 13:10:48 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id BC950207FF for ; Tue, 21 Jan 2020 13:10:48 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="JByx/Bu5" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org BC950207FF Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:53582 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ittIt-0001dh-DT for qemu-devel@archiver.kernel.org; Tue, 21 Jan 2020 08:10:47 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:51875) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1itseD-0000KJ-8B for qemu-devel@nongnu.org; Tue, 21 Jan 2020 07:28:50 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1itse9-0003Ib-Bn for qemu-devel@nongnu.org; Tue, 21 Jan 2020 07:28:45 -0500 Received: from us-smtp-delivery-1.mimecast.com ([205.139.110.120]:57571 helo=us-smtp-1.mimecast.com) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1itse9-0003IB-6d for qemu-devel@nongnu.org; Tue, 21 Jan 2020 07:28:41 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1579609720; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zVu4+dOBOSZm4ajqCmhCBPv5dYoX27g/ueg33XYeO40=; b=JByx/Bu5KiaLpIipJRcX6b3I8/MtAkjSJKGENDNLy9nc68kQFwRjJ89j2B9Fg2dkJepPjf jZyBWbFjLTywW3/hssJu4nL1Dy4YBKVxrzOKQSlW1Fjd3KKahvn354oT92j5Z4r510nIjX jal1pAQCO/Lfcs9WS01UxynPfLjrAMk= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-380-Zw6V0lE2OC62pXSYG_JP9A-1; Tue, 21 Jan 2020 07:28:39 -0500 Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 57DB010054E3; Tue, 21 Jan 2020 12:28:38 +0000 (UTC) Received: from dgilbert-t580.localhost (unknown [10.36.118.32]) by smtp.corp.redhat.com (Postfix) with ESMTP id 9AF4C60BE0; Tue, 21 Jan 2020 12:28:36 +0000 (UTC) From: "Dr. David Alan Gilbert (git)" To: qemu-devel@nongnu.org, stefanha@redhat.com, vgoyal@redhat.com, berrange@redhat.com, slp@redhat.com, philmd@redhat.com Subject: [PATCH v2 050/109] virtiofsd: move to a new pid namespace Date: Tue, 21 Jan 2020 12:23:34 +0000 Message-Id: <20200121122433.50803-51-dgilbert@redhat.com> In-Reply-To: <20200121122433.50803-1-dgilbert@redhat.com> References: <20200121122433.50803-1-dgilbert@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-MC-Unique: Zw6V0lE2OC62pXSYG_JP9A-1 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 205.139.110.120 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: m.mizuma@jp.fujitsu.com, misono.tomohiro@jp.fujitsu.com Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" From: Stefan Hajnoczi virtiofsd needs access to /proc/self/fd. Let's move to a new pid namespace so that a compromised process cannot see another other processes running on the system. One wrinkle in this approach: unshare(CLONE_NEWPID) affects *child* processes and not the current process. Therefore we need to fork the pid 1 process that will actually run virtiofsd and leave a parent in waitpid(2). This is not the same thing as daemonization and parent processes should not notice a difference. Signed-off-by: Stefan Hajnoczi Reviewed-by: Daniel P. Berrang=C3=A9 --- tools/virtiofsd/passthrough_ll.c | 134 ++++++++++++++++++++----------- 1 file changed, 86 insertions(+), 48 deletions(-) diff --git a/tools/virtiofsd/passthrough_ll.c b/tools/virtiofsd/passthrough= _ll.c index 0d061de438..752beb459a 100644 --- a/tools/virtiofsd/passthrough_ll.c +++ b/tools/virtiofsd/passthrough_ll.c @@ -50,7 +50,10 @@ #include #include #include +#include #include +#include +#include #include #include =20 @@ -1944,24 +1947,95 @@ static void print_capabilities(void) } =20 /* - * Called after our UNIX domain sockets have been created, now we can move= to - * an empty network namespace to prevent TCP/IP and other network activity= in - * case this process is compromised. + * Move to a new mount, net, and pid namespaces to isolate this process. */ -static void setup_net_namespace(void) +static void setup_namespaces(struct lo_data *lo, struct fuse_session *se) { - if (unshare(CLONE_NEWNET) !=3D 0) { - fuse_log(FUSE_LOG_ERR, "unshare(CLONE_NEWNET): %m\n"); + pid_t child; + + /* + * Create a new pid namespace for *child* processes. We'll have to + * fork in order to enter the new pid namespace. A new mount namespac= e + * is also needed so that we can remount /proc for the new pid + * namespace. + * + * Our UNIX domain sockets have been created. Now we can move to + * an empty network namespace to prevent TCP/IP and other network + * activity in case this process is compromised. + */ + if (unshare(CLONE_NEWPID | CLONE_NEWNS | CLONE_NEWNET) !=3D 0) { + fuse_log(FUSE_LOG_ERR, "unshare(CLONE_NEWPID | CLONE_NEWNS): %m\n"= ); + exit(1); + } + + child =3D fork(); + if (child < 0) { + fuse_log(FUSE_LOG_ERR, "fork() failed: %m\n"); + exit(1); + } + if (child > 0) { + pid_t waited; + int wstatus; + + /* The parent waits for the child */ + do { + waited =3D waitpid(child, &wstatus, 0); + } while (waited < 0 && errno =3D=3D EINTR && !se->exited); + + /* We were terminated by a signal, see fuse_signals.c */ + if (se->exited) { + exit(0); + } + + if (WIFEXITED(wstatus)) { + exit(WEXITSTATUS(wstatus)); + } + + exit(1); + } + + /* Send us SIGTERM when the parent thread terminates, see prctl(2) */ + prctl(PR_SET_PDEATHSIG, SIGTERM); + + /* + * If the mounts have shared propagation then we want to opt out so ou= r + * mount changes don't affect the parent mount namespace. + */ + if (mount(NULL, "/", NULL, MS_REC | MS_SLAVE, NULL) < 0) { + fuse_log(FUSE_LOG_ERR, "mount(/, MS_REC|MS_SLAVE): %m\n"); + exit(1); + } + + /* The child must remount /proc to use the new pid namespace */ + if (mount("proc", "/proc", "proc", + MS_NODEV | MS_NOEXEC | MS_NOSUID | MS_RELATIME, NULL) < 0) { + fuse_log(FUSE_LOG_ERR, "mount(/proc): %m\n"); + exit(1); + } + + /* Now we can get our /proc/self/fd directory file descriptor */ + lo->proc_self_fd =3D open("/proc/self/fd", O_PATH); + if (lo->proc_self_fd =3D=3D -1) { + fuse_log(FUSE_LOG_ERR, "open(/proc/self/fd, O_PATH): %m\n"); exit(1); } } =20 -/* This magic is based on lxc's lxc_pivot_root() */ -static void setup_pivot_root(const char *source) +/* + * Make the source directory our root so symlinks cannot escape and no oth= er + * files are accessible. Assumes unshare(CLONE_NEWNS) was already called. + */ +static void setup_mounts(const char *source) { int oldroot; int newroot; =20 + if (mount(source, source, NULL, MS_BIND, NULL) < 0) { + fuse_log(FUSE_LOG_ERR, "mount(%s, %s, MS_BIND): %m\n", source, sou= rce); + exit(1); + } + + /* This magic is based on lxc's lxc_pivot_root() */ oldroot =3D open("/", O_DIRECTORY | O_RDONLY | O_CLOEXEC); if (oldroot < 0) { fuse_log(FUSE_LOG_ERR, "open(/): %m\n"); @@ -2008,47 +2082,14 @@ static void setup_pivot_root(const char *source) close(oldroot); } =20 -static void setup_proc_self_fd(struct lo_data *lo) -{ - lo->proc_self_fd =3D open("/proc/self/fd", O_PATH); - if (lo->proc_self_fd =3D=3D -1) { - fuse_log(FUSE_LOG_ERR, "open(/proc/self/fd, O_PATH): %m\n"); - exit(1); - } -} - -/* - * Make the source directory our root so symlinks cannot escape and no oth= er - * files are accessible. - */ -static void setup_mount_namespace(const char *source) -{ - if (unshare(CLONE_NEWNS) !=3D 0) { - fuse_log(FUSE_LOG_ERR, "unshare(CLONE_NEWNS): %m\n"); - exit(1); - } - - if (mount(NULL, "/", NULL, MS_REC | MS_SLAVE, NULL) < 0) { - fuse_log(FUSE_LOG_ERR, "mount(/, MS_REC|MS_PRIVATE): %m\n"); - exit(1); - } - - if (mount(source, source, NULL, MS_BIND, NULL) < 0) { - fuse_log(FUSE_LOG_ERR, "mount(%s, %s, MS_BIND): %m\n", source, sou= rce); - exit(1); - } - - setup_pivot_root(source); -} - /* * Lock down this process to prevent access to other processes or files ou= tside * source directory. This reduces the impact of arbitrary code execution = bugs. */ -static void setup_sandbox(struct lo_data *lo) +static void setup_sandbox(struct lo_data *lo, struct fuse_session *se) { - setup_net_namespace(); - setup_mount_namespace(lo->source); + setup_namespaces(lo, se); + setup_mounts(lo->source); } =20 int main(int argc, char *argv[]) @@ -2172,10 +2213,7 @@ int main(int argc, char *argv[]) =20 fuse_daemonize(opts.foreground); =20 - /* Must be after daemonize to get the right /proc/self/fd */ - setup_proc_self_fd(&lo); - - setup_sandbox(&lo); + setup_sandbox(&lo, se); =20 /* Block until ctrl+c or fusermount -u */ ret =3D virtio_loop(se); --=20 2.24.1