From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2B5A5C48BE5 for ; Tue, 15 Jun 2021 19:58:36 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 931AD613B1 for ; Tue, 15 Jun 2021 19:58:35 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 931AD613B1 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:48144 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ltFCk-00028h-AE for qemu-devel@archiver.kernel.org; Tue, 15 Jun 2021 15:58:34 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:47188) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ltFC3-0001Sx-Ii for qemu-devel@nongnu.org; Tue, 15 Jun 2021 15:57:51 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:25966) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ltFC0-00035A-Sh for qemu-devel@nongnu.org; Tue, 15 Jun 2021 15:57:50 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1623787067; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=pbovfBVSYDBhSRvNIYdu9kia6NCI+4ZAoVlEG/134Eo=; b=IfBEshs/UGd72N2QeUUf6ZkkYB4lPbAJIlauV+Jin1kigpx4EpbZxlbe95FiPxi2FhzaO+ EJD15SCVXI2FWX/Jvp2EVin8EjgkSmN2g5HHQR1c+7i/bB1CvmefcMuXui1JJ/wKAEq1AB Oxhe6M8/x7Wu8LI9K8HcEiQap+D/jhw= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-487-ywz9TwSKOTuOP2Do0PtZmA-1; Tue, 15 Jun 2021 15:57:45 -0400 X-MC-Unique: ywz9TwSKOTuOP2Do0PtZmA-1 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id CFB618042A8 for ; Tue, 15 Jun 2021 19:57:44 +0000 (UTC) Received: from horse.redhat.com (ovpn-115-170.rdu2.redhat.com [10.10.115.170]) by smtp.corp.redhat.com (Postfix) with ESMTP id 5722D60853; Tue, 15 Jun 2021 19:57:41 +0000 (UTC) Received: by horse.redhat.com (Postfix, from userid 10451) id C4883220BCF; Tue, 15 Jun 2021 15:57:40 -0400 (EDT) Date: Tue, 15 Jun 2021 15:57:40 -0400 From: Vivek Goyal To: Daniel =?iso-8859-1?Q?P=2E_Berrang=E9?= Subject: Re: [Virtio-fs] [PATCH] docs: describe the security considerations with virtiofsd xattr mapping Message-ID: <20210615195740.GC965196@redhat.com> References: <20210611120427.49736-1-berrange@redhat.com> <20210611154222.GA761698@redhat.com> MIME-Version: 1.0 In-Reply-To: X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=vgoyal@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=216.205.24.124; envelope-from=vgoyal@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -29 X-Spam_score: -3.0 X-Spam_bar: --- X-Spam_report: (-3.0 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.197, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: virtio-fs@redhat.com, Miklos Szeredi , Daniel J Walsh , qemu-devel@nongnu.org, "Dr. David Alan Gilbert" Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On Tue, Jun 15, 2021 at 04:46:45PM +0100, Daniel P. Berrangé wrote: > On Fri, Jun 11, 2021 at 11:42:22AM -0400, Vivek Goyal wrote: > > On Fri, Jun 11, 2021 at 01:04:27PM +0100, Daniel P. Berrangé wrote: > > > Different guest xattr prefixes have distinct access control rules applied > > > by the guest. When remapping a guest xattr care must be taken that the > > > remapping does not allow the a guest user to bypass guest kernel access > > > control rules. > > > > > > For example if 'trusted.*' which requires CAP_SYS_ADMIN is remapped > > > to 'user.virtiofs.trusted.*', an unprivileged guest user which can > > > write to 'user.*' can bypass the CAP_SYS_ADMIN control. Thus the > > > target of any remapping must be explicitly blocked from read/writes > > > by the guest, to prevent access control bypass. > > > > > > The examples shown in the virtiofsd man page already do the right > > > thing and ensure safety, but the security implications of getting > > > this wrong were not made explicit. This could lead to host admins > > > and apps unwittingly creating insecure configurations. > > > > > > Signed-off-by: Daniel P. Berrangé > > > --- > > > docs/tools/virtiofsd.rst | 55 ++++++++++++++++++++++++++++++++++++---- > > > 1 file changed, 50 insertions(+), 5 deletions(-) > > > > > > diff --git a/docs/tools/virtiofsd.rst b/docs/tools/virtiofsd.rst > > > index 00554c75bd..6370ab927c 100644 > > > --- a/docs/tools/virtiofsd.rst > > > +++ b/docs/tools/virtiofsd.rst > > > @@ -127,8 +127,8 @@ Options > > > timeout. ``always`` sets a long cache lifetime at the expense of coherency. > > > The default is ``auto``. > > > > > > -xattr-mapping > > > -------------- > > > +Extended attribute (xattr) mapping > > > +---------------------------------- > > > > > > By default the name of xattr's used by the client are passed through to the server > > > file system. This can be a problem where either those xattr names are used > > > @@ -136,6 +136,9 @@ by something on the server (e.g. selinux client/server confusion) or if the > > > virtiofsd is running in a container with restricted privileges where it cannot > > > access some attributes. > > > > > > +Mapping syntax > > > +~~~~~~~~~~~~~~ > > > + > > > A mapping of xattr names can be made using -o xattrmap=mapping where the ``mapping`` > > > string consists of a series of rules. > > > > > > @@ -232,8 +235,48 @@ Note: When the 'security.capability' xattr is remapped, the daemon has to do > > > extra work to remove it during many operations, which the host kernel normally > > > does itself. > > > > > > -xattr-mapping Examples > > > ----------------------- > > > +Security considerations > > > +~~~~~~~~~~~~~~~~~~~~~~~ > > > + > > > +Operating systems typically partition the xattr namespace using > > > +well defined name prefixes. Each partition may have different > > > +access controls applied. For example, on Linux there are multiple > > > +partitions > > > + > > > + * ``system.*`` - access varies depending on attribute & filesystem > > > + * ``security.*`` - only processes with CAP_SYS_ADMIN > > > + * ``trusted.*`` - only processes with CAP_SYS_ADMIN > > > + * ``user.*`` - any process granted by file permissions / ownership > > > + > > > +While other OS such as FreeBSD have different name prefixes > > > +and access control rules. > > > + > > > +When remapping attributes on the host, it is important to > > > +ensure that the remapping does not allow a guest user to > > > +evade the guest access control rules. > > > + > > > +Consider if ``trusted.*`` from the guest was remapped to > > > +``user.virtiofs.trusted*`` in the host. An unprivileged > > > +user in a Linux guest has the ability to write to xattrs > > > +under ``user.*``. Thus the user can evade the access > > > +control restriction on ``trusted.*`` by instead writing > > > +to ``user.virtiofs.trusted.*``. > > > + > > > +As noted above, the partitions used and access controls > > > +applied, will vary across guest OS, so it is not wise to > > > +try to predict what the guest OS will use. > > > + > > > +The simplest way to avoid an insecure configuration is > > > +to remap all xattrs at once, to a given fixed prefix. > > > > Remapping all xattrs seem to make sense. It probably will lead > > to less confusion. Nested guests add another level of redirection. > > > > BTW, remapping xattr has limitation that it does not work on > > symlinks. So "user.*" can't be set on symlink. And that means > > selinux relabeling of symlinks fails with remapped xattrs. > > > > Not sure how to address this limitation. Host kernel imposes > > this limit. (man xattr). > > Oh fun, I had not noticed this limitation before :-( > > Here are some ideas I had, none especially nice > > - Use 'trusted.*' namespace for remapping instead of 'user.' > > virtiofsd needs to have CAP_SYS_ADMIN though which is > quite horrible if your goal is to confine its privileges > in any meaningful way > > - Store a symlinks' xattr on the target of the symlink > > if the symlink has dev:inode 54:224, and points to > a file 'foo', then on 'foo' create an xattr > "user.virtiofs.link:54:224." > > This gets quite horrendous when you have symlinks > pointing to symlinks pointing to symlinks. Does > not work too well if the 'st_dev' value is > not stable across reboots either. > > - Don't use xattrs at all for remapping, instead use > hidden files. > > eg for a file 'foo', if an xattr is set then create > a file '.foo.xattr' in the same directory and store > the xattrs in that file in some format. Need to hide > this lookaside files from the guest of course. I kind of like this idea of creating a regular file, say .user.virtiofs.foo.xattr. So any file prefixed by ".user.virtiofs" will be hidden from guest. And probably same can be done for selinux labels for special files (device nodes, pipes, sockets etc). Thanks Vivek