From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pf1-f176.google.com (mail-pf1-f176.google.com [209.85.210.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 722B62F41; Fri, 10 Feb 2023 22:53:21 +0000 (UTC) Received: by mail-pf1-f176.google.com with SMTP id t17so4521409pfj.0; Fri, 10 Feb 2023 14:53:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=5C7mT14sIcQvZGqVI82PDB3oIpwvIfrZYj8GQKRk2hw=; b=P/Tr0QaVTqrmzTX9y2izxlfHtpFEpelXkhC8PrVRQIjIVTa77U5WVEXpobrw1wVXOt ec2pULGZcCu1Q7QhlKmTHf6rsvSMr7NgLeQyrTQW3dBUJ/1d7BguZLWiBIlUibtR1yfm Saq9iljFRa5en+DF9HAaDWUvOYQJzIpAdoW9S9GWKt7stpbuanfGr2xP6Xp9h1KCP+6V waRMfWEy2EzM3N2uDUoOm4I4jtsWp7/YssULyHh3pMg+vhuP4liovJurTHrijef6L1f3 IbO/b56MVFY+bZnP2Nuu4dBpl9z7BiZl1gfPc0+aAXV6+KVD5otUeFJKwhSG8pjWX2pL 8hjA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=5C7mT14sIcQvZGqVI82PDB3oIpwvIfrZYj8GQKRk2hw=; b=F3dBRSc9Pz255iiPzQ8uCCo6d4An4QxpswCK6daoo6DPaTrFpj4Mly1U04q8cr/hvv QvEqwYzqpRW9aQAUUca5Ab6Gd43d/SOH65EtpXJFNstFcXDw6OOYpMeSlN9dfve6UEIC EXmrzoqfO+YoKo57GGQcTS5fF2/Nx++9sRfmmDeOLqrFokB3oXxtXGg40NyPorPmLLzd HmKKlebukNQWu66tVqqCRNdp3tGJhNh0ik4SWl4G3HfoiSc8P6MKjvZu+7fut0ZZK3hD /RiU8yWwRmlyXVQ5hGH42iXrMe4zyplQo5Q+PZf4xX6lc7WoVJc3FwBwnbqGfDs7QjiG bvZw== X-Gm-Message-State: AO0yUKXqXLr/NpL+qdAzstXZzZtar5s4yglxSPHTwwO0bYZbPwu/ECWk UJeyPDFFk2jDCufcZXpTfhR758PftxfSe2+3WNQ= X-Google-Smtp-Source: AK7set/GNEl9KMH8Zwkoa7+0XItH/dxabtmg2DZlqpwxk0lC0z5W8yfttgTmQiqIMrBuECnEJk6/1mNLzLdb19oPgIs= X-Received: by 2002:a62:17c3:0:b0:5a8:6aeb:e95e with SMTP id 186-20020a6217c3000000b005a86aebe95emr1009703pfx.33.1676069600452; Fri, 10 Feb 2023 14:53:20 -0800 (PST) Precedence: bulk X-Mailing-List: linux-coco@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 References: <20230127112248.136810-1-suzuki.poulose@arm.com> In-Reply-To: From: Itaru Kitayama Date: Sat, 11 Feb 2023 07:53:09 +0900 Message-ID: Subject: Re: [RFC] Support for Arm CCA VMs on Linux To: Ryan Roberts Cc: Suzuki K Poulose , linux-coco@lists.linux.dev, linux-kernel@vger.kernel.org, kvm@vger.kernel.org, kvmarm@lists.linux.dev, linux-arm-kernel@lists.infradead.org, Alexandru Elisei , Andrew Jones , Catalin Marinas , Chao Peng , Christoffer Dall , Fuad Tabba , James Morse , Jean-Philippe Brucker , Joey Gouly , Marc Zyngier , Mark Rutland , Oliver Upton , Paolo Bonzini , Quentin Perret , Sean Christopherson , Steven Price , Thomas Huth , Will Deacon , Zenghui Yu , kvmarm@lists.cs.columbia.edu Content-Type: text/plain; charset="UTF-8" On Sat, Feb 11, 2023 at 1:56 AM Ryan Roberts wrote: > > On 27/01/2023 11:22, Suzuki K Poulose wrote: > > [...] > > > Running the stack > > ==================== > > > > To run/test the stack, you would need the following components : > > > > 1) FVP Base AEM RevC model with FEAT_RME support [4] > > 2) TF-A firmware for EL3 [5] > > 3) TF-A RMM for R-EL2 [3] > > 4) Linux Kernel [6] > > 5) kvmtool [7] > > 6) kvm-unit-tests [8] > > > > Instructions for building the firmware components and running the model are > > available here [9]. Once, the host kernel is booted, a Realm can be launched by > > invoking the `lkvm` commad as follows: > > > > $ lkvm run --realm \ > > --measurement-algo=["sha256", "sha512"] \ > > --disable-sve \ > > > > > > Where: > > * --measurement-algo (Optional) specifies the algorithm selected for creating the > > initial measurements by the RMM for this Realm (defaults to sha256). > > * GICv3 is mandatory for the Realms. > > * SVE is not yet supported in the TF-RMM, and thus must be disabled using > > --disable-sve > > > > You may also run the kvm-unit-tests inside the Realm world, using the similar > > options as above. > > Building all of these components and configuring the FVP correctly can be quite > tricky, so I thought I would plug a tool we have called Shrinkwrap, which can > simplify all of this. > > The tool accepts a yaml input configuration that describes how a set of > components should be built and packaged, and how the FVP should be configured > and booted. And by default, it uses a Docker container on its backend, which > contains all the required tools, including the FVP. You can optionally use > Podman or have it run on your native system if you prefer. It supports both > x86_64 and aarch64. And you can even run it in --dry-run mode to see the set of > shell commands that would have been executed. > > It comes with two CCA configs out-of-the-box; cca-3world.yaml builds TF-A, RMM, > Linux (for both host and guest), kvmtool and kvm-unit-tests. cca-4world.yaml > adds Hafnium and some demo SPs for the secure world (although since Hafnium > requires x86_64 to build, cca-4world.yaml doesn't currently work on an aarch64 > build host). > > See the documentation [1] and repository [2] for more info. > > Brief instructions to get you up and running: > > # Install shrinkwrap. (I assume you have Docker installed): > sudo pip3 install pyyaml termcolor tuxmake > git clone https://git.gitlab.arm.com/tooling/shrinkwrap.git > export PATH=$PWD/shrinkwrap/shrinkwrap:$PATH > > # If running Python < 3.9: > sudo pip3 install graphlib-backport > > # Build all the CCA components: > shrinkwrap build cca-3world.yaml [--dry-run] This has been working on my Multipass instance on M1, thanks for the tool. Thanks, Itaru. > > # Run the stack in the FVP: > shrinkwrap run cca-3world.yaml -r ROOTFS= [--dry-run] > > By default, building is done at ~/.shrinkwrap/build/cca-3world and the package > is created at ~/.shrinkwrap/package/cca-3world (this can be changed with > envvars). > > The 'run' command will boot TF-A, RMM and host Linux kernel in the FVP, and > mount the provided rootfs. You will likely want to have copied the userspace > pieces into the rootfs before running, so you can create realms: > > - ~/.shrinkwrap/package/cca-3world/Image (kernel with RMI and RSI support) > - ~/.shrinkwrap/package/cca-3world/lkvm (kvmtool able to launch realms) > - ~/.shrinkwrap/package/cca-3world/kvm-unit-tests.tgz (built kvm-unit-tests) > > Once the FVP is booted to a shell, you can do something like this to launch a > Linux guest in a realm: > > lkvm run --realm --disable-sve -c 1 -m 256 -k Image > > [1] https://shrinkwrap.docs.arm.com > [2] https://gitlab.arm.com/tooling/shrinkwrap > > > _______________________________________________ > linux-arm-kernel mailing list > linux-arm-kernel@lists.infradead.org > http://lists.infradead.org/mailman/listinfo/linux-arm-kernel From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id DBDD5C05027 for ; Fri, 10 Feb 2023 22:54:18 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:Cc:To:Subject:Message-ID:Date:From: In-Reply-To:References:MIME-Version:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=LmkfkVI1AP+2Xrl4yMKsc1wX07tASrA+muateTGTVtc=; b=W3tXLVWwvZYKE4 iYH2J0bdeEBd2rRmgU8+zZ57OfZfHStBHpeGmRIrM2jSqV84gMWQcrBxmFLjVeqcI2rG3gyNuw2Nm K1TKhN2HkAEET3kHJcYToLJacg1Fyyc4CzDKkOggrg5/Fa+zaNCsmTd6N484Abf0N3CPyPAnKl1qR 0vc9cU+nhBp8kzP+2DC2zJBF/vaUtbGREP/Dlj//T5jP85X1o+2Yw4lGO2VSO8qo5daTvRhCCizZx 2B4H80aOu+OH+WRqLJyyaWiYs4fNapgoOkK5W4XYDSqaTpyY1pYbbzQHkWhVIQQDH7n/VSD7N2xxL uXjVyAu9O1SYmiu9VU+Q==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1pQcGj-007qM7-7G; Fri, 10 Feb 2023 22:53:25 +0000 Received: from mail-pf1-x42c.google.com ([2607:f8b0:4864:20::42c]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1pQcGg-007qKt-3i for linux-arm-kernel@lists.infradead.org; Fri, 10 Feb 2023 22:53:23 +0000 Received: by mail-pf1-x42c.google.com with SMTP id g9so4491902pfo.5 for ; Fri, 10 Feb 2023 14:53:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=5C7mT14sIcQvZGqVI82PDB3oIpwvIfrZYj8GQKRk2hw=; b=P/Tr0QaVTqrmzTX9y2izxlfHtpFEpelXkhC8PrVRQIjIVTa77U5WVEXpobrw1wVXOt ec2pULGZcCu1Q7QhlKmTHf6rsvSMr7NgLeQyrTQW3dBUJ/1d7BguZLWiBIlUibtR1yfm Saq9iljFRa5en+DF9HAaDWUvOYQJzIpAdoW9S9GWKt7stpbuanfGr2xP6Xp9h1KCP+6V waRMfWEy2EzM3N2uDUoOm4I4jtsWp7/YssULyHh3pMg+vhuP4liovJurTHrijef6L1f3 IbO/b56MVFY+bZnP2Nuu4dBpl9z7BiZl1gfPc0+aAXV6+KVD5otUeFJKwhSG8pjWX2pL 8hjA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=5C7mT14sIcQvZGqVI82PDB3oIpwvIfrZYj8GQKRk2hw=; b=yR6UHryZPiw3YX6aTxHG9ONhW7Dd2WNCIWT/qFwAT/r2UM/PRi8SRCgatZGOzA1jBH 4yNj0pVNgLL+rQW8KeJ6ZysAkP7TduL7m4efrW+b9ft4BareFUANiG7oqHJVgwEm4Cgr ymOze7Pi3NToQIPwA5P7WGsGu/nX76AwO9MJz8H8A6Fcc9AeqOn0L1ppIBWODXkLYt9K GmNcCFxcocWCE08Mvwvyfxvk2lEy1DAuBBa7qTLke+g6ZpGiyWSAZdpwtXdKRJ/Na1KW BE0pOIIFE4OO95ooWgPHtwCai4L1RjFA/YjoB11MCegUyPmleljdmIPhWVH5a6dfL8S2 nJjg== X-Gm-Message-State: AO0yUKVBF+A4b9srYKRaa9EU0lEfl9JclvH9kH51wodWlOLImRTlo6Uy /W+PRYU/OBMIr6/Mi5NzCh9Hv8m3HargU+WId91riFZNT29lLw== X-Google-Smtp-Source: AK7set/GNEl9KMH8Zwkoa7+0XItH/dxabtmg2DZlqpwxk0lC0z5W8yfttgTmQiqIMrBuECnEJk6/1mNLzLdb19oPgIs= X-Received: by 2002:a62:17c3:0:b0:5a8:6aeb:e95e with SMTP id 186-20020a6217c3000000b005a86aebe95emr1009703pfx.33.1676069600452; Fri, 10 Feb 2023 14:53:20 -0800 (PST) MIME-Version: 1.0 References: <20230127112248.136810-1-suzuki.poulose@arm.com> In-Reply-To: From: Itaru Kitayama Date: Sat, 11 Feb 2023 07:53:09 +0900 Message-ID: Subject: Re: [RFC] Support for Arm CCA VMs on Linux To: Ryan Roberts Cc: Suzuki K Poulose , linux-coco@lists.linux.dev, linux-kernel@vger.kernel.org, kvm@vger.kernel.org, kvmarm@lists.linux.dev, linux-arm-kernel@lists.infradead.org, Alexandru Elisei , Andrew Jones , Catalin Marinas , Chao Peng , Christoffer Dall , Fuad Tabba , James Morse , Jean-Philippe Brucker , Joey Gouly , Marc Zyngier , Mark Rutland , Oliver Upton , Paolo Bonzini , Quentin Perret , Sean Christopherson , Steven Price , Thomas Huth , Will Deacon , Zenghui Yu , kvmarm@lists.cs.columbia.edu X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20230210_145322_192233_1A44E0BA X-CRM114-Status: GOOD ( 34.62 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Sat, Feb 11, 2023 at 1:56 AM Ryan Roberts wrote: > > On 27/01/2023 11:22, Suzuki K Poulose wrote: > > [...] > > > Running the stack > > ==================== > > > > To run/test the stack, you would need the following components : > > > > 1) FVP Base AEM RevC model with FEAT_RME support [4] > > 2) TF-A firmware for EL3 [5] > > 3) TF-A RMM for R-EL2 [3] > > 4) Linux Kernel [6] > > 5) kvmtool [7] > > 6) kvm-unit-tests [8] > > > > Instructions for building the firmware components and running the model are > > available here [9]. Once, the host kernel is booted, a Realm can be launched by > > invoking the `lkvm` commad as follows: > > > > $ lkvm run --realm \ > > --measurement-algo=["sha256", "sha512"] \ > > --disable-sve \ > > > > > > Where: > > * --measurement-algo (Optional) specifies the algorithm selected for creating the > > initial measurements by the RMM for this Realm (defaults to sha256). > > * GICv3 is mandatory for the Realms. > > * SVE is not yet supported in the TF-RMM, and thus must be disabled using > > --disable-sve > > > > You may also run the kvm-unit-tests inside the Realm world, using the similar > > options as above. > > Building all of these components and configuring the FVP correctly can be quite > tricky, so I thought I would plug a tool we have called Shrinkwrap, which can > simplify all of this. > > The tool accepts a yaml input configuration that describes how a set of > components should be built and packaged, and how the FVP should be configured > and booted. And by default, it uses a Docker container on its backend, which > contains all the required tools, including the FVP. You can optionally use > Podman or have it run on your native system if you prefer. It supports both > x86_64 and aarch64. And you can even run it in --dry-run mode to see the set of > shell commands that would have been executed. > > It comes with two CCA configs out-of-the-box; cca-3world.yaml builds TF-A, RMM, > Linux (for both host and guest), kvmtool and kvm-unit-tests. cca-4world.yaml > adds Hafnium and some demo SPs for the secure world (although since Hafnium > requires x86_64 to build, cca-4world.yaml doesn't currently work on an aarch64 > build host). > > See the documentation [1] and repository [2] for more info. > > Brief instructions to get you up and running: > > # Install shrinkwrap. (I assume you have Docker installed): > sudo pip3 install pyyaml termcolor tuxmake > git clone https://git.gitlab.arm.com/tooling/shrinkwrap.git > export PATH=$PWD/shrinkwrap/shrinkwrap:$PATH > > # If running Python < 3.9: > sudo pip3 install graphlib-backport > > # Build all the CCA components: > shrinkwrap build cca-3world.yaml [--dry-run] This has been working on my Multipass instance on M1, thanks for the tool. Thanks, Itaru. > > # Run the stack in the FVP: > shrinkwrap run cca-3world.yaml -r ROOTFS= [--dry-run] > > By default, building is done at ~/.shrinkwrap/build/cca-3world and the package > is created at ~/.shrinkwrap/package/cca-3world (this can be changed with > envvars). > > The 'run' command will boot TF-A, RMM and host Linux kernel in the FVP, and > mount the provided rootfs. You will likely want to have copied the userspace > pieces into the rootfs before running, so you can create realms: > > - ~/.shrinkwrap/package/cca-3world/Image (kernel with RMI and RSI support) > - ~/.shrinkwrap/package/cca-3world/lkvm (kvmtool able to launch realms) > - ~/.shrinkwrap/package/cca-3world/kvm-unit-tests.tgz (built kvm-unit-tests) > > Once the FVP is booted to a shell, you can do something like this to launch a > Linux guest in a realm: > > lkvm run --realm --disable-sve -c 1 -m 256 -k Image > > [1] https://shrinkwrap.docs.arm.com > [2] https://gitlab.arm.com/tooling/shrinkwrap > > > _______________________________________________ > linux-arm-kernel mailing list > linux-arm-kernel@lists.infradead.org > http://lists.infradead.org/mailman/listinfo/linux-arm-kernel _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel