From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-17.4 required=3.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, USER_IN_DEF_DKIM_WL autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C863DC4727C for ; Thu, 1 Oct 2020 10:52:08 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 6D3A220B1F for ; Thu, 1 Oct 2020 10:52:08 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="peG/ZBsE" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732132AbgJAKwH (ORCPT ); Thu, 1 Oct 2020 06:52:07 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52714 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1731884AbgJAKwG (ORCPT ); Thu, 1 Oct 2020 06:52:06 -0400 Received: from mail-wr1-x443.google.com (mail-wr1-x443.google.com [IPv6:2a00:1450:4864:20::443]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 21231C0613D0 for ; Thu, 1 Oct 2020 03:52:06 -0700 (PDT) Received: by mail-wr1-x443.google.com with SMTP id z1so5134772wrt.3 for ; Thu, 01 Oct 2020 03:52:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=k2N0J/M9yplh3qBJTgm1trDqAWsQTbieqBVpcxzeRPI=; b=peG/ZBsEykKqm9oTMBx4fR4/bBMNa2xWkWHFuhuoSp0nPd5MDVeQdCOKCO0kN9CmDD zOEavwXdNYiPi/kCnqk+LFRkpLO0FY+b64//p4gpheRsRoOK6OJ0dhW5Mwu6xCQ/hON9 H8cV2/1Ra0LflfbdXgYJRQhgBrc4eMajxPOjteMUYyy38iowW7V2U8JOzeNt6mDY7ghf 0mSKl4BBUxSkzLB9wQ5dH0sQKkOpNPrWa5E3/fa7qMkauuksf1AnibTgAhVL0Xp9rcd6 60gOegQinQi70+Ie2OKoyJQnhll6RVXNxDB1cfegJ9LIFjUIt4qIyl5WhQbWjwVIPDLE cAqQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=k2N0J/M9yplh3qBJTgm1trDqAWsQTbieqBVpcxzeRPI=; b=t5AEF/VAH/lO+V/luf0+VedDRDG66gYCI91tZILRltvmMXeU/up4bf/HrU+X1ix9xG LjHdDCQUtuukjjG/qd/t7H5GwzZvYqA/rCjoAPj8A0YCpJ73GVLe3My8cgazZ+/drg2O UhQFGOZsGhFu0YCfDOw79blqEYfBTz0F/P6ZYmR7rUEjtzynwf4+RNugBMyTSRY/BF+n UeBQtIzD/WMNvGcKA72AYQaklYZt0cCJD99Zh9Ndk74vk+Vg5FnW7erX8d84pUGExrmF CTstDCWMr4ZCCaHlIkPu7uJaeSNMtPgznqQ0NvFijL6k5nZbPelgdQWlQVLy1qH1mi1l sPwQ== X-Gm-Message-State: AOAM533vJvC0BWfvO0eN/tlCMdLATplq6sCbPf8Hie7x7jsFVz6TVh/2 3lcQ9qqIry8Ibyltlwbm5skHKA== X-Google-Smtp-Source: ABdhPJw4xVEknNO9ydWnolFnG34BKOtlr/IEZ4YTGX+i9Dn0gani5VcV6oYIUxM0kGF6DYGs385bBQ== X-Received: by 2002:adf:f2d0:: with SMTP id d16mr7896961wrp.332.1601549524567; Thu, 01 Oct 2020 03:52:04 -0700 (PDT) Received: from google.com ([2a00:79e0:d:109:4a0f:cfff:fe4a:6363]) by smtp.gmail.com with ESMTPSA id i33sm9151325wri.79.2020.10.01.03.52.03 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 01 Oct 2020 03:52:03 -0700 (PDT) Date: Thu, 1 Oct 2020 11:51:59 +0100 From: Andrew Scull To: George-Aurelian Popescu Cc: maz@kernel.org, catalin.marinas@arm.com, will@kernel.org, masahiroy@kernel.org, michal.lkml@markovi.net, linux-arm-kernel@lists.infradead.org, kvmarm@lists.cs.columbia.edu, linux-kernel@vger.kernel.org, linux-kbuild@vger.kernel.org, clang-built-linux@googlegroups.com, james.morse@arm.com, julien.thierry.kdev@gmail.com, suzuki.poulose@arm.com, natechancellor@gmail.com, ndesaulniers@google.com, dbrazdil@google.com, broonie@kernel.org, maskray@google.com, keescook@chromium.org, akpm@linux-foundation.org, dvyukov@google.com, elver@google.com, tglx@linutronix.de, arnd@arndb.de Subject: Re: [PATCH 05/14] KVM: arm64: Define a buffer that can pass UBSan data from hyp/nVHE to kernel Message-ID: <20201001105159.GB541087@google.com> References: <20200914172750.852684-1-georgepope@google.com> <20200914172750.852684-6-georgepope@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200914172750.852684-6-georgepope@google.com> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Sep 14, 2020 at 05:27:41PM +0000, George-Aurelian Popescu wrote: > From: George Popescu > > Store data, which is collected from UBSan handlers that lives inside hyp/nVHE, > into the kvm_ubsan_buffer. > This buffer is designed to store only UBSan data because it should not be > preoccupied by other mechanisms data structures and functionalities. > > Map the buffer and the write iqndex before switching the control to > hyp/nVHE. > > Map the kernel .data region to read the compile time generated UBSan struct's > data from hyp/nVHE. > > Signed-off-by: George Popescu > --- > arch/arm64/include/asm/kvm_asm.h | 3 +++ > arch/arm64/include/asm/kvm_host.h | 6 +++++ > arch/arm64/include/asm/kvm_ubsan.h | 17 +++++++++++++ > arch/arm64/kvm/Makefile | 4 ++++ > arch/arm64/kvm/arm.c | 38 +++++++++++++++++++++++++++++- > arch/arm64/kvm/hyp/hyp-entry.S | 4 ++++ > arch/arm64/kvm/hyp/nvhe/ubsan.c | 24 ++++++++++++++++++- > arch/arm64/kvm/kvm_ubsan_buffer.c | 32 +++++++++++++++++++++++++ > 8 files changed, 126 insertions(+), 2 deletions(-) > create mode 100644 arch/arm64/include/asm/kvm_ubsan.h > create mode 100644 arch/arm64/kvm/kvm_ubsan_buffer.c > > diff --git a/arch/arm64/include/asm/kvm_asm.h b/arch/arm64/include/asm/kvm_asm.h > index 200bb8d0a720..9d4a77f08ffd 100644 > --- a/arch/arm64/include/asm/kvm_asm.h > +++ b/arch/arm64/include/asm/kvm_asm.h > @@ -63,6 +63,9 @@ > #define CHOOSE_VHE_SYM(sym) sym > #define CHOOSE_NVHE_SYM(sym) kvm_nvhe_sym(sym) > > +#define this_cpu_ptr_nvhe(sym) this_cpu_ptr(&kvm_nvhe_sym(sym)) > +#define per_cpu_ptr_nvhe(sym, cpu) per_cpu_ptr(&kvm_nvhe_sym(sym), cpu) > + > #ifndef __KVM_NVHE_HYPERVISOR__ > /* > * BIG FAT WARNINGS: > diff --git a/arch/arm64/include/asm/kvm_host.h b/arch/arm64/include/asm/kvm_host.h > index adc8957e9321..337fd2d0f976 100644 > --- a/arch/arm64/include/asm/kvm_host.h > +++ b/arch/arm64/include/asm/kvm_host.h > @@ -494,8 +494,14 @@ u64 __kvm_call_hyp(void *hypfn, ...); > __kvm_call_hyp(kvm_ksym_ref_nvhe(f), ##__VA_ARGS__); \ > }) > > +#ifdef CONFIG_UBSAN > +extern void __kvm_check_ubsan_buffer(void); > +#endif > + > #define __kvm_arm_check_debug_buffer() \ > { \ > + if (IS_ENABLED(CONFIG_UBSAN)) \ > + __kvm_check_ubsan_buffer(); \ > } > > /* > diff --git a/arch/arm64/include/asm/kvm_ubsan.h b/arch/arm64/include/asm/kvm_ubsan.h > new file mode 100644 > index 000000000000..af607a796376 > --- /dev/null > +++ b/arch/arm64/include/asm/kvm_ubsan.h > @@ -0,0 +1,17 @@ > +/* SPDX-License-Identifier: GPL-2.0-only */ > +/* > + * Copyright 2020 Google LLC > + * Author: George Popescu > + */ > + > +#ifdef CONFIG_UBSAN The header should have an inclusion guard as well. > +#include Is it possible to only include this from within kvm_ubsan_buffer.c similar to how lib/ubsan.c keeps it self contained? Then export function for things like mapping it up to hyp? > + > + > +#define UBSAN_MAX_TYPE 6 > +#define KVM_UBSAN_BUFFER_SIZE 1000 > + > +struct kvm_ubsan_info { > + int type; > +}; > +#endif > diff --git a/arch/arm64/kvm/Makefile b/arch/arm64/kvm/Makefile > index 99977c1972cc..92f06cb5b3df 100644 > --- a/arch/arm64/kvm/Makefile > +++ b/arch/arm64/kvm/Makefile > @@ -24,4 +24,8 @@ kvm-y := $(KVM)/kvm_main.o $(KVM)/coalesced_mmio.o $(KVM)/eventfd.o \ > vgic/vgic-mmio-v3.o vgic/vgic-kvm-device.o \ > vgic/vgic-its.o vgic/vgic-debug.o > > +CFLAGS_kvm_ubsan_buffer.o += -I $(srctree)/lib/ > +CFLAGS_arm.o += -I $(srctree)/lib > + > +kvm-$(CONFIG_UBSAN) += kvm_ubsan_buffer.o > kvm-$(CONFIG_KVM_ARM_PMU) += pmu-emul.o > diff --git a/arch/arm64/kvm/arm.c b/arch/arm64/kvm/arm.c > index b588c3b5c2f0..eff57069e103 100644 > --- a/arch/arm64/kvm/arm.c > +++ b/arch/arm64/kvm/arm.c > @@ -42,10 +42,17 @@ > #include > #include > > +#include > +#include > + > #ifdef REQUIRES_VIRT > __asm__(".arch_extension virt"); > #endif > > +#ifdef CONFIG_UBSAN > +DECLARE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > +#endif > + > DEFINE_PER_CPU(kvm_host_data_t, kvm_host_data); > static DEFINE_PER_CPU(unsigned long, kvm_arm_hyp_stack_page); > > @@ -1519,7 +1526,15 @@ static int init_hyp_mode(void) > kvm_err("Cannot map bss section\n"); > goto out_err; > } > - > +#ifdef CONFIG_UBSAN > + /* required by ubsan to access the handlers structures fields */ > + err = create_hyp_mappings(kvm_ksym_ref(_data), > + kvm_ksym_ref(__end_once), PAGE_HYP_RO); > + if (err) { > + kvm_err("Cannot map data section\n"); > + goto out_err; > + } > +#endif > err = kvm_map_vectors(); > if (err) { > kvm_err("Cannot map vectors\n"); > @@ -1552,6 +1567,27 @@ static int init_hyp_mode(void) > } > } > > +#ifdef CONFIG_UBSAN > + for_each_possible_cpu(cpu) { > + /* map the write index */ > + struct kvm_ubsan_info *buff; > + unsigned long *wr_ind; > + > + wr_ind = per_cpu_ptr_nvhe(kvm_ubsan_buff_wr_ind, cpu); > + err = create_hyp_mappings(wr_ind, wr_ind + 1, PAGE_HYP); > + if (err) { > + kvm_err("Cannot map the busan buffer write index: %d\n", err); > + goto out_err; > + } > + buff = per_cpu_ptr(kvm_nvhe_sym(kvm_ubsan_buff), cpu); > + err = create_hyp_mappings(buff, buff + KVM_UBSAN_BUFFER_SIZE, PAGE_HYP); > + if (err) { > + kvm_err("Cannot map the ubsan buffer: %d\n", err); > + goto out_err; > + } > + } > +#endif > + > err = hyp_map_aux_data(); > if (err) > kvm_err("Cannot map host auxiliary data: %d\n", err); > diff --git a/arch/arm64/kvm/hyp/hyp-entry.S b/arch/arm64/kvm/hyp/hyp-entry.S > index 8df0082b9ccf..bcdbab4d2e43 100644 > --- a/arch/arm64/kvm/hyp/hyp-entry.S > +++ b/arch/arm64/kvm/hyp/hyp-entry.S > @@ -14,6 +14,7 @@ > #include > #include > #include > +#include > > .macro save_caller_saved_regs_vect > /* x0 and x1 were saved in the vector entry */ > @@ -74,6 +75,9 @@ el1_sync: // Guest trapped into EL2 > cmp x0, #HVC_STUB_HCALL_NR > b.hs 1f > > +#ifdef CONFIG_UBSAN > + clear_kvm_debug_buffer kvm_ubsan_buff_wr_ind, x4, x5, x6 > +#endif > /* > * Compute the idmap address of __kvm_handle_stub_hvc and > * jump there. Since we use kimage_voffset, do not use the > diff --git a/arch/arm64/kvm/hyp/nvhe/ubsan.c b/arch/arm64/kvm/hyp/nvhe/ubsan.c > index a5db6b61ceb2..a43c9646e1e8 100644 > --- a/arch/arm64/kvm/hyp/nvhe/ubsan.c > +++ b/arch/arm64/kvm/hyp/nvhe/ubsan.c > @@ -3,9 +3,31 @@ > * Copyright 2020 Google LLC > * Author: George Popescu > */ > +#include > #include > #include > -#include > +#include > +#include > +#include > +#include > +#include > +#include > +#include > + > +DEFINE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > + > +static inline struct kvm_ubsan_info *kvm_ubsan_buffer_next_slot(void) > +{ > + struct kvm_ubsan_info *res; > + struct kvm_ubsan_info *buff; > + unsigned long *buff_ind; > + unsigned long buff_size = KVM_UBSAN_BUFFER_SIZE; > + unsigned int struct_size = sizeof(struct kvm_ubsan_info); > + > + init_kvm_debug_buffer(kvm_ubsan_buff, struct kvm_ubsan_info, buff, buff_ind); > + res = kvm_debug_buffer_next_slot(buff, buff_ind, struct_size, buff_size); > + return res; > +} > > void __ubsan_handle_add_overflow(void *_data, void *lhs, void *rhs) {} > > diff --git a/arch/arm64/kvm/kvm_ubsan_buffer.c b/arch/arm64/kvm/kvm_ubsan_buffer.c > new file mode 100644 > index 000000000000..28dcf19b5706 > --- /dev/null > +++ b/arch/arm64/kvm/kvm_ubsan_buffer.c > @@ -0,0 +1,32 @@ > +// SPDX-License-Identifier: GPL-2.0-only > +/* > + * Copyright 2020 Google LLC > + * Author: George Popescu > + */ > + > +#include > +#include > +#include > +#include > +#include > +#include > + > +#include > +#include > + > +DECLARE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > + > + > +void __kvm_check_ubsan_buffer(void) > +{ > + unsigned long *write_ind; > + unsigned long it; > + struct kvm_ubsan_info *slot; > + > + init_kvm_debug_buffer(kvm_ubsan_buff, struct kvm_ubsan_info, slot, write_ind); > + for_each_kvm_debug_buffer_slot(slot, write_ind, it) { > + /* check ubsan data */ > + slot->type = 0; > + } > +} > + > -- > 2.28.0.618.gf4bc123cb7-goog > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-9.5 required=3.0 tests=BAYES_00,DKIM_ADSP_CUSTOM_MED, DKIM_INVALID,DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 59B94C47420 for ; Thu, 1 Oct 2020 10:52:11 +0000 (UTC) Received: from mm01.cs.columbia.edu (mm01.cs.columbia.edu [128.59.11.253]) by mail.kernel.org (Postfix) with ESMTP id 9262120B1F for ; Thu, 1 Oct 2020 10:52:10 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=google.com header.i=@google.com header.b="peG/ZBsE" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9262120B1F Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvmarm-bounces@lists.cs.columbia.edu Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id DB28E4B13B; Thu, 1 Oct 2020 06:52:09 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Authentication-Results: mm01.cs.columbia.edu (amavisd-new); dkim=softfail (fail, message has been altered) header.i=@google.com Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id gbc9gsLqRRa1; Thu, 1 Oct 2020 06:52:08 -0400 (EDT) Received: from mm01.cs.columbia.edu (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 78A114B109; Thu, 1 Oct 2020 06:52:08 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 5AB394B109 for ; Thu, 1 Oct 2020 06:52:07 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cq8pdpTONpbK for ; Thu, 1 Oct 2020 06:52:06 -0400 (EDT) Received: from mail-wr1-f67.google.com (mail-wr1-f67.google.com [209.85.221.67]) by mm01.cs.columbia.edu (Postfix) with ESMTPS id D49C64B0EE for ; Thu, 1 Oct 2020 06:52:05 -0400 (EDT) Received: by mail-wr1-f67.google.com with SMTP id s12so5119489wrw.11 for ; Thu, 01 Oct 2020 03:52:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=k2N0J/M9yplh3qBJTgm1trDqAWsQTbieqBVpcxzeRPI=; b=peG/ZBsEykKqm9oTMBx4fR4/bBMNa2xWkWHFuhuoSp0nPd5MDVeQdCOKCO0kN9CmDD zOEavwXdNYiPi/kCnqk+LFRkpLO0FY+b64//p4gpheRsRoOK6OJ0dhW5Mwu6xCQ/hON9 H8cV2/1Ra0LflfbdXgYJRQhgBrc4eMajxPOjteMUYyy38iowW7V2U8JOzeNt6mDY7ghf 0mSKl4BBUxSkzLB9wQ5dH0sQKkOpNPrWa5E3/fa7qMkauuksf1AnibTgAhVL0Xp9rcd6 60gOegQinQi70+Ie2OKoyJQnhll6RVXNxDB1cfegJ9LIFjUIt4qIyl5WhQbWjwVIPDLE cAqQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=k2N0J/M9yplh3qBJTgm1trDqAWsQTbieqBVpcxzeRPI=; b=csV+38l3zDqhIeBUsZS15CNM1eiQG4+TlYSprdy141hMzdKffRlOMS2A2GJRU+w9eb Kmt2I3YMjrzkbVRYxPaStFAT5ZW69ddttO1gU9kHdiSYtY+RAKajXyVkF5ocFBAW0pvp qMB0gpSfADyBhPY05sXXUHj9nrYhrZ27Jq85M4aAAjXFAFDxXLkxvbbT6bAmm+qJ0Sdp 965NEJOAW0/LNxeWDjoa3mUH5oa2fhEC+Y9VqraZfgI33+VsTZOYh/U16+q8MXA/YB9U rFE3GBYeLp+0Rh02wcGTcm+1v1OWg4GtW4SuY4awemc/c6dFhbXs5Qvl4yfbiqhUmAtX LnUA== X-Gm-Message-State: AOAM530+U411L7oq3XmcpO1rDaBH1FDh+U3e/YY4pY3QbkttF13kCbJm 8xPx/hL00cEaHbAcEfmX2ZEMQw== X-Google-Smtp-Source: ABdhPJw4xVEknNO9ydWnolFnG34BKOtlr/IEZ4YTGX+i9Dn0gani5VcV6oYIUxM0kGF6DYGs385bBQ== X-Received: by 2002:adf:f2d0:: with SMTP id d16mr7896961wrp.332.1601549524567; Thu, 01 Oct 2020 03:52:04 -0700 (PDT) Received: from google.com ([2a00:79e0:d:109:4a0f:cfff:fe4a:6363]) by smtp.gmail.com with ESMTPSA id i33sm9151325wri.79.2020.10.01.03.52.03 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 01 Oct 2020 03:52:03 -0700 (PDT) Date: Thu, 1 Oct 2020 11:51:59 +0100 From: Andrew Scull To: George-Aurelian Popescu Subject: Re: [PATCH 05/14] KVM: arm64: Define a buffer that can pass UBSan data from hyp/nVHE to kernel Message-ID: <20201001105159.GB541087@google.com> References: <20200914172750.852684-1-georgepope@google.com> <20200914172750.852684-6-georgepope@google.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20200914172750.852684-6-georgepope@google.com> Cc: tglx@linutronix.de, catalin.marinas@arm.com, will@kernel.org, kvmarm@lists.cs.columbia.edu, maskray@google.com, maz@kernel.org, masahiroy@kernel.org, clang-built-linux@googlegroups.com, linux-arm-kernel@lists.infradead.org, elver@google.com, keescook@chromium.org, arnd@arndb.de, linux-kbuild@vger.kernel.org, broonie@kernel.org, natechancellor@gmail.com, dvyukov@google.com, michal.lkml@markovi.net, ndesaulniers@google.com, linux-kernel@vger.kernel.org, akpm@linux-foundation.org X-BeenThere: kvmarm@lists.cs.columbia.edu X-Mailman-Version: 2.1.14 Precedence: list List-Id: Where KVM/ARM decisions are made List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: kvmarm-bounces@lists.cs.columbia.edu Sender: kvmarm-bounces@lists.cs.columbia.edu On Mon, Sep 14, 2020 at 05:27:41PM +0000, George-Aurelian Popescu wrote: > From: George Popescu > > Store data, which is collected from UBSan handlers that lives inside hyp/nVHE, > into the kvm_ubsan_buffer. > This buffer is designed to store only UBSan data because it should not be > preoccupied by other mechanisms data structures and functionalities. > > Map the buffer and the write iqndex before switching the control to > hyp/nVHE. > > Map the kernel .data region to read the compile time generated UBSan struct's > data from hyp/nVHE. > > Signed-off-by: George Popescu > --- > arch/arm64/include/asm/kvm_asm.h | 3 +++ > arch/arm64/include/asm/kvm_host.h | 6 +++++ > arch/arm64/include/asm/kvm_ubsan.h | 17 +++++++++++++ > arch/arm64/kvm/Makefile | 4 ++++ > arch/arm64/kvm/arm.c | 38 +++++++++++++++++++++++++++++- > arch/arm64/kvm/hyp/hyp-entry.S | 4 ++++ > arch/arm64/kvm/hyp/nvhe/ubsan.c | 24 ++++++++++++++++++- > arch/arm64/kvm/kvm_ubsan_buffer.c | 32 +++++++++++++++++++++++++ > 8 files changed, 126 insertions(+), 2 deletions(-) > create mode 100644 arch/arm64/include/asm/kvm_ubsan.h > create mode 100644 arch/arm64/kvm/kvm_ubsan_buffer.c > > diff --git a/arch/arm64/include/asm/kvm_asm.h b/arch/arm64/include/asm/kvm_asm.h > index 200bb8d0a720..9d4a77f08ffd 100644 > --- a/arch/arm64/include/asm/kvm_asm.h > +++ b/arch/arm64/include/asm/kvm_asm.h > @@ -63,6 +63,9 @@ > #define CHOOSE_VHE_SYM(sym) sym > #define CHOOSE_NVHE_SYM(sym) kvm_nvhe_sym(sym) > > +#define this_cpu_ptr_nvhe(sym) this_cpu_ptr(&kvm_nvhe_sym(sym)) > +#define per_cpu_ptr_nvhe(sym, cpu) per_cpu_ptr(&kvm_nvhe_sym(sym), cpu) > + > #ifndef __KVM_NVHE_HYPERVISOR__ > /* > * BIG FAT WARNINGS: > diff --git a/arch/arm64/include/asm/kvm_host.h b/arch/arm64/include/asm/kvm_host.h > index adc8957e9321..337fd2d0f976 100644 > --- a/arch/arm64/include/asm/kvm_host.h > +++ b/arch/arm64/include/asm/kvm_host.h > @@ -494,8 +494,14 @@ u64 __kvm_call_hyp(void *hypfn, ...); > __kvm_call_hyp(kvm_ksym_ref_nvhe(f), ##__VA_ARGS__); \ > }) > > +#ifdef CONFIG_UBSAN > +extern void __kvm_check_ubsan_buffer(void); > +#endif > + > #define __kvm_arm_check_debug_buffer() \ > { \ > + if (IS_ENABLED(CONFIG_UBSAN)) \ > + __kvm_check_ubsan_buffer(); \ > } > > /* > diff --git a/arch/arm64/include/asm/kvm_ubsan.h b/arch/arm64/include/asm/kvm_ubsan.h > new file mode 100644 > index 000000000000..af607a796376 > --- /dev/null > +++ b/arch/arm64/include/asm/kvm_ubsan.h > @@ -0,0 +1,17 @@ > +/* SPDX-License-Identifier: GPL-2.0-only */ > +/* > + * Copyright 2020 Google LLC > + * Author: George Popescu > + */ > + > +#ifdef CONFIG_UBSAN The header should have an inclusion guard as well. > +#include Is it possible to only include this from within kvm_ubsan_buffer.c similar to how lib/ubsan.c keeps it self contained? Then export function for things like mapping it up to hyp? > + > + > +#define UBSAN_MAX_TYPE 6 > +#define KVM_UBSAN_BUFFER_SIZE 1000 > + > +struct kvm_ubsan_info { > + int type; > +}; > +#endif > diff --git a/arch/arm64/kvm/Makefile b/arch/arm64/kvm/Makefile > index 99977c1972cc..92f06cb5b3df 100644 > --- a/arch/arm64/kvm/Makefile > +++ b/arch/arm64/kvm/Makefile > @@ -24,4 +24,8 @@ kvm-y := $(KVM)/kvm_main.o $(KVM)/coalesced_mmio.o $(KVM)/eventfd.o \ > vgic/vgic-mmio-v3.o vgic/vgic-kvm-device.o \ > vgic/vgic-its.o vgic/vgic-debug.o > > +CFLAGS_kvm_ubsan_buffer.o += -I $(srctree)/lib/ > +CFLAGS_arm.o += -I $(srctree)/lib > + > +kvm-$(CONFIG_UBSAN) += kvm_ubsan_buffer.o > kvm-$(CONFIG_KVM_ARM_PMU) += pmu-emul.o > diff --git a/arch/arm64/kvm/arm.c b/arch/arm64/kvm/arm.c > index b588c3b5c2f0..eff57069e103 100644 > --- a/arch/arm64/kvm/arm.c > +++ b/arch/arm64/kvm/arm.c > @@ -42,10 +42,17 @@ > #include > #include > > +#include > +#include > + > #ifdef REQUIRES_VIRT > __asm__(".arch_extension virt"); > #endif > > +#ifdef CONFIG_UBSAN > +DECLARE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > +#endif > + > DEFINE_PER_CPU(kvm_host_data_t, kvm_host_data); > static DEFINE_PER_CPU(unsigned long, kvm_arm_hyp_stack_page); > > @@ -1519,7 +1526,15 @@ static int init_hyp_mode(void) > kvm_err("Cannot map bss section\n"); > goto out_err; > } > - > +#ifdef CONFIG_UBSAN > + /* required by ubsan to access the handlers structures fields */ > + err = create_hyp_mappings(kvm_ksym_ref(_data), > + kvm_ksym_ref(__end_once), PAGE_HYP_RO); > + if (err) { > + kvm_err("Cannot map data section\n"); > + goto out_err; > + } > +#endif > err = kvm_map_vectors(); > if (err) { > kvm_err("Cannot map vectors\n"); > @@ -1552,6 +1567,27 @@ static int init_hyp_mode(void) > } > } > > +#ifdef CONFIG_UBSAN > + for_each_possible_cpu(cpu) { > + /* map the write index */ > + struct kvm_ubsan_info *buff; > + unsigned long *wr_ind; > + > + wr_ind = per_cpu_ptr_nvhe(kvm_ubsan_buff_wr_ind, cpu); > + err = create_hyp_mappings(wr_ind, wr_ind + 1, PAGE_HYP); > + if (err) { > + kvm_err("Cannot map the busan buffer write index: %d\n", err); > + goto out_err; > + } > + buff = per_cpu_ptr(kvm_nvhe_sym(kvm_ubsan_buff), cpu); > + err = create_hyp_mappings(buff, buff + KVM_UBSAN_BUFFER_SIZE, PAGE_HYP); > + if (err) { > + kvm_err("Cannot map the ubsan buffer: %d\n", err); > + goto out_err; > + } > + } > +#endif > + > err = hyp_map_aux_data(); > if (err) > kvm_err("Cannot map host auxiliary data: %d\n", err); > diff --git a/arch/arm64/kvm/hyp/hyp-entry.S b/arch/arm64/kvm/hyp/hyp-entry.S > index 8df0082b9ccf..bcdbab4d2e43 100644 > --- a/arch/arm64/kvm/hyp/hyp-entry.S > +++ b/arch/arm64/kvm/hyp/hyp-entry.S > @@ -14,6 +14,7 @@ > #include > #include > #include > +#include > > .macro save_caller_saved_regs_vect > /* x0 and x1 were saved in the vector entry */ > @@ -74,6 +75,9 @@ el1_sync: // Guest trapped into EL2 > cmp x0, #HVC_STUB_HCALL_NR > b.hs 1f > > +#ifdef CONFIG_UBSAN > + clear_kvm_debug_buffer kvm_ubsan_buff_wr_ind, x4, x5, x6 > +#endif > /* > * Compute the idmap address of __kvm_handle_stub_hvc and > * jump there. Since we use kimage_voffset, do not use the > diff --git a/arch/arm64/kvm/hyp/nvhe/ubsan.c b/arch/arm64/kvm/hyp/nvhe/ubsan.c > index a5db6b61ceb2..a43c9646e1e8 100644 > --- a/arch/arm64/kvm/hyp/nvhe/ubsan.c > +++ b/arch/arm64/kvm/hyp/nvhe/ubsan.c > @@ -3,9 +3,31 @@ > * Copyright 2020 Google LLC > * Author: George Popescu > */ > +#include > #include > #include > -#include > +#include > +#include > +#include > +#include > +#include > +#include > +#include > + > +DEFINE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > + > +static inline struct kvm_ubsan_info *kvm_ubsan_buffer_next_slot(void) > +{ > + struct kvm_ubsan_info *res; > + struct kvm_ubsan_info *buff; > + unsigned long *buff_ind; > + unsigned long buff_size = KVM_UBSAN_BUFFER_SIZE; > + unsigned int struct_size = sizeof(struct kvm_ubsan_info); > + > + init_kvm_debug_buffer(kvm_ubsan_buff, struct kvm_ubsan_info, buff, buff_ind); > + res = kvm_debug_buffer_next_slot(buff, buff_ind, struct_size, buff_size); > + return res; > +} > > void __ubsan_handle_add_overflow(void *_data, void *lhs, void *rhs) {} > > diff --git a/arch/arm64/kvm/kvm_ubsan_buffer.c b/arch/arm64/kvm/kvm_ubsan_buffer.c > new file mode 100644 > index 000000000000..28dcf19b5706 > --- /dev/null > +++ b/arch/arm64/kvm/kvm_ubsan_buffer.c > @@ -0,0 +1,32 @@ > +// SPDX-License-Identifier: GPL-2.0-only > +/* > + * Copyright 2020 Google LLC > + * Author: George Popescu > + */ > + > +#include > +#include > +#include > +#include > +#include > +#include > + > +#include > +#include > + > +DECLARE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > + > + > +void __kvm_check_ubsan_buffer(void) > +{ > + unsigned long *write_ind; > + unsigned long it; > + struct kvm_ubsan_info *slot; > + > + init_kvm_debug_buffer(kvm_ubsan_buff, struct kvm_ubsan_info, slot, write_ind); > + for_each_kvm_debug_buffer_slot(slot, write_ind, it) { > + /* check ubsan data */ > + slot->type = 0; > + } > +} > + > -- > 2.28.0.618.gf4bc123cb7-goog > _______________________________________________ kvmarm mailing list kvmarm@lists.cs.columbia.edu https://lists.cs.columbia.edu/mailman/listinfo/kvmarm From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-9.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_ADSP_CUSTOM_MED,DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 49B2FC47420 for ; Thu, 1 Oct 2020 10:53:48 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id BA681207DE for ; Thu, 1 Oct 2020 10:53:47 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="Tgt6p5F6"; dkim=fail reason="signature verification failed" (2048-bit key) header.d=google.com header.i=@google.com header.b="peG/ZBsE" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org BA681207DE Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References:Message-ID: Subject:To:From:Date:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=2Bg7ZNr1b0nN1WtTE4AS7Q91pLrgq00AQHbDjYeIARk=; b=Tgt6p5F6ujPfIJPyYDMq3yj9d h2JpxbmQfu7C5hMNh1rkBrSJgbjW2kRato4Wvw8sFdaQ4qQhJTN5QD7+O/bUHlZu/0JG/1ts29eUY vOF79c4XLYkCgEGtdnnOx2DwXMYh21dtvZCOj3hHsk8kJyd6Bn9At7gCaJR3FRqHcy/74yqoH1WIo 39gWwpCu/OuPvt91XqYe9fBNqOYyrn2/tD1r2yT6JieA7pHZetVe6z88GjwM4NVzwKW884bdE5LLF 6yNbJ9kAb3grlrDhZHG5i68UQWFQ6qTQsgDEvx1KTrUo+I/q27EZvlZrSi4eyyaroKYl9ED2CJYEo vpZWevDMQ==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1kNwBz-0007ec-Ob; Thu, 01 Oct 2020 10:52:07 +0000 Received: from mail-wr1-x444.google.com ([2a00:1450:4864:20::444]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1kNwBx-0007eE-Md for linux-arm-kernel@lists.infradead.org; Thu, 01 Oct 2020 10:52:06 +0000 Received: by mail-wr1-x444.google.com with SMTP id m6so5143079wrn.0 for ; Thu, 01 Oct 2020 03:52:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=k2N0J/M9yplh3qBJTgm1trDqAWsQTbieqBVpcxzeRPI=; b=peG/ZBsEykKqm9oTMBx4fR4/bBMNa2xWkWHFuhuoSp0nPd5MDVeQdCOKCO0kN9CmDD zOEavwXdNYiPi/kCnqk+LFRkpLO0FY+b64//p4gpheRsRoOK6OJ0dhW5Mwu6xCQ/hON9 H8cV2/1Ra0LflfbdXgYJRQhgBrc4eMajxPOjteMUYyy38iowW7V2U8JOzeNt6mDY7ghf 0mSKl4BBUxSkzLB9wQ5dH0sQKkOpNPrWa5E3/fa7qMkauuksf1AnibTgAhVL0Xp9rcd6 60gOegQinQi70+Ie2OKoyJQnhll6RVXNxDB1cfegJ9LIFjUIt4qIyl5WhQbWjwVIPDLE cAqQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=k2N0J/M9yplh3qBJTgm1trDqAWsQTbieqBVpcxzeRPI=; b=QHR6AJoVh1sA0nM0UHHXb57qlm7eMKgD1gmJZHbJ85hZmTAW7Fe2BeqQczOPBpI0XQ DVzBJ6qLE9hZ5adlkhvaP4QNTcIWnzQ9zevulZT8ZPq3Jh1od4qya+10dUP9PpYIXTMm bVfpVTcR+lfjDh9HSbtoidAB/Et0ygHdIvDPqFLZaOiMkVhLUAX6eNt0N0tmJgymaxef EwGLD5rcSFj/xr9qS6neJsI4n5H+8k1j0v7GrnyaFWWCDfmbdz8YTBb0QS7l2YtK7D8b rsroNG0i2Ee/bXezjfYgJjNUL7MrGNyXuttgTmXbqhwavHHMlPfW3CXFaPQ+9BFtLQye xkqA== X-Gm-Message-State: AOAM531aGY2gT7myHfwTmDS7tRvcfiJQsqMtgzk/UoFfbuzMaEPJDFU/ Ry3MtaG4YYCFlrh7Xpf7GxWdfQ== X-Google-Smtp-Source: ABdhPJw4xVEknNO9ydWnolFnG34BKOtlr/IEZ4YTGX+i9Dn0gani5VcV6oYIUxM0kGF6DYGs385bBQ== X-Received: by 2002:adf:f2d0:: with SMTP id d16mr7896961wrp.332.1601549524567; Thu, 01 Oct 2020 03:52:04 -0700 (PDT) Received: from google.com ([2a00:79e0:d:109:4a0f:cfff:fe4a:6363]) by smtp.gmail.com with ESMTPSA id i33sm9151325wri.79.2020.10.01.03.52.03 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 01 Oct 2020 03:52:03 -0700 (PDT) Date: Thu, 1 Oct 2020 11:51:59 +0100 From: Andrew Scull To: George-Aurelian Popescu Subject: Re: [PATCH 05/14] KVM: arm64: Define a buffer that can pass UBSan data from hyp/nVHE to kernel Message-ID: <20201001105159.GB541087@google.com> References: <20200914172750.852684-1-georgepope@google.com> <20200914172750.852684-6-georgepope@google.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20200914172750.852684-6-georgepope@google.com> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20201001_065205_792449_5953E509 X-CRM114-Status: GOOD ( 32.98 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: tglx@linutronix.de, catalin.marinas@arm.com, will@kernel.org, kvmarm@lists.cs.columbia.edu, maskray@google.com, maz@kernel.org, masahiroy@kernel.org, suzuki.poulose@arm.com, clang-built-linux@googlegroups.com, linux-arm-kernel@lists.infradead.org, dbrazdil@google.com, julien.thierry.kdev@gmail.com, elver@google.com, keescook@chromium.org, arnd@arndb.de, linux-kbuild@vger.kernel.org, broonie@kernel.org, natechancellor@gmail.com, dvyukov@google.com, michal.lkml@markovi.net, ndesaulniers@google.com, linux-kernel@vger.kernel.org, james.morse@arm.com, akpm@linux-foundation.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Mon, Sep 14, 2020 at 05:27:41PM +0000, George-Aurelian Popescu wrote: > From: George Popescu > > Store data, which is collected from UBSan handlers that lives inside hyp/nVHE, > into the kvm_ubsan_buffer. > This buffer is designed to store only UBSan data because it should not be > preoccupied by other mechanisms data structures and functionalities. > > Map the buffer and the write iqndex before switching the control to > hyp/nVHE. > > Map the kernel .data region to read the compile time generated UBSan struct's > data from hyp/nVHE. > > Signed-off-by: George Popescu > --- > arch/arm64/include/asm/kvm_asm.h | 3 +++ > arch/arm64/include/asm/kvm_host.h | 6 +++++ > arch/arm64/include/asm/kvm_ubsan.h | 17 +++++++++++++ > arch/arm64/kvm/Makefile | 4 ++++ > arch/arm64/kvm/arm.c | 38 +++++++++++++++++++++++++++++- > arch/arm64/kvm/hyp/hyp-entry.S | 4 ++++ > arch/arm64/kvm/hyp/nvhe/ubsan.c | 24 ++++++++++++++++++- > arch/arm64/kvm/kvm_ubsan_buffer.c | 32 +++++++++++++++++++++++++ > 8 files changed, 126 insertions(+), 2 deletions(-) > create mode 100644 arch/arm64/include/asm/kvm_ubsan.h > create mode 100644 arch/arm64/kvm/kvm_ubsan_buffer.c > > diff --git a/arch/arm64/include/asm/kvm_asm.h b/arch/arm64/include/asm/kvm_asm.h > index 200bb8d0a720..9d4a77f08ffd 100644 > --- a/arch/arm64/include/asm/kvm_asm.h > +++ b/arch/arm64/include/asm/kvm_asm.h > @@ -63,6 +63,9 @@ > #define CHOOSE_VHE_SYM(sym) sym > #define CHOOSE_NVHE_SYM(sym) kvm_nvhe_sym(sym) > > +#define this_cpu_ptr_nvhe(sym) this_cpu_ptr(&kvm_nvhe_sym(sym)) > +#define per_cpu_ptr_nvhe(sym, cpu) per_cpu_ptr(&kvm_nvhe_sym(sym), cpu) > + > #ifndef __KVM_NVHE_HYPERVISOR__ > /* > * BIG FAT WARNINGS: > diff --git a/arch/arm64/include/asm/kvm_host.h b/arch/arm64/include/asm/kvm_host.h > index adc8957e9321..337fd2d0f976 100644 > --- a/arch/arm64/include/asm/kvm_host.h > +++ b/arch/arm64/include/asm/kvm_host.h > @@ -494,8 +494,14 @@ u64 __kvm_call_hyp(void *hypfn, ...); > __kvm_call_hyp(kvm_ksym_ref_nvhe(f), ##__VA_ARGS__); \ > }) > > +#ifdef CONFIG_UBSAN > +extern void __kvm_check_ubsan_buffer(void); > +#endif > + > #define __kvm_arm_check_debug_buffer() \ > { \ > + if (IS_ENABLED(CONFIG_UBSAN)) \ > + __kvm_check_ubsan_buffer(); \ > } > > /* > diff --git a/arch/arm64/include/asm/kvm_ubsan.h b/arch/arm64/include/asm/kvm_ubsan.h > new file mode 100644 > index 000000000000..af607a796376 > --- /dev/null > +++ b/arch/arm64/include/asm/kvm_ubsan.h > @@ -0,0 +1,17 @@ > +/* SPDX-License-Identifier: GPL-2.0-only */ > +/* > + * Copyright 2020 Google LLC > + * Author: George Popescu > + */ > + > +#ifdef CONFIG_UBSAN The header should have an inclusion guard as well. > +#include Is it possible to only include this from within kvm_ubsan_buffer.c similar to how lib/ubsan.c keeps it self contained? Then export function for things like mapping it up to hyp? > + > + > +#define UBSAN_MAX_TYPE 6 > +#define KVM_UBSAN_BUFFER_SIZE 1000 > + > +struct kvm_ubsan_info { > + int type; > +}; > +#endif > diff --git a/arch/arm64/kvm/Makefile b/arch/arm64/kvm/Makefile > index 99977c1972cc..92f06cb5b3df 100644 > --- a/arch/arm64/kvm/Makefile > +++ b/arch/arm64/kvm/Makefile > @@ -24,4 +24,8 @@ kvm-y := $(KVM)/kvm_main.o $(KVM)/coalesced_mmio.o $(KVM)/eventfd.o \ > vgic/vgic-mmio-v3.o vgic/vgic-kvm-device.o \ > vgic/vgic-its.o vgic/vgic-debug.o > > +CFLAGS_kvm_ubsan_buffer.o += -I $(srctree)/lib/ > +CFLAGS_arm.o += -I $(srctree)/lib > + > +kvm-$(CONFIG_UBSAN) += kvm_ubsan_buffer.o > kvm-$(CONFIG_KVM_ARM_PMU) += pmu-emul.o > diff --git a/arch/arm64/kvm/arm.c b/arch/arm64/kvm/arm.c > index b588c3b5c2f0..eff57069e103 100644 > --- a/arch/arm64/kvm/arm.c > +++ b/arch/arm64/kvm/arm.c > @@ -42,10 +42,17 @@ > #include > #include > > +#include > +#include > + > #ifdef REQUIRES_VIRT > __asm__(".arch_extension virt"); > #endif > > +#ifdef CONFIG_UBSAN > +DECLARE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > +#endif > + > DEFINE_PER_CPU(kvm_host_data_t, kvm_host_data); > static DEFINE_PER_CPU(unsigned long, kvm_arm_hyp_stack_page); > > @@ -1519,7 +1526,15 @@ static int init_hyp_mode(void) > kvm_err("Cannot map bss section\n"); > goto out_err; > } > - > +#ifdef CONFIG_UBSAN > + /* required by ubsan to access the handlers structures fields */ > + err = create_hyp_mappings(kvm_ksym_ref(_data), > + kvm_ksym_ref(__end_once), PAGE_HYP_RO); > + if (err) { > + kvm_err("Cannot map data section\n"); > + goto out_err; > + } > +#endif > err = kvm_map_vectors(); > if (err) { > kvm_err("Cannot map vectors\n"); > @@ -1552,6 +1567,27 @@ static int init_hyp_mode(void) > } > } > > +#ifdef CONFIG_UBSAN > + for_each_possible_cpu(cpu) { > + /* map the write index */ > + struct kvm_ubsan_info *buff; > + unsigned long *wr_ind; > + > + wr_ind = per_cpu_ptr_nvhe(kvm_ubsan_buff_wr_ind, cpu); > + err = create_hyp_mappings(wr_ind, wr_ind + 1, PAGE_HYP); > + if (err) { > + kvm_err("Cannot map the busan buffer write index: %d\n", err); > + goto out_err; > + } > + buff = per_cpu_ptr(kvm_nvhe_sym(kvm_ubsan_buff), cpu); > + err = create_hyp_mappings(buff, buff + KVM_UBSAN_BUFFER_SIZE, PAGE_HYP); > + if (err) { > + kvm_err("Cannot map the ubsan buffer: %d\n", err); > + goto out_err; > + } > + } > +#endif > + > err = hyp_map_aux_data(); > if (err) > kvm_err("Cannot map host auxiliary data: %d\n", err); > diff --git a/arch/arm64/kvm/hyp/hyp-entry.S b/arch/arm64/kvm/hyp/hyp-entry.S > index 8df0082b9ccf..bcdbab4d2e43 100644 > --- a/arch/arm64/kvm/hyp/hyp-entry.S > +++ b/arch/arm64/kvm/hyp/hyp-entry.S > @@ -14,6 +14,7 @@ > #include > #include > #include > +#include > > .macro save_caller_saved_regs_vect > /* x0 and x1 were saved in the vector entry */ > @@ -74,6 +75,9 @@ el1_sync: // Guest trapped into EL2 > cmp x0, #HVC_STUB_HCALL_NR > b.hs 1f > > +#ifdef CONFIG_UBSAN > + clear_kvm_debug_buffer kvm_ubsan_buff_wr_ind, x4, x5, x6 > +#endif > /* > * Compute the idmap address of __kvm_handle_stub_hvc and > * jump there. Since we use kimage_voffset, do not use the > diff --git a/arch/arm64/kvm/hyp/nvhe/ubsan.c b/arch/arm64/kvm/hyp/nvhe/ubsan.c > index a5db6b61ceb2..a43c9646e1e8 100644 > --- a/arch/arm64/kvm/hyp/nvhe/ubsan.c > +++ b/arch/arm64/kvm/hyp/nvhe/ubsan.c > @@ -3,9 +3,31 @@ > * Copyright 2020 Google LLC > * Author: George Popescu > */ > +#include > #include > #include > -#include > +#include > +#include > +#include > +#include > +#include > +#include > +#include > + > +DEFINE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > + > +static inline struct kvm_ubsan_info *kvm_ubsan_buffer_next_slot(void) > +{ > + struct kvm_ubsan_info *res; > + struct kvm_ubsan_info *buff; > + unsigned long *buff_ind; > + unsigned long buff_size = KVM_UBSAN_BUFFER_SIZE; > + unsigned int struct_size = sizeof(struct kvm_ubsan_info); > + > + init_kvm_debug_buffer(kvm_ubsan_buff, struct kvm_ubsan_info, buff, buff_ind); > + res = kvm_debug_buffer_next_slot(buff, buff_ind, struct_size, buff_size); > + return res; > +} > > void __ubsan_handle_add_overflow(void *_data, void *lhs, void *rhs) {} > > diff --git a/arch/arm64/kvm/kvm_ubsan_buffer.c b/arch/arm64/kvm/kvm_ubsan_buffer.c > new file mode 100644 > index 000000000000..28dcf19b5706 > --- /dev/null > +++ b/arch/arm64/kvm/kvm_ubsan_buffer.c > @@ -0,0 +1,32 @@ > +// SPDX-License-Identifier: GPL-2.0-only > +/* > + * Copyright 2020 Google LLC > + * Author: George Popescu > + */ > + > +#include > +#include > +#include > +#include > +#include > +#include > + > +#include > +#include > + > +DECLARE_KVM_DEBUG_BUFFER(struct kvm_ubsan_info, kvm_ubsan_buff, KVM_UBSAN_BUFFER_SIZE); > + > + > +void __kvm_check_ubsan_buffer(void) > +{ > + unsigned long *write_ind; > + unsigned long it; > + struct kvm_ubsan_info *slot; > + > + init_kvm_debug_buffer(kvm_ubsan_buff, struct kvm_ubsan_info, slot, write_ind); > + for_each_kvm_debug_buffer_slot(slot, write_ind, it) { > + /* check ubsan data */ > + slot->type = 0; > + } > +} > + > -- > 2.28.0.618.gf4bc123cb7-goog > _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel