From: Andrey Konovalov <andreyknvl@google.com> To: Dmitry Vyukov <dvyukov@google.com>, Vincenzo Frascino <vincenzo.frascino@arm.com>, Catalin Marinas <catalin.marinas@arm.com>, kasan-dev@googlegroups.com Cc: Andrey Ryabinin <aryabinin@virtuozzo.com>, Alexander Potapenko <glider@google.com>, Marco Elver <elver@google.com>, Evgenii Stepanov <eugenis@google.com>, Elena Petrova <lenaptr@google.com>, Branislav Rankov <Branislav.Rankov@arm.com>, Kevin Brodsky <kevin.brodsky@arm.com>, Will Deacon <will.deacon@arm.com>, Andrew Morton <akpm@linux-foundation.org>, linux-arm-kernel@lists.infradead.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, Andrey Konovalov <andreyknvl@google.com> Subject: [PATCH v3 00/39] kasan: add hardware tag-based mode for arm64 Date: Fri, 25 Sep 2020 00:50:07 +0200 [thread overview] Message-ID: <cover.1600987622.git.andreyknvl@google.com> (raw) This patchset adds a new hardware tag-based mode to KASAN [1]. The new mode is similar to the existing software tag-based KASAN, but relies on arm64 Memory Tagging Extension (MTE) [2] to perform memory and pointer tagging (instead of shadow memory and compiler instrumentation). This patchset is co-developed by Vincenzo Frascino <vincenzo.frascino@arm.com>. This patchset is available here: https://github.com/xairy/linux/tree/up-kasan-mte-v2 and has also been uploaded to the Linux kernel Gerrit instance: https://linux-review.googlesource.com/c/linux/kernel/git/torvalds/linux/+/2700 This patchset is based on the v10 of the user MTE patchset [3]. This patchset essentially consists of four parts: 1. Rework KASAN code to allow easier integration of the hardware tag-based mode. 2. Introduce config option for the new mode. 3. Introduce core in-kernel MTE routines. 4. Combine the previous parts together to implement the new mode. For testing in QEMU hardware tag-based KASAN requires: 1. QEMU built from master [4] (use "-machine virt,mte=on -cpu max" arguments to run). 2. GCC version 10. [1] https://www.kernel.org/doc/html/latest/dev-tools/kasan.html [2] https://community.arm.com/developer/ip-products/processors/b/processors-ip-blog/posts/enhancing-memory-safety [3] git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux for-next/mte [4] https://github.com/qemu/qemu ====== Overview The underlying ideas of the approach used by hardware tag-based KASAN are: 1. By relying on the Top Byte Ignore (TBI) arm64 CPU feature, pointer tags are stored in the top byte of each kernel pointer. 2. With the Memory Tagging Extension (MTE) arm64 CPU feature, memory tags for kernel memory allocations are stored in a dedicated memory not accessible via normal instuctions. 3. On each memory allocation, a random tag is generated, embedded it into the returned pointer, and the corresponding memory is tagged with the same tag value. 4. With MTE the CPU performs a check on each memory access to make sure that the pointer tag matches the memory tag. 5. On a tag mismatch the CPU generates a tag fault, and a KASAN report is printed. Same as other KASAN modes, hardware tag-based KASAN is intended as a debugging feature at this point. ====== Rationale There are two main reasons for this new hardware tag-based mode: 1. Previously implemented software tag-based KASAN is being successfully used on dogfood testing devices due to its low memory overhead (as initially planned). The new hardware mode keeps the same low memory overhead, and is expected to have significantly lower performance impact, due to the tag checks being performed by the hardware. Therefore the new mode can be used as a better alternative in dogfood testing for hardware that supports MTE. 2. The new mode lays the groundwork for the planned in-kernel MTE-based memory corruption mitigation to be used in production. ====== Technical details From the implementation perspective, hardware tag-based KASAN is almost identical to the software mode. The key difference is using MTE for assigning and checking tags. Compared to the software mode, the hardware mode uses 4 bits per tag, as dictated by MTE. Pointer tags are stored in bits [56:60), the top 4 bits have the normal value 0xF. Having less distict tags increases the probablity of false negatives (from ~1/256 to ~1/16) in certain cases. Only synchronous exceptions are set up and used by hardware tag-based KASAN. ====== Benchmarks Note: all measurements have been performed with software emulation of Memory Tagging Extension, performance numbers for hardware tag-based KASAN on the actual hardware are expected to be better. Boot time [1]: * 2.8 sec for clean kernel * 5.7 sec for hardware tag-based KASAN * 11.8 sec for software tag-based KASAN * 11.6 sec for generic KASAN Slab memory usage after boot [2]: * 7.0 kb for clean kernel * 9.7 kb for hardware tag-based KASAN * 9.7 kb for software tag-based KASAN * 41.3 kb for generic KASAN Measurements have been performed with: * defconfig-based configs * Manually built QEMU master * QEMU arguments: -machine virt,mte=on -cpu max * CONFIG_KASAN_STACK_ENABLE disabled * CONFIG_KASAN_INLINE enabled * clang-10 as the compiler and gcc-10 as the assembler [1] Time before the ext4 driver is initialized. [2] Measured as `cat /proc/meminfo | grep Slab`. ====== Notes The cover letter for software tag-based KASAN patchset can be found here: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=0116523cfffa62aeb5aa3b85ce7419f3dae0c1b8 ====== History Changes v2->v3: (Vincenzo:) - Use ARM64_ASM_PREAMBLE for asm macros. - Rename mte-helper.h to mte-kasan.h. The new header is meant to contain only macros and prototypes directly used in KASAN. The rest is defined in mte.h. - Update mte_get_mem_tag()/mte_get_random_tag() to used directly asm volatile() macros instead of calling library functions. - Harden mte_assign_mem_tag_range() to prevent an infinite loop in case of unaligned size. - Made sure that report_tag_fault() is executed only once. - Simplify the mte code in __cpu_setup. - Remove kprobes.h from mte.c includes. - General cleanup of the code. (Andrey:) - Use READ/WRITE_ONCE when accessing reported in do_tag_recovery(). - Move .unreq mte_tcr under CONFIG_ARM64_MTE to avoid build errors when MTE is not enabled. - Improve mm/kasan/shadow.c comment header. - Clarify what is a memory granule in "kasan: rename KASAN_SHADOW_* to KASAN_GRANULE_" commit description. - Rename (report_)tags_sw/hw.c to to (report_)sw/hw_tags.c and drop unnecessary rename commit. - Adopt 100 lines limit for some mm/kasan/ changes. - Align arguments for stack_trace_save() call in mm/slub.c. - Restore comment before kasan_init_tags(). - Remove GNU headers from all mm/kasan/ files. - Simplify check_invalid_free() implementation tag-based modes. - Drop subsequently removed report_tag_fault() implementation. - Add KASAN_GRANULE_PAGE and use instead of PAGE_SIZE * KASAN_GRANULE_SIZE. - Move kasan_enable/disable_current() declarations to simplify include/linux/kasan.h. - Drop dependency on CONFIG_SLUB_DEBUG. - Clarify the purpose of CONFIG_STACKTRACE in KASAN Kconfig. Changes v1->v2: - Rebase onto v10 of the user MTE patchset. - Only enable in-kernel MTE when KASAN_HW_TAGS is enabled. - Add a layer of arch-level indirection, so KASAN doesn't call MTE helpers directly (this will be useful in case more architectures will add support for HW_TAGS). - Don't do arm64_skip_faulting_instruction() on MTE fault, disable MTE instead. - Don't allow software tags with MTE via arch/arm64/Kconfig instead of lib/Kconfig.kasan. - Rename mm/kasan/tags.c to tags_sw.c and mte.c to tags_hw.c, and do the same for report_*.c files. - Reword HW_TAGS Kconfig help text to make it less MTE specific. - Reword and clarify Documentation. - Drop unnecessary is_el1_mte_sync_tag_check_fault(). - Change report_tag_fault() to only call kasan_report() once HW_TAGS is introduced. - Rename arch/arm64/include/asm/mte_asm.h to mte-helpers.h and move all MTE-related defines and some helper functions there. - Change mm/kasan/kasan.h to include mte-def.h instead of mte.h. - Add WARN_ON() on unaligned size to mte_set_mem_tag_range(). - Implement ldg/irg MTE routines as inline assembly. - Remove smp_wmb() from mte_set_mem_tag_range(). - Drop __must_check from mte_set_mem_tag_range() as KASAN has no use for the return value. - Drop zero size check from mte_assign_mem_tag_range(). - Drop unnecessary include <asm/kasan.h> from low-level arm64 code. - Move enabling TBI1 into __cpu_setup(). - Drop stale comment about callee-saved register from arch/arm64/kernel/entry.S. - Mark gcr_kernel_excl as __ro_after_init. - Use GENMASK() in mte_init_tags(). Andrey Konovalov (32): kasan: drop unnecessary GPL text from comment headers kasan: KASAN_VMALLOC depends on KASAN_GENERIC kasan: group vmalloc code kasan: shadow declarations only for software modes kasan: rename (un)poison_shadow to (un)poison_memory kasan: rename KASAN_SHADOW_* to KASAN_GRANULE_* kasan: only build init.c for software modes kasan: split out shadow.c from common.c kasan: define KASAN_GRANULE_PAGE kasan: rename report and tags files kasan: don't duplicate config dependencies kasan: hide invalid free check implementation kasan: decode stack frame only with KASAN_STACK_ENABLE kasan, arm64: only init shadow for software modes kasan, arm64: only use kasan_depth for software modes kasan: rename addr_has_shadow to addr_has_metadata kasan: rename print_shadow_for_address to print_memory_metadata kasan: kasan_non_canonical_hook only for software modes kasan: rename SHADOW layout macros to META kasan: separate metadata_fetch_row for each mode kasan: don't allow SW_TAGS with ARM64_MTE kasan: introduce CONFIG_KASAN_HW_TAGS arm64: kasan: Add arch layer for memory tagging helpers arm64: kasan: Align allocations for HW_TAGS kasan: define KASAN_GRANULE_SIZE for HW_TAGS kasan, x86, s390: update undef CONFIG_KASAN kasan, arm64: expand CONFIG_KASAN checks kasan, arm64: implement HW_TAGS runtime kasan, arm64: print report from tag fault handler kasan, slub: reset tags when accessing metadata kasan, arm64: enable CONFIG_KASAN_HW_TAGS kasan: add documentation for hardware tag-based mode Vincenzo Frascino (7): arm64: Enable armv8.5-a asm-arch option arm64: mte: Add in-kernel MTE helpers arm64: mte: Add in-kernel tag fault handler arm64: kasan: Enable in-kernel MTE arm64: mte: Convert gcr_user into an exclude mask arm64: mte: Switch GCR_EL1 in kernel entry and exit arm64: kasan: Enable TBI EL1 Documentation/dev-tools/kasan.rst | 80 ++- arch/arm64/Kconfig | 9 +- arch/arm64/Makefile | 7 +- arch/arm64/include/asm/assembler.h | 2 +- arch/arm64/include/asm/cache.h | 3 + arch/arm64/include/asm/esr.h | 1 + arch/arm64/include/asm/kasan.h | 8 +- arch/arm64/include/asm/memory.h | 14 +- arch/arm64/include/asm/mte-kasan.h | 66 +++ arch/arm64/include/asm/mte.h | 19 +- arch/arm64/include/asm/processor.h | 2 +- arch/arm64/include/asm/string.h | 5 +- arch/arm64/include/asm/uaccess.h | 23 + arch/arm64/kernel/asm-offsets.c | 3 + arch/arm64/kernel/cpufeature.c | 10 + arch/arm64/kernel/entry.S | 47 ++ arch/arm64/kernel/head.S | 2 +- arch/arm64/kernel/image-vars.h | 2 +- arch/arm64/kernel/mte.c | 85 ++- arch/arm64/kernel/setup.c | 5 +- arch/arm64/lib/mte.S | 19 + arch/arm64/mm/dump.c | 6 +- arch/arm64/mm/fault.c | 52 +- arch/arm64/mm/kasan_init.c | 22 +- arch/arm64/mm/proc.S | 24 +- arch/s390/boot/string.c | 1 + arch/x86/boot/compressed/misc.h | 1 + include/linux/kasan-checks.h | 2 +- include/linux/kasan.h | 104 ++-- include/linux/mm.h | 2 +- include/linux/moduleloader.h | 3 +- include/linux/page-flags-layout.h | 2 +- include/linux/sched.h | 2 +- include/linux/string.h | 2 +- init/init_task.c | 2 +- kernel/fork.c | 4 +- lib/Kconfig.kasan | 66 ++- lib/test_kasan.c | 2 +- mm/kasan/Makefile | 25 +- mm/kasan/common.c | 560 +------------------ mm/kasan/generic.c | 38 +- mm/kasan/generic_report.c | 165 ------ mm/kasan/hw_tags.c | 70 +++ mm/kasan/init.c | 17 +- mm/kasan/kasan.h | 64 ++- mm/kasan/quarantine.c | 10 - mm/kasan/report.c | 259 ++------- mm/kasan/report_generic.c | 326 +++++++++++ mm/kasan/report_hw_tags.c | 42 ++ mm/kasan/{tags_report.c => report_sw_tags.c} | 14 +- mm/kasan/shadow.c | 503 +++++++++++++++++ mm/kasan/{tags.c => sw_tags.c} | 18 +- mm/page_poison.c | 2 +- mm/ptdump.c | 13 +- mm/slab_common.c | 2 +- mm/slub.c | 25 +- scripts/Makefile.lib | 2 + 57 files changed, 1727 insertions(+), 1137 deletions(-) create mode 100644 arch/arm64/include/asm/mte-kasan.h delete mode 100644 mm/kasan/generic_report.c create mode 100644 mm/kasan/hw_tags.c create mode 100644 mm/kasan/report_generic.c create mode 100644 mm/kasan/report_hw_tags.c rename mm/kasan/{tags_report.c => report_sw_tags.c} (87%) create mode 100644 mm/kasan/shadow.c rename mm/kasan/{tags.c => sw_tags.c} (94%) -- 2.28.0.681.g6f77f65b4e-goog
WARNING: multiple messages have this Message-ID (diff)
From: Andrey Konovalov <andreyknvl@google.com> To: Dmitry Vyukov <dvyukov@google.com>, Vincenzo Frascino <vincenzo.frascino@arm.com>, Catalin Marinas <catalin.marinas@arm.com>, kasan-dev@googlegroups.com Cc: Marco Elver <elver@google.com>, Elena Petrova <lenaptr@google.com>, Andrey Konovalov <andreyknvl@google.com>, Kevin Brodsky <kevin.brodsky@arm.com>, Will Deacon <will.deacon@arm.com>, Branislav Rankov <Branislav.Rankov@arm.com>, linux-kernel@vger.kernel.org, linux-mm@kvack.org, Alexander Potapenko <glider@google.com>, linux-arm-kernel@lists.infradead.org, Andrey Ryabinin <aryabinin@virtuozzo.com>, Andrew Morton <akpm@linux-foundation.org>, Evgenii Stepanov <eugenis@google.com> Subject: [PATCH v3 00/39] kasan: add hardware tag-based mode for arm64 Date: Fri, 25 Sep 2020 00:50:07 +0200 [thread overview] Message-ID: <cover.1600987622.git.andreyknvl@google.com> (raw) This patchset adds a new hardware tag-based mode to KASAN [1]. The new mode is similar to the existing software tag-based KASAN, but relies on arm64 Memory Tagging Extension (MTE) [2] to perform memory and pointer tagging (instead of shadow memory and compiler instrumentation). This patchset is co-developed by Vincenzo Frascino <vincenzo.frascino@arm.com>. This patchset is available here: https://github.com/xairy/linux/tree/up-kasan-mte-v2 and has also been uploaded to the Linux kernel Gerrit instance: https://linux-review.googlesource.com/c/linux/kernel/git/torvalds/linux/+/2700 This patchset is based on the v10 of the user MTE patchset [3]. This patchset essentially consists of four parts: 1. Rework KASAN code to allow easier integration of the hardware tag-based mode. 2. Introduce config option for the new mode. 3. Introduce core in-kernel MTE routines. 4. Combine the previous parts together to implement the new mode. For testing in QEMU hardware tag-based KASAN requires: 1. QEMU built from master [4] (use "-machine virt,mte=on -cpu max" arguments to run). 2. GCC version 10. [1] https://www.kernel.org/doc/html/latest/dev-tools/kasan.html [2] https://community.arm.com/developer/ip-products/processors/b/processors-ip-blog/posts/enhancing-memory-safety [3] git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux for-next/mte [4] https://github.com/qemu/qemu ====== Overview The underlying ideas of the approach used by hardware tag-based KASAN are: 1. By relying on the Top Byte Ignore (TBI) arm64 CPU feature, pointer tags are stored in the top byte of each kernel pointer. 2. With the Memory Tagging Extension (MTE) arm64 CPU feature, memory tags for kernel memory allocations are stored in a dedicated memory not accessible via normal instuctions. 3. On each memory allocation, a random tag is generated, embedded it into the returned pointer, and the corresponding memory is tagged with the same tag value. 4. With MTE the CPU performs a check on each memory access to make sure that the pointer tag matches the memory tag. 5. On a tag mismatch the CPU generates a tag fault, and a KASAN report is printed. Same as other KASAN modes, hardware tag-based KASAN is intended as a debugging feature at this point. ====== Rationale There are two main reasons for this new hardware tag-based mode: 1. Previously implemented software tag-based KASAN is being successfully used on dogfood testing devices due to its low memory overhead (as initially planned). The new hardware mode keeps the same low memory overhead, and is expected to have significantly lower performance impact, due to the tag checks being performed by the hardware. Therefore the new mode can be used as a better alternative in dogfood testing for hardware that supports MTE. 2. The new mode lays the groundwork for the planned in-kernel MTE-based memory corruption mitigation to be used in production. ====== Technical details From the implementation perspective, hardware tag-based KASAN is almost identical to the software mode. The key difference is using MTE for assigning and checking tags. Compared to the software mode, the hardware mode uses 4 bits per tag, as dictated by MTE. Pointer tags are stored in bits [56:60), the top 4 bits have the normal value 0xF. Having less distict tags increases the probablity of false negatives (from ~1/256 to ~1/16) in certain cases. Only synchronous exceptions are set up and used by hardware tag-based KASAN. ====== Benchmarks Note: all measurements have been performed with software emulation of Memory Tagging Extension, performance numbers for hardware tag-based KASAN on the actual hardware are expected to be better. Boot time [1]: * 2.8 sec for clean kernel * 5.7 sec for hardware tag-based KASAN * 11.8 sec for software tag-based KASAN * 11.6 sec for generic KASAN Slab memory usage after boot [2]: * 7.0 kb for clean kernel * 9.7 kb for hardware tag-based KASAN * 9.7 kb for software tag-based KASAN * 41.3 kb for generic KASAN Measurements have been performed with: * defconfig-based configs * Manually built QEMU master * QEMU arguments: -machine virt,mte=on -cpu max * CONFIG_KASAN_STACK_ENABLE disabled * CONFIG_KASAN_INLINE enabled * clang-10 as the compiler and gcc-10 as the assembler [1] Time before the ext4 driver is initialized. [2] Measured as `cat /proc/meminfo | grep Slab`. ====== Notes The cover letter for software tag-based KASAN patchset can be found here: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=0116523cfffa62aeb5aa3b85ce7419f3dae0c1b8 ====== History Changes v2->v3: (Vincenzo:) - Use ARM64_ASM_PREAMBLE for asm macros. - Rename mte-helper.h to mte-kasan.h. The new header is meant to contain only macros and prototypes directly used in KASAN. The rest is defined in mte.h. - Update mte_get_mem_tag()/mte_get_random_tag() to used directly asm volatile() macros instead of calling library functions. - Harden mte_assign_mem_tag_range() to prevent an infinite loop in case of unaligned size. - Made sure that report_tag_fault() is executed only once. - Simplify the mte code in __cpu_setup. - Remove kprobes.h from mte.c includes. - General cleanup of the code. (Andrey:) - Use READ/WRITE_ONCE when accessing reported in do_tag_recovery(). - Move .unreq mte_tcr under CONFIG_ARM64_MTE to avoid build errors when MTE is not enabled. - Improve mm/kasan/shadow.c comment header. - Clarify what is a memory granule in "kasan: rename KASAN_SHADOW_* to KASAN_GRANULE_" commit description. - Rename (report_)tags_sw/hw.c to to (report_)sw/hw_tags.c and drop unnecessary rename commit. - Adopt 100 lines limit for some mm/kasan/ changes. - Align arguments for stack_trace_save() call in mm/slub.c. - Restore comment before kasan_init_tags(). - Remove GNU headers from all mm/kasan/ files. - Simplify check_invalid_free() implementation tag-based modes. - Drop subsequently removed report_tag_fault() implementation. - Add KASAN_GRANULE_PAGE and use instead of PAGE_SIZE * KASAN_GRANULE_SIZE. - Move kasan_enable/disable_current() declarations to simplify include/linux/kasan.h. - Drop dependency on CONFIG_SLUB_DEBUG. - Clarify the purpose of CONFIG_STACKTRACE in KASAN Kconfig. Changes v1->v2: - Rebase onto v10 of the user MTE patchset. - Only enable in-kernel MTE when KASAN_HW_TAGS is enabled. - Add a layer of arch-level indirection, so KASAN doesn't call MTE helpers directly (this will be useful in case more architectures will add support for HW_TAGS). - Don't do arm64_skip_faulting_instruction() on MTE fault, disable MTE instead. - Don't allow software tags with MTE via arch/arm64/Kconfig instead of lib/Kconfig.kasan. - Rename mm/kasan/tags.c to tags_sw.c and mte.c to tags_hw.c, and do the same for report_*.c files. - Reword HW_TAGS Kconfig help text to make it less MTE specific. - Reword and clarify Documentation. - Drop unnecessary is_el1_mte_sync_tag_check_fault(). - Change report_tag_fault() to only call kasan_report() once HW_TAGS is introduced. - Rename arch/arm64/include/asm/mte_asm.h to mte-helpers.h and move all MTE-related defines and some helper functions there. - Change mm/kasan/kasan.h to include mte-def.h instead of mte.h. - Add WARN_ON() on unaligned size to mte_set_mem_tag_range(). - Implement ldg/irg MTE routines as inline assembly. - Remove smp_wmb() from mte_set_mem_tag_range(). - Drop __must_check from mte_set_mem_tag_range() as KASAN has no use for the return value. - Drop zero size check from mte_assign_mem_tag_range(). - Drop unnecessary include <asm/kasan.h> from low-level arm64 code. - Move enabling TBI1 into __cpu_setup(). - Drop stale comment about callee-saved register from arch/arm64/kernel/entry.S. - Mark gcr_kernel_excl as __ro_after_init. - Use GENMASK() in mte_init_tags(). Andrey Konovalov (32): kasan: drop unnecessary GPL text from comment headers kasan: KASAN_VMALLOC depends on KASAN_GENERIC kasan: group vmalloc code kasan: shadow declarations only for software modes kasan: rename (un)poison_shadow to (un)poison_memory kasan: rename KASAN_SHADOW_* to KASAN_GRANULE_* kasan: only build init.c for software modes kasan: split out shadow.c from common.c kasan: define KASAN_GRANULE_PAGE kasan: rename report and tags files kasan: don't duplicate config dependencies kasan: hide invalid free check implementation kasan: decode stack frame only with KASAN_STACK_ENABLE kasan, arm64: only init shadow for software modes kasan, arm64: only use kasan_depth for software modes kasan: rename addr_has_shadow to addr_has_metadata kasan: rename print_shadow_for_address to print_memory_metadata kasan: kasan_non_canonical_hook only for software modes kasan: rename SHADOW layout macros to META kasan: separate metadata_fetch_row for each mode kasan: don't allow SW_TAGS with ARM64_MTE kasan: introduce CONFIG_KASAN_HW_TAGS arm64: kasan: Add arch layer for memory tagging helpers arm64: kasan: Align allocations for HW_TAGS kasan: define KASAN_GRANULE_SIZE for HW_TAGS kasan, x86, s390: update undef CONFIG_KASAN kasan, arm64: expand CONFIG_KASAN checks kasan, arm64: implement HW_TAGS runtime kasan, arm64: print report from tag fault handler kasan, slub: reset tags when accessing metadata kasan, arm64: enable CONFIG_KASAN_HW_TAGS kasan: add documentation for hardware tag-based mode Vincenzo Frascino (7): arm64: Enable armv8.5-a asm-arch option arm64: mte: Add in-kernel MTE helpers arm64: mte: Add in-kernel tag fault handler arm64: kasan: Enable in-kernel MTE arm64: mte: Convert gcr_user into an exclude mask arm64: mte: Switch GCR_EL1 in kernel entry and exit arm64: kasan: Enable TBI EL1 Documentation/dev-tools/kasan.rst | 80 ++- arch/arm64/Kconfig | 9 +- arch/arm64/Makefile | 7 +- arch/arm64/include/asm/assembler.h | 2 +- arch/arm64/include/asm/cache.h | 3 + arch/arm64/include/asm/esr.h | 1 + arch/arm64/include/asm/kasan.h | 8 +- arch/arm64/include/asm/memory.h | 14 +- arch/arm64/include/asm/mte-kasan.h | 66 +++ arch/arm64/include/asm/mte.h | 19 +- arch/arm64/include/asm/processor.h | 2 +- arch/arm64/include/asm/string.h | 5 +- arch/arm64/include/asm/uaccess.h | 23 + arch/arm64/kernel/asm-offsets.c | 3 + arch/arm64/kernel/cpufeature.c | 10 + arch/arm64/kernel/entry.S | 47 ++ arch/arm64/kernel/head.S | 2 +- arch/arm64/kernel/image-vars.h | 2 +- arch/arm64/kernel/mte.c | 85 ++- arch/arm64/kernel/setup.c | 5 +- arch/arm64/lib/mte.S | 19 + arch/arm64/mm/dump.c | 6 +- arch/arm64/mm/fault.c | 52 +- arch/arm64/mm/kasan_init.c | 22 +- arch/arm64/mm/proc.S | 24 +- arch/s390/boot/string.c | 1 + arch/x86/boot/compressed/misc.h | 1 + include/linux/kasan-checks.h | 2 +- include/linux/kasan.h | 104 ++-- include/linux/mm.h | 2 +- include/linux/moduleloader.h | 3 +- include/linux/page-flags-layout.h | 2 +- include/linux/sched.h | 2 +- include/linux/string.h | 2 +- init/init_task.c | 2 +- kernel/fork.c | 4 +- lib/Kconfig.kasan | 66 ++- lib/test_kasan.c | 2 +- mm/kasan/Makefile | 25 +- mm/kasan/common.c | 560 +------------------ mm/kasan/generic.c | 38 +- mm/kasan/generic_report.c | 165 ------ mm/kasan/hw_tags.c | 70 +++ mm/kasan/init.c | 17 +- mm/kasan/kasan.h | 64 ++- mm/kasan/quarantine.c | 10 - mm/kasan/report.c | 259 ++------- mm/kasan/report_generic.c | 326 +++++++++++ mm/kasan/report_hw_tags.c | 42 ++ mm/kasan/{tags_report.c => report_sw_tags.c} | 14 +- mm/kasan/shadow.c | 503 +++++++++++++++++ mm/kasan/{tags.c => sw_tags.c} | 18 +- mm/page_poison.c | 2 +- mm/ptdump.c | 13 +- mm/slab_common.c | 2 +- mm/slub.c | 25 +- scripts/Makefile.lib | 2 + 57 files changed, 1727 insertions(+), 1137 deletions(-) create mode 100644 arch/arm64/include/asm/mte-kasan.h delete mode 100644 mm/kasan/generic_report.c create mode 100644 mm/kasan/hw_tags.c create mode 100644 mm/kasan/report_generic.c create mode 100644 mm/kasan/report_hw_tags.c rename mm/kasan/{tags_report.c => report_sw_tags.c} (87%) create mode 100644 mm/kasan/shadow.c rename mm/kasan/{tags.c => sw_tags.c} (94%) -- 2.28.0.681.g6f77f65b4e-goog _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
next reply other threads:[~2020-09-24 22:50 UTC|newest] Thread overview: 223+ messages / expand[flat|nested] mbox.gz Atom feed top 2020-09-24 22:50 Andrey Konovalov [this message] 2020-09-24 22:50 ` [PATCH v3 00/39] kasan: add hardware tag-based mode for arm64 Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 01/39] kasan: drop unnecessary GPL text from comment headers Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:18 ` elver 2020-10-01 17:18 ` elver 2020-09-24 22:50 ` [PATCH v3 02/39] kasan: KASAN_VMALLOC depends on KASAN_GENERIC Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:19 ` elver 2020-10-01 17:19 ` elver 2020-09-24 22:50 ` [PATCH v3 03/39] kasan: group vmalloc code Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:27 ` elver 2020-10-01 17:27 ` elver 2020-09-24 22:50 ` [PATCH v3 04/39] kasan: shadow declarations only for software modes Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:29 ` elver 2020-10-01 17:29 ` elver 2020-09-24 22:50 ` [PATCH v3 05/39] kasan: rename (un)poison_shadow to (un)poison_memory Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:29 ` elver 2020-10-01 17:29 ` elver 2020-09-24 22:50 ` [PATCH v3 06/39] kasan: rename KASAN_SHADOW_* to KASAN_GRANULE_* Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:30 ` elver 2020-10-01 17:30 ` elver 2020-09-24 22:50 ` [PATCH v3 07/39] kasan: only build init.c for software modes Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:31 ` elver 2020-10-01 17:31 ` elver 2020-09-24 22:50 ` [PATCH v3 08/39] kasan: split out shadow.c from common.c Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:32 ` elver 2020-10-01 17:32 ` elver 2020-09-24 22:50 ` [PATCH v3 09/39] kasan: define KASAN_GRANULE_PAGE Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:33 ` elver 2020-10-01 17:33 ` elver 2020-09-24 22:50 ` [PATCH v3 10/39] kasan: rename report and tags files Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:36 ` elver 2020-10-01 17:36 ` elver 2020-09-24 22:50 ` [PATCH v3 11/39] kasan: don't duplicate config dependencies Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:39 ` elver 2020-10-01 17:39 ` elver 2020-10-01 21:54 ` Andrey Konovalov 2020-10-01 21:54 ` Andrey Konovalov 2020-10-01 21:54 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 12/39] kasan: hide invalid free check implementation Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:41 ` elver 2020-10-01 17:41 ` elver 2020-09-24 22:50 ` [PATCH v3 13/39] kasan: decode stack frame only with KASAN_STACK_ENABLE Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:43 ` elver 2020-10-01 17:43 ` elver 2020-09-24 22:50 ` [PATCH v3 14/39] kasan, arm64: only init shadow for software modes Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 15/39] kasan, arm64: only use kasan_depth " Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 16/39] kasan: rename addr_has_shadow to addr_has_metadata Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:45 ` elver 2020-10-01 17:45 ` elver 2020-09-24 22:50 ` [PATCH v3 17/39] kasan: rename print_shadow_for_address to print_memory_metadata Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:45 ` elver 2020-10-01 17:45 ` elver 2020-09-24 22:50 ` [PATCH v3 18/39] kasan: kasan_non_canonical_hook only for software modes Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:47 ` elver 2020-10-01 17:47 ` elver 2020-09-24 22:50 ` [PATCH v3 19/39] kasan: rename SHADOW layout macros to META Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:48 ` elver 2020-10-01 17:48 ` elver 2020-09-24 22:50 ` [PATCH v3 20/39] kasan: separate metadata_fetch_row for each mode Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:54 ` elver 2020-10-01 17:54 ` elver 2020-10-01 21:56 ` Andrey Konovalov 2020-10-01 21:56 ` Andrey Konovalov 2020-10-01 21:56 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 21/39] kasan: don't allow SW_TAGS with ARM64_MTE Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:55 ` elver 2020-10-01 17:55 ` elver 2020-10-01 21:57 ` Andrey Konovalov 2020-10-01 21:57 ` Andrey Konovalov 2020-10-01 21:57 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 22/39] kasan: introduce CONFIG_KASAN_HW_TAGS Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:57 ` elver 2020-10-01 17:57 ` elver 2020-09-24 22:50 ` [PATCH v3 23/39] arm64: Enable armv8.5-a asm-arch option Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-25 10:16 ` Catalin Marinas 2020-09-25 10:16 ` Catalin Marinas 2020-09-24 22:50 ` [PATCH v3 24/39] arm64: mte: Add in-kernel MTE helpers Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-25 10:15 ` Catalin Marinas 2020-09-25 10:15 ` Catalin Marinas 2020-09-25 11:28 ` Vincenzo Frascino 2020-09-25 11:28 ` Vincenzo Frascino 2020-09-25 12:50 ` Catalin Marinas 2020-09-25 12:50 ` Catalin Marinas 2020-09-25 13:36 ` Vincenzo Frascino 2020-09-25 13:36 ` Vincenzo Frascino 2020-09-24 22:50 ` [PATCH v3 25/39] arm64: kasan: Add arch layer for memory tagging helpers Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 26/39] arm64: mte: Add in-kernel tag fault handler Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-25 10:49 ` Catalin Marinas 2020-09-25 10:49 ` Catalin Marinas 2020-09-25 11:26 ` Andrey Konovalov 2020-09-25 11:26 ` Andrey Konovalov 2020-09-25 11:26 ` Andrey Konovalov 2020-09-25 11:47 ` Catalin Marinas 2020-09-25 11:47 ` Catalin Marinas 2020-09-25 11:52 ` Andrey Konovalov 2020-09-25 11:52 ` Andrey Konovalov 2020-09-25 11:52 ` Andrey Konovalov 2020-09-25 12:35 ` Catalin Marinas 2020-09-25 12:35 ` Catalin Marinas 2020-09-25 12:35 ` Catalin Marinas 2020-09-25 12:35 ` Catalin Marinas 2020-09-24 22:50 ` [PATCH v3 27/39] arm64: kasan: Enable in-kernel MTE Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-25 11:14 ` Catalin Marinas 2020-09-25 11:14 ` Catalin Marinas 2020-09-24 22:50 ` [PATCH v3 28/39] arm64: mte: Convert gcr_user into an exclude mask Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 29/39] arm64: mte: Switch GCR_EL1 in kernel entry and exit Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-25 11:34 ` Catalin Marinas 2020-09-25 11:34 ` Catalin Marinas 2020-09-25 11:50 ` Vincenzo Frascino 2020-09-25 11:50 ` Vincenzo Frascino 2020-09-25 12:38 ` Catalin Marinas 2020-09-25 12:38 ` Catalin Marinas 2020-09-24 22:50 ` [PATCH v3 30/39] arm64: kasan: Enable TBI EL1 Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-25 11:37 ` Catalin Marinas 2020-09-25 11:37 ` Catalin Marinas 2020-09-25 11:47 ` Vincenzo Frascino 2020-09-25 11:47 ` Vincenzo Frascino 2020-09-24 22:50 ` [PATCH v3 31/39] arm64: kasan: Align allocations for HW_TAGS Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 32/39] kasan: define KASAN_GRANULE_SIZE " Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:58 ` elver 2020-10-01 17:58 ` elver 2020-10-01 21:59 ` Andrey Konovalov 2020-10-01 21:59 ` Andrey Konovalov 2020-10-01 21:59 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 33/39] kasan, x86, s390: update undef CONFIG_KASAN Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 17:59 ` elver 2020-10-01 17:59 ` elver 2020-09-24 22:50 ` [PATCH v3 34/39] kasan, arm64: expand CONFIG_KASAN checks Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 35/39] kasan, arm64: implement HW_TAGS runtime Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 18:00 ` elver 2020-10-01 18:00 ` elver 2020-09-24 22:50 ` [PATCH v3 36/39] kasan, arm64: print report from tag fault handler Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-25 11:39 ` Catalin Marinas 2020-09-25 11:39 ` Catalin Marinas 2020-09-24 22:50 ` [PATCH v3 37/39] kasan, slub: reset tags when accessing metadata Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 18:03 ` elver 2020-10-01 18:03 ` elver 2020-10-01 22:00 ` Andrey Konovalov 2020-10-01 22:00 ` Andrey Konovalov 2020-10-01 22:00 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 38/39] kasan, arm64: enable CONFIG_KASAN_HW_TAGS Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` [PATCH v3 39/39] kasan: add documentation for hardware tag-based mode Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-09-24 22:50 ` Andrey Konovalov 2020-10-01 18:03 ` elver 2020-10-01 18:03 ` elver
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=cover.1600987622.git.andreyknvl@google.com \ --to=andreyknvl@google.com \ --cc=Branislav.Rankov@arm.com \ --cc=akpm@linux-foundation.org \ --cc=aryabinin@virtuozzo.com \ --cc=catalin.marinas@arm.com \ --cc=dvyukov@google.com \ --cc=elver@google.com \ --cc=eugenis@google.com \ --cc=glider@google.com \ --cc=kasan-dev@googlegroups.com \ --cc=kevin.brodsky@arm.com \ --cc=lenaptr@google.com \ --cc=linux-arm-kernel@lists.infradead.org \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-mm@kvack.org \ --cc=vincenzo.frascino@arm.com \ --cc=will.deacon@arm.com \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.