From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.4 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,USER_IN_DEF_DKIM_WL autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DA09FECE58C for ; Mon, 7 Oct 2019 10:51:56 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 8222E20867 for ; Mon, 7 Oct 2019 10:51:56 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="ZblYnebK" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 8222E20867 Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id EDE3B8E0005; Mon, 7 Oct 2019 06:51:55 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E8F628E0003; Mon, 7 Oct 2019 06:51:55 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D7CED8E0005; Mon, 7 Oct 2019 06:51:55 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0022.hostedemail.com [216.40.44.22]) by kanga.kvack.org (Postfix) with ESMTP id B00248E0003 for ; Mon, 7 Oct 2019 06:51:55 -0400 (EDT) Received: from smtpin07.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with SMTP id 4C6D1824CA0E for ; Mon, 7 Oct 2019 10:51:55 +0000 (UTC) X-FDA: 76016673390.07.veil88_4ae748a238b63 X-HE-Tag: veil88_4ae748a238b63 X-Filterd-Recvd-Size: 15444 Received: from mail-qk1-f193.google.com (mail-qk1-f193.google.com [209.85.222.193]) by imf30.hostedemail.com (Postfix) with ESMTP for ; Mon, 7 Oct 2019 10:51:54 +0000 (UTC) Received: by mail-qk1-f193.google.com with SMTP id w2so12096480qkf.2 for ; Mon, 07 Oct 2019 03:51:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=/leRBOsNsqe76Ah8fFAhq4JY83SUXLtPEp8isBCEQQA=; b=ZblYnebKy5nVmD4w5DCdzfBr9RCyf/gfRyRExhiXMdwiQOYMPHPC/Mi5qi1NI+SBMk h2ThS+4OSFTOObKHItH85FPN4X6LrdNLhXDmpYYy2jtdFKgtlHzi4N539t36onsz+Nvu PxjoDCPThWd136RCLi3JZSCu632jouv1Ljcn/8hysNpNclbMfcWvYfe8q+5oVIFL20x3 NGgpYIXTcHLzzgijHVkrFXT2ZR2TPE+k1dwtfiyUyUGPE2/dsO9p5DT+BZDis/FrOs3P nLTo7OaXxhIhc7WEsU3bxcO+tUS1CUqTgxGBlq3754JtXSPxluPbjgBKrlutpMp6Yn4N fIog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=/leRBOsNsqe76Ah8fFAhq4JY83SUXLtPEp8isBCEQQA=; b=Wr1RGyI4y8+4JMGcZ/oI8SEg+85/WZ90n64B930ql0Y5AfwcQ1b6lyaV7Vjq+at/O1 yizHqq+jamzvHiL2gYT/NGXCzm6vwES9rxhwWWBnqWNjos91BB7rwUm3rBWHBKWr4K5t zQ7nRprnFQmZSq2Iujjo0/0ImPb6Va/H+TjFidDm0lQSgrjfDBX69XuujuxjIXzAWwLX XtGHl5HRQ9tPZr/ogQX7Uf4id93wVs8nTHHOuntTM3gghJvtnj369SZz4XYMrvOiZmXX 6mWFhp0yIiPqt6cacQ94L4AQhJaAubFW5z7ztrwRchcygBc0ooypHW16/ublWZxf0owg sheQ== X-Gm-Message-State: APjAAAWXhqm2ohbjWoe+jMxVUEduZoJ1R+ydv38wYvYU7dBYgLWQF6c9 AUHO7nT1ZrF/O0IZ+FM8F3m8mWYsrA2lc1wvF2enJg== X-Google-Smtp-Source: APXvYqwdre+IkJSeHtcfjRYYH3e+7r7rE9zRTH1UAe52gIZ0ERyXzgBOt0MPcj4HlrY+CdQvjcYaUK159P3C2rVyKK8= X-Received: by 2002:a37:9c57:: with SMTP id f84mr23248727qke.250.1570445513471; Mon, 07 Oct 2019 03:51:53 -0700 (PDT) MIME-Version: 1.0 References: <20190927034338.15813-1-walter-zh.wu@mediatek.com> <1569594142.9045.24.camel@mtksdccf07> <1569818173.17361.19.camel@mtksdccf07> <1570018513.19702.36.camel@mtksdccf07> <1570069078.19702.57.camel@mtksdccf07> <1570095525.19702.59.camel@mtksdccf07> <1570110681.19702.64.camel@mtksdccf07> <1570164140.19702.97.camel@mtksdccf07> <1570176131.19702.105.camel@mtksdccf07> <1570182257.19702.109.camel@mtksdccf07> <1570190718.19702.125.camel@mtksdccf07> <1570418576.4686.30.camel@mtksdccf07> <1570436289.4686.40.camel@mtksdccf07> <1570438317.4686.44.camel@mtksdccf07> <1570439032.4686.50.camel@mtksdccf07> <1570440492.4686.59.camel@mtksdccf07> <1570441833.4686.66.camel@mtksdccf07> In-Reply-To: <1570441833.4686.66.camel@mtksdccf07> From: Dmitry Vyukov Date: Mon, 7 Oct 2019 12:51:41 +0200 Message-ID: Subject: Re: [PATCH] kasan: fix the missing underflow in memmove and memcpy with CONFIG_KASAN_GENERIC=y To: Walter Wu Cc: Andrey Ryabinin , Alexander Potapenko , Matthias Brugger , LKML , kasan-dev , Linux-MM , Linux ARM , linux-mediatek@lists.infradead.org, wsd_upstream Content-Type: text/plain; charset="UTF-8" X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Mon, Oct 7, 2019 at 11:50 AM Walter Wu wrote: > > On Mon, 2019-10-07 at 17:28 +0800, Walter Wu wrote: > > On Mon, 2019-10-07 at 11:10 +0200, Dmitry Vyukov wrote: > > > On Mon, Oct 7, 2019 at 11:03 AM Walter Wu wrote: > > > > > > > > On Mon, 2019-10-07 at 10:54 +0200, Dmitry Vyukov wrote: > > > > > On Mon, Oct 7, 2019 at 10:52 AM Walter Wu wrote: > > > > > > > > > > > > On Mon, 2019-10-07 at 10:24 +0200, Dmitry Vyukov wrote: > > > > > > > On Mon, Oct 7, 2019 at 10:18 AM Walter Wu wrote: > > > > > > > > The patchsets help to produce KASAN report when size is negative numbers > > > > > > > > in memory operation function. It is helpful for programmer to solve the > > > > > > > > undefined behavior issue. Patch 1 based on Dmitry's review and > > > > > > > > suggestion, patch 2 is a test in order to verify the patch 1. > > > > > > > > > > > > > > > > [1]https://bugzilla.kernel.org/show_bug.cgi?id=199341 > > > > > > > > [2]https://lore.kernel.org/linux-arm-kernel/20190927034338.15813-1-walter-zh.wu@mediatek.com/ > > > > > > > > > > > > > > > > Walter Wu (2): > > > > > > > > kasan: detect invalid size in memory operation function > > > > > > > > kasan: add test for invalid size in memmove > > > > > > > > > > > > > > > > lib/test_kasan.c | 18 ++++++++++++++++++ > > > > > > > > mm/kasan/common.c | 13 ++++++++----- > > > > > > > > mm/kasan/generic.c | 5 +++++ > > > > > > > > mm/kasan/generic_report.c | 12 ++++++++++++ > > > > > > > > mm/kasan/tags.c | 5 +++++ > > > > > > > > mm/kasan/tags_report.c | 12 ++++++++++++ > > > > > > > > 6 files changed, 60 insertions(+), 5 deletions(-) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > commit 5b3b68660b3d420fd2bd792f2d9fd3ccb8877ef7 > > > > > > > > Author: Walter-zh Wu > > > > > > > > Date: Fri Oct 4 18:38:31 2019 +0800 > > > > > > > > > > > > > > > > kasan: detect invalid size in memory operation function > > > > > > > > > > > > > > > > It is an undefined behavior to pass a negative numbers to > > > > > > > > memset()/memcpy()/memmove() > > > > > > > > , so need to be detected by KASAN. > > > > > > > > > > > > > > > > If size is negative numbers, then it has two reasons to be defined > > > > > > > > as out-of-bounds bug type. > > > > > > > > 1) Casting negative numbers to size_t would indeed turn up as a > > > > > > > > large > > > > > > > > size_t and its value will be larger than ULONG_MAX/2, so that this > > > > > > > > can > > > > > > > > qualify as out-of-bounds. > > > > > > > > 2) Don't generate new bug type in order to prevent duplicate reports > > > > > > > > by > > > > > > > > some systems, e.g. syzbot. > > > > > > > > > > > > > > > > KASAN report: > > > > > > > > > > > > > > > > BUG: KASAN: out-of-bounds in kmalloc_memmove_invalid_size+0x70/0xa0 > > > > > > > > Read of size 18446744073709551608 at addr ffffff8069660904 by task > > > > > > > > cat/72 > > > > > > > > > > > > > > > > CPU: 2 PID: 72 Comm: cat Not tainted > > > > > > > > 5.4.0-rc1-next-20191004ajb-00001-gdb8af2f372b2-dirty #1 > > > > > > > > Hardware name: linux,dummy-virt (DT) > > > > > > > > Call trace: > > > > > > > > dump_backtrace+0x0/0x288 > > > > > > > > show_stack+0x14/0x20 > > > > > > > > dump_stack+0x10c/0x164 > > > > > > > > print_address_description.isra.9+0x68/0x378 > > > > > > > > __kasan_report+0x164/0x1a0 > > > > > > > > kasan_report+0xc/0x18 > > > > > > > > check_memory_region+0x174/0x1d0 > > > > > > > > memmove+0x34/0x88 > > > > > > > > kmalloc_memmove_invalid_size+0x70/0xa0 > > > > > > > > > > > > > > > > [1] https://bugzilla.kernel.org/show_bug.cgi?id=199341 > > > > > > > > > > > > > > > > Signed-off-by: Walter Wu > > > > > > > > Reported -by: Dmitry Vyukov > > > > > > > > Suggested-by: Dmitry Vyukov > > > > > > > > > > > > > > > > diff --git a/mm/kasan/common.c b/mm/kasan/common.c > > > > > > > > index 6814d6d6a023..6ef0abd27f06 100644 > > > > > > > > --- a/mm/kasan/common.c > > > > > > > > +++ b/mm/kasan/common.c > > > > > > > > @@ -102,7 +102,8 @@ EXPORT_SYMBOL(__kasan_check_write); > > > > > > > > #undef memset > > > > > > > > void *memset(void *addr, int c, size_t len) > > > > > > > > { > > > > > > > > - check_memory_region((unsigned long)addr, len, true, _RET_IP_); > > > > > > > > + if (!check_memory_region((unsigned long)addr, len, true, _RET_IP_)) > > > > > > > > + return NULL; > > > > > > > > > > > > > > > > return __memset(addr, c, len); > > > > > > > > } > > > > > > > > @@ -110,8 +111,9 @@ void *memset(void *addr, int c, size_t len) > > > > > > > > #undef memmove > > > > > > > > void *memmove(void *dest, const void *src, size_t len) > > > > > > > > { > > > > > > > > - check_memory_region((unsigned long)src, len, false, _RET_IP_); > > > > > > > > - check_memory_region((unsigned long)dest, len, true, _RET_IP_); > > > > > > > > + if (!check_memory_region((unsigned long)src, len, false, _RET_IP_) || > > > > > > > > + !check_memory_region((unsigned long)dest, len, true, _RET_IP_)) > > > > > > > > + return NULL; > > > > > > > > > > > > > > > > return __memmove(dest, src, len); > > > > > > > > } > > > > > > > > @@ -119,8 +121,9 @@ void *memmove(void *dest, const void *src, size_t > > > > > > > > len) > > > > > > > > #undef memcpy > > > > > > > > void *memcpy(void *dest, const void *src, size_t len) > > > > > > > > { > > > > > > > > - check_memory_region((unsigned long)src, len, false, _RET_IP_); > > > > > > > > - check_memory_region((unsigned long)dest, len, true, _RET_IP_); > > > > > > > > + if (!check_memory_region((unsigned long)src, len, false, _RET_IP_) || > > > > > > > > + !check_memory_region((unsigned long)dest, len, true, _RET_IP_)) > > > > > > > > + return NULL; > > > > > > > > > > > > > > > > return __memcpy(dest, src, len); > > > > > > > > } > > > > > > > > diff --git a/mm/kasan/generic.c b/mm/kasan/generic.c > > > > > > > > index 616f9dd82d12..02148a317d27 100644 > > > > > > > > --- a/mm/kasan/generic.c > > > > > > > > +++ b/mm/kasan/generic.c > > > > > > > > @@ -173,6 +173,11 @@ static __always_inline bool > > > > > > > > check_memory_region_inline(unsigned long addr, > > > > > > > > if (unlikely(size == 0)) > > > > > > > > return true; > > > > > > > > > > > > > > > > + if (unlikely((long)size < 0)) { > > > > > > > > + kasan_report(addr, size, write, ret_ip); > > > > > > > > + return false; > > > > > > > > + } > > > > > > > > + > > > > > > > > if (unlikely((void *)addr < > > > > > > > > kasan_shadow_to_mem((void *)KASAN_SHADOW_START))) { > > > > > > > > kasan_report(addr, size, write, ret_ip); > > > > > > > > diff --git a/mm/kasan/generic_report.c b/mm/kasan/generic_report.c > > > > > > > > index 36c645939bc9..ed0eb94cb811 100644 > > > > > > > > --- a/mm/kasan/generic_report.c > > > > > > > > +++ b/mm/kasan/generic_report.c > > > > > > > > @@ -107,6 +107,18 @@ static const char *get_wild_bug_type(struct > > > > > > > > kasan_access_info *info) > > > > > > > > > > > > > > > > const char *get_bug_type(struct kasan_access_info *info) > > > > > > > > { > > > > > > > > + /* > > > > > > > > + * If access_size is negative numbers, then it has two reasons > > > > > > > > + * to be defined as out-of-bounds bug type. > > > > > > > > + * 1) Casting negative numbers to size_t would indeed turn up as > > > > > > > > + * a 'large' size_t and its value will be larger than ULONG_MAX/2, > > > > > > > > + * so that this can qualify as out-of-bounds. > > > > > > > > + * 2) Don't generate new bug type in order to prevent duplicate > > > > > > > > reports > > > > > > > > + * by some systems, e.g. syzbot. > > > > > > > > + */ > > > > > > > > + if ((long)info->access_size < 0) > > > > > > > > + return "out-of-bounds"; > > > > > > > > > > > > > > "out-of-bounds" is the _least_ frequent KASAN bug type. It won't > > > > > > > prevent duplicates. "heap-out-of-bounds" is the frequent one. > > > > > > > > > > > > > > > > > > /* > > > > > > * If access_size is negative numbers, then it has two reasons > > > > > > * to be defined as out-of-bounds bug type. > > > > > > * 1) Casting negative numbers to size_t would indeed turn up as > > > > > > * a "large" size_t and its value will be larger than ULONG_MAX/2, > > > > > > * so that this can qualify as out-of-bounds. > > > > > > * 2) Don't generate new bug type in order to prevent duplicate > > > > > > reports > > > > > > * by some systems, e.g. syzbot. "out-of-bounds" is the _least_ > > > > > > frequent KASAN bug type. > > > > > > * It won't prevent duplicates. "heap-out-of-bounds" is the > > > > > > frequent one. > > > > > > */ > > > > > > > > > > > > We directly add it into the comment. > > > > > > > > > > > > > > > OK, let's start from the beginning: why do you return "out-of-bounds" here? > > > > > > > > > Uh, comment 1 and 2 should explain it. :) > > > > > > The comment says it will cause duplicate reports. It does not explain > > > why you want syzbot to produce duplicate reports and spam kernel > > > developers... So why do you want that? > > > > > We don't generate new bug type in order to prevent duplicate by some > > systems, e.g. syzbot. Is it right? If yes, then it should not have > > duplicate report. > > > Sorry, because we don't generate new bug type. it should be duplicate > report(only one report which may be oob or size invlid), > the duplicate report goal is that invalid size is oob issue, too. > > I would not introduce a new bug type. > These are parsed and used by some systems, e.g. syzbot. If size is > user-controllable, then a new bug type for this will mean 2 bug > reports. To prevent duplicates, the new crash title must not just match _any_ crash title that kernel can potentially produce. It must match exactly the crash that kernel produces for this bug on other input data. Consider, userspace passes size=123, KASAN produces "heap-out-of-bounds in foo". Now userspace passes size=-1 and KASAN produces "invalid-size in foo". This will be a duplicate bug report. Now if KASAN will produce "out-of-bounds in foo", it will also lead to a duplicate report. Only iff KASAN will produce "heap-out-of-bounds in foo" for size=-1, it will not lead to a duplicate report.