From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 234C4C433DB for ; Fri, 12 Mar 2021 08:03:32 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 10FDA64F83 for ; Fri, 12 Mar 2021 08:03:31 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 10FDA64F83 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=rock-chips.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 8BF1E8D032E; Fri, 12 Mar 2021 03:03:30 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 86F898D0317; Fri, 12 Mar 2021 03:03:30 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6C4838D032E; Fri, 12 Mar 2021 03:03:30 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0253.hostedemail.com [216.40.44.253]) by kanga.kvack.org (Postfix) with ESMTP id 483828D0317 for ; Fri, 12 Mar 2021 03:03:30 -0500 (EST) Received: from smtpin03.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 0567E4FE6 for ; Fri, 12 Mar 2021 08:03:30 +0000 (UTC) X-FDA: 77910482580.03.039CC2E Received: from lucky1.263xmail.com (lucky1.263xmail.com [211.157.147.131]) by imf08.hostedemail.com (Postfix) with ESMTP id 0E462801914B for ; Fri, 12 Mar 2021 08:03:19 +0000 (UTC) Received: from localhost (unknown [192.168.167.235]) by lucky1.263xmail.com (Postfix) with ESMTP id E926BB9646; Fri, 12 Mar 2021 16:03:23 +0800 (CST) X-MAIL-GRAY:0 X-MAIL-DELIVERY:1 X-ADDR-CHECKED4:1 X-ANTISPAM-LEVEL:2 X-ABS-CHECKED:0 Received: from localhost.localdomain (unknown [58.22.7.114]) by smtp.263.net (postfix) whith ESMTP id P24306T139684564936448S1615536202373594_; Fri, 12 Mar 2021 16:03:23 +0800 (CST) X-IP-DOMAINF:1 X-UNIQUE-TAG: X-RL-SENDER:jay.xu@rock-chips.com X-SENDER:xjq@rock-chips.com X-LOGIN-NAME:jay.xu@rock-chips.com X-FST-TO:cl@linux.co X-SENDER-IP:58.22.7.114 X-ATTACHMENT-NUM:0 X-System-Flag:0 From: Jianqun Xu To: cl@linux.co, penberg@kernel.org, rientjes@google.com, iamjoonsoo.kim@lge.com, akpm@linux-foundation.org Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-rockchip@lists.infradead.org, Jianqun Xu Subject: [PATCH] mm/slab: kmalloc with GFP_DMA32 allocate from SLAB_CACHE_DMA32 Date: Fri, 12 Mar 2021 16:03:20 +0800 Message-Id: <20210312080320.1965201-1-jay.xu@rock-chips.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-Stat-Signature: yg7fihfq756wjrnisbjre49ugtf5xd5e X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 0E462801914B Received-SPF: none (rock-chips.com>: No applicable sender policy available) receiver=imf08; identity=mailfrom; envelope-from=""; helo=lucky1.263xmail.com; client-ip=211.157.147.131 X-HE-DKIM-Result: none/none X-HE-Tag: 1615536199-65644 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: The flag GFP_DMA32 only effect in kmalloc_large currently. This patch will create caches with GFP_DMA32 to support kmalloc with size under KMALLOC_MAX_CACHE_SIZE. Signed-off-by: Jianqun Xu --- include/linux/slab.h | 7 +++++++ mm/slab_common.c | 14 ++++++++++++++ 2 files changed, 21 insertions(+) diff --git a/include/linux/slab.h b/include/linux/slab.h index be4ba5867ac5..f4317663d148 100644 --- a/include/linux/slab.h +++ b/include/linux/slab.h @@ -307,6 +307,9 @@ enum kmalloc_cache_type { KMALLOC_RECLAIM, #ifdef CONFIG_ZONE_DMA KMALLOC_DMA, +#endif +#ifdef CONFIG_ZONE_DMA32 + KMALLOC_DMA32, #endif NR_KMALLOC_TYPES }; @@ -331,6 +334,10 @@ static __always_inline enum kmalloc_cache_type kmall= oc_type(gfp_t flags) */ return flags & __GFP_DMA ? KMALLOC_DMA : KMALLOC_RECLAIM; #else +#ifdef CONFIG_ZONE_DMA32 + if (unlikely(flags & __GFP_DMA32)) + return KMALLOC_DMA32; +#endif return flags & __GFP_RECLAIMABLE ? KMALLOC_RECLAIM : KMALLOC_NORMAL; #endif } diff --git a/mm/slab_common.c b/mm/slab_common.c index e981c80d216c..2a04736fe8f5 100644 --- a/mm/slab_common.c +++ b/mm/slab_common.c @@ -805,6 +805,20 @@ void __init create_kmalloc_caches(slab_flags_t flags= ) } } #endif +#ifdef CONFIG_ZONE_DMA32 + for (i =3D 0; i <=3D KMALLOC_SHIFT_HIGH; i++) { + struct kmem_cache *s =3D kmalloc_caches[KMALLOC_NORMAL][i]; + + if (s) { + unsigned int size =3D kmalloc_size(i); + const char *n =3D kmalloc_cache_name("dma32-kmalloc", size); + + BUG_ON(!n); + kmalloc_caches[KMALLOC_DMA32][i] =3D create_kmalloc_cache( + n, size, SLAB_CACHE_DMA32 | flags, 0, 0); + } + } +#endif } #endif /* !CONFIG_SLOB */ =20 --=20 2.25.1