From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754056AbdEQHpK (ORCPT ); Wed, 17 May 2017 03:45:10 -0400 Received: from mx2.suse.de ([195.135.220.15]:41019 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1752993AbdEQHpG (ORCPT ); Wed, 17 May 2017 03:45:06 -0400 Date: Wed, 17 May 2017 09:44:53 +0200 From: Michal Hocko To: Chris Wilson Cc: dri-devel@lists.freedesktop.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, Daniel Vetter , Jani Nikula , Sean Paul , David Airlie Subject: Re: [PATCH] drm: use kvmalloc_array for drm_malloc* Message-ID: <20170517074453.GC18247@dhcp22.suse.cz> References: <20170516090606.5891-1-mhocko@kernel.org> <20170516093119.GW19912@nuc-i3427.alporthouse.com> <20170516105352.GH2481@dhcp22.suse.cz> <20170516110908.GE26693@nuc-i3427.alporthouse.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20170516110908.GE26693@nuc-i3427.alporthouse.com> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue 16-05-17 12:09:08, Chris Wilson wrote: > On Tue, May 16, 2017 at 12:53:52PM +0200, Michal Hocko wrote: > > On Tue 16-05-17 10:31:19, Chris Wilson wrote: > > > On Tue, May 16, 2017 at 11:06:06AM +0200, Michal Hocko wrote: > > > > From: Michal Hocko > > > > > > > > drm_malloc* has grown their own kmalloc with vmalloc fallback > > > > implementations. MM has grown kvmalloc* helpers in the meantime. Let's > > > > use those because it a) reduces the code and b) MM has a better idea > > > > how to implement fallbacks (e.g. do not vmalloc before kmalloc is tried > > > > with __GFP_NORETRY). > > > > > > Better? The same idea. The only difference I was reluctant to hand out > > > large pages for long lived objects. If that's the wisdom of the core mm, > > > so be it. > > > > vmalloc tends to fragment physical memory more os it is preferable to > > try the physically contiguous request first and only fall back to > > vmalloc if the first attempt would be too costly or it fails. > > Not relevant for the changelog in this patch, but it would be nice to > have that written in kvmalloc() as to why the scatterring of 4k vmapped > pages prevents defragmentation when compared to allocating large pages. Well, it is not as much about defragmentation because both vmapped and kmalloc allocations are very likely to be unmovable (at least currently). Theoretically there shouldn't be a problem to make vmapped pages movable as the ptes can be modified but this is not implemented... The problem is that vmapped pages are more likely to break up more larger order blocks. kmalloc will naturally break a single larger block. > I have vague recollections of seeing the conversation, but a summary as > to the reason why kvmalloc prefers large pages will be good for future > reference. Does the following sound better to you? diff --git a/mm/util.c b/mm/util.c index 464df3489903..87499f8119f2 100644 --- a/mm/util.c +++ b/mm/util.c @@ -357,7 +357,10 @@ void *kvmalloc_node(size_t size, gfp_t flags, int node) WARN_ON_ONCE((flags & GFP_KERNEL) != GFP_KERNEL); /* - * Make sure that larger requests are not too disruptive - no OOM + * We want to attempt a large physically contiguous block first because + * it is less likely to fragment multiple larger blocks and therefore + * contribute to a long term fragmentation less than vmalloc fallback. + * However make sure that larger requests are not too disruptive - no OOM * killer and no allocation failure warnings as we have a fallback */ if (size > PAGE_SIZE) { -- Michal Hocko SUSE Labs