From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 58C9EC46497 for ; Thu, 4 Jul 2019 23:38:05 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id D47E020449 for ; Thu, 4 Jul 2019 23:38:04 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=intel-com.20150623.gappssmtp.com header.i=@intel-com.20150623.gappssmtp.com header.b="ftzysFAg" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org D47E020449 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 207056B0003; Thu, 4 Jul 2019 19:38:04 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 191258E0003; Thu, 4 Jul 2019 19:38:04 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 031628E0001; Thu, 4 Jul 2019 19:38:03 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from mail-ot1-f69.google.com (mail-ot1-f69.google.com [209.85.210.69]) by kanga.kvack.org (Postfix) with ESMTP id CA12E6B0003 for ; Thu, 4 Jul 2019 19:38:03 -0400 (EDT) Received: by mail-ot1-f69.google.com with SMTP id x18so3488247otp.9 for ; Thu, 04 Jul 2019 16:38:03 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:dkim-signature:mime-version:references :in-reply-to:from:date:message-id:subject:to:cc; bh=ve/CczmjDTp62IiyOlOME0RVKS5HfvyxwnJvsVLm4Vs=; b=Qugef+LdAsmTLxNdF30PcIVXt9ulJC2at3stpDB8Pg4G8CBf63SJfHSeLm8coAr5I4 VdXIVPlkik4N9AVaIAgtrGYFaGT0h9jIxNg7yDuFZiCo/v+Kp6z5WcABWx0LjRTQYblf 5Gk6Xq17TSKJ/iKsR+NDfD4P73wF3Je9wnZgFRHByXQZowZTVZNLcNDFNcjHuZds7a7B MBaYxolRi3sqgLDe6MEjmH9/a6ju1VX08LQNHWJ29mj44zg764CR1CaeY8F0PV3oIVn5 Ri78auWtN6LonKyOrwMaCG6cBE2HFuRuauZNz86gur1/iO1n+Bczns9GiwhTfx4jNdxW i9FA== X-Gm-Message-State: APjAAAUcLWTqfpsJZn1sG2Gjvdf4uKrdKu4Sq1kPcGni5UQdIh1qVr46 2CIMvb8awXL7PuZOO3nOxHUD3WXqT1ySfiW5eXnOduSiinSCGiLwZqbLQsvNnT8kUe8GHDHTxtm pcrbeJIM9SLbn6WEBL9OikWJOOlQykFHlqIuoVnBwF2stLuvYtDElbJHf7GDgWCrT7A== X-Received: by 2002:a9d:6282:: with SMTP id x2mr429231otk.223.1562283483460; Thu, 04 Jul 2019 16:38:03 -0700 (PDT) X-Received: by 2002:a9d:6282:: with SMTP id x2mr429205otk.223.1562283482658; Thu, 04 Jul 2019 16:38:02 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1562283482; cv=none; d=google.com; s=arc-20160816; b=p0u1dbHwNzobrE6HUGpYrSXTsUiX5ZnfCp6y6fGtuuC5VJbhyvgxm+MNbQ6OOFpyiL mOdOQgImfO6XSwVTYvDDekUuYmR0KCWGNP3wdhsXKW4l1l1mWWZlbci9gRxgIEoIOBwJ pludw51U5aom5eCsF3VmkX697FrEyZoqlEV7NfIaIXNrGBmQnPg5LkQT0B9aIdtaBQ60 VD7X1vquYFX0/NU0mdwMXRCS3lPA7F1loQAJrrqL9AF1ObllgBt5vGYf/ZJqGrvxJYLx F5dfszV6DuaF5bcbVqie1Bavf6VCH3yjrSf4DEX60tAxXSsBd6X8pNBMYpZdMA4wo/Z3 qD1A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=ve/CczmjDTp62IiyOlOME0RVKS5HfvyxwnJvsVLm4Vs=; b=PrOVgWn0vHwlU19U3stYd2v2mXyrHo5ZSKfZTHPTcUXsF/RsW6SrUlJY9Ezl270ilY 14osZAIc07mvpsdcwuq3TShsBlbk0VQxI1pxlhZfRbk2TNuOMuEwbd+93ePjFzhMAJjb NvloUeuJfNIU+7qi99MZFmwuy8L7pPJfLJSZHT1wWn7XNm1GgrHKPDQFVqiaUZkHzepu DVLtzlytDL9BUcAVfsuveK6tL0BzV39rL7fGu+jxqFuSTSug4c7YJDwnYU+nWo8oAV0o syN7Xonan6ihLYLp+N8/O+wzyR4zfuRF7wlEjKLn0H4VzEgkpu5qLw9S5VK0CaDPkzJS 5KSA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel-com.20150623.gappssmtp.com header.s=20150623 header.b=ftzysFAg; spf=pass (google.com: domain of dan.j.williams@intel.com designates 209.85.220.65 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from mail-sor-f65.google.com (mail-sor-f65.google.com. [209.85.220.65]) by mx.google.com with SMTPS id p187sor3185529oia.145.2019.07.04.16.38.02 for (Google Transport Security); Thu, 04 Jul 2019 16:38:02 -0700 (PDT) Received-SPF: pass (google.com: domain of dan.j.williams@intel.com designates 209.85.220.65 as permitted sender) client-ip=209.85.220.65; Authentication-Results: mx.google.com; dkim=pass header.i=@intel-com.20150623.gappssmtp.com header.s=20150623 header.b=ftzysFAg; spf=pass (google.com: domain of dan.j.williams@intel.com designates 209.85.220.65 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ve/CczmjDTp62IiyOlOME0RVKS5HfvyxwnJvsVLm4Vs=; b=ftzysFAgpNAb+BruhLNH0hJPG1+DZJH5fW47QFP2ZCCrJsWY0QiqCN33vLIdmP+YKX oYjFGqBNFdAiE67/Scf00vlp73/xqc9pUOTQqv50+CArtatDE9N0E1fmMn6a6b4TXgvC b4ikeLch0hVf8zFQYSEq1w3vTKY09hc+kjsVZV/qqSlPyxPEUIxUQ7KsfqcwWe9BrcAA v/Qn7UXw1I9f8vsa2e7SuNV9MVKpvVtW0GhCb8C3HKqRROUiumhwmxjXK1mvWegh7J9t v+AIy6jg8Of0NKSl5vCY5SL/L+7uGHiv+8rWcdQo5jq8sjpRw09XucLUw0n59f/fPRH+ PPcw== X-Google-Smtp-Source: APXvYqxPvl0JaE/xctjYrnEPxDDTTNAKohKZCdbZNul+YnSwqo3/7CHb/acC/vbGgVjEA6Xdvr5WpUQKmbNeFnXQ/uE= X-Received: by 2002:aca:ba02:: with SMTP id k2mr441491oif.70.1562283482013; Thu, 04 Jul 2019 16:38:02 -0700 (PDT) MIME-Version: 1.0 References: <20190626073533.GA24199@infradead.org> <20190626123139.GB20635@lakrids.cambridge.arm.com> <20190626153829.GA22138@infradead.org> <20190626154532.GA3088@mellanox.com> <20190626203551.4612e12be27be3458801703b@linux-foundation.org> <20190704115324.c9780d01ef6938ab41403bf9@linux-foundation.org> <20190704195934.GA23542@mellanox.com> In-Reply-To: <20190704195934.GA23542@mellanox.com> From: Dan Williams Date: Thu, 4 Jul 2019 16:37:51 -0700 Message-ID: Subject: Re: [PATCH v3 0/4] Devmap cleanups + arm64 support To: Jason Gunthorpe Cc: Andrew Morton , Christoph Hellwig , Mark Rutland , Robin Murphy , "linux-mm@kvack.org" , "will.deacon@arm.com" , "catalin.marinas@arm.com" , "anshuman.khandual@arm.com" , "linux-arm-kernel@lists.infradead.org" , "linux-kernel@vger.kernel.org" , Michal Hocko Content-Type: text/plain; charset="UTF-8" X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu, Jul 4, 2019 at 12:59 PM Jason Gunthorpe wrote: > > On Thu, Jul 04, 2019 at 11:53:24AM -0700, Andrew Morton wrote: > > On Wed, 26 Jun 2019 20:35:51 -0700 Andrew Morton wrote: > > > > > > Let me know and I can help orchestate this. > > > > > > Well. Whatever works. In this situation I'd stage the patches after > > > linux-next and would merge them up after the prereq patches have been > > > merged into mainline. Easy. > > > > All right, what the hell just happened? > > Christoph's patch series for the devmap & hmm rework finally made it > into linux-next, sorry, it took quite a few iterations on the list to > get all the reviews and tests, and figure out how to resolve some > other conflicting things. So it just made it this week. > > Recall, this is the patch series I asked you about routing a few weeks > ago, as it really exceeded the small area that hmm.git was supposed to > cover. I think we are both caught off guard how big the conflict is! > > > A bunch of new material has just been introduced into linux-next. > > I've partially unpicked the resulting mess, haven't dared trying to > > compile it yet. To get this far I'll need to drop two patch series > > and one individual patch: > > > mm-clean-up-is_device__page-definitions.patch > > mm-introduce-arch_has_pte_devmap.patch > > arm64-mm-implement-pte_devmap-support.patch > > arm64-mm-implement-pte_devmap-support-fix.patch > > This one we discussed, and I thought we agreed would go to your 'stage > after linux-next' flow (see above). I think the conflict was minor > here. > > > mm-sparsemem-introduce-struct-mem_section_usage.patch > > mm-sparsemem-introduce-a-section_is_early-flag.patch > > mm-sparsemem-add-helpers-track-active-portions-of-a-section-at-boot.patch > > mm-hotplug-prepare-shrink_zone-pgdat_span-for-sub-section-removal.patch > > mm-sparsemem-convert-kmalloc_section_memmap-to-populate_section_memmap.patch > > mm-hotplug-kill-is_dev_zone-usage-in-__remove_pages.patch > > mm-kill-is_dev_zone-helper.patch > > mm-sparsemem-prepare-for-sub-section-ranges.patch > > mm-sparsemem-support-sub-section-hotplug.patch > > mm-document-zone_device-memory-model-implications.patch > > mm-document-zone_device-memory-model-implications-fix.patch > > mm-devm_memremap_pages-enable-sub-section-remap.patch > > libnvdimm-pfn-fix-fsdax-mode-namespace-info-block-zero-fields.patch > > libnvdimm-pfn-stop-padding-pmem-namespaces-to-section-alignment.patch > > Dan pointed to this while reviewing CH's series and said the conflicts > would be manageable, but they are certainly larger than I expected! > > This series is the one that seems to be the really big trouble. I > already checked all the other stuff that Stephen resolved, and it > looks OK and managable. Just this one conflict with kernel/memremap.c > is beyond me. > > What approach do you want to take to go forward? Here are some thoughts: > > CH has said he is away for the long weekend, so the path that involves > the fewest people is if Dan respins the above on linux-next and it > goes later with the arm patches above, assuming defering it for now > has no other adverse effects on -mm. > > Pushing CH's series to -mm would need a respin on top of Dan's series > above and would need to carry along the whole hmm.git (about 44 > patches). Signs are that this could be managed with the code currently > in the GPU trees. > > If we give up on CH's series the hmm.git will not have conflicts, > however we just kick the can to the next merge window where we will be > back to having to co-ordinate amd/nouveau/rdma git trees and -mm's > patch workflow - and I think we will be worse off as we will have > totally given up on a git based work flow for this. :( I think the problem would be resolved going forward post-v5.3 since we won't have two tress managing kernel/memremap.c. This cycle however there is a backlog of kernel/memremap.c changes in -mm.