From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=MAILING_LIST_MULTI, SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2BDA4C33CB6 for ; Wed, 22 Jan 2020 08:06:57 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id EF1EE2465A for ; Wed, 22 Jan 2020 08:06:56 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org EF1EE2465A Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 7D4DF6B0007; Wed, 22 Jan 2020 03:06:56 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 785506B0008; Wed, 22 Jan 2020 03:06:56 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 699FA6B000A; Wed, 22 Jan 2020 03:06:56 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0137.hostedemail.com [216.40.44.137]) by kanga.kvack.org (Postfix) with ESMTP id 5431E6B0007 for ; Wed, 22 Jan 2020 03:06:56 -0500 (EST) Received: from smtpin21.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with SMTP id 0A23D180AD806 for ; Wed, 22 Jan 2020 08:06:56 +0000 (UTC) X-FDA: 76404539232.21.pipe16_3c7848c8f9a3a X-HE-Tag: pipe16_3c7848c8f9a3a X-Filterd-Recvd-Size: 7188 Received: from mail-wm1-f68.google.com (mail-wm1-f68.google.com [209.85.128.68]) by imf43.hostedemail.com (Postfix) with ESMTP for ; Wed, 22 Jan 2020 08:06:55 +0000 (UTC) Received: by mail-wm1-f68.google.com with SMTP id t23so2142719wmi.1 for ; Wed, 22 Jan 2020 00:06:55 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=yQD6BMfgsUB2zOq+Dz3vFA3XMaEJr7rjWMT5V31lJ5U=; b=mtJolLQiUChfGBF726uYGkr84D1j1IUjJSpfSA4Zk8K4lh6n3L+MhMEjb+rohjDzhF TovbIGPJ3FbFUiTHWQqv7kqn/gF4T6WkCdXLMAwSa29rzfe4JKmZR83v9QeRqSHT8yAc j1yqodoul8I2GGn7sj6bbMoEyy2rZQwCPbfXXBXok3Ohfaxag3xQBQ9HWL4S8zauNwDm Y0LfZIP3uqxqp+vw8upHlpvHTj81SEcldSlzh5tegHv9LHgwFIRqcpAaY9Ohip6D+LNq wFmdmfrGxEz1B/oYOxte6StNwJXo3sarqQ/b/S3cwE6xsM7QgUTOFWzny/3K3AzozCcg WD0g== X-Gm-Message-State: APjAAAXjKElm3TJjRlniIO1bpp3JB1i1JGC7PlwznKo7+dLSpdV35OHD mfawZioUDW5HVO/SAYgxc7A= X-Google-Smtp-Source: APXvYqwNgTz3qLi4HX2cdSOMQc1vCTzd88y/8o+O59L5Ua2zKcJ3ht7mYGYZCXzAvQJpyMQxasO53A== X-Received: by 2002:a1c:f003:: with SMTP id a3mr1584888wmb.41.1579680414195; Wed, 22 Jan 2020 00:06:54 -0800 (PST) Received: from localhost (ip-37-188-245-167.eurotel.cz. [37.188.245.167]) by smtp.gmail.com with ESMTPSA id p15sm2716017wma.40.2020.01.22.00.06.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 22 Jan 2020 00:06:52 -0800 (PST) Date: Wed, 22 Jan 2020 09:06:51 +0100 From: Michal Hocko To: Yang Shi Cc: Wei Yang , akpm@linux-foundation.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, stable@vger.kernel.org Subject: Re: [PATCH] mm: move_pages: fix the return value if there are not-migrated pages Message-ID: <20200122080651.GN29276@dhcp22.suse.cz> References: <1579325203-16405-1-git-send-email-yang.shi@linux.alibaba.com> <20200120130624.GD18451@dhcp22.suse.cz> <20200120131744.GE18451@dhcp22.suse.cz> <20200121014416.GC1567@richard> <20200121084040.GC29276@dhcp22.suse.cz> <27b993f4-cc50-d5a9-1cda-89dd022aea16@linux.alibaba.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <27b993f4-cc50-d5a9-1cda-89dd022aea16@linux.alibaba.com> X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Tue 21-01-20 11:01:30, Yang Shi wrote: > > > On 1/21/20 12:40 AM, Michal Hocko wrote: > > On Tue 21-01-20 09:44:16, Wei Yang wrote: > > > On Mon, Jan 20, 2020 at 02:17:44PM +0100, Michal Hocko wrote: > > > > On Mon 20-01-20 14:06:26, Michal Hocko wrote: > > > > > On Sat 18-01-20 13:26:43, Yang Shi wrote: > > > > > > The do_move_pages_to_node() might return > 0 value, the number of pages > > > > > > that are not migrated, then the value will be returned to userspace > > > > > > directly. But, move_pages() syscall would just return 0 or errno. So, > > > > > > we need reset the return value to 0 for such case as what pre-v4.17 did. > > > > > The patch is wrong. migrate_pages returns the number of pages it > > > > > _hasn't_ migrated or -errno. Yeah that semantic sucks but... > > > > > So err != 0 is always an error. Except err > 0 doesn't really provide > > > > > any useful information to the userspace. I cannot really remember what > > > > > was the actual behavior before my rework because there were some gotchas > > > > > hidden there. > > > > OK, so I've double checked. do_move_page_to_node_array would carry the > > > > error code over to do_pages_move and it would store the status stored > > > > in the pm array. It contains page_to_nid(page) so the resulting code > > > > indeed behaves properly before my change and this is a regression. I > > > Thanks, I see the change. > > > > > > > have a very vague recollection that this has been brought up already. > > > > <...looks in notes...> > > > > Found it! The report is > > > > http://lkml.kernel.org/r/0329efa0984b9b0252ef166abb4498c0795fab36.1535113317.git.jstancek@redhat.com > > > > and my proposed workaround was http://lkml.kernel.org/r/20180829145537.GZ10223@dhcp22.suse.cz > > > Well, the above two links return 404. > > You are right. They are not archived for some reason. Anyway, the patch > > I was proposing back then is below: > > > > commit cfb88c266b645197135cde2905c2bfc82f6d82a9 > > Author: Michal Hocko > > Date: Wed Nov 14 12:19:09 2018 +0100 > > > > mm: fix do_pages_move error reporting > > a49bd4d71637 ("mm, numa: rework do_pages_move") has changed the way how > > we report error to layers above. As the changelog mentioned the semantic > > was quite unclear previously because the return 0 could mean both > > success and failure. > > The above mentioned commit didn't get all the way down to fix this > > completely because it doesn't report pages that we even haven't > > attempted to migrate and therefore we cannot simply say that the > > semantic is: > > - err < 0 - errno > > - err >= 0 number of non-migrated pages. > > Fixes: a49bd4d71637 ("mm, numa: rework do_pages_move") > > Signed-off-by: Michal Hocko > > Thanks, Michal. But, it looks this patch still could return > 0 value (the > total number of non-migrated pages, including not even attempted pages) too, > but the problem we are trying to fix is to make do_pages_move() return <= 0 > value only since the man page of move_pages() doesn't allow return > 0 > value. Yes this patch just lives with the changed semantic and tries to make it sensible. So if some page cannot be migrated then we just stop and return the number of non migrated pages at the tail of the given array. This would make error handling slightly easier because you know that count - ret pages of the array can be skipped if ret >= 0. > And, by looking into the old code (v4.16), I spotted another problem. The > migrate_pages() would store the migration failure error code into > page_to_node->status. So, When do_move_page_to_node_array() returns > 0 > value, the return value would be reset to 0 and the migration error codes > for non-migrated pages would be stored into status to return to userspace. > But, the rework removed this. > > I didn't dig into the intention of the rework, is it expected? I have tried to preserve the original semantic as possible. As explained in the changelog there were quite some discrepancies even before. This new one was not really intentional. We have effectively two options here. Either somebody really depend on the former semantic and we have to fix this or we can relax the semantic as the above patch attempts. I would be more inclined for the second option as nobody has complained about the new semantic except for few ltp tests which do not represent real workload. If you have a real usecase then speak up please. -- Michal Hocko SUSE Labs