From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934426AbdC3QUk (ORCPT ); Thu, 30 Mar 2017 12:20:40 -0400 Received: from mx2.suse.de ([195.135.220.15]:36938 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S934118AbdC3QUj (ORCPT ); Thu, 30 Mar 2017 12:20:39 -0400 Date: Thu, 30 Mar 2017 18:20:34 +0200 From: Michal Hocko To: Jiri Kosina Cc: "Rafael J. Wysocki" , Toshi Kani , joeyli , linux-mm@kvack.org, LKML , linux-api@vger.kernel.org Subject: Re: memory hotplug and force_remove Message-ID: <20170330162031.GE4326@dhcp22.suse.cz> References: <20170320192938.GA11363@dhcp22.suse.cz> <2735706.OR0SQDpVy6@aspire.rjw.lan> <20170328075808.GB18241@dhcp22.suse.cz> <2203902.lsAnRkUs2Y@aspire.rjw.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu 30-03-17 10:47:52, Jiri Kosina wrote: > On Tue, 28 Mar 2017, Rafael J. Wysocki wrote: > > > > > > we have been chasing the following BUG() triggering during the memory > > > > > hotremove (remove_memory): > > > > > ret = walk_memory_range(PFN_DOWN(start), PFN_UP(start + size - 1), NULL, > > > > > check_memblock_offlined_cb); > > > > > if (ret) > > > > > BUG(); > > > > > > > > > > and it took a while to learn that the issue is caused by > > > > > /sys/firmware/acpi/hotplug/force_remove being enabled. I was really > > > > > surprised to see such an option because at least for the memory hotplug > > > > > it cannot work at all. Memory hotplug fails when the memory is still > > > > > in use. Even if we do not BUG() here enforcing the hotplug operation > > > > > will lead to problematic behavior later like crash or a silent memory > > > > > corruption if the memory gets onlined back and reused by somebody else. > > > > > > > > > > I am wondering what was the motivation for introducing this behavior and > > > > > whether there is a way to disallow it for memory hotplug. Or maybe drop > > > > > it completely. What would break in such a case? > > > > > > > > Honestly, I don't remember from the top of my head and I haven't looked at > > > > that code for several months. > > > > > > > > I need some time to recall that. > > > > > > Did you have any chance to look into this? > > > > Well, yes. > > > > It looks like that was added for some people who depended on the old behavior > > at that time. > > > > I guess we can try to drop it and see what happpens. :-) > > I'd agree with that; at the same time, udev rule should be submitted to > systemd folks though. I don't think there is anything existing in this > area yet (neither do distros ship their own udev rules for this AFAIK). Another option would keepint the force_remove knob but make the code be error handling aware. In other words rather than ignoring offline error simply propagate it up the chain and do not consider the offline. Would that be acceptable? -- Michal Hocko SUSE Labs From mboxrd@z Thu Jan 1 00:00:00 1970 From: Michal Hocko Subject: Re: memory hotplug and force_remove Date: Thu, 30 Mar 2017 18:20:34 +0200 Message-ID: <20170330162031.GE4326@dhcp22.suse.cz> References: <20170320192938.GA11363@dhcp22.suse.cz> <2735706.OR0SQDpVy6@aspire.rjw.lan> <20170328075808.GB18241@dhcp22.suse.cz> <2203902.lsAnRkUs2Y@aspire.rjw.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Content-Disposition: inline In-Reply-To: Sender: owner-linux-mm@kvack.org To: Jiri Kosina Cc: "Rafael J. Wysocki" , Toshi Kani , joeyli , linux-mm@kvack.org, LKML , linux-api@vger.kernel.org List-Id: linux-api@vger.kernel.org On Thu 30-03-17 10:47:52, Jiri Kosina wrote: > On Tue, 28 Mar 2017, Rafael J. Wysocki wrote: > > > > > > we have been chasing the following BUG() triggering during the memory > > > > > hotremove (remove_memory): > > > > > ret = walk_memory_range(PFN_DOWN(start), PFN_UP(start + size - 1), NULL, > > > > > check_memblock_offlined_cb); > > > > > if (ret) > > > > > BUG(); > > > > > > > > > > and it took a while to learn that the issue is caused by > > > > > /sys/firmware/acpi/hotplug/force_remove being enabled. I was really > > > > > surprised to see such an option because at least for the memory hotplug > > > > > it cannot work at all. Memory hotplug fails when the memory is still > > > > > in use. Even if we do not BUG() here enforcing the hotplug operation > > > > > will lead to problematic behavior later like crash or a silent memory > > > > > corruption if the memory gets onlined back and reused by somebody else. > > > > > > > > > > I am wondering what was the motivation for introducing this behavior and > > > > > whether there is a way to disallow it for memory hotplug. Or maybe drop > > > > > it completely. What would break in such a case? > > > > > > > > Honestly, I don't remember from the top of my head and I haven't looked at > > > > that code for several months. > > > > > > > > I need some time to recall that. > > > > > > Did you have any chance to look into this? > > > > Well, yes. > > > > It looks like that was added for some people who depended on the old behavior > > at that time. > > > > I guess we can try to drop it and see what happpens. :-) > > I'd agree with that; at the same time, udev rule should be submitted to > systemd folks though. I don't think there is anything existing in this > area yet (neither do distros ship their own udev rules for this AFAIK). Another option would keepint the force_remove knob but make the code be error handling aware. In other words rather than ignoring offline error simply propagate it up the chain and do not consider the offline. Would that be acceptable? -- Michal Hocko SUSE Labs -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org