From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.0 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7E0F9C433B4 for ; Wed, 12 May 2021 14:52:09 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 40397613AF for ; Wed, 12 May 2021 14:52:09 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231189AbhELOxQ (ORCPT ); Wed, 12 May 2021 10:53:16 -0400 Received: from us-smtp-delivery-124.mimecast.com ([170.10.133.124]:20163 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230280AbhELOxP (ORCPT ); Wed, 12 May 2021 10:53:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1620831127; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=Z8Zk8qLE4OHzoCZMBvPW/IQrRM4D7QFd4d74w1gNqKA=; b=GGXheoarvlU8gv9YgtBRsY019ZYvkZsRI8c2e/B3bLzZ+tziWS5RaQemtWxttg7HmavqK1 2WCMEEje1RA8VONPoZS/2zCGwZ0gZUUp7K4lWBGePKx/7McwK6REjQtW/+s7QMoGHRqYHJ hjJJ1AscogUe0wGMo3k45YPvLPheqGw= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-188-9lL__QH_Nz2uCsqr7zMdqA-1; Wed, 12 May 2021 10:52:06 -0400 X-MC-Unique: 9lL__QH_Nz2uCsqr7zMdqA-1 Received: from smtp.corp.redhat.com (int-mx07.intmail.prod.int.phx2.redhat.com [10.5.11.22]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 61579A40C0; Wed, 12 May 2021 14:52:03 +0000 (UTC) Received: from localhost (ovpn-12-39.pek2.redhat.com [10.72.12.39]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 6D412100EBAF; Wed, 12 May 2021 14:51:54 +0000 (UTC) Date: Wed, 12 May 2021 22:51:50 +0800 From: Baoquan He To: David Hildenbrand Cc: Mike Rapoport , Dave Young , Andrew Morton , christian.brauner@ubuntu.com, colin.king@canonical.com, corbet@lwn.net, frederic@kernel.org, gpiccoli@canonical.com, john.p.donnelly@oracle.com, jpoimboe@redhat.com, keescook@chromium.org, linux-mm@kvack.org, masahiroy@kernel.org, mchehab+huawei@kernel.org, mike.kravetz@oracle.com, mingo@kernel.org, mm-commits@vger.kernel.org, paulmck@kernel.org, peterz@infradead.org, rdunlap@infradead.org, rostedt@goodmis.org, saeed.mirzamohammadi@oracle.com, samitolvanen@google.com, sboyd@kernel.org, tglx@linutronix.de, torvalds@linux-foundation.org, vgoyal@redhat.com, yifeifz2@illinois.edu, Michal Hocko , kasong@redhat.com Subject: Re: [patch 48/91] kernel/crash_core: add crashkernel=auto for vmcore creation Message-ID: <20210512145150.GG2834@localhost.localdomain> References: <2d0f53d9-51ca-da57-95a3-583dc81f35ef@redhat.com> <20210510045338.GB2946@localhost.localdomain> <4a544493-0622-ac6d-f14b-fb338e33b25e@redhat.com> <20210510104359.GC2946@localhost.localdomain> <20210511133641.GE2834@localhost.localdomain> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) X-Scanned-By: MIMEDefang 2.84 on 10.5.11.22 Precedence: bulk Reply-To: linux-kernel@vger.kernel.org List-ID: X-Mailing-List: mm-commits@vger.kernel.org On 05/11/21 at 07:07pm, David Hildenbrand wrote: > > > If the way adding default value into kernel config is disliked, > > > this a) option looks good. We can get value with x% of system RAM, but > > > clamp it with CRASH_KERNEL_MIN/MAX. The CRASH_KERNEL_MIN/MAX may need be > > > defined with a default value for different ARCHes. It's very close to > > > our current implementation, and handling 'auto' in kernel. > > > > > > And kernel config provided so that people can tune the MIN/MAX value, > > > but no need to post patch to do the tuning each time if have to? > > Maybe I'm missing something, but the whole point is to avoid kernel > > configuration option at all. If the crashkernel=auto works good for 99% of > > the cases, there is no need to provide build time configuration along with > > it. There are plenty of ways users can control crashkernel reservations > > with the existing 2-4 (depending on architecture) command line options. > > > > Simply hard coding a reasonable defaults (e.g. > > "1G-64G:128M,64G-1T:256M,1T-:512M"), and using these defaults when > > crashkernel=auto is set would cover the same 99% of users you referred to. > > Right, and we can easily allocate a bit more as a safety net temporarily > when we can actually shrink the area later. > > > > > If we can resize the reservation later during boot this will also address > > David's concern about the wasted memory. > > > > Yes. > > > You mentioned that amount of memory that is required for crash kernel > > reservation depends on the devices present on the system. Is is possible to > > detect how much memory is required at late stages of boot? > > Here is my thinking: > > There seems to be some kind of formula we can roughly use to come up with > the final crashkernel size. Baoquan for sure knows all the dirty details, I > assume it's roughly "core kernel + drivers + user space". > > In the kernel, we can only come up with "core kernel + drivers" expecting > that we will run > > a) roughly the same kernel > b) with roughly the same drivers As replied to Mike, kernel size is undecided for different kernel with different configs. We can define a default minimal size to cover kernel and driver on systems with not many devices, but hardcoding the size into upstream is not helpful. If the size is big, users will be asked to check and shrink always. If the size is too small, a new value need be got and added to cmdline and reboot. > > The "user space" part is completely under user space control, depending on > what application will be run after kexec. > > So I wonder if something like > > crashkernel=auto,100M > > whereby "100M" corresponds to user space demands in addition to the variable > part depend on the current kernel + drivers. > > would already be somewhat sufficient for main use cases I guess. > > Of course, that approach will get more complicated if the user space portion > heavily depends on the drivers etc. Then we need more tunables. > > -- > Thanks, > > David / dhildenb >