* [PATCH] arm64: kexec: flush log to console in nmi_panic() @ 2021-06-17 12:50 Huang Shijie 2021-06-17 17:52 ` Will Deacon 0 siblings, 1 reply; 7+ messages in thread From: Huang Shijie @ 2021-06-17 12:50 UTC (permalink / raw) To: catalin.marinas Cc: will, tabba, ardb, mark.rutland, pasha.tatashin, linux-arm-kernel, linux-kernel, patches, zwang, Huang Shijie If kdump is configured, nmi_panic() may run to machine_kexec(). But in NMI context, the log is put in PER-CPU nmi_print_seq. So we can not see any log on the console since we entered the NMI context, such as the "Bye!" in previous line. This patch fixes this issue by two steps: 1) Uses printk_safe_flush_on_panic() to flush the log from nmi_print_seq to global printk ring buffer, 2) Then uses console_flush_on_panic() to flush to console. After this patch, we can see the "Bye!" log in the panic console. Signed-off-by: Huang Shijie <shijie@os.amperecomputing.com> --- arch/arm64/kernel/machine_kexec.c | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/arch/arm64/kernel/machine_kexec.c b/arch/arm64/kernel/machine_kexec.c index 213d56c14f60..0ab841dab9db 100644 --- a/arch/arm64/kernel/machine_kexec.c +++ b/arch/arm64/kernel/machine_kexec.c @@ -6,6 +6,7 @@ * Copyright (C) Huawei Futurewei Technologies. */ +#include <linux/console.h> #include <linux/interrupt.h> #include <linux/irq.h> #include <linux/kernel.h> @@ -189,6 +190,12 @@ void machine_kexec(struct kimage *kimage) pr_info("Bye!\n"); + if (in_nmi()) { + /* Flush the log to console if we are in NMI context */ + printk_safe_flush_on_panic(); + console_flush_on_panic(CONSOLE_FLUSH_PENDING); + } + local_daif_mask(); /* -- 2.30.2 _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel ^ permalink raw reply related [flat|nested] 7+ messages in thread
* Re: [PATCH] arm64: kexec: flush log to console in nmi_panic() 2021-06-17 12:50 [PATCH] arm64: kexec: flush log to console in nmi_panic() Huang Shijie @ 2021-06-17 17:52 ` Will Deacon 2021-06-17 17:55 ` Pavel Tatashin 0 siblings, 1 reply; 7+ messages in thread From: Will Deacon @ 2021-06-17 17:52 UTC (permalink / raw) To: Huang Shijie Cc: catalin.marinas, tabba, ardb, mark.rutland, pasha.tatashin, linux-arm-kernel, linux-kernel, patches, zwang On Thu, Jun 17, 2021 at 12:50:23PM +0000, Huang Shijie wrote: > If kdump is configured, nmi_panic() may run to machine_kexec(). > > But in NMI context, the log is put in PER-CPU nmi_print_seq. > So we can not see any log on the console since we entered the NMI context, > such as the "Bye!" in previous line. > > This patch fixes this issue by two steps: > 1) Uses printk_safe_flush_on_panic() to flush the log from > nmi_print_seq to global printk ring buffer, > 2) Then uses console_flush_on_panic() to flush to console. > > After this patch, we can see the "Bye!" log in the panic console. Does it matter? I'd be more inclined to remove the print altogether... Will _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [PATCH] arm64: kexec: flush log to console in nmi_panic() 2021-06-17 17:52 ` Will Deacon @ 2021-06-17 17:55 ` Pavel Tatashin 2021-06-17 17:58 ` Will Deacon 0 siblings, 1 reply; 7+ messages in thread From: Pavel Tatashin @ 2021-06-17 17:55 UTC (permalink / raw) To: Will Deacon Cc: Huang Shijie, Catalin Marinas, tabba, Ard Biesheuvel, Mark Rutland, Linux ARM, LKML, patches, zwang On Thu, Jun 17, 2021 at 1:52 PM Will Deacon <will@kernel.org> wrote: > > On Thu, Jun 17, 2021 at 12:50:23PM +0000, Huang Shijie wrote: > > If kdump is configured, nmi_panic() may run to machine_kexec(). > > > > But in NMI context, the log is put in PER-CPU nmi_print_seq. > > So we can not see any log on the console since we entered the NMI context, > > such as the "Bye!" in previous line. > > > > This patch fixes this issue by two steps: > > 1) Uses printk_safe_flush_on_panic() to flush the log from > > nmi_print_seq to global printk ring buffer, > > 2) Then uses console_flush_on_panic() to flush to console. > > > > After this patch, we can see the "Bye!" log in the panic console. > > Does it matter? I'd be more inclined to remove the print altogether... I agree, the print could be removed entirely. But, my assumption was that this patch meant to flush other buffered prints beside this last "Bye" one. > > Will _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [PATCH] arm64: kexec: flush log to console in nmi_panic() 2021-06-17 17:55 ` Pavel Tatashin @ 2021-06-17 17:58 ` Will Deacon 2021-06-18 9:03 ` Huang Shijie 0 siblings, 1 reply; 7+ messages in thread From: Will Deacon @ 2021-06-17 17:58 UTC (permalink / raw) To: Pavel Tatashin Cc: Huang Shijie, Catalin Marinas, tabba, Ard Biesheuvel, Mark Rutland, Linux ARM, LKML, patches, zwang On Thu, Jun 17, 2021 at 01:55:08PM -0400, Pavel Tatashin wrote: > On Thu, Jun 17, 2021 at 1:52 PM Will Deacon <will@kernel.org> wrote: > > > > On Thu, Jun 17, 2021 at 12:50:23PM +0000, Huang Shijie wrote: > > > If kdump is configured, nmi_panic() may run to machine_kexec(). > > > > > > But in NMI context, the log is put in PER-CPU nmi_print_seq. > > > So we can not see any log on the console since we entered the NMI context, > > > such as the "Bye!" in previous line. > > > > > > This patch fixes this issue by two steps: > > > 1) Uses printk_safe_flush_on_panic() to flush the log from > > > nmi_print_seq to global printk ring buffer, > > > 2) Then uses console_flush_on_panic() to flush to console. > > > > > > After this patch, we can see the "Bye!" log in the panic console. > > > > Does it matter? I'd be more inclined to remove the print altogether... > > I agree, the print could be removed entirely. But, my assumption was > that this patch meant to flush other buffered prints beside this last > "Bye" one. That sounds like something which should be done in the core code, rather than the in the architecture backend (and looks like panic() might do this already?) Will _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [PATCH] arm64: kexec: flush log to console in nmi_panic() 2021-06-17 17:58 ` Will Deacon @ 2021-06-18 9:03 ` Huang Shijie 2021-06-21 10:08 ` Will Deacon 0 siblings, 1 reply; 7+ messages in thread From: Huang Shijie @ 2021-06-18 9:03 UTC (permalink / raw) To: Will Deacon Cc: Pavel Tatashin, Catalin Marinas, tabba, Ard Biesheuvel, Mark Rutland, Linux ARM, LKML, patches, zwang On Thu, Jun 17, 2021 at 06:58:23PM +0100, Will Deacon wrote: > On Thu, Jun 17, 2021 at 01:55:08PM -0400, Pavel Tatashin wrote: > > On Thu, Jun 17, 2021 at 1:52 PM Will Deacon <will@kernel.org> wrote: > > > > > > On Thu, Jun 17, 2021 at 12:50:23PM +0000, Huang Shijie wrote: > > > > If kdump is configured, nmi_panic() may run to machine_kexec(). > > > > > > > > But in NMI context, the log is put in PER-CPU nmi_print_seq. > > > > So we can not see any log on the console since we entered the NMI context, > > > > such as the "Bye!" in previous line. > > > > > > > > This patch fixes this issue by two steps: > > > > 1) Uses printk_safe_flush_on_panic() to flush the log from > > > > nmi_print_seq to global printk ring buffer, > > > > 2) Then uses console_flush_on_panic() to flush to console. > > > > > > > > After this patch, we can see the "Bye!" log in the panic console. > > > > > > Does it matter? I'd be more inclined to remove the print altogether... We may remove the log in the arm64 code. But in the panic() itself, it still has many log, such as: .............. pr_emerg("Kernel panic - not syncing: %s\n", buf); .............. dump_stack(); .............. kdb_printf("PANIC: %s\n", msg); Without this patch, all these log above will loss.. > > > > I agree, the print could be removed entirely. But, my assumption was > > that this patch meant to flush other buffered prints beside this last > > "Bye" one. > > That sounds like something which should be done in the core code, rather > than the in the architecture backend (and looks like panic() might do this > already?) In the non-kdump code path, the core code will take care of it, please read the code in panic(). But in the kdump code path, the architecture code should take care of it. Thanks Huang Shijie _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [PATCH] arm64: kexec: flush log to console in nmi_panic() 2021-06-18 9:03 ` Huang Shijie @ 2021-06-21 10:08 ` Will Deacon 2021-06-22 10:14 ` Huang Shijie 0 siblings, 1 reply; 7+ messages in thread From: Will Deacon @ 2021-06-21 10:08 UTC (permalink / raw) To: Huang Shijie Cc: Pavel Tatashin, Catalin Marinas, tabba, Ard Biesheuvel, Mark Rutland, Linux ARM, LKML, patches, zwang On Fri, Jun 18, 2021 at 09:03:26AM +0000, Huang Shijie wrote: > On Thu, Jun 17, 2021 at 06:58:23PM +0100, Will Deacon wrote: > > On Thu, Jun 17, 2021 at 01:55:08PM -0400, Pavel Tatashin wrote: > > > On Thu, Jun 17, 2021 at 1:52 PM Will Deacon <will@kernel.org> wrote: > > > > > > > > On Thu, Jun 17, 2021 at 12:50:23PM +0000, Huang Shijie wrote: > > > > > If kdump is configured, nmi_panic() may run to machine_kexec(). > > > > > > > > > > But in NMI context, the log is put in PER-CPU nmi_print_seq. > > > > > So we can not see any log on the console since we entered the NMI context, > > > > > such as the "Bye!" in previous line. > > > > > > > > > > This patch fixes this issue by two steps: > > > > > 1) Uses printk_safe_flush_on_panic() to flush the log from > > > > > nmi_print_seq to global printk ring buffer, > > > > > 2) Then uses console_flush_on_panic() to flush to console. > > > > > > > > > > After this patch, we can see the "Bye!" log in the panic console. > > > > > > > > Does it matter? I'd be more inclined to remove the print altogether... > We may remove the log in the arm64 code. > > But in the panic() itself, it still has many log, such as: > > .............. > pr_emerg("Kernel panic - not syncing: %s\n", buf); > .............. > dump_stack(); > .............. > kdb_printf("PANIC: %s\n", msg); > > Without this patch, all these log above will loss.. > > > > > > > I agree, the print could be removed entirely. But, my assumption was > > > that this patch meant to flush other buffered prints beside this last > > > "Bye" one. > > > > That sounds like something which should be done in the core code, rather > > than the in the architecture backend (and looks like panic() might do this > > already?) > In the non-kdump code path, the core code will take care of it, please read the > code in panic(). > > But in the kdump code path, the architecture code should take care of it. Why the discrepancy? Wouldn't it make more sense to do this in panic() for both cases, if the prints that we want to display are coming from panic() itself? Will _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [PATCH] arm64: kexec: flush log to console in nmi_panic() 2021-06-21 10:08 ` Will Deacon @ 2021-06-22 10:14 ` Huang Shijie 0 siblings, 0 replies; 7+ messages in thread From: Huang Shijie @ 2021-06-22 10:14 UTC (permalink / raw) To: Will Deacon Cc: Pavel Tatashin, Catalin Marinas, tabba, Ard Biesheuvel, Mark Rutland, Linux ARM, LKML, patches, zwang Hi Will, On Mon, Jun 21, 2021 at 11:08:37AM +0100, Will Deacon wrote: > > > That sounds like something which should be done in the core code, rather > > > than the in the architecture backend (and looks like panic() might do this > > > already?) > > In the non-kdump code path, the core code will take care of it, please read the > > code in panic(). > > > > But in the kdump code path, the architecture code should take care of it. > > Why the discrepancy? Wouldn't it make more sense to do this in panic() for > both cases, if the prints that we want to display are coming from panic() > itself? In the kdump code path, code call like this: panic() -->__crash_kexec() --> machine_kexec(); When we reach arm64's machine_kexec(), it means we can __NOT__ return to the panic(), we will run to the kdump linux kernel by cpu_soft_restart(). So we can not depend the panic() to print the log. :) By the way, I quote part of the arm64 log after we enter __crash_kexec() in NMI context: 1.) the log in machine_crash_shutdown() .............. pr_crit("SMP: stopping secondary CPUs\n"); .............. pr_info("Starting crashdump kernel...\n"); .............. 2.) the log in machine_kexec() .............. WARN(in_kexec_crash && (stuck_cpus || smp_crash_stop_failed()), "Some CPUs may be stale, kdump will be unreliable.\n"); .............. the logs in kexec_segment_flush(kimage); .............. pr_info("Bye!\n"); We cannot remove them all, and need to flush all the logs above to console in the NMI context. Thanks Huang Shijie _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel ^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2021-06-22 2:17 UTC | newest] Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2021-06-17 12:50 [PATCH] arm64: kexec: flush log to console in nmi_panic() Huang Shijie 2021-06-17 17:52 ` Will Deacon 2021-06-17 17:55 ` Pavel Tatashin 2021-06-17 17:58 ` Will Deacon 2021-06-18 9:03 ` Huang Shijie 2021-06-21 10:08 ` Will Deacon 2021-06-22 10:14 ` Huang Shijie
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).