From mboxrd@z Thu Jan 1 00:00:00 1970 From: Bartlomiej Zolnierkiewicz Subject: Re: exynos5420/arndale-octa: imprecise external aborts on exynos_defconfig Date: Tue, 30 Sep 2014 20:17:38 +0200 Message-ID: <11034593.CCZ1LqhX6D@amdc1032> References: <7hk351ep8e.fsf@deeprootsystems.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7Bit Return-path: Received: from mailout1.samsung.com ([203.254.224.24]:10735 "EHLO mailout1.samsung.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751074AbaI3SRw (ORCPT ); Tue, 30 Sep 2014 14:17:52 -0400 Received: from epcpsbgm2.samsung.com (epcpsbgm2 [203.254.230.27]) by mailout1.samsung.com (Oracle Communications Messaging Server 7u4-24.01(7.0.4.24.0) 64bit (built Nov 17 2011)) with ESMTP id <0NCQ00MG585QT170@mailout1.samsung.com> for linux-samsung-soc@vger.kernel.org; Wed, 01 Oct 2014 03:17:50 +0900 (KST) In-reply-to: <7hk351ep8e.fsf@deeprootsystems.com> Sender: linux-samsung-soc-owner@vger.kernel.org List-Id: linux-samsung-soc@vger.kernel.org To: Kevin Hilman Cc: Thomas Abraham , Tyler Baker , "linux-samsung-soc@vger.kernel.org" , "linux-arm-kernel@lists.infradead.org" , Sachin Kamat , Kukjin Kim Hi, On Wednesday, September 17, 2014 05:39:29 PM Kevin Hilman wrote: > Thomas Abraham writes: > > > On Thu, Sep 11, 2014 at 12:16 AM, Kevin Hilman wrote: > >> Tyler Baker writes: > >> > >>> Exynos5420-based Arndale octa boards have recently started failing boot > >>> tests due to imprecise external aborts. This only appears to happen > >>> when using exynos_defconfig and boots fine with multi_v7_defconfig. The > >>> issue seems to be intermittent, so is not reliably reproducable and > >>> difficult to bisect. Here are a few boot logs from recent > >>> mainline/linux-next kernels that are failing: > >> > >> FYI, I'm seeing the same periodic aborts. For example, here's my boot > >> of next-20140910: > >> http://images.armcloud.us/kernel-ci/next/next-20140910/arm-exynos_defconfig/boot-exynos5420-arndale-octa.html > >> > >> However, my userspace is much simpler and doesn't seem to cause a panic, > >> so my boot tests report passing. (I should fixup my scripts so these > >> imprecise aborts are reported as a FAIL.) > >> > >> I'm glad you pointed out that it happens only with exynos_defconfig and > >> not multi_v7_defconfig because I noticed that too. I haven't had the > >> time to track it any further than that, so maybe the exynos folks can > >> help track it down from here. > >> > >> Thanks for reporting this, > >> > >> Kevin > > > > Hi Tyler, Kevin, > > > > From the bootlog you have shared, > > > > [ 1.060016] CPU4: failed to come online > > [ 2.070031] CPU5: failed to come online > > [ 3.080049] CPU6: failed to come online > > [ 4.090066] CPU7: failed to come online > > [ 4.090099] Brought up 4 CPUs > > [ 4.090109] SMP: Total of 4 processors activated. > > [ 4.090119] CPU: WARNING: CPU(s) started in wrong/inconsistent > > modes (primary CPU mode 0x13) > > [ 4.090128] CPU: This may indicate a broken bootloader or firmware. > > > > Would it be possible to set max cpus to 1, disable switcher and try Which "max cpus" do you mean? For NR_CPUS the lower limit is 2. > > again. I don't have a arndale octa board but I have tested mainline > > kernel with smdk5420 board. It boots all eight CPUs, switcher works > > fine and there are no imprecise aborts seen. > > Sorry for the delay, I'm travelling this week. > > FWIW, the same CPU boot failures you hilight above are happening on > multi_v7_defconfig[1] which is not getting the imprecise abort. This is > only happening on exynos_defconfig[2], so I'm curious why you think the > switcher or NR_CPUS might be the issues. > > Anyways, I narrowed this down a bit and discovered it's > CONFIG_EXYNOS5420_MCPM=y that's the root cause. If I use > exynos_defconfig and then disable that option, I don't get any more > imprecise aborts. I have exactly the same issue with Exynos5420 Arndale Octa. CONFIG_EXYNOS5420_MCPM was enabled by commit fc3791f3a95d ("ARM: exynos_defconfig: Update exynos_defconfig") which get merged into v3.17-rc1. It seems that this part of the patch should be reverted for the final v3.17 kernel. > Kevin > > [1] http://images.armcloud.us/kernel-ci/mainline/v3.17-rc5-25-g8ba4caf/arm-multi_v7_defconfig/boot-exynos5420-arndale-octa.html > [2] http://images.armcloud.us/kernel-ci/mainline/v3.17-rc5-25-g8ba4caf/arm-exynos_defconfig/boot-exynos5420-arndale-octa.html Best regards, -- Bartlomiej Zolnierkiewicz Samsung R&D Institute Poland Samsung Electronics From mboxrd@z Thu Jan 1 00:00:00 1970 From: b.zolnierkie@samsung.com (Bartlomiej Zolnierkiewicz) Date: Tue, 30 Sep 2014 20:17:38 +0200 Subject: exynos5420/arndale-octa: imprecise external aborts on exynos_defconfig In-Reply-To: <7hk351ep8e.fsf@deeprootsystems.com> References: <7hk351ep8e.fsf@deeprootsystems.com> Message-ID: <11034593.CCZ1LqhX6D@amdc1032> To: linux-arm-kernel@lists.infradead.org List-Id: linux-arm-kernel.lists.infradead.org Hi, On Wednesday, September 17, 2014 05:39:29 PM Kevin Hilman wrote: > Thomas Abraham writes: > > > On Thu, Sep 11, 2014 at 12:16 AM, Kevin Hilman wrote: > >> Tyler Baker writes: > >> > >>> Exynos5420-based Arndale octa boards have recently started failing boot > >>> tests due to imprecise external aborts. This only appears to happen > >>> when using exynos_defconfig and boots fine with multi_v7_defconfig. The > >>> issue seems to be intermittent, so is not reliably reproducable and > >>> difficult to bisect. Here are a few boot logs from recent > >>> mainline/linux-next kernels that are failing: > >> > >> FYI, I'm seeing the same periodic aborts. For example, here's my boot > >> of next-20140910: > >> http://images.armcloud.us/kernel-ci/next/next-20140910/arm-exynos_defconfig/boot-exynos5420-arndale-octa.html > >> > >> However, my userspace is much simpler and doesn't seem to cause a panic, > >> so my boot tests report passing. (I should fixup my scripts so these > >> imprecise aborts are reported as a FAIL.) > >> > >> I'm glad you pointed out that it happens only with exynos_defconfig and > >> not multi_v7_defconfig because I noticed that too. I haven't had the > >> time to track it any further than that, so maybe the exynos folks can > >> help track it down from here. > >> > >> Thanks for reporting this, > >> > >> Kevin > > > > Hi Tyler, Kevin, > > > > From the bootlog you have shared, > > > > [ 1.060016] CPU4: failed to come online > > [ 2.070031] CPU5: failed to come online > > [ 3.080049] CPU6: failed to come online > > [ 4.090066] CPU7: failed to come online > > [ 4.090099] Brought up 4 CPUs > > [ 4.090109] SMP: Total of 4 processors activated. > > [ 4.090119] CPU: WARNING: CPU(s) started in wrong/inconsistent > > modes (primary CPU mode 0x13) > > [ 4.090128] CPU: This may indicate a broken bootloader or firmware. > > > > Would it be possible to set max cpus to 1, disable switcher and try Which "max cpus" do you mean? For NR_CPUS the lower limit is 2. > > again. I don't have a arndale octa board but I have tested mainline > > kernel with smdk5420 board. It boots all eight CPUs, switcher works > > fine and there are no imprecise aborts seen. > > Sorry for the delay, I'm travelling this week. > > FWIW, the same CPU boot failures you hilight above are happening on > multi_v7_defconfig[1] which is not getting the imprecise abort. This is > only happening on exynos_defconfig[2], so I'm curious why you think the > switcher or NR_CPUS might be the issues. > > Anyways, I narrowed this down a bit and discovered it's > CONFIG_EXYNOS5420_MCPM=y that's the root cause. If I use > exynos_defconfig and then disable that option, I don't get any more > imprecise aborts. I have exactly the same issue with Exynos5420 Arndale Octa. CONFIG_EXYNOS5420_MCPM was enabled by commit fc3791f3a95d ("ARM: exynos_defconfig: Update exynos_defconfig") which get merged into v3.17-rc1. It seems that this part of the patch should be reverted for the final v3.17 kernel. > Kevin > > [1] http://images.armcloud.us/kernel-ci/mainline/v3.17-rc5-25-g8ba4caf/arm-multi_v7_defconfig/boot-exynos5420-arndale-octa.html > [2] http://images.armcloud.us/kernel-ci/mainline/v3.17-rc5-25-g8ba4caf/arm-exynos_defconfig/boot-exynos5420-arndale-octa.html Best regards, -- Bartlomiej Zolnierkiewicz Samsung R&D Institute Poland Samsung Electronics