From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.3 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DEDBAC433E6 for ; Thu, 4 Feb 2021 15:44:51 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 891B164F4D for ; Thu, 4 Feb 2021 15:44:51 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S237326AbhBDPoi (ORCPT ); Thu, 4 Feb 2021 10:44:38 -0500 Received: from mail.kernel.org ([198.145.29.99]:33110 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S237534AbhBDPnK (ORCPT ); Thu, 4 Feb 2021 10:43:10 -0500 Received: by mail.kernel.org (Postfix) with ESMTPSA id 6419464F6C for ; Thu, 4 Feb 2021 15:42:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1612453348; bh=4dX/aXt8PQev+SQRXcQKXWa21f8rZJMURijB1ULwj98=; h=References:In-Reply-To:From:Date:Subject:To:Cc:From; b=hoVbiHQUkE4hJSLw20HF/3Kot3RYdBdJynSlKX59zoVbw4SXJBC0N1ndPyw5c1ffl jKoZ60ne18UjTPrfa/FBF8UyvyoZ8mIM9sYKquvBcCVcunvgvhyApys+QI4dVwRcwI J21SUkyRCoCrU7NYy/toDrfPVM6tECZhJdWktaEt3F+koQpSKz8xrGzR/DFfltMEqc fnkhGsywVUVpDEb1lM1IDfs52dtFtLsVAcxiVeGJZkU6myCzlY8gPhk9010iMdrSr4 xHZuXOUWymzua2p4Ih6sErvt+Fqrf8hUuTH5vnJKkY+MHlfzLKxRxZ+HlQgEZVCbsp iqlgNEIAaRSZQ== Received: by mail-ot1-f48.google.com with SMTP id o12so3766458ote.12 for ; Thu, 04 Feb 2021 07:42:28 -0800 (PST) X-Gm-Message-State: AOAM531QkRg2nIBHVtRjxQ0hf3FliIlc0/VsQI64RpCPy/zJyiwgRqU6 yuwN+AKPSf/xcLHjmS86bKMt2/aXYEQqpcco748= X-Google-Smtp-Source: ABdhPJwD/kbrwmqs2NdZLVcMlXr0lx+ORD/zaYBwCBPO0OLKHj53vdIL0sQ70Cf0CtKjIEN0exZyIjoegkqz25Eoy0g= X-Received: by 2002:a05:6830:1e2a:: with SMTP id t10mr6205441otr.90.1612453347580; Thu, 04 Feb 2021 07:42:27 -0800 (PST) MIME-Version: 1.0 References: <601b773a.1c69fb81.9f381.a32a@mx.google.com> <6c65bcef-d4e7-25fa-43cf-2c435bb61bb9@collabora.com> <20210204100601.GT1463@shell.armlinux.org.uk> <46373679-a149-8a3d-e914-780e4c6ff8be@collabora.com> In-Reply-To: <46373679-a149-8a3d-e914-780e4c6ff8be@collabora.com> From: Ard Biesheuvel Date: Thu, 4 Feb 2021 16:42:15 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: next/master bisection: baseline.login on rk3288-rock2-square To: Guillaume Tucker Cc: Russell King - ARM Linux admin , Geert Uytterhoeven , Linux Kernel Mailing List , Linus Walleij , Linux ARM , Nicolas Pitre , "kernelci-results@groups.io" , clang-built-linux , Nick Desaulniers Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, 4 Feb 2021 at 12:32, Guillaume Tucker wrote: > > On 04/02/2021 10:33, Guillaume Tucker wrote: > > On 04/02/2021 10:27, Ard Biesheuvel wrote: > >> On Thu, 4 Feb 2021 at 11:06, Russell King - ARM Linux admin > >> wrote: > >>> > >>> On Thu, Feb 04, 2021 at 10:07:58AM +0100, Ard Biesheuvel wrote: > >>>> On Thu, 4 Feb 2021 at 09:43, Guillaume Tucker > >>>> wrote: > >>>>> > >>>>> Hi Ard, > >>>>> > >>>>> Please see the bisection report below about a boot failure on > >>>>> rk3288 with next-20210203. It was also bisected on > >>>>> imx6q-var-dt6customboard with next-20210202. > >>>>> > >>>>> Reports aren't automatically sent to the public while we're > >>>>> trialing new bisection features on kernelci.org but this one > >>>>> looks valid. > >>>>> > >>>>> The kernel is most likely crashing very early on, so there's > >>>>> nothing in the logs. Please let us know if you need some help > >>>>> with debugging or trying a fix on these platforms. > >>>>> > >>>> > >>>> Thanks for the report. > >>> > >>> Ard, > >>> > >>> I want to send my fixes branch today which includes your regression > >>> fix that caused this regression. > >>> > >>> As this is proving difficult to fix, I can only drop your fix from > >>> my fixes branch - and given that this seems to be problematical, I'm > >>> tempted to revert the original change at this point which should fix > >>> both of these regressions - and then we have another go at getting rid > >>> of the set/way instructions during the next cycle. > >>> > >>> Thoughts? > >>> > >> > >> Hi Russell, > >> > >> If Guillaume is willing to do the experiment, and it fixes the issue, > > > > Yes, I'm running some tests with that fix now and should have > > some results shortly. > > Yes it does fix the issue: > > https://lava.collabora.co.uk/scheduler/job/3173819 > > with Ard's fix applied to this test branch: > > https://gitlab.collabora.com/gtucker/linux/-/commits/next-20210203-ard-fix/ > > > +clang +Nick > > It's worth mentioning that the issue only happens with kernels > built with Clang. As you can see there are several other arm > platforms failing with clang-11 builds but booting fine with > gcc-8: > > https://kernelci.org/test/job/next/branch/master/kernel/next-20210203/plan/baseline/ > > Here's a sample build log: > > https://storage.staging.kernelci.org/gtucker/next-20210203-ard-fix/v5.10-rc4-24722-g58b6c0e507b7-gtucker_single-staging-33/arm/multi_v7_defconfig/clang-11/build.log > > Essentially: > > make -j18 ARCH=arm CROSS_COMPILE=arm-linux-gnueabihf- LLVM=1 CC="ccache clang" zImage > > I believe it should be using the GNU assembler as LLVM_IAS=1 is > not defined, but there may be something more subtle about it. > Do you have a link for a failing zImage built from multi_v7_defconfig? From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.3 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 27203C433DB for ; Thu, 4 Feb 2021 15:43:45 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id C2D2364F4A for ; Thu, 4 Feb 2021 15:43:44 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C2D2364F4A Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:To:Subject:Message-ID:Date:From:In-Reply-To: References:MIME-Version:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=8W2vsgk4PdotQi6CsH6xQAadg4/q9gE7RDXxXKcUzCg=; b=qcc87TFmzGANSLmPURIUt1SyG Fjx4qoI5Bm/6KCVA7BhmS/7ldLnnxc66068nE4zxhGMNG/fE2F2b+eNDMLXBvpOdC+WWEjn58xheU XOGdHk00MAGo6r667fnG3Mker1y1TSii4rmbTbyHZHVZ0UQtiPohTk6BK5Ifh7cci6PypySdU6ol7 e8uf4A7Tm8SKAJ9KpOFZAKf8SbS/uXP/o4V2ifD0T4neZDsgD/RmPqOJ06Qh2ZJotdf6BaVfynZer FMEE0U/aL4TCMeBmEI/MZ3bE1ZJZRmixSg9EoGOKJlv3Ynr4xrcIqFUFTXGZMe6ZJDdsTGiFuO3R+ Hy+br25cw==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1l7gm8-0005Rp-2G; Thu, 04 Feb 2021 15:42:32 +0000 Received: from mail.kernel.org ([198.145.29.99]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1l7gm5-0005RG-5R for linux-arm-kernel@lists.infradead.org; Thu, 04 Feb 2021 15:42:30 +0000 Received: by mail.kernel.org (Postfix) with ESMTPSA id 5D01964F67 for ; Thu, 4 Feb 2021 15:42:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1612453348; bh=4dX/aXt8PQev+SQRXcQKXWa21f8rZJMURijB1ULwj98=; h=References:In-Reply-To:From:Date:Subject:To:Cc:From; b=hoVbiHQUkE4hJSLw20HF/3Kot3RYdBdJynSlKX59zoVbw4SXJBC0N1ndPyw5c1ffl jKoZ60ne18UjTPrfa/FBF8UyvyoZ8mIM9sYKquvBcCVcunvgvhyApys+QI4dVwRcwI J21SUkyRCoCrU7NYy/toDrfPVM6tECZhJdWktaEt3F+koQpSKz8xrGzR/DFfltMEqc fnkhGsywVUVpDEb1lM1IDfs52dtFtLsVAcxiVeGJZkU6myCzlY8gPhk9010iMdrSr4 xHZuXOUWymzua2p4Ih6sErvt+Fqrf8hUuTH5vnJKkY+MHlfzLKxRxZ+HlQgEZVCbsp iqlgNEIAaRSZQ== Received: by mail-ot1-f47.google.com with SMTP id v1so3775042ott.10 for ; Thu, 04 Feb 2021 07:42:28 -0800 (PST) X-Gm-Message-State: AOAM530AGRlOUZnBMS7bJ3jeZVpm7HnjnFwM/5X8wQ/iVu5Y5FjF1Xxw e0I0XDQeHIQECWMoJsBGgizv87JZasjFJ/tuvP0= X-Google-Smtp-Source: ABdhPJwD/kbrwmqs2NdZLVcMlXr0lx+ORD/zaYBwCBPO0OLKHj53vdIL0sQ70Cf0CtKjIEN0exZyIjoegkqz25Eoy0g= X-Received: by 2002:a05:6830:1e2a:: with SMTP id t10mr6205441otr.90.1612453347580; Thu, 04 Feb 2021 07:42:27 -0800 (PST) MIME-Version: 1.0 References: <601b773a.1c69fb81.9f381.a32a@mx.google.com> <6c65bcef-d4e7-25fa-43cf-2c435bb61bb9@collabora.com> <20210204100601.GT1463@shell.armlinux.org.uk> <46373679-a149-8a3d-e914-780e4c6ff8be@collabora.com> In-Reply-To: <46373679-a149-8a3d-e914-780e4c6ff8be@collabora.com> From: Ard Biesheuvel Date: Thu, 4 Feb 2021 16:42:15 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: next/master bisection: baseline.login on rk3288-rock2-square To: Guillaume Tucker X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210204_104229_437419_DA159031 X-CRM114-Status: GOOD ( 29.92 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "kernelci-results@groups.io" , Geert Uytterhoeven , Nicolas Pitre , Linus Walleij , Nick Desaulniers , Russell King - ARM Linux admin , Linux Kernel Mailing List , clang-built-linux , Linux ARM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Thu, 4 Feb 2021 at 12:32, Guillaume Tucker wrote: > > On 04/02/2021 10:33, Guillaume Tucker wrote: > > On 04/02/2021 10:27, Ard Biesheuvel wrote: > >> On Thu, 4 Feb 2021 at 11:06, Russell King - ARM Linux admin > >> wrote: > >>> > >>> On Thu, Feb 04, 2021 at 10:07:58AM +0100, Ard Biesheuvel wrote: > >>>> On Thu, 4 Feb 2021 at 09:43, Guillaume Tucker > >>>> wrote: > >>>>> > >>>>> Hi Ard, > >>>>> > >>>>> Please see the bisection report below about a boot failure on > >>>>> rk3288 with next-20210203. It was also bisected on > >>>>> imx6q-var-dt6customboard with next-20210202. > >>>>> > >>>>> Reports aren't automatically sent to the public while we're > >>>>> trialing new bisection features on kernelci.org but this one > >>>>> looks valid. > >>>>> > >>>>> The kernel is most likely crashing very early on, so there's > >>>>> nothing in the logs. Please let us know if you need some help > >>>>> with debugging or trying a fix on these platforms. > >>>>> > >>>> > >>>> Thanks for the report. > >>> > >>> Ard, > >>> > >>> I want to send my fixes branch today which includes your regression > >>> fix that caused this regression. > >>> > >>> As this is proving difficult to fix, I can only drop your fix from > >>> my fixes branch - and given that this seems to be problematical, I'm > >>> tempted to revert the original change at this point which should fix > >>> both of these regressions - and then we have another go at getting rid > >>> of the set/way instructions during the next cycle. > >>> > >>> Thoughts? > >>> > >> > >> Hi Russell, > >> > >> If Guillaume is willing to do the experiment, and it fixes the issue, > > > > Yes, I'm running some tests with that fix now and should have > > some results shortly. > > Yes it does fix the issue: > > https://lava.collabora.co.uk/scheduler/job/3173819 > > with Ard's fix applied to this test branch: > > https://gitlab.collabora.com/gtucker/linux/-/commits/next-20210203-ard-fix/ > > > +clang +Nick > > It's worth mentioning that the issue only happens with kernels > built with Clang. As you can see there are several other arm > platforms failing with clang-11 builds but booting fine with > gcc-8: > > https://kernelci.org/test/job/next/branch/master/kernel/next-20210203/plan/baseline/ > > Here's a sample build log: > > https://storage.staging.kernelci.org/gtucker/next-20210203-ard-fix/v5.10-rc4-24722-g58b6c0e507b7-gtucker_single-staging-33/arm/multi_v7_defconfig/clang-11/build.log > > Essentially: > > make -j18 ARCH=arm CROSS_COMPILE=arm-linux-gnueabihf- LLVM=1 CC="ccache clang" zImage > > I believe it should be using the GNU assembler as LLVM_IAS=1 is > not defined, but there may be something more subtle about it. > Do you have a link for a failing zImage built from multi_v7_defconfig? _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel