From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.6 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 40CDAC43603 for ; Tue, 10 Dec 2019 00:52:48 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 152DF2077B for ; Tue, 10 Dec 2019 00:52:48 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1575939168; bh=0fCKRrO+qbAUzYrgrBX7cVTSkGUF7f+hVZZmtOT+t68=; h=Subject:To:Cc:References:From:Date:In-Reply-To:List-ID:From; b=PDMU9+rLuowfDNaoqA35DjuP9e8BotN8yM+QhBmpqHl9wHPPgg2f6mL6Yww6vOwxf zt8Q5mi9OWn4XFQaOJxCcdtPo/6RL6LG+uKSqSx+clP/zqN7mxqpWEJuPntVLvqV0K ASRFCSTTlLmShWHfRI4/5eMw1av6GHB2FO8GGUJI= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727492AbfLJAwr (ORCPT ); Mon, 9 Dec 2019 19:52:47 -0500 Received: from mail.kernel.org ([198.145.29.99]:40806 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727487AbfLJAwr (ORCPT ); Mon, 9 Dec 2019 19:52:47 -0500 Received: from [192.168.1.112] (c-24-9-64-241.hsd1.co.comcast.net [24.9.64.241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id A3A3920637; Tue, 10 Dec 2019 00:52:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1575939166; bh=0fCKRrO+qbAUzYrgrBX7cVTSkGUF7f+hVZZmtOT+t68=; h=Subject:To:Cc:References:From:Date:In-Reply-To:From; b=fWlr7CAkvOSknyYBHXTRNgavvE6mrK/r1AXrtBH6eUb+QsI0YBjenvLz4Ffo/2APl LR0r5YeA3jG0qPNX+P99Rz3GlrTOSKghEMpjjpWH4ALe1L8aaili6f0vkaCwq1/yL8 xd06QqNxVPuYRk4Yn/GdJ537OQjyDQOzqTj02KzA= Subject: Re: [PATCH 4.14 000/209] 4.14.158-stable review To: Guenter Roeck , Greg Kroah-Hartman Cc: linux-kernel@vger.kernel.org, torvalds@linux-foundation.org, akpm@linux-foundation.org, patches@kernelci.org, ben.hutchings@codethink.co.uk, lkft-triage@lists.linaro.org, stable@vger.kernel.org, shuah References: <20191204175321.609072813@linuxfoundation.org> <1dac10cd-7183-9dfd-204c-05fae75bcd74@kernel.org> <20191206152823.GA75339@kroah.com> <785c9534-1eb2-ea9b-8c9b-6713fdefdd01@kernel.org> <5e923897-6bc6-5756-1283-39e5ff1481b7@roeck-us.net> From: shuah Message-ID: <453edaee-3622-dcde-1f46-4bf3aceb8c6a@kernel.org> Date: Mon, 9 Dec 2019 17:52:34 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.1 MIME-Version: 1.0 In-Reply-To: <5e923897-6bc6-5756-1283-39e5ff1481b7@roeck-us.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit Sender: stable-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: stable@vger.kernel.org On 12/6/19 9:56 AM, Guenter Roeck wrote: > On 12/6/19 8:23 AM, shuah wrote: >> On 12/6/19 9:10 AM, Guenter Roeck wrote: >>> On 12/6/19 7:35 AM, shuah wrote: >>>> On 12/6/19 8:28 AM, Greg Kroah-Hartman wrote: >>>>> On Fri, Dec 06, 2019 at 08:24:36AM -0700, shuah wrote: >>>>>> On 12/4/19 10:53 AM, Greg Kroah-Hartman wrote: >>>>>>> This is the start of the stable review cycle for the 4.14.158 >>>>>>> release. >>>>>>> There are 209 patches in this series, all will be posted as a >>>>>>> response >>>>>>> to this one.  If anyone has any issues with these being applied, >>>>>>> please >>>>>>> let me know. >>>>>>> >>>>>>> Responses should be made by Fri, 06 Dec 2019 17:50:10 +0000. >>>>>>> Anything received after that time might be too late. >>>>>>> >>>>>>> The whole patch series can be found in one patch at: >>>>>>>     https://www.kernel.org/pub/linux/kernel/v4.x/stable-review/patch-4.14.158-rc1.gz >>>>>>> >>>>>>> or in the git tree and branch at: >>>>>>>     git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git >>>>>>> linux-4.14.y >>>>>>> and the diffstat can be found below. >>>>>>> >>>>>>> thanks, >>>>>>> >>>>>>> greg k-h >>>>>>> >>>>>> >>>>>> Starting with Linux 4.14.157, 4.9.204, and 4.4.204 stables stopped >>>>>> booting on my system. It can't find the root disk. No config changes >>>>>> in between. >>>>>> >>>>>> I have been bisecting 4.14 and 4.9 with no luck so far. I updated >>>>>> to Ubuntu 19.10 in between. >>>>>> >>>>>> The only other thing I see is CONFIG_GCC_VERSION which is supported >>>>>> starting 4.18. I don't this boot failing issue on 4.19 + up. I am >>>>>> also chasing any links between this config and scripts and tools >>>>>> that generate the initramfs. >>>>> >>>>> Did you also upgrade your version of gcc?  I know I build those older >>>>> kernels with the latest version of gcc for build tests, but I do not >>>>> boot them.  I think everyone who still uses them uses older >>>>> versions of >>>>> gcc. >>>> >>>> Yes. gcc version changed. That has been my strong suspect since I >>>> started poking around the CONFIG_GCC_VERSION. >>>> >>> >>> What version of gcc are you using ? I currently use gcc 8.3.0 for all >>> qemu boot tests (except for 3.16 which doesn't support it, or at least >>> it didn't when I last checked), and have not observed any problems. >>> >> >> With the upgrade gcc version went from 8.3.0 to 9.2.1 >> >> Interestingly enough all the older 4.14, 4.9, and 4.4 kernel I have >> on the system boot just fine. It fails when build newer rcs with new >> gcc, boot fails. >> >> I would really like to understand it just in case something in our >> kbuild scrips is the issue. >> > > v4.4.206 boots for me into qemu when compiled with gcc 9.2.0 (9.2.1 does > not > appear to be an official release). So at least it isn't that simple. Let me > know if I can test anything else. > Update on this. I managed to boot 4.14.158 by installing stripping modules INSTALL_MOD_STRIP=1. I also disabled KASAN. The above doesn't work on Linux 4.9.206 or Linux 4.4.206. Investigating still. thanks, -- Shuah