From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932625AbcHKNFJ (ORCPT ); Thu, 11 Aug 2016 09:05:09 -0400 Received: from mout.kundenserver.de ([212.227.126.130]:55636 "EHLO mout.kundenserver.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S932301AbcHKNFF (ORCPT ); Thu, 11 Aug 2016 09:05:05 -0400 From: Arnd Bergmann To: Nicholas Piggin Cc: linuxppc-dev@lists.ozlabs.org, Segher Boessenkool , Stephen Rothwell , "linux-kernel@vger.kernel.org" , "Luis R. Rodriguez" , linux-next@vger.kernel.org, Paul Mackerras , Fengguang Wu , Guenter Roeck , Alan Modra Subject: Re: powerpc allyesconfig / allmodconfig linux-next next-20160729 - next-20160729 build failures Date: Thu, 11 Aug 2016 15:04:00 +0200 Message-ID: <6327068.NbTmhQA6XD@wuerfel> User-Agent: KMail/5.1.3 (Linux/4.4.0-31-generic; KDE/5.18.0; x86_64; ; ) In-Reply-To: <20160811224320.52950a5c@roar.ozlabs.ibm.com> References: <6481373.xtk4H4bKaE@wuerfel> <20160811224320.52950a5c@roar.ozlabs.ibm.com> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Provags-ID: V03:K0:YmjZONpBT1YpDcOEj0HgrrK3TNCWvQBitwqBPQeE0pP/cLiAJke shpFyBRUeA/6SZnmkc7ezYkucCGa001535W20IJY1dRLnU4/Pg79A6J58wxbxDF5PnbLSae dyo/2PZvb3Yz3T7WLCnPETYvgAld281hcd+3IWRXp400wgUXK5oHafQ5KLRjyygfvq+XG3C QNS+S07yFK2ck0elaUzew== X-UI-Out-Filterresults: notjunk:1;V01:K0:oAn0nrNKH1A=:iQWioVjRZeHgbfFGPZ4lj4 my83/GTozX1h6+ADHME5xGGoJk9tOXYRB/NznS9BRy3vFWtTfkrMHFrwr7kIe4/3z3emfDSWX iQKmMAoVntOW3njKuxcXIvpfj7H3hAlgfrXSo17XeBAG3h4j0nrd9wJqefSK/BhniAANqKYii 32LuuUH/bFbupux6c08xmfQjl7d2ica/hYbfIXUc9Tjl4RU5/SJt53qHq4VHGr1/v+EqOlakc HY+LzLyk8zlgF6V0iBuQ9VNAK256LZGhgtyKUu87w+g4f62BAtfoike/PAhbG/hxQjeYUn5Iz m/MpFlrRR/PhF9fWXW1oaw/ZR7e5rxLcnDD0VshuyEF73CU1zX1sgAqGt9EbdLlj+e7oH4hyY 59ghnZ5P++bxCk9xPVCd+shP6hnd1TIWdMumFP6wP3JyXXpKjKLgAtsxilFc14SjO80To71i4 gzBId7mtNmSp9IP7Ux7gfSjhTNhzzAGVrVJetTjMbDPcCd3S3xh2aKPcMkS1bmpaXTk6ERiQL 2TsQ+btxNf7U0tddgypTxDSWPh1tpjDtulIfQedIm23ZRBFrbwH5McRrmsnCuD9y1eSh4fuZ7 OuEQAE4n7FnU2zaeOH7Ou3693BOLEo27+Iv3L6lkg2HhSpyCIfTBg7ucWXVp+annTrJ4Rh020 NHgDMlJIasGBx0S/ELZhB+UKuN4yuJnBtr3koD5LIjTY8hFMbaiNgvErXmzc0YwL2qon+hKon TzwAEjFmjKDNEvG6 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thursday, August 11, 2016 10:43:20 PM CEST Nicholas Piggin wrote: > On Wed, 03 Aug 2016 22:13:28 +0200 > Arnd Bergmann wrote: > > > On Wednesday, August 3, 2016 2:44:29 PM CEST Segher Boessenkool wrote: > > > Hi Arnd, > > > > > > On Wed, Aug 03, 2016 at 08:52:48PM +0200, Arnd Bergmann wrote: > > > > From my first look, it seems that all of lib/*.o is now getting linked > > > > into vmlinux, while we traditionally leave out everything from lib/ > > > > that is not referenced. > > > > > > > > I also see a noticeable overhead in link time, the numbers are for > > > > a cache-hot rebuild after a successful allyesconfig build, using a > > > > 24-way Opteron@2.5Ghz, just relinking vmlinux: > > > > > > > > $ time make skj30 vmlinux # before > > > > real 2m8.092s > > > > user 3m41.008s > > > > sys 0m48.172s > > > > > > > > $ time make skj30 vmlinux # after > > > > real 4m10.189s > > > > user 5m43.804s > > > > sys 0m52.988s > > > > > > Is it better when using rcT instead of rcsT? > > > > It seems to be noticeably better for the clean rebuild case, though > > not as good as the original: > > > > real 3m34.015s > > user 5m7.104s > > sys 0m49.172s > > > > I've also tried now with my own patch applied as well (linking > > each drivers/*/built-in.o into vmlinux rather than having them > > linked into drivers/built-in.o first), but that makes no > > difference. > > I just want to come back to this, because I've subbmitted the thin > archives kbuild patch, I wanted to make sure we're doing okay on > ARM/ARM64. I cross compiled with my laptop. > > For ARM64 allyesconfig: > > After building then removing all built-in.o then rebuilding vmlinux: > inclink > time make ARCH=arm64 CROSS_COMPILE=aarch64-linux-gnu- -j8 vmlinux > real 1m18.977s > user 2m14.512s > sys 0m29.704s > > thinarc > time make ARCH=arm64 CROSS_COMPILE=aarch64-linux-gnu- -j8 vmlinux > real 1m18.433s > user 2m6.128s > sys 0m28.372s > > > Final ld time > inclink > real 0m4.005s > user 0m3.464s > sys 0m0.536s > > thinarc > real 0m5.841s > user 0m4.916s > sys 0m0.916s > > > Build directory size is of course much better (3953MB vs 5519MB). Ok, looks great. Some downsides and some upsides here, but overall I think this is a win. > > For ARM, defconfig > > After building then removing all built-in.o then rebuilding vmlinux: > inclink > real 0m19.593s > user 0m22.372s > sys 0m6.428s > > thinarc > real 0m18.919s > user 0m21.924s > sys 0m6.400s > > > Final ld time > inclink > real 0m0.378s > user 0m0.304s > sys 0m0.076s > > thinarc > real 0m0.894s > user 0m0.684s > sys 0m0.200s This also still seems fine. > For both cases final link gets slower with thin archives. I guess there is some > per-file overhead but I thought with --whole-archive it should not be that much > slower. Still, overall time for main ar/ld phases comes out about the same in > the end so I don't think it's too much problem. Unless ARM blows up significantly > worse with a bigger config. Unfortunately I think it does. I haven't tried your latest series yet, but I think the total time for removing built-in.o and relinking went up from around 4 minutes (already way too much) to 18 minutes for me. > Linking with thin archives takes significantly more time in bfd hash lookup code. > I haven't dug much further yet. Can you try the ARM allyesconfig with thin archives? I'll follow up with two patches: one to get ARM to link without thin archives, and one that I used to get --gc-sections to work. Arnd