From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-10.2 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6FF30C64E7C for ; Wed, 2 Dec 2020 14:26:03 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id C14DC21D7F for ; Wed, 2 Dec 2020 14:26:02 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C14DC21D7F Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=suse.de Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:58616 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kkT4z-0004AF-Hs for qemu-devel@archiver.kernel.org; Wed, 02 Dec 2020 09:26:01 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:33410) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kkT3X-0003Zk-85 for qemu-devel@nongnu.org; Wed, 02 Dec 2020 09:24:32 -0500 Received: from mx2.suse.de ([195.135.220.15]:42996) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kkT3V-0003OE-2O for qemu-devel@nongnu.org; Wed, 02 Dec 2020 09:24:30 -0500 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 0A916AB7F; Wed, 2 Dec 2020 14:24:27 +0000 (UTC) Subject: Re: check-tcg errors (build-user, build-user-plugins) again To: =?UTF-8?Q?Alex_Benn=c3=a9e?= References: <87v9dksbkb.fsf@linaro.org> <87pn3ss73p.fsf@linaro.org> From: Claudio Fontana Message-ID: Date: Wed, 2 Dec 2020 15:24:26 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <87pn3ss73p.fsf@linaro.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=195.135.220.15; envelope-from=cfontana@suse.de; helo=mx2.suse.de X-Spam_score_int: -41 X-Spam_score: -4.2 X-Spam_bar: ---- X-Spam_report: (-4.2 / 5.0 requ) BAYES_00=-1.9, NICE_REPLY_A=-0.001, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?UTF-8?Q?Marc-Andr=c3=a9_Lureau?= , =?UTF-8?Q?Philippe_Mathieu-Daud=c3=a9?= , qemu-devel Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On 12/2/20 1:52 PM, Alex Bennée wrote: > > Claudio Fontana writes: > >> On 12/2/20 12:16 PM, Alex Bennée wrote: >>> >>> Claudio Fontana writes: >>> >>>> Hi Alex and all, >>>> >>>> when trying to use check-tcg (master), I am getting often these errors: >>>> >>>> $ ../configure --disable-system --disable-tools >>>> >>>> $ make -j12 check-tcg >>>> >>>> ERRO[0000] cannot find mappings for user claudio: No subgid ranges found for group "claudio" in /etc/subgid >>>> ERRO[0000] cannot find mappings for user claudio: No subgid ranges found for group "claudio" in /etc/subgid >>>> ERRO[0000] cannot find mappings for user claudio: No subgid ranges found for group "claudio" in /etc/subgid >>>> Trying to pull registry.gitlab.com/qemu-project/qemu/qemu/debian11... >>>> Trying to pull registry.gitlab.com/qemu-project/qemu/qemu/fedora-cris-cross... >>>> Trying to pull registry.gitlab.com/qemu-project/qemu/qemu/debian10... >>>> ERRO[0000] cannot find mappings for user claudio: No subgid ranges found for group "claudio" in /etc/subgid >>>> >>>> [...] >>>> TEST linux-test on x86_64 >>>> timeout: failed to run command ‘/home/claudio/git/qemu/build/qemu-x86_64’timeout: : No such file or directoryfailed to run command ‘/home/claudio/git/qemu/build/qemu-x86_64’ >>>> >>>> [...] >>>> >>>> >>>> Is there some pre-configuration on the host necessary to be able to >>>> run check-tcg? >>> >>> There shouldn't be but those errors remind me of some of the tweaks I >>> had to make to me Gentoo system when using podman (instead of docker). >>> In the end I think I just ended up adding the lines: >>> >>> alex:100000:65536 >>> >>> to /etc/subgid and /etc/subgid- >>> >>> Marc-André may have some better pointers as he added podman support to >>> the builder scripts. >> >> >> I did that and things seem a bit better, but still a lot of errors: >> >> >> 63 ../sysdeps/x86_64/start.S: No such file or directory. >> >> Error: error creating build container: The following failures happened while trying to pull image specified by "debian:bullseye-slim" based on search registries in /etc/containers/registries.conf: >> * "localhost/debian:bullseye-slim": Error initializing source docker://localhost/debian:bullseye-slim: error pinging docker registry localhost: Get https://localhost/v2/: dial tcp [::1]:443: connect: connection refused >> * "docker.io/library/debian:bullseye-slim": Error committing the finished image: error adding layer with blob "sha256:ae63fcbbc3b289e425e4c8840ccde4314f4a060cbc0345e6871a28bdc72f6fe8": Error processing tar file(exit status 1): there might not be enough IDs available in the namespace (requested 0:42 for /etc/gshadow): lchown /etc/gshadow: invalid argument >> Traceback (most recent call last): >> File "/home/claudio/git/qemu-pristine/qemu/tests/docker/docker.py", line 709, in >> sys.exit(main()) >> File "/home/claudio/git/qemu-pristine/qemu/tests/docker/docker.py", line 705, in main >> return args.cmdobj.run(args, argv) >> File "/home/claudio/git/qemu-pristine/qemu/tests/docker/docker.py", line 501, in run >> extra_files_cksum=cksum) >> File "/home/claudio/git/qemu-pristine/qemu/tests/docker/docker.py", line 354, in build_image >> quiet=quiet) >> File "/home/claudio/git/qemu-pristine/qemu/tests/docker/docker.py", line 244, in _do_check >> return subprocess.check_call(self._command + cmd, **kwargs) >> File "/usr/lib64/python3.6/subprocess.py", line 311, in check_call >> raise CalledProcessError(retcode, cmd) >> >> >> [...] >> Error: error pulling image "registry.gitlab.com/qemu-project/qemu/qemu/fedora-cris-cross": unable to pull registry.gitlab.com/qemu-project/ >> > > I'm guessing this can be fixed by adding gitlab to /etc/containers/registries.conf Hi Alex, I added: [registries.search] registries = ["docker.io", "registry.gitlab.com"] I get: Storing signatures Error processing tar file(exit status 1): there might not be enough IDs available in the namespace (requested 0:42 for /etc/gshadow): lchown /etc/gshadow: invalid argument Error: error pulling image "registry.gitlab.com/qemu-project/qemu/qemu/debian11": unable to pull registry.gitlab.com/qemu-project/qemu/qemu/debian11: unable to pull image: Error committing the finished image: error adding layer with blob "sha256:ae63fcbbc3b289e425e4c8840ccde4314f4a060cbc0345e6871a28bdc72f6fe8": Error processing tar file(exit status 1): there might not be enough IDs available in the namespace (requested 0:42 for /etc/gshadow): lchown /etc/gshadow: invalid argument Any idea? > > I'll see if I can resurrect my podman setup because it was working before > we added the caching from gitlab. > >> [...] >> >> >> >>> >>> The main difference between the images on the registry and the local >>> versions is most add the current user so there is a clean mapping >>> between the container user and the host file-system. It's the last step >>> of the build so we still use the cached layers from the registry >>> versions. >>> >>>> I see these errors in gitlab also for >>>> >>>> build-user >>>> build-user-plugin >>>> >>>> Maybe this is what Philippe mentioned before though, that this is >>>> expected at the moment due to a temporary Meson shortcoming? >>> >>> That is odd - I'm not seeing anything like that on the master builds: >>> >>> https://gitlab.com/qemu-project/qemu/-/jobs/883985106 >>> https://gitlab.com/qemu-project/qemu/-/jobs/883985113 >>> >>> AFAIK GitLab is still using Docker to build it's containers (albeit with >>> BUILDKIT enabled). >> >> >> I am running again on gitlab the master branch, maybe there is something I need to fix, but to do that I need to enable check-tcg successfully I think. >> >> Thanks! >> >> Claudio >> >>> >>>> >>>> Ciao, >>>> >>>> Claudio >>> >>> > >