From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3E434CA9EA9 for ; Fri, 18 Oct 2019 14:54:45 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 16054222C3 for ; Fri, 18 Oct 2019 14:54:45 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 16054222C3 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:41384 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iLTeO-0004Ww-AZ for qemu-devel@archiver.kernel.org; Fri, 18 Oct 2019 10:54:44 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:36846) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iLTbc-00024E-8k for qemu-devel@nongnu.org; Fri, 18 Oct 2019 10:51:54 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iLTba-0003Fx-RQ for qemu-devel@nongnu.org; Fri, 18 Oct 2019 10:51:52 -0400 Received: from mx1.redhat.com ([209.132.183.28]:51532) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1iLTba-0003FB-HG for qemu-devel@nongnu.org; Fri, 18 Oct 2019 10:51:50 -0400 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 706AE3071D85; Fri, 18 Oct 2019 14:51:49 +0000 (UTC) Received: from localhost (ovpn-116-20.phx2.redhat.com [10.3.116.20]) by smtp.corp.redhat.com (Postfix) with ESMTP id 93C885DA8C; Fri, 18 Oct 2019 14:51:37 +0000 (UTC) Date: Fri, 18 Oct 2019 11:51:36 -0300 From: Eduardo Habkost To: Thomas Huth Subject: Re: Python 2 and test/vm/netbsd Message-ID: <20191018145136.GO4084@habkost.net> References: <20191016030021.GD4084@habkost.net> <20191016224124.GF4084@habkost.net> <20191017220541.GJ4084@habkost.net> <20191017225548.GL4084@habkost.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.47]); Fri, 18 Oct 2019 14:51:49 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 209.132.183.28 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Fam Zheng , Peter Maydell , Samuel Thibault , Philippe =?iso-8859-1?Q?Mathieu-Daud=E9?= , QEMU Developers , John Snow , Kamil Rytarowski , Gerd Hoffmann , Kevin Wolf , Cleber Rosa , =?iso-8859-1?Q?Marc-Andr=E9?= Lureau , Alex =?iso-8859-1?Q?Benn=E9e?= Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On Fri, Oct 18, 2019 at 09:13:24AM +0200, Thomas Huth wrote: > On 18/10/2019 00.55, Eduardo Habkost wrote: > > On Thu, Oct 17, 2019 at 07:05:41PM -0300, Eduardo Habkost wrote: > >> On Wed, Oct 16, 2019 at 07:41:24PM -0300, Eduardo Habkost wrote: > >>> On Wed, Oct 16, 2019 at 08:11:57AM +0200, Thomas Huth wrote: > >>>> On 16/10/2019 05.00, Eduardo Habkost wrote: > >>>>> On Tue, Sep 17, 2019 at 08:31:40PM -0300, Eduardo Habkost wrote: > >>>>>> On Mon, Jul 01, 2019 at 07:25:27PM -0300, Eduardo Habkost wrote: > >>>>>>> On Mon, Jun 10, 2019 at 01:58:50PM +0100, Peter Maydell wrote: > >>>>> [...] > >>>>>>>> The configure check also spits out deprecation warnings for > >>>>>>>> the NetBSD/FreeBSD/OpenBSD tests/vm configurations. It would be nice > >>>>>>>> to get those updated. > >>>>>>> > >>>>>>> CCing the test/vm maintainers. > >>>>>>> > >>>>>>> Fam, Alex, are you able to fix this and create new BSD VM images > >>>>>>> with Python 3 available? I thought the VM image configurations > >>>>>>> were stored in the source tree, but they are downloaded from > >>>>>>> download.patchew.org. > >>>>>> > >>>>>> Fam, Alex, can you help us on this? Python 2 won't be supported > >>>>>> anymore, so we need the VM images to be updated. > >>>>> > >>>>> Anyone? > >>>>> > >>>>> I'm about to submit patches to remove Python 2 support, and this > >>>>> will break tests/vm/netbsd. > >>>>> > >>>>> I'm powerless to fix this issue, because the netbsd image is > >>>>> hosted at download.patchew.org. > >>>> > >>>> Gerd had a patch to convert the netbsd VM script to ad hoc image > >>>> creation, too: > >>>> > >>>> https://lists.gnu.org/archive/html/qemu-devel/2019-05/msg04459.html > >>>> > >>>> But there was a regression with the serial port between QEMU v3.0 and > >>>> v4.x, so it was not included: > >>>> > >>>> https://lists.gnu.org/archive/html/qemu-devel/2019-05/msg06784.html > >>> > >>> The URL above has this error: > >>> > >>> con recv: x: Exitqqqqqqqqqqqqqqqqqqqqqqqqqj > >>> con recv: To be able to use the network, we need answers to the > >>> following:Network media type > >>> con send: > >>> con recv: : qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqk Perform autoconfiguration? > >>> >a: Yes b: Noqqqqqqqqqqqqqqqqq > >>> console: *** read timeout *** > >>> console: waiting for: 'a: Yes' > >>> console: line buffer: > >>> > >>> con recv: qqqqqqqqqqqqqqj > >>> > >>> I believe that problem was solved in v4, because v4 was reading > >>> the serial output 1 byte at a time. > >>> > >>> The issue that caused the netbsd patch to be dropped was: > >>> https://lore.kernel.org/qemu-devel/CAFEAcA8k9QJA9iE-kwiaPhr0fY_2zG7JRX5uV4AaSSjXCSs4+A@mail.gmail.com/ > >>> > >>> Possibly this is the same issue we saw at: > >>> https://lore.kernel.org/qemu-devel/20190607034214.GB22416@habkost.net/ > >>> > >>> The test script must either close the console socket, or keep > >>> reading from it. Otherwise, the QEMU VCPU threads might get > >>> stuck waiting for the chardev to be writeable. > >> > >> It doesn't seem to be the same issue. Even if the console socket is closed, > >> I'm seeing results similar to the ones reported by Peter (the "pkgin -y > >> install" step is unreasonably slow). > >> > >> Running with V=1, I see packages being downloaded at reasonable speeds, but > >> there's a huge interval (of various minutes) between each package download. > > > > I've found the cause for the slowness I'm seeing: for each file > > being downloaded, the guest spents at least 75 seconds trying to > > connect to the IPv6 address of ftp.NetBSD.org, before trying > > IPv4. I don't know if this is a NetBSD bug, or a slirp bug. > > Does it work better if you turn IPv6 off? E.g.: > > diff --git a/tests/vm/basevm.py b/tests/vm/basevm.py > --- a/tests/vm/basevm.py > +++ b/tests/vm/basevm.py > @@ -81,7 +81,7 @@ class BaseVM(object): > self._args = [ \ > "-nodefaults", "-m", "4G", > "-cpu", "max", > - "-netdev", "user,id=vnet,hostfwd=:127.0.0.1:0-:22", > + "-netdev", "user,id=vnet,hostfwd=:127.0.0.1:0-:22,ipv6=off", > "-device", "virtio-net-pci,netdev=vnet", > "-vnc", "127.0.0.1:0,to=20"] > if vcpus and vcpus > 1: Yes, it is much better. Thanks! I will send a series disabling ipv6 in tests/vm/netbsd as a workaround. -- Eduardo