[Qemu-devel] [Bug 1838658] [NEW] qemu 4.0.0 broken by glib update

[Qemu-devel] [Bug 1838658] [NEW] qemu 4.0.0 broken by glib update

[Patrick Welche]

Public bug reported:

In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
```
 git checkout -f 2.60.4
 git revert --no-edit 86c6f7e2b..3bed8a13b
 git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
 git revert --no-edit 603fb5958..d3074a748
 git revert --no-edit 0b45ddc55..0600dd322
```
When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

For the full saga, see: http://gnats.netbsd.org/54310

** Affects: qemu
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  New

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

Re: [Qemu-devel] [Bug 1838658] [NEW] qemu 4.0.0 broken by glib update

[Markus Armbruster]

Patrick Welche <prlw1@cam.ac.uk> writes:

> Public bug reported:
>
> In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
> ```
>  git checkout -f 2.60.4
>  git revert --no-edit 86c6f7e2b..3bed8a13b
>  git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
>  git revert --no-edit 603fb5958..d3074a748
>  git revert --no-edit 0b45ddc55..0600dd322
> ```
> When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.
>
> For the full saga, see: http://gnats.netbsd.org/54310

Please quote the preemptive note in full.  I wasted several minutes
looking for it in the supposedly full saga, and in GLib git.  I still
have absolutely no clue what QEMU is doing wrong.

If I read the saga's "Subject: PR/54310 CVS commit: pkgsrc/devel/glib2"
part correctly, the GHashTable improvements have been or are being
removed.  Correct?

[Qemu-devel] [Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Daniel Berrange]

Fedora 30 has been shipping glib2 2.60.0 through to 2.60.5 and QEMU in
general has been working normally AFAICT.

>From the netbsd bug report it looks like the reproducer was demoed using
the sparc emulator - is that the only QEMU arch that is affected ?

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  New

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

[Qemu-devel] [Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Daniel Berrange]

The test image that the netbsd bug points to no longer exists.

If I pick the image currently available:

  http://nycdn.netbsd.org/pub/NetBSD-
daily/HEAD/latest/images/NetBSD-9.99.2-sparc.iso

And launch it in a QEMU built from today's GIT master, on Fedora 30 with
glib2 2.60.5, NetBSD successfully boots and launches the installer...


$ ~/usr/qemu-git/bin/qemu-system-sparc -drive file=NetBSD-9.99.2-sparc.img,format=raw,media=disk,snapshot=off  -cdrom  /var/lib/libvirt/images/NetBSD-9.99.2-sparc.iso -boot d -nographic
Configuration device id QEMU version 1 machine id 32
Probing SBus slot 0 offset 0
Probing SBus slot 1 offset 0
Probing SBus slot 2 offset 0
Probing SBus slot 3 offset 0
Probing SBus slot 4 offset 0
Probing SBus slot 5 offset 0
Invalid FCode start byte
CPUs: 1 x FMI,MB86904
UUID: 00000000-0000-0000-0000-000000000000
Welcome to OpenBIOS v1.1 built on Jul 1 2019 17:08
  Type 'help' for detailed information
Trying cdrom:d...
Not a bootable ELF image
Loading a.out image...
Loaded 65536 bytes
entry point is 0x4000
bootpath: /iommu@0,10000000/sbus@0,10001000/espdma@5,8400000/esp@5,8800000/sd@2,0:d
switching to new context:
>> NetBSD/sparc Secondary Boot, Revision 1.15 (Thu Aug  1 22:23:16 UTC 2019)
Booting netbsd
3375564+96668=0x34ffe0
OBP version 3, revision 2.25 (plugin rev 2)
[   1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
[   1.0000000]     2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017,
[   1.0000000]     2018, 2019 The NetBSD Foundation, Inc.  All rights reserved.
[   1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[   1.0000000]     The Regents of the University of California.  All rights reserved.

[   1.0000000] NetBSD 9.99.2 (INSTALL) #0: Thu Aug  1 22:23:16 UTC 2019
[   1.0000000] 	mkrepro@mkrepro.NetBSD.org:/usr/src/sys/arch/sparc/compile/INSTALL
[   1.0000000] total memory = 111 MB
[   1.0000000] avail memory = 106 MB
[   1.0000000] bootpath: /iommu@0,10000000/sbus@0,10001000/espdma@5,8400000/esp@5,8800000/sd@2,0:d
[   1.0000000] mainbus0 (root): SUNW,SPARCstation-5: hostid 80123456
[   1.0000000] cpu0 at mainbus0: FMI,MB86904 @ 170 MHz, MB86910 or WTL1164/5 FPU
[   1.0000000] cpu0: 16K instruction (32 b/l), 8K data (16 b/l), 512K external (32 b/l): cache enabled
[   1.0000000] obio0 at mainbus0
[   1.0000000] clock0 at obio0 slot 0 offset 0x200000: mk48t08
[   1.0000000] timer0 at obio0 slot 0 offset 0xd00000: delay constant 201, frequency = 2000000 Hz
[   1.0000050] zs0 at obio0 slot 0 offset 0x100000 level 12 softpri 6
[   1.0000050] zstty0 at zs0 channel 0 (console i/o)
[   1.0000050] zstty1 at zs0 channel 1
[   1.0000050] zs1 at obio0 slot 0 offset 0x0 level 12 softpri 6
[   1.0000050] zstty2 at zs1 channel 0
[   1.0000050] kbd0 at zstty2
[   1.0000050] zstty3 at zs1 channel 1
[   1.0000050] ms0 at zstty3
[   1.0000050] wsmouse0 at ms0 mux 0
[   1.0000050] fdc0 at obio0 slot 0 offset 0x400000 level 11 softpri 4: chip 82077
[   1.0000050] fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
[   1.0000050] auxreg0 at obio0 slot 0 offset 0x900000
[   1.0000050] power0 at obio0 slot 0 offset 0x910000 level 2
[   1.0000050] slavioconfig at obio0 slot 0 offset 0x800000 not configured
[   1.0000050] iommu0 at mainbus0 addr 0x10000000: version 0x5/0x0, page-size 4096, range 64MB
[   1.0000050] sbus0 at iommu0: clock = 21.250 MHz
[   1.0000050] dma0 at sbus0 slot 5 offset 0x8400000: DMA rev 2
[   1.0000050] esp0 at dma0 slot 5 offset 0x8800000 level 4: ESP200, 40MHz, SCSI ID 7
[   1.0000050] scsibus0 at esp0: 8 targets, 8 luns per target
[   1.0000050] ledma0 at sbus0 slot 5 offset 0x8400010: DMA rev 2
[   1.0000050] le0 at ledma0 slot 5 offset 0x8c00000 level 6: address 52:54:00:12:34:56
[   1.0000050] le0: 8 receive buffers, 2 transmit buffers
[   1.0000050] tcx0 at sbus0 slot 3 offset 0x800000 level 5 (ipl 9) (8-bit only TCX)
[   1.0000050] tcx0: SUNW,tcx, 1024 x 768
[   1.0000050] tcx0: id 0, rev 0, sense 0
[   1.0000050] tcx0: attached to /dev/fb0
[   1.0000050] wsdisplay1 at tcx0 kbdmux 1
[   1.0000050] SUNW,CS4231 at sbus0 slot 4 offset 0xc000000 level 5 (ipl 9) not configured
[   1.0000050] power-management at sbus0 slot 4 offset 0xa000000 not configured
[   1.0000050] scsibus0: waiting 2 seconds for devices to settle...
[   1.0000050] wskbd0 at kbd0 mux 1
[   3.4705415] sd0 at scsibus0 target 0 lun 0: <QEMU, QEMU HARDDISK, 2.5+> disk fixed
[   3.4805320] sd0: 2048 MB, 4161 cyl, 16 head, 63 sec, 512 bytes/sect x 4194304 sectors
[   3.4805320] cd0 at scsibus0 target 2 lun 0: <QEMU, QEMU CD-ROM, 2.5+> cdrom removable
[   4.4805570] kbd0: reset failed
[   4.5705505] root on md0a dumps on md0b
[   4.5805965] root file system type: ffs
[   4.5805965] kern.module.path=/stand/sparc/9.99.2/modules
Welcome to the NetBSD/sparc microroot setup utility.

We've just completed the first stage of a two-stage procedure to load a
fully functional NetBSD installation environment on your machine.  In the
second stage which is to follow now, a set of additional installation
utilities must be load from your NetBSD/sparc installation medium.

This procedure supports one of the following media:

1) cdrom
2) tape
3) floppy

Installation medium to load the additional utilities from:


Can you confirm that you can still reproduce the original problem using QEMU git master, and latest NetBSD ISO image.

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  New

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

[Qemu-devel] [Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Andreas Gustafsson]

> From the netbsd bug report it looks like the reproducer was demoed
> using the sparc emulator - is that the only QEMU arch that is affected ?

Only one arch is affected, but it's sparc64, not sparc.

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  New

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

[Qemu-devel] [Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Andreas Gustafsson]

> The test image that the netbsd bug points to no longer exists.

Please try this one instead:

  https://www.gson.org/bugs/qemu/NetBSD-8.99.47-sparc64.iso

I just verified that this image works for reproducing the bug.

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  New

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

[Qemu-devel] [Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Daniel Berrange]

Doh,  sorry for my comment earlier where I mistakenly used sparc instead
of sparc64.

I've now tested QEMU git master with that sparc64 ISO and qemu-system-
sparc64.

I still can't reproduce it though - it boots past the disk probing, and
into the installer, where it asks for the terminal type.

So looks like there's some further variable involved beyond just the
glib update - perhaps something about the host OS is combining with the
glib update to trigger it.

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  New

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

[Qemu-devel] [Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Andreas Gustafsson]

> \x10So looks like there's some further variable involved beyond just the 
> glib update - perhaps something about the host OS is combining with
> the glib update to trigger it.

Agreed - I just retested using a Fedora 30 instance on EC2, with
glib2-2.60.1-2.fc30.x86_64, and was also unable to reproduce the
issue there.

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  New

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

[Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Peter Maydell]

The linked NetBSD bug report http://gnats.netbsd.org/54310 now has
confirmation that this crash was the result of a memory corruption bug
in QEMU which happened to manifest with the newer glib version. That bug
is fixed in QEMU master in commit ef905eff421c5a06a01 which will be in
the 5.2 release, so we can mark this as 'fix committed'.


** Changed in: qemu
       Status: New => Fix Committed

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  Fix Committed

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions

[Bug 1838658] Re: qemu 4.0.0 broken by glib update

[Thomas Huth]

Released with QEMU v5.2.0.

** Changed in: qemu
       Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1838658

Title:
  qemu 4.0.0 broken by glib update

Status in QEMU:
  Fix Released

Bug description:
  In brief, an install CD will successfully boot with qemu 4.0.0 built with glib 2.58.3, but freeze during boot with qemu 4.0.0 built with glib 2.60.0. I tracked it down to glib's GHashTable improvements. qemu is happy with a glib built from
  ```
   git checkout -f 2.60.4
   git revert --no-edit 86c6f7e2b..3bed8a13b
   git revert --no-edit 75f8ec1df9b48b0c3a13a9125f2c7d7c5adf5159
   git revert --no-edit 603fb5958..d3074a748
   git revert --no-edit 0b45ddc55..0600dd322
  ```
  When the GHashTable improvements were committed, there was already a preemptive note about any breakage being due to using private implementation details, hence mentioning it here rather than with glib.

  For the full saga, see: http://gnats.netbsd.org/54310

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1838658/+subscriptions