Re: need help with my config

Re: need help with my config

[Philippe Mathieu-Daudé]

Cc'ing qemu-ppc@

On 7/30/21 6:25 AM, Lindsay Ryan wrote:
> Hi
> I'm trying to emulate some physical IBM Power 9's that we have. There
> seems to be plenty of examples of using x86_64 qemu, but slightly less
> for Power. Unless it's specifically for installing AIX
> Anyway, I'm trying to boot the VM as I guess a bare metal Power 9 box,
> then install redhat from Iso on a disk and have it on the network.
> 
> ./qemu-system-ppc64 -cpu POWER9 -smp cpus=4 -machine pseries -m 4096 -M
> accel=tcg  -serial stdio -nodefaults -nographic -device
> megasas,id=scsi0,bus=pci.0,addr=0x5 -drive
> file=/home/hdisk1.qcow2,if=none,id=drive-scsi0-0-0-0,format=qcow2,cache=none
> -device
> scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=2
> -cdrom /mnt/images/rhel-8.4-ppc64le-boot.iso -monitor
> telnet:0.0.0.0:3344,server,nowait -netdev
> bridge,id=net0,helper=qemu-bridge-helper,br=bridge0,id=hostnet0
> 
> So the megasas gets detected as a raid controller. Yay. 
> But my qcow2 disk image doesn't seem to be plugged into it correctly as
> it's not detected. 
> It sees the cdrom image and I can boot from it.
> The other thing I can't get working is the network card. 
> 
> On this host system I have some other x86 kvm's running. So Ideally if I
> could plug the nic on this vm into 
> 7: virbr0
> 
> 6: bridge0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
> state UP group default qlen 1000
>     link/ether 00:25:b5:04:2a:1e brd ff:ff:ff:ff:ff:ff
>     inet 10.126.24.82/24 brd 10.126.24.255 scope global noprefixroute
> bridge0
>        valid_lft forever preferred_lft forever
>     inet6 fe80::76a8:89ec:fc62:9c94/64 scope link noprefixroute
>        valid_lft forever preferred_lft forever
> 7: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
> state UP group default qlen 1000
>     link/ether 52:54:00:51:db:be brd ff:ff:ff:ff:ff:ff
>     inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
>        valid_lft forever preferred_lft forever
> 
> If I can't do that, then I really only need the ppc64 guest to have
> access out to the internet and I can nat anything incoming
> 
> Any help, particularly about how to plug virtual disk drives into
> virtual disk controllers would be helpful
> regards
> 
> 
> Ryan Lindsay BEng, MSc.
> Linux Storage Administrator
> Research Computing Facility
> 
> 
> *Disclaimer: *This email (including any attachments or links) may
> contain confidential and/or legally privileged information and is
> intended only to be read or used by the addressee. If you are not the
> intended addressee, any use, distribution, disclosure or copying of this
> email is strictly prohibited. Confidentiality and legal privilege
> attached to this email (including any attachments) are not waived or
> lost by reason of its mistaken delivery to you. If you have received
> this email in error, please delete it and notify us immediately by
> telephone or email. Peter MacCallum Cancer Centre provides no guarantee
> that this transmission is free of virus or that it has not been
> intercepted or altered and will not be liable for any delay in its receipt.
> 

Re: need help with my config

[Klaus Kiwi]

[-- Attachment #1: Type: text/plain, Size: 3629 bytes --]

Just making sure Cedric is also seeing this...

 -Klaus

On Fri, Jul 30, 2021 at 10:27 AM Philippe Mathieu-Daudé <philmd@redhat.com>
wrote:

> Cc'ing qemu-ppc@
>
> On 7/30/21 6:25 AM, Lindsay Ryan wrote:
> > Hi
> > I'm trying to emulate some physical IBM Power 9's that we have. There
> > seems to be plenty of examples of using x86_64 qemu, but slightly less
> > for Power. Unless it's specifically for installing AIX
> > Anyway, I'm trying to boot the VM as I guess a bare metal Power 9 box,
> > then install redhat from Iso on a disk and have it on the network.
> >
> > ./qemu-system-ppc64 -cpu POWER9 -smp cpus=4 -machine pseries -m 4096 -M
> > accel=tcg  -serial stdio -nodefaults -nographic -device
> > megasas,id=scsi0,bus=pci.0,addr=0x5 -drive
> >
> file=/home/hdisk1.qcow2,if=none,id=drive-scsi0-0-0-0,format=qcow2,cache=none
> > -device
> >
> scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=2
> > -cdrom /mnt/images/rhel-8.4-ppc64le-boot.iso -monitor
> > telnet:0.0.0.0:3344,server,nowait -netdev
> > bridge,id=net0,helper=qemu-bridge-helper,br=bridge0,id=hostnet0
> >
> > So the megasas gets detected as a raid controller. Yay.
> > But my qcow2 disk image doesn't seem to be plugged into it correctly as
> > it's not detected.
> > It sees the cdrom image and I can boot from it.
> > The other thing I can't get working is the network card.
> >
> > On this host system I have some other x86 kvm's running. So Ideally if I
> > could plug the nic on this vm into
> > 7: virbr0
> >
> > 6: bridge0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
> > state UP group default qlen 1000
> >     link/ether 00:25:b5:04:2a:1e brd ff:ff:ff:ff:ff:ff
> >     inet 10.126.24.82/24 brd 10.126.24.255 scope global noprefixroute
> > bridge0
> >        valid_lft forever preferred_lft forever
> >     inet6 fe80::76a8:89ec:fc62:9c94/64 scope link noprefixroute
> >        valid_lft forever preferred_lft forever
> > 7: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
> > state UP group default qlen 1000
> >     link/ether 52:54:00:51:db:be brd ff:ff:ff:ff:ff:ff
> >     inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
> >        valid_lft forever preferred_lft forever
> >
> > If I can't do that, then I really only need the ppc64 guest to have
> > access out to the internet and I can nat anything incoming
> >
> > Any help, particularly about how to plug virtual disk drives into
> > virtual disk controllers would be helpful
> > regards
> >
> >
> > Ryan Lindsay BEng, MSc.
> > Linux Storage Administrator
> > Research Computing Facility
> >
> >
> > *Disclaimer: *This email (including any attachments or links) may
> > contain confidential and/or legally privileged information and is
> > intended only to be read or used by the addressee. If you are not the
> > intended addressee, any use, distribution, disclosure or copying of this
> > email is strictly prohibited. Confidentiality and legal privilege
> > attached to this email (including any attachments) are not waived or
> > lost by reason of its mistaken delivery to you. If you have received
> > this email in error, please delete it and notify us immediately by
> > telephone or email. Peter MacCallum Cancer Centre provides no guarantee
> > that this transmission is free of virus or that it has not been
> > intercepted or altered and will not be liable for any delay in its
> receipt.
> >
>
>
>

-- 
Klaus Heinrich Kiwi <kkiwi@redhat.com>
Manager, Software Engineering - Red Hat Virtualization

[-- Attachment #2: Type: text/html, Size: 4722 bytes --]

Re: need help with my config

[Cédric Le Goater]

Hello,

On 7/30/21 3:25 PM, Philippe Mathieu-Daudé wrote:
> Cc'ing qemu-ppc@
> 
> On 7/30/21 6:25 AM, Lindsay Ryan wrote:
>> Hi
>> I'm trying to emulate some physical IBM Power 9's that we have. There
>> seems to be plenty of examples of using x86_64 qemu, but slightly less
>> for Power. 

For baremetal emulation, please use the PowerNV machine. See this page : 

  https://qemu.readthedocs.io/en/latest/system/ppc/powernv.html

HW is not fully emulated but QEMU has enough support to start a multichip
system running any distro.  

>> Unless it's specifically for installing AIX

AIX only runs under the pseries machine (virtualized) and not on baremetal. 

>> Anyway, I'm trying to boot the VM as I guess a bare metal Power 9 box,
>> then install redhat from Iso on a disk and have it on the network.
>>
>> ./qemu-system-ppc64 -cpu POWER9 -smp cpus=4 -machine pseries -m 4096 -M
>> accel=tcg  -serial stdio -nodefaults -nographic -device
>> megasas,id=scsi0,bus=pci.0,addr=0x5 -drive
>> file=/home/hdisk1.qcow2,if=none,id=drive-scsi0-0-0-0,format=qcow2,cache=none
>> -device
>> scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=2
>> -cdrom /mnt/images/rhel-8.4-ppc64le-boot.iso -monitor
>> telnet:0.0.0.0:3344,server,nowait -netdev
>> bridge,id=net0,helper=qemu-bridge-helper,br=bridge0,id=hostnet0

This is a pseries machine (virtualized) and not baremetal.

Which machine do you want to run ? pseries is the VM platform as run by KVM, 
It can run under TCG also. PowerNV is the baremetal platform on which KVM 
runs using the OPAL firmware. QEMU only has a PowerNV emulator, so TCG. 

These are two very different PPC machines.

>> So the megasas gets detected as a raid controller. Yay. 
>> But my qcow2 disk image doesn't seem to be plugged into it correctly as
>> it's not detected. 
>> It sees the cdrom image and I can boot from it.
>> The other thing I can't get working is the network card. 

because you don't have any :) Add a device and link it to the netdev.


That's how I run a TCG pseries POWER9 machine on my x86 laptop:

qemu-system-ppc64 -M pseries,cap-cfpc=workaround,cap-sbbc=workaround,cap-ibs=workaround,cap-ccf-assist=on,ic-mode=dual -m 4G -accel tcg,thread=multi -cpu POWER9 -smp 4,cores=4,maxcpus=8,threads=1 -device virtio-net-pci,netdev=net0,mac=C0:FF:EE:00:00:02,bus=pci.0,addr=0x2 -netdev tap,id=net0,helper=/usr/libexec/qemu-bridge-helper,br=virbr0,vhost=on -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x1 -drive file=./ubuntu-ppc64le.qcow2,if=none,id=drive-scsi0-0-0-0,format=qcow2,cache=none -device scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=1 -device qemu-xhci,id=usb,bus=pci.0,addr=0x4 -nographic -nodefaults -serial mon:stdio    

and a PowerNV POWER9 machine :

qemu-system-ppc64 -m 4G -machine powernv9 -smp 2 -accel tcg,thread=multi -kernel ./open-power/images/witherspoon-latest/zImage.epapr -initrd ./open-power/images/witherspoon-latest/rootfs.cpio.xz -bios ./open-power/images/witherspoon-latest/skiboot.lid -device pcie-pci-bridge,id=bridge1,bus=pcie.1,addr=0x0 -device ich9-ahci,id=sata0,bus=pcie.0,addr=0x0 -drive file=./ubuntu-ppc64le-powernv.qcow2,if=none,id=drive0,format=qcow2,cache=none -device ide-hd,bus=sata0.0,unit=0,drive=drive0,id=ide,bootindex=1 -device e1000e,netdev=net0,mac=C0:FF:EE:00:01:03,bus=bridge1,addr=0x3 -netdev bridge,helper=/usr/libexec/qemu-bridge-helper,br=virbr0,id=net0 -device nec-usb-xhci,bus=bridge1,addr=0x2 -device usb-storage,drive=usbkey -drive file=./usb.img,if=none,id=usbkey,format=raw,cache=none -serial mon:stdio -nographic

You will need firmware images for the latter.


Cheers,
C.

Re: need help with my config

[Lindsay Ryan]

[-- Attachment #1: Type: text/plain, Size: 5353 bytes --]

Hi Cedric,
Thanks for replying.
I think I want to go down the PowerNV Power 9
Which I will need the OpenPower firmware.
Looks like the webpage for downloading prebuild witherspoon and skiboot is down/dead. Hasn't been working for me for 24hours anyway
Is that the only place to download that firmware?

regards


Ryan Lindsay BEng, MSc.
Linux Storage Administrator
Research Computing Facility

________________________________
From: Cédric Le Goater <clg@kaod.org>
Sent: Saturday, 31 July 2021 2:50 AM
To: Philippe Mathieu-Daudé <philmd@redhat.com>; Lindsay Ryan <Ryan.Lindsay@petermac.org>; qemu-discuss@nongnu.org <qemu-discuss@nongnu.org>
Cc: qemu-ppc <qemu-ppc@nongnu.org>; qemu-devel <qemu-devel@nongnu.org>
Subject: Re: need help with my config

! EXTERNAL EMAIL: Think before you click. If suspicious send to CyberReport@petermac.org

Hello,

On 7/30/21 3:25 PM, Philippe Mathieu-Daudé wrote:
> Cc'ing qemu-ppc@
>
> On 7/30/21 6:25 AM, Lindsay Ryan wrote:
>> Hi
>> I'm trying to emulate some physical IBM Power 9's that we have. There
>> seems to be plenty of examples of using x86_64 qemu, but slightly less
>> for Power.

For baremetal emulation, please use the PowerNV machine. See this page :

  https://qemu.readthedocs.io/en/latest/system/ppc/powernv.html

HW is not fully emulated but QEMU has enough support to start a multichip
system running any distro.

>> Unless it's specifically for installing AIX

AIX only runs under the pseries machine (virtualized) and not on baremetal.

>> Anyway, I'm trying to boot the VM as I guess a bare metal Power 9 box,
>> then install redhat from Iso on a disk and have it on the network.
>>
>> ./qemu-system-ppc64 -cpu POWER9 -smp cpus=4 -machine pseries -m 4096 -M
>> accel=tcg  -serial stdio -nodefaults -nographic -device
>> megasas,id=scsi0,bus=pci.0,addr=0x5 -drive
>> file=/home/hdisk1.qcow2,if=none,id=drive-scsi0-0-0-0,format=qcow2,cache=none
>> -device
>> scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=2
>> -cdrom /mnt/images/rhel-8.4-ppc64le-boot.iso -monitor
>> telnet:0.0.0.0:3344,server,nowait -netdev
>> bridge,id=net0,helper=qemu-bridge-helper,br=bridge0,id=hostnet0

This is a pseries machine (virtualized) and not baremetal.

Which machine do you want to run ? pseries is the VM platform as run by KVM,
It can run under TCG also. PowerNV is the baremetal platform on which KVM
runs using the OPAL firmware. QEMU only has a PowerNV emulator, so TCG.

These are two very different PPC machines.

>> So the megasas gets detected as a raid controller. Yay.
>> But my qcow2 disk image doesn't seem to be plugged into it correctly as
>> it's not detected.
>> It sees the cdrom image and I can boot from it.
>> The other thing I can't get working is the network card.

because you don't have any :) Add a device and link it to the netdev.


That's how I run a TCG pseries POWER9 machine on my x86 laptop:

qemu-system-ppc64 -M pseries,cap-cfpc=workaround,cap-sbbc=workaround,cap-ibs=workaround,cap-ccf-assist=on,ic-mode=dual -m 4G -accel tcg,thread=multi -cpu POWER9 -smp 4,cores=4,maxcpus=8,threads=1 -device virtio-net-pci,netdev=net0,mac=C0:FF:EE:00:00:02,bus=pci.0,addr=0x2 -netdev tap,id=net0,helper=/usr/libexec/qemu-bridge-helper,br=virbr0,vhost=on -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x1 -drive file=./ubuntu-ppc64le.qcow2,if=none,id=drive-scsi0-0-0-0,format=qcow2,cache=none -device scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=1 -device qemu-xhci,id=usb,bus=pci.0,addr=0x4 -nographic -nodefaults -serial mon:stdio

and a PowerNV POWER9 machine :

qemu-system-ppc64 -m 4G -machine powernv9 -smp 2 -accel tcg,thread=multi -kernel ./open-power/images/witherspoon-latest/zImage.epapr -initrd ./open-power/images/witherspoon-latest/rootfs.cpio.xz -bios ./open-power/images/witherspoon-latest/skiboot.lid -device pcie-pci-bridge,id=bridge1,bus=pcie.1,addr=0x0 -device ich9-ahci,id=sata0,bus=pcie.0,addr=0x0 -drive file=./ubuntu-ppc64le-powernv.qcow2,if=none,id=drive0,format=qcow2,cache=none -device ide-hd,bus=sata0.0,unit=0,drive=drive0,id=ide,bootindex=1 -device e1000e,netdev=net0,mac=C0:FF:EE:00:01:03,bus=bridge1,addr=0x3 -netdev bridge,helper=/usr/libexec/qemu-bridge-helper,br=virbr0,id=net0 -device nec-usb-xhci,bus=bridge1,addr=0x2 -device usb-storage,drive=usbkey -drive file=./usb.img,if=none,id=usbkey,format=raw,cache=none -serial mon:stdio -nographic

You will need firmware images for the latter.


Cheers,
C.


Disclaimer: This email (including any attachments or links) may contain confidential and/or legally privileged information and is intended only to be read or used by the addressee. If you are not the intended addressee, any use, distribution, disclosure or copying of this email is strictly prohibited. Confidentiality and legal privilege attached to this email (including any attachments) are not waived or lost by reason of its mistaken delivery to you. If you have received this email in error, please delete it and notify us immediately by telephone or email. Peter MacCallum Cancer Centre provides no guarantee that this transmission is free of virus or that it has not been intercepted or altered and will not be liable for any delay in its receipt.

[-- Attachment #2: Type: text/html, Size: 9578 bytes --]

Re: need help with my config

[Cédric Le Goater]

Hello,

On 8/3/21 1:22 AM, Lindsay Ryan wrote:
> Hi Cedric, 
> Thanks for replying.
> I think I want to go down the PowerNV Power 9
> Which I will need the OpenPower firmware. 
> Looks like the webpage for downloading prebuild witherspoon and skiboot is down/dead. Hasn't been working for me for 24hours anyway

Indeed :/

> Is that the only place to download that firmware?

Until we find a new hosting place, probably GH, you can try to build 
the FW images :

  https://github.com/open-power/op-build

from :

  https://github.com/open-power/op-build/archive/refs/tags/v2.6.tar.gz

or you can use these v2.6 files :

  https://www.kaod.org/qemu/powernv/

Cheers,

C.