Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

[Fabrice Bellard]

Kuniyasu Suzaki wrote:
> Dear,
> 
> We released new Xenoppix which is consisted of KNOPPIX5.1.1, Xen3.0.4, QEMU/KVM, 
> and HTTP-FUSE(stackable/network virtual disk). You can compare Xen(3.0.4 on Linux2.6.16) 
> and KVM(Release 12 on Linux2.6.19) on the CD-ROM.
> [...]
> ### Performance 
>  -PI calculation(3 Million-digits) is used to compare. 
>     http://h2np.net/pi/pi_quick_start.tar.gz
>   We confirmed the performance of kvm was very close to native CPU. However the I/O
>   was still slow.
>                | sec   |
>     -----------+-------+----------------------------
>      Native CPU| 14.67 | Core2 Duo (T7200)
>             kvm| 17.90 | IntelVT is effective
>        kvm(off)| 225.1 | "-no-kvm" is used
>     qemu(kqemu)| 24.87 | "-kernel-kqemu" isn't used
>            qemu| 227.1 | "-no-kqemu" is used
>       Xen(DomU)| 14.68 |
>        Xen(HVM)| 15.99 | IntelVT is effective
>     -----------+-------+---------------------------

Hi,

Since your benchmark involve a mostly user task, the performance of 
kqemu must be very close to native CPU time. I suggest you make the 
following tests to improve your benchmarking of qemu/kqemu:

1) Do not use the clock of the virtualized OS to make the measure. QEMU 
may have bugs which make it very inaccurate.

2) For best performances with kqemu, it is better to use Linux 2.4 as 
guest OS (I know this is far from acceptable, but it can help some 
people to get better performance !).

Regards,

Fabrice.

[Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

[Kuniyasu Suzaki]

Dear,

We released new Xenoppix which is consisted of KNOPPIX5.1.1, Xen3.0.4, QEMU/KVM, 
and HTTP-FUSE(stackable/network virtual disk). You can compare Xen(3.0.4 on Linux2.6.16) 
and KVM(Release 12 on Linux2.6.19) on the CD-ROM.

The boot of CD image is accelerated by LCAT.
  http://www.alpha.co.jp/biz/rdg/ac-knoppix/index_en.html

===================================================================================
### New Feature (chagelog) 
 - KNOPPIX is upgraded to 5.1.1(Japanese Edition) and Xen is upgraded to 3.0.4.
   GRUB Menu includes two items; Xen3.04(kenrel 2.6.16.33) and normal KNOPPIX (kernel 2.6.19). 
   Xen3.0.4 improved support for SMP and ACPI. The feature enables to merge 
   previous EFI version and normal BIOS version. 
     -"konppixHMV" command runs KNOPPIX on a full virtualization on IntelVT/AMD-V.
     -"knoppixU" command runs KNOPPIX on a para virtualization.
 
 - KVM(Kernel based Virtual Machine) is included. The version is Release 12 2007-01-23 
   on Linux 2.6.19. 
     -"QEMU/KVM" is runnable on IntelVT/AMD-V with "kvm" command. If IntelVT/AMD-V isn't on, 
      the window bar shows "QEMU".

 - [Experimental] HTTP-FUSE (stackable/network virtual disk)
     -It enables to boot Debian/GNU Linux Etch on Xen form Internet. 
     -HTTP-FUSE CLOOP is stackable/network virtual disk. The virtual disk can be rollback 
      to an old image.
    *** Reference 
        Linux.conf.au Virtualization Miniconf 
        OS Circulation Environment "Trusted HTTP-FUSE Xenoppix"
        http://virtminiconf.linux.hp.com/program/os-circulation-environment-201ctrusted-http-fuse-xenoppix201d
       Slide
        PDF http://unit.aist.go.jp/itri/knoppix/20070118-LCA-HTTP-FUSE.pdf
        O0o Impress http://unit.aist.go.jp/itri/knoppix/20070118-LCA-HTTP-FUSE.odp
       News Article
        http://community.linux.com/article.pl?sid=07/01/16/1554236&from=rss
 
### USAGE
 - Xen3.04 
     -Boot with "Xen3.0.4" at GRUB Menu.
     -Para virtualization 
         Run # knoppixU 
       KNOPPIX will boot via VNC.
     -Full Virtualization 
       If IntelVT/AMD-V is available, we can use full virtualization of Xen "HVM ".
        run # knoppixHVM 
       KNOPPIX will boot via SDL(Simple DirectMedia Layer) 
       "knoppixHVM" command has options to boot from an iso file. 
            # knoppixHVM [/path/to/isofile] [domain_name]
      Caution) Add "nofirewire" kernel option at GRUB Menu for Intel MAC.
 
 - QEMU/KVM 
     -Boot "KNOPPIX(normal kernel)" at GRUB Menu on IntelVT/AMD-V. 
      Include a KVM driver. The driver depends on IntelVT/AMD-V. 
            # modprobe kvm-intel or # modprobe kvm-amd
      Run "kvm" command. The options are same for QEMU. 
            # kvm -cdrom /dev/cdrom -boot d -m 256 -localtime
      A window will be appeared. The window bar indicates QEMU/KVM if the kvm is 
      effective. If not, the window bar indicates QEMU.
      Caution) If you boot with KNOPPIX(normal kernel) image(The second item of GRUB Menu), 
               add "nolapc noapic noapm" options for kernel at GRUB>
      [sample] OSZoo offrers many Disk images(OpenSolairs, Darwin, ReactOS, etc) for QEMU. 
               Please try them on KVM. 

 - [Experimental] HTTP-FUSE 
     -Boot with "Xen3.0.4" at GRUB Menu on IntelVT/AMD-V.
      Confirm that "eth0" is IP reachable and Xen is running. 
            # pump -i eth0
            # /etc/init.d/xend start
            # httpfuse-hvm.sh 
      Selection Menu will be appeared. Select a near site. 
      Contents Menu will be appeared. Select your favorite image. 
      The OS will be appeared. Current Debian Etch has accounts, "root/http-fuse" or 
      "http-fuse/http-fuse". 
      Caution) Add "nofirewire" kernel option at GRUB Menu for Intel MAC.
      Caution) The console must be wider than 80x24to run httpfuse-hvm.sh, because 
               "dialog" requires wide console. If the console is small, the message 
               "httpstoraged is ready ..." will continue.
 
### Performance 
 -PI calculation(3 Million-digits) is used to compare. 
    http://h2np.net/pi/pi_quick_start.tar.gz
  We confirmed the performance of kvm was very close to native CPU. However the I/O
  was still slow.
               | sec   |
    -----------+-------+----------------------------
     Native CPU| 14.67 | Core2 Duo (T7200)
            kvm| 17.90 | IntelVT is effective
       kvm(off)| 225.1 | "-no-kvm" is used
    qemu(kqemu)| 24.87 | "-kernel-kqemu" isn't used
           qemu| 227.1 | "-no-kqemu" is used
      Xen(DomU)| 14.68 |
       Xen(HVM)| 15.99 | IntelVT is effective
    -----------+-------+---------------------------

### Download 
File: knoppix_v5.1.1CD_20070104_xen3.0.4.0-20070206+IPAFont_AC20070206.iso (610MB) 
MD5: 1c7eb2981cbbeb268ecc16d643587ae4
  Bittorrrent http://unit.aist.go.jp/itri/knoppix/knoppix_v5.1.1CD_20070104_xen3.0.4.0-20070206+IPAFont_AC20070206.iso.torrent
  FTP ftp://unit.aist.go.jp/itri/knoppix/iso/knoppix_v5.1.1CD_20070104_xen3.0.4.0-20070206+IPAFont_AC20070206.iso
  RING HTTP Server http://www.ring.gr.jp/archives/linux/knoppix/iso/
===================================================================================

------
suzaki

Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

[Ricardo Almeida]

Hi,

> We released new Xenoppix which is consisted of KNOPPIX5.1.1, Xen3.0.4, QEMU/KVM,
> and HTTP-FUSE(stackable/network virtual disk).

Great :) But now that KQEmu is GPL why not include it to, so that
people that don't have a KVM compatible processor can use an
accelerated environment?

Regards,
Ricardo Almeida

PS - I haven't download it, so if you already provide it please inform
and sorry for my comment.

Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

[Kuniyasu Suzaki]

Hello.

Thank you for your quick response. We are just trying qemu 0.9.0.

 >>From: Fabrice Bellard <fabrice@bellard.org>
 >>Subject: Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released
 >>
 >>Kuniyasu Suzaki wrote:
 >>> Dear,
 >>> 
 >>> We released new Xenoppix which is consisted of KNOPPIX5.1.1, Xen3.0.4, QEMU/KVM, 
 >>> and HTTP-FUSE(stackable/network virtual disk). You can compare Xen(3.0.4 on Linux2.6.16) 
 >>> and KVM(Release 12 on Linux2.6.19) on the CD-ROM.

I forgot telling our project home page.
  http://unit.aist.go.jp/itri/knoppix/xen/index-en.html

 >>> [...]
 >>> ### Performance 
 >>>  -PI calculation(3 Million-digits) is used to compare. 
 >>>     http://h2np.net/pi/pi_quick_start.tar.gz
 >>>   We confirmed the performance of kvm was very close to native CPU. However the I/O
 >>>   was still slow.
 >>>                | sec   |
 >>>     -----------+-------+----------------------------
 >>>      Native CPU| 14.67 | Core2 Duo (T7200)
 >>>             kvm| 17.90 | IntelVT is effective
 >>>        kvm(off)| 225.1 | "-no-kvm" is used
 >>>     qemu(kqemu)| 24.87 | "-kernel-kqemu" isn't used
 >>>            qemu| 227.1 | "-no-kqemu" is used
 >>>       Xen(DomU)| 14.68 |
 >>>        Xen(HVM)| 15.99 | IntelVT is effective
 >>>     -----------+-------+---------------------------
 >>
 >>Hi,
 >>
 >>Since your benchmark involve a mostly user task, the performance of 
 >>kqemu must be very close to native CPU time. I suggest you make the 
 >>following tests to improve your benchmarking of qemu/kqemu:
 >>
 >>1) Do not use the clock of the virtualized OS to make the measure. QEMU 
 >>may have bugs which make it very inaccurate.

O.K. We will use a physical stopwatch to compare the performance.
The accuracy will be decreased but the fairness will be increased.

 >>2) For best performances with kqemu, it is better to use Linux 2.4 as 
 >>guest OS (I know this is far from acceptable, but it can help some 
 >>people to get better performance !).

Please tell me the reason why Linux 2.4 shows better performance, if
you have time. Does the difference of clock tick cause the problem?

------
suzaki

Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

[Kuniyasu Suzaki]

Hello,

 >>From: "Ricardo Almeida" <ric.almeida@gmail.com>
 >>Subject: Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released
 >>
 >>Hi,
 >>
 >>> We released new Xenoppix which is consisted of KNOPPIX5.1.1, Xen3.0.4, QEMU/KVM,
 >>> and HTTP-FUSE(stackable/network virtual disk).
 >>
 >>Great :) But now that KQEmu is GPL why not include it to, so that
 >>people that don't have a KVM compatible processor can use an
 >>accelerated environment?

O.K. We will include GPL-KQEMU on the next Xenoppix.

------
suzaki


 >>
 >>Regards,
 >>Ricardo Almeida
 >>
 >>PS - I haven't download it, so if you already provide it please inform
 >>and sorry for my comment.
 >>

Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

[Fabrice Bellard]

Kuniyasu Suzaki wrote:
 > [...]
>  >>2) For best performances with kqemu, it is better to use Linux 2.4 as 
>  >>guest OS (I know this is far from acceptable, but it can help some 
>  >>people to get better performance !).
> 
> Please tell me the reason why Linux 2.4 shows better performance, if
> you have time. Does the difference of clock tick cause the problem?

The Linux 2.6 kernel has more code running with the interrupts disabled 
than the 2.4 one. kqemu interprets the x86 code when the interrupts are 
disabled, so it is very slow in this case.

A potential solution I am investigating is to use the new 
paravirtualization API of the kernel versions >= 2.6.20.

Regards,

Fabrice.

Re: [Qemu-devel] Xenoppix (KNOPPIX5.1.1 + Xen3.0.4 + QEMU/KVM + HTTP-FUSE) is released

[Jens Axboe]

On Fri, Feb 09 2007, Fabrice Bellard wrote:
> Kuniyasu Suzaki wrote:
> > [...]
> > >>2) For best performances with kqemu, it is better to use Linux 2.4 as 
> > >>guest OS (I know this is far from acceptable, but it can help some 
> > >>people to get better performance !).
> >
> >Please tell me the reason why Linux 2.4 shows better performance, if
> >you have time. Does the difference of clock tick cause the problem?
> 
> The Linux 2.6 kernel has more code running with the interrupts disabled 
> than the 2.4 one. kqemu interprets the x86 code when the interrupts are 
> disabled, so it is very slow in this case.
> 
> A potential solution I am investigating is to use the new 
> paravirtualization API of the kernel versions >= 2.6.20.

That'd be a great idea!

-- 
Jens Axboe