From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mike Viau Subject: RE: [Xen-devel] RE: How to: Improve Network Throughput of a XEN kernel? Date: Sun, 7 Mar 2010 00:55:38 -0500 Message-ID: References: , <20100303091844.GI2761@reaktio.net>, , <1267639660.8743.6.camel@sl300> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0202768744==" Return-path: In-Reply-To: <1267639660.8743.6.camel@sl300> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xensource.com Errors-To: xen-users-bounces@lists.xensource.com To: lists@thohal.de Cc: bderzhavets@yahoo.com, xen-devel@lists.xensource.com, xen-users@lists.xensource.com List-Id: xen-devel@lists.xenproject.org --===============0202768744== Content-Type: multipart/alternative; boundary="_ba2b45a9-d24e-487d-a1c9-45634ae5b702_" --_ba2b45a9-d24e-487d-a1c9-45634ae5b702_ Content-Type: text/plain; charset="windows-1256" Content-Transfer-Encoding: quoted-printable >Re: [Xen-users] Error: Device 0 (vif) could notbeconnected. Hotplugscrip= ts not working=FE >From: Carlos Echevarne (cechevarne@gmail.com) >Sent: March 4, 2010 3:36:18 AM > >Hola Jose! > >Try to comment the line "handle_iptable" of /etc/xen/vif-bridge. > >I think that's a problem with iptables. I did not attempt this, I believe this suggestion was fixing a hotplug is= sue... but it was in reply to How to: Improve Network Throughput of a XEN= kernel? > Subject: RE: [Xen-devel] RE: [Xen-users] How to: Improve Network Throug= hput of a XEN kernel? > From: lists@thohal.de > To: viaum@sheridanc.on.ca > Date: Wed, 3 Mar 2010 19:07:40 +0100 > CC: bderzhavets@yahoo.com; xen-devel@lists.xensource.com; xen-users@lis= ts.xensource.com >=20 > Hi, >=20 > Am Mittwoch, den 03.03.2010, 10:44 -0500 schrieb Mike Viau: > > >=20 > > > On Tue, Mar 02, 2010 at 07:50:59PM -0500, Mike Viau wrote: > > > > >Any=20 > > just first argument dummy=3Ddummy should on kenel line. > > > > > Read Wiki one more time. It works. > > > >=20 > > > > I believe you that it does work. I was able to see (XEN) messages > > coming from the hypervisor, but no matter how I changed the option I > > kept getting a kernel fault. > > > >=20 > > > > I feel like it was time to stop mucking around with getting Ubunt= u > > and the grub2 boot loader to work with XEN so I decided to install a > > headless OpenSUSE 11.2 system. > > > >=20 > > > > The openSUSE distribution supported Xen 3.4.1 tools, and had a > > 2.6.31.12 xenified kernel. On this setup I experience identical > > network performance. > > > >=20 > > > > ~1MB/s - w/ xen kernel > > > > ~4.5 MB/s - w/ non-xen kernel > > > >=20 > > > > I use the e1000e kernel module driver for my Ethernet card. > > > >=20 > > > > Is this typical Dom0 (or Xen Host) network performance with a > > xenified kernel or is just in my two setups that one encounters such = a > > network performance hit to the Dom0? > > > > > > >=20 > > > No, it's not typical. > > >=20 > > > How are you measuring the performance? In a gigabit network you > > should be able > > > to push around 110 MB/sec.. 4.5 MB/sec sounds really slow. > >=20 > >=20 > > I am using Fast Ethernet (100MB). What sort of throughput should I > > expect becasue I also believe ~1MB is too slow, even just to/from the > > Dom0, without any network emulation to the DomUs. >=20 > 10 - 12 MB/s should be expected.... >=20 > >=20 > > I simply used SCP, HTTP, and FTP file transfer protocols on the Xen > > host to another computer on the LAN.=20 >=20 > Please do something like >=20 > Start netCat on a "server" >=20 > Server: # nc -l 1111 > /dev/null >=20 > and start dd+nc on your XEN-Box/Client >=20 > Client: # dd if=3D/dev/zero bs=3D1M count=3D10000 | nc $SERVER-IP 1111 >=20 > This should show up raw network throughput.... >=20 >=20 Yup I was able to get 8MB/s, this time I believe the network equipement i= s to blame, but this has been a wonderful suggestion, thank you. I'd just= like to note the -p option was required to start netcats listening on th= e specified port number. > > The ~4.5MB/s bottleneck is the hard drive on the other computer so I > > suspect the true bandwidth would be higher, but getting past the > > ~1MB/s roadblock is my major concern. >=20 > use /dev/null instead of HDDs >=20 > > I have tried two linux distros and both forward ported xenified and > > parvirtualized xen kernel. > >=20 > > Does the Xen hypervisor have any effect on the network throughput? >=20 > No, but the underlying dom0-Kernel could affect the NIC-Performance... > Had some Issues with running Intel 10GB-NICs (ixgbe) on a 2.6.18-Kernel= , > while 2.6.27/29 performed nice. >=20 This is what I specualt to have been the issue to. After using a stable x= enified 2.6.33 kernel my throughput shot up 8 times to the Dom0! Also I n= oted that between kernel versions 2.6.31 and 2.6.33 the exact same module= driver version was used. filename: /lib/modules/2.6.33-xen/kernel/drivers/net/e1000e/e1000e.= ko version: 1.0.2-k2 filename: /lib/modules/2.6.31.12-xen/kernel/drivers/net/e1000e/e100= 0e.ko version: 1.0.2-k2 > > Would updating the Intel E1000E kernel module driver affect the > > network throughput? So I guess in this case updating the kernel module driver was not require= d. > >=20 > >=20 > > -M >=20 >=20 > hth, >=20 > thomas >=20 > >=20 > >=20 > > >=20 > > > -- Pasi > > >=20 > > > > -M > > > >=20 > > > > --- On Mon, 3/1/10, Mike Viau wrote: > > > >=20 > > > > From: Mike Viau > > > > Subject: RE: [Xen-devel] RE: [Xen-users] How to: Improve Network > > Throughput of a XEN kernel? > > > > To: bderzhavets@yahoo.com > > > > Cc: xen-devel@lists.xensource.com, xen-users@lists.xensource.com > > > > Date: Monday, March 1, 2010, 2:52 PM > > > >=20 > > > > Why using grub2 vs grub is baffling am not sure.... > > > >=20 > > > > I think I'd prefer to use the kernel command line in grub2 so tha= t > > the options may be changed easier laster on. However I still have bee= n > > having so success with boot > > > > XEN with Ubuntu's grub2 boot loader. > > > >=20 > > > > Am I correct to conclude CONFIG_CMDLINE_BOL must =3D N to allow > > GRUB2 to pass kernel options? > > > > [1]http://cateee.net/lkddb/web-lkddb/CMDLINE_BOOL.html > > > >=20 > > > > I have read through the Wiki page at > > [2]http://wiki.xensource.com/xenwiki/XenCommonProblems. I am running = a > > 64-bit Xen Hypervisor. > > > >=20 > > > > Thus far I have been having no success with using the example > > entry found at > > [3]http://old.nabble.com/Strange-interaction-from-grub2-and-XEN-td264= 64067.html > > > >=20 > > > > A question regarding that entry is what would be the root device > > when there are separate /boot and root partitions? I am using the > > partition with the /boot (grub2) as > > > > my 'set root' device right? > > > >=20 > > > > I am also using the dummy=3Ddummy as the first option on the firs= t > > module line, again as discovered on the wiki. > > > >=20 > > > > Additionally posted on another thread here in the Xen mailing lis= t > > was: > > > >=20 > > > > > On 1 March 2010 08:09, Luke Carrier > > wrote: > > > > >> > > > > >> Not sure about Debian, but I know Ubuntu isn*t ideal for Xen > > any more > > > > >> because of the presence of GRUB2 * the new boot loader doesn*t > > support > > > > >> passing certain command lines and the current multiboot > > implementation > > > > >> breaks the method Xen uses to load the > > > > Dom0 kernel * you can*t use Ubuntu > > > > >> 9.10 Server with Xen. > > > >=20 > > > > I am confused now because Boris clearly created a wordpress.com > > weblog in where Ubuntu 9.10 Server was > > > > used with XEN. > > > >=20 > > > > Lastly, out of curiosity, what (or what kind) of commands cannot > > be passed with GRUB2? > > > >=20 > > > > ThX! > > > >=20 > > > >=20 > > > > -M > > > >=20 > > > > > > ---------------------------------------------------------------------= -------------------------------------------------------------------------= ---------------------------- > > > >=20 > > > > Date: Sat, 27 Feb 2010 11:20:31 -0800 > > > > From: bderzhavets@yahoo.com > > > > Subject: Re: [Xen-devel] RE: [Xen-users] How to: Improve Network > > Throughput of a XEN kernel? > > > > To: mike.viau@sheridanc.on.ca > > > > CC: xen-devel@lists.xensource.com; xen-users@lists.xensource.com > > > >=20 > > > > In Xen Wiki is mentioned , that parameters for kernel may be set > > via command line as follows:- > > > > > > *********************************************************************= *************************************** > > > > module (hd1,10)/vmlinuz-2.6.31.8 dummy=3Ddummy root=3D/dev/sda7 r= o > > console=3Dtty0 > > > > > > *********************************************************************= *************************************** > > > > # cat /proc/cmdline > > > >=20 > > > > shows that GRUB2 skips first argument, what causes problem. > > > >=20 > > > > Compiling built-in CMD_LINE is just an option. > > > > Read all Wiki written by Pasi and you would never be surprised ;) > > > >=20 > > > > > P.S: What is your feeling on using a recent Ubuntu system with > > > > > grub-legacy as the boot loader? I noticed that Squeeze has > > adopted grub2 > package as well too... > > > >=20 > > > > I have development Xen 3.4.3 instance on top Ubuntu 9.10 Server > > with GRUB2 ( baremetall) loading any from 3 mentioned bellow kernels > > under Xen 3.4.3 > > > >=20 > > > > 1.) 2.6.32.9 PVOPS > > > > 2.) 2.6.31.6 PVOPS > > > > 3.) 2.6.31.12 xenified > > > >=20 > > > > with no problems with dummy=3Ddummy as first parameter ( thanks > > Pasi). > > > > It may also may be done via compiling kernels with built-in > > CMD_LINE. > > > > It works fine as well. > > > >=20 > > > > Boris. > > > >=20 > > > > --- On Sat, 2/27/10, Mike Viau wrote: > > > >=20 > > > > From: Mike Viau > > > > Subject: [Xen-devel] RE: [Xen-users] How to: Improve Network > > Throughput of a XEN kernel? > > > > To: bderzhavets@yahoo.com > > > > Cc: xen-devel@lists.xensource.com, xen-users@lists.xensource.com > > > > Date: Saturday, February 27, 2010, 12:03 PM > > > >=20 > > > > Yes, thank you Boris for pointing that out. I found that was > > defiantly true. The 3.2.1 xen hypervisor could only boot the 2.6.26-2 > > xen kernel and the xenified > > > > 2.6.31.12. > > > >=20 > > > > Additionally I found that: > > > >=20 > > > > Xend does not start when using pv_ops dom0 kernel? > > > >=20 > > > > In December 2009 pv_ops dom0 kernel modules were renamed to have = a > > "xen-" prefix in them, ie. "evtchn.ko" became "xen-evtchn.ko". > > > >=20 > > > > This makes Xen 3.4.x xend fail to start, because it tried to load > > "evtchn.ko", but that doesn't exist. You need to load "xen-evtchn.ko" > > and then start xend. Fedora 12 > > > > xen-3.4.2-2 rpms have this problem fixed. > > > >=20 > > > > Also make sure you have xenfs mounted to "/proc/xen", that's > > needed aswell. > > > >=20 > > > > [Source: [4]http://wiki.xensource.com/xenwiki/XenParavirtOps] > > > >=20 > > > > And it appears the Debian xen-3.4.2-2 debs (in squeeze) have not > > fixed this problem. > > > >=20 > > > > Lastly I am still doing some reading on the grub2 package and how > > to configure it. It turns out that I have been using grub-legacy (or > > just good old grub) for so long > > > > that configuring the grub2 boot loader is turning out to be my ow= n > > personal kryptonite. > > > >=20 > > > >=20 > > > >=20 > > > > I am still working on getting the hypervisor to load the dom0 > > kernel in a Ubuntu system. > > > >=20 > > > >=20 > > > >=20 > > > > I have noticed an example in your wordpress @ [5]Set up Xen > > 3.4.3-rc2 & Libvirt 0.7.0 Dom0 (with 2.6.31.8 xenified aka Suse > > kernel) on top of Ubuntu 9.10 Server > > > >=20 > > > >=20 > > > >=20 > > > > With CONFIG_CMDLINE=3D"root=3D/dev/sdb11 ro console=3Dtty0" > > > >=20 > > > >=20 > > > >=20 > > > > menuentry "Xen 3.4 / Ubuntu 9.10 kernel 2.6.31.8 xenified" { > > > > insmod ext2 > > > > set root=3D(hd1,10) > > > > multiboot (hd1,10)/xen-3.4.gz > > > > module (hd1,10)/vmlinuz-2.6.31.8 > > > > module (hd1,10)/initrd-2.6.31.8.img > > > > } > > > >=20 > > > >=20 > > > >=20 > > > > I am sure you wouldn't of mentioned the CONFIG_CMDLINE kernel > > option is it was not important for using with grub2 right? I have not > > have to compile a kernel with the > > > > command line previous as I was just able to supply the arguments > > on the kernel line of my menu.lst (grub configuration file). > > > >=20 > > > > P.S: What is your feeling on using a recent Ubuntu system with > > grub-legacy as the boot loader? I noticed that Squeeze has adopted > > grub2 package as well too... > > > >=20 > > > >=20 > > > > -M > > > >=20 > > > > > > ---------------------------------------------------------------------= -------------------------------------------------------------------------= -------------------------- > > > >=20 > > > > Date: Sat, 27 Feb 2010 04:32:59 -0800 > > > > From: bderzhavets@yahoo.com > > > > Subject: Re: FW: [Xen-users] How to: Improve Network Throughput o= f > > a XEN kernel? > > > > To: jbeulich@novell.com; mike.viau@sheridanc.on.ca > > > > CC: xen-devel@lists.xensource.com; xen-users@lists.xensource.com > > > >=20 > > > > You cannot load pvops kernel under xen-hypervisor 3.2.1 ( >=3D3.4= .0 > > in general) > > > >=20 > > > > Boris. > > > >=20 > > > > --- On Fri, 2/26/10, Mike Viau wrote: > > > >=20 > > > > From: Mike Viau > > > > Subject: FW: [Xen-users] How to: Improve Network Throughput of a > > XEN kernel? > > > > To: bderzhavets@yahoo.com, jbeulich@novell.com > > > > Cc: xen-users@lists.xensource.com, xen-devel@lists.xensource.com > > > > Date: Friday, February 26, 2010, 3:19 PM > > > >=20 > > > > Hello again, > > > >=20 > > > > Just a quick update... > > > >=20 > > > > I was really hoping it was just going to be an issue with the > > kernel .config, however I copied exact configuration from the working > > Debain 2.6.26-2-xen-amd64 kernel > > > > and used a make oldconfig but the end result was the same. > > > >=20 > > > > After booting the xenified (2.6.31.12) or pvops kernel (2.6.31.6) > > via both xen-hypervisor 3.2.1 or xen-hypervisor 3.4.2 the maximum dat= a > > transfer to/from the Dom0 > > > > (Xen host) is ~1MB/s. > > > >=20 > > > > Next I plan on re-trying my efforts on a Ubuntu system to see if > > same network bottlenecking is present. > > > >=20 > > > > > > ---------------------------------------------------------------------= -------------------------------------------------------------------------= ------------------------ > > > >=20 > > > > Date: Fri, 26 Feb 2010 09:16:59 -0800 > > > > From: bderzhavets@yahoo.com > > > > Subject: Re: [Xen-users] How to: Improve Network Throughput of a > > XEN kernel? > > > > To: xen-users@lists.xensource.com; viaum@sheridanc.on.ca > > > >=20 > > > > Would escalate to xen-devel. 2.6.31.8 (12) aka Suse xenified was > > Jan Beulich stuff. > > > > He might have an answer. > > > > Boris. > > > >=20 > > > > --- On Fri, 2/26/10, Mike Viau wrote: > > > >=20 > > > > From: Mike Viau > > > > Subject: [Xen-users] How to: Improve Network Throughput of a XEN > > kernel? > > > > To: xen-users@lists.xensource.com > > > > Cc: waldi@debian.org > > > > Date: Friday, February 26, 2010, 12:09 PM > > > >=20 > > > > Hi there, > > > >=20 > > > > I am starting a new thread to try and solve a problem I am having > > will slow network throughput to the XEN host (not to a domU). > > > >=20 > > > > I have confirmed my problem occurs with PVOPS 'xen/master' kernel > > as well using > > > > > > [6]http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.31.6-pvo= ps-dom0-xen-master-x86_64 as the .config. > > > >=20 > > > > It also occurs with a forward ported xenified kernel (2.6.31.12) > > using the attached config-11-xen (.config). > > > >=20 > > > > However when using the xen kernel found in debain lenny (2.6.26-2= ) > > for the amd64 architecture I get similiar transfer rates to my Xen > > host as I do on a baremetel > > > > kernel. > > > >=20 > > > > Bastian Blank perhaps you could point me in the right direction i= n > > regards to a debian specific customization or patch I should be aware > > of? > > > > Maxium transfer rate (to/from hard disk) using the PVOPS > > 'xen/master' kernel and forward ported xenified kernel (2.6.31.12) is > > bottlenecking at ~1MB/s. On the > > > > debain lenny xen kernel I am getting ~4.5MB/s. > > > >=20 > > > > I was hoping one could suggest options in the .config that might > > be modified in order to improve network throughput of a XEN kernel an= d > > therefor increase the data > > > > transfer rates over the netowork to and from the Xen host. > > > >=20 > > > > Thanks alot for any help! As always I will be willing to accept > > any suggestions :) > > > >=20 > > > > -M =20 _________________________________________________________________ Check your Hotmail from your phone.=20 http://go.microsoft.com/?linkid=3D9712957 --_ba2b45a9-d24e-487d-a1c9-45634ae5b702_ Content-Type: text/html; charset="windows-1256" Content-Transfer-Encoding: quoted-printable >Re: [Xen-users] Error: Device 0 (vif) could notbeconnected. Hotplugsc= ripts not working=FE
>From:     Carlos Echevarne (ce= chevarne@gmail.com)
>Sent:     March 4, 2010 3:36:18= AM
>
>Hola Jose!
>
>Try to comment the line "han= dle_iptable" of /etc/xen/vif-bridge.
>
>I think that's a prob= lem with iptables.

I did not attempt this, I believe this suggesti= on was fixing a hotplug issue... but it was in reply to How to: Improve N= etwork Throughput of a XEN kernel?

> Subject: RE: [Xen-devel] R= E: [Xen-users] How to: Improve Network Throughput of a XEN kernel?
>= ; From: lists@thohal.de
> To: viaum@sheridanc.on.ca
> Date: W= ed, 3 Mar 2010 19:07:40 +0100
> CC: bderzhavets@yahoo.com; xen-deve= l@lists.xensource.com; xen-users@lists.xensource.com
>
> Hi,=
>
> Am Mittwoch, den 03.03.2010, 10:44 -0500 schrieb Mike V= iau:
> > >
> > > O n Tue, Mar 02, 2010 at 07:50:59PM -0500, Mike Viau wrote:
> > &= gt; > >Any
> > just first argument dummy=3Ddummy should o= n kenel line.
> > > > > Read Wiki one more time. It wor= ks.
> > > >
> > > > I believe you that it = does work. I was able to see (XEN) messages
> > coming from the = hypervisor, but no matter how I changed the option I
> > kept ge= tting a kernel fault.
> > > >
> > > > I fe= el like it was time to stop mucking around with getting Ubuntu
> &g= t; and the grub2 boot loader to work with XEN so I decided to install a> > headless OpenSUSE 11.2 system.
> > > >
>= ; > > > The openSUSE distribution supported Xen 3.4.1 tools, and= had a
> > 2.6.31.12 xenified kernel. On this setup I experience= identical
> > network performance.
> > > >
&= gt; > > > ~1MB/s - w/ xen kernel
> > > > ~4.5 MB/s - w/ non-xen kernel
> > > >= ;
> > > > I use the e1000e kernel module driver for my Et= hernet card.
> > > >
> > > > Is this typic= al Dom0 (or Xen Host) network performance with a
> > xenified ke= rnel or is just in my two setups that one encounters such a
> > = network performance hit to the Dom0?
> > > >
> > = >
> > > No, it's not typical.
> > >
> = > > How are you measuring the performance? In a gigabit network you=
> > should be able
> > > to push around 110 MB/sec.= . 4.5 MB/sec sounds really slow.
> >
> >
> >= I am using Fast Ethernet (100MB). What sort of throughput should I
&g= t; > expect becasue I also believe ~1MB is too slow, even just to/from= the
> > Dom0, without any network emulation to the DomUs.
&g= t;
> 10 - 12 MB/s should be expecte d....
>
> >
> > I simply used SCP, HTTP, and F= TP file transfer protocols on the Xen
> > host to another comput= er on the LAN.
>
> Please do something like
>
>= ; Start netCat on a "server"
>
> Server: # nc -l 1111 > /= dev/null
>
> and start dd+nc on your XEN-Box/Client
> =
> Client: # dd if=3D/dev/zero bs=3D1M count=3D10000 | nc $SERVER-I= P 1111
>
> This should show up raw network throughput....>
>

Yup I was able to get 8MB/s, this time I believe t= he network equipement is to blame, but this has been a wonderful suggesti= on, thank you. I'd just like to note the -p option was required to start = netcats listening on the specified port number.

> > The ~4.5= MB/s bottleneck is the hard drive on the other computer so I
> >= suspect the true bandwidth would be higher, but getting past the
>= > ~1MB/s roadblock is my major concern.
& gt;
> use /dev/null instead of HDDs
>
> > I have = tried two linux distros and both forward ported xenified and
> >= parvirtualized xen kernel.
> >
> > Does the Xen hyper= visor have any effect on the network throughput?
>
> No, but= the underlying dom0-Kernel could affect the NIC-Performance...
> H= ad some Issues with running Intel 10GB-NICs (ixgbe) on a 2.6.18-Kernel,> while 2.6.27/29 performed nice.
>

This is what I spe= cualt to have been the issue to. After using a stable xenified 2.6.33 ker= nel my throughput shot up 8 times to the Dom0! Also I noted that between = kernel versions 2.6.31 and 2.6.33 the exact same module driver version wa= s used.

filename:       /lib/modules= /2.6.33-xen/kernel/drivers/net/e1000e/e1000e.ko
version:  &n= bsp;     1.0.2-k2

filename:   &= nbsp;   /lib/modules/2.6.31.12-x en/kernel/drivers/net/e1000e/e1000e.ko
version:   &nbs= p;    1.0.2-k2



> > Would updating th= e Intel E1000E kernel module driver affect the
> > network throu= ghput?

So I guess in this case updating the kernel module driver w= as not required.

> >
> >
> > -M
> =
>
> hth,
>
> thomas
>
> >
= > >
> > >
> > > -- Pasi
> > >=
> > > > -M
> > > >
> > > >= ; --- On Mon, 3/1/10, Mike Viau <viaum@sheridanc.on.ca> wrote:
&= gt; > > >
> > > > From: Mike Viau <viaum@sher= idanc.on.ca>
> > > > Subject: RE: [Xen-devel] RE: [Xen-= users] How to: Improve Network
> > Throughput of a XEN kernel?> > > > To: bderzhavets@yahoo.com
> > > > Cc= : xen-devel@lists.xensource.com, xen-users @lists.xensource.com
> > > > Date: Monday, March 1, 2010,= 2:52 PM
> > > >
> > > > Why using grub2 v= s grub is baffling am not sure....
> > > >
> > &= gt; > I think I'd prefer to use the kernel command line in grub2 so th= at
> > the options may be changed easier laster on. However I st= ill have been
> > having so success with boot
> > > = > XEN with Ubuntu's grub2 boot loader.
> > > >
>= > > > Am I correct to conclude CONFIG_CMDLINE_BOL must =3D N to= allow
> > GRUB2 to pass kernel options?
> > > > = [1]http://cateee.net/lkddb/web-lkddb/CMDLINE_BOOL.html
> > > = >
> > > > I have read through the Wiki page at
>= > [2]http://wiki.xensource.com/xenwiki/XenCommonProblems. I am runnin= g a
> > 64-bit Xen Hypervisor.
> > > >
> &= gt; > > Thus far I have been having no success with using the example
> > entry found at
> >= [3]http://old.nabble.com/Strange-interaction-from-grub2-and-XEN-td264640= 67.html
> > > >
> > > > A question regardi= ng that entry is what would be the root device
> > when there ar= e separate /boot and root partitions? I am using the
> > partiti= on with the /boot (grub2) as
> > > > my 'set root' device = right?
> > > >
> > > > I am also using the= dummy=3Ddummy as the first option on the first
> > module line,= again as discovered on the wiki.
> > > >
> > &g= t; > Additionally posted on another thread here in the Xen mailing lis= t
> > was:
> > > >
> > > > > O= n 1 March 2010 08:09, Luke Carrier <luke.carrier@xinos.org>
>= > wrote:
> > > > >>
> > > > >&= gt; Not sure about Debian, but I know Ubuntu isn*t ideal for Xen
> > any more
> > > > >&g= t; because of the presence of GRUB2 * the new boot loader doesn*t
>= > support
> > > > >> passing certain command lin= es and the current multiboot
> > implementation
> > >= ; > >> breaks the method Xen uses to load the
> > > = > Dom0 kernel * you can*t use Ubuntu
> > > > >> 9= .10 Server with Xen.
> > > >
> > > > I am = confused now because Boris clearly created a wordpress.com
> > w= eblog in where Ubuntu 9.10 Server was
> > > > used with XE= N.
> > > >
> > > > Lastly, out of curiosit= y, what (or what kind) of commands cannot
> > be passed with GRU= B2?
> > > >
> > > > ThX!
> > >= >
> > > >
> > > > -M
> > >= ; >
> > > >
> > ; ----------------------------------------------------------------------= -------------------------------------------------------------------------= ---------------------------
> > > >
> > > >= ; Date: Sat, 27 Feb 2010 11:20:31 -0800
> > > > From: bder= zhavets@yahoo.com
> > > > Subject: Re: [Xen-devel] RE: [Xe= n-users] How to: Improve Network
> > Throughput of a XEN kernel?=
> > > > To: mike.viau@sheridanc.on.ca
> > > &= gt; CC: xen-devel@lists.xensource.com; xen-users@lists.xensource.com
&= gt; > > >
> > > > In Xen Wiki is mentioned , tha= t parameters for kernel may be set
> > via command line as follo= ws:-
> > > >
> > ********************************= *************************************************************************= ***
> > > > module (hd1,10)/vmlinuz-2.6.31.8 dummy=3Ddummy= root=3D/dev/sda7 ro
> > console=3Dtty0
> > > >
> > ***********************************= *************************************************************************=
> > > > # cat /proc/cmdline
> > > >
&g= t; > > > shows that GRUB2 skips first argument, what causes prob= lem.
> > > >
> > > > Compiling built-in CM= D_LINE is just an option.
> > > > Read all Wiki written by= Pasi and you would never be surprised ;)
> > > >
>= > > > > P.S: What is your feeling on using a recent Ubuntu s= ystem with
> > > > > grub-legacy as the boot loader? I = noticed that Squeeze has
> > adopted grub2 > package as well = too...
> > > >
> > > > I have development = Xen 3.4.3 instance on top Ubuntu 9.10 Server
> > with GRUB2 ( ba= remetall) loading any from 3 mentioned bellow kernels
> > under = Xen 3.4.3
> > > >
>=20 > > > 1.) 2.6.32.9 PVOPS
> > > > 2.) 2.6.31.6 PV= OPS
> > > > 3.) 2.6.31.12 xenified
> > > > =
> > > > with no problems with dummy=3Ddummy as first para= meter ( thanks
> > Pasi).
> > > > It may also may= be done via compiling kernels with built-in
> > CMD_LINE.
&g= t; > > > It works fine as well.
> > > >
> = > > > Boris.
> > > >
> > > > --- = On Sat, 2/27/10, Mike Viau <viaum@sheridanc.on.ca> wrote:
> &= gt; > >
> > > > From: Mike Viau <viaum@sheridanc= .on.ca>
> > > > Subject: [Xen-devel] RE: [Xen-users] Ho= w to: Improve Network
> > Throughput of a XEN kernel?
> &g= t; > > To: bderzhavets@yahoo.com
> > > > Cc: xen-dev= el@lists.xensource.com, xen-users@lists.xensource.com
> > > &= gt; Date: Saturday, February 27, 2010, 12:03 PM
> > > >
> > > > Yes, thank you Boris = for pointing that out. I found that was
> > defiantly true. The = 3.2.1 xen hypervisor could only boot the 2.6.26-2
> > xen kernel= and the xenified
> > > > 2.6.31.12.
> > > >= ;
> > > > Additionally I found that:
> > > &g= t;
> > > > Xend does not start when using pv_ops dom0 ker= nel?
> > > >
> > > > In December 2009 pv_o= ps dom0 kernel modules were renamed to have a
> > "xen-" prefix = in them, ie. "evtchn.ko" became "xen-evtchn.ko".
> > > > <= br>> > > > This makes Xen 3.4.x xend fail to start, because i= t tried to load
> > "evtchn.ko", but that doesn't exist. You nee= d to load "xen-evtchn.ko"
> > and then start xend. Fedora 12
= > > > > xen-3.4.2-2 rpms have this problem fixed.
> >= ; > >
> > > > Also m ake sure you have xenfs mounted to "/proc/xen", that's
> > need= ed aswell.
> > > >
> > > > [Source: [4]htt= p://wiki.xensource.com/xenwiki/XenParavirtOps]
> > > > > > > > And it appears the Debian xen-3.4.2-2 debs (in squee= ze) have not
> > fixed this problem.
> > > >
= > > > > Lastly I am still doing some reading on the grub2 pac= kage and how
> > to configure it. It turns out that I have been = using grub-legacy (or
> > just good old grub) for so long
>= ; > > > that configuring the grub2 boot loader is turning out to= be my own
> > personal kryptonite.
> > > >
&= gt; > > >
> > > >
> > > > I am s= till working on getting the hypervisor to load the dom0
> > kern= el in a Ubuntu system.
> > > >
> > > > > > > >
> > > &g t; I have noticed an example in your wordpress @ [5]Set up Xen
> &= gt; 3.4.3-rc2 & Libvirt 0.7.0 Dom0 (with 2.6.31.8 xenified aka Suse> > kernel) on top of Ubuntu 9.10 Server
> > > > <= br>> > > >
> > > >
> > > > Wi= th CONFIG_CMDLINE=3D"root=3D/dev/sdb11 ro console=3Dtty0"
> > &g= t; >
> > > >
> > > >
> > >= ; > menuentry "Xen 3.4 / Ubuntu 9.10 kernel 2.6.31.8 xenified" {
&g= t; > > > insmod ext2
> > > > set root=3D(hd1,10)<= br>> > > > multiboot (hd1,10)/xen-3.4.gz
> > > &g= t; module (hd1,10)/vmlinuz-2.6.31.8
> > > > module (hd1,10= )/initrd-2.6.31.8.img
> > > > }
> > > > > > > >
> > > >
> > > > I am= sure you wouldn't of mentioned the CONFIG_CMDLINE kernel
> > op= tion is it was not important for using with grub2=20 right? I have not
> > have to compile a kernel with the
>= > > > command line previous as I was just able to supply the ar= guments
> > on the kernel line of my menu.lst (grub configuratio= n file).
> > > >
> > > > P.S: What is your= feeling on using a recent Ubuntu system with
> > grub-legacy as= the boot loader? I noticed that Squeeze has adopted
> > grub2 p= ackage as well too...
> > > >
> > > >
= > > > > -M
> > > >
> > > >
= > > ---------------------------------------------------------------= -------------------------------------------------------------------------= --------------------------------
> > > >
> > >= ; > Date: Sat, 27 Feb 2010 04:32:59 -0800
> > > > From:= bderzhavets@yahoo.com
> > > > Subject: Re: FW: [Xen-users= ] How to: Improve Network Throughput of
> > a XEN kernel?
> > > > To: jbeulich@novell.com;= mike.viau@sheridanc.on.ca
> > > > CC: xen-devel@lists.xen= source.com; xen-users@lists.xensource.com
> > > >
>= > > > You cannot load pvops kernel under xen-hypervisor 3.2.1 (= >=3D3.4.0
> > in general)
> > > >
> &g= t; > > Boris.
> > > >
> > > > --- On= Fri, 2/26/10, Mike Viau <viaum@sheridanc.on.ca> wrote:
> >= ; > >
> > > > From: Mike Viau <viaum@sheridanc.o= n.ca>
> > > > Subject: FW: [Xen-users] How to: Improve = Network Throughput of a
> > XEN kernel?
> > > > T= o: bderzhavets@yahoo.com, jbeulich@novell.com
> > > > Cc: = xen-users@lists.xensource.com, xen-devel@lists.xensource.com
> >= > > Date: Friday, February 26, 2010, 3:19 PM
> > > >= ;
> > > > Hello again,
&g t; > > >
> > > > Just a quick update...
>= > > >
> > > > I was really hoping it was just g= oing to be an issue with the
> > kernel .config, however I copie= d exact configuration from the working
> > Debain 2.6.26-2-xen-a= md64 kernel
> > > > and used a make oldconfig but the end = result was the same.
> > > >
> > > > After= booting the xenified (2.6.31.12) or pvops kernel (2.6.31.6)
> >= via both xen-hypervisor 3.2.1 or xen-hypervisor 3.4.2 the maximum data> > transfer to/from the Dom0
> > > > (Xen host) i= s ~1MB/s.
> > > >
> > > > Next I plan on r= e-trying my efforts on a Ubuntu system to see if
> > same networ= k bottlenecking is present.
> > > >
> > > >= ;
> > ----------------------------------------------------------= ------------------------------------------ ------------------------------------------------------------------
&g= t; > > >
> > > > Date: Fri, 26 Feb 2010 09:16:59= -0800
> > > > From: bderzhavets@yahoo.com
> > &g= t; > Subject: Re: [Xen-users] How to: Improve Network Throughput of a<= br>> > XEN kernel?
> > > > To: xen-users@lists.xenso= urce.com; viaum@sheridanc.on.ca
> > > >
> > >= > Would escalate to xen-devel. 2.6.31.8 (12) aka Suse xenified was> > Jan Beulich stuff.
> > > > He might have an ans= wer.
> > > > Boris.
> > > >
> > &= gt; > --- On Fri, 2/26/10, Mike Viau <viaum@sheridanc.on.ca> wro= te:
> > > >
> > > > From: Mike Viau <vi= aum@sheridanc.on.ca>
> > > > Subject: [Xen-users] How t= o: Improve Network Throughput of a XEN
> > kernel?
> > = > > To: xen-users@lists.xensource.co m
> > > > Cc: waldi@debian.org
> > > > Dat= e: Friday, February 26, 2010, 12:09 PM
> > > >
> &g= t; > > Hi there,
> > > >
> > > > I a= m starting a new thread to try and solve a problem I am having
> &g= t; will slow network throughput to the XEN host (not to a domU).
> = > > >
> > > > I have confirmed my problem occurs= with PVOPS 'xen/master' kernel
> > as well using
> > &= gt; >
> > [6]http://pasik.reaktio.net/xen/pv_ops-dom0-debug/c= onfig-2.6.31.6-pvops-dom0-xen-master-x86_64 as the .config.
> > = > >
> > > > It also occurs with a forward ported xe= nified kernel (2.6.31.12)
> > using the attached config-11-xen (= .config).
> > > >
> > > > However when usi= ng the xen kernel found in debain lenny (2.6.26-2)
> > for the a= md64 architecture I get similiar transfer=20 rates to my Xen
> > host as I do on a baremetel
> > &g= t; > kernel.
> > > >
> > > > Bastian Bl= ank perhaps you could point me in the right direction in
> > reg= ards to a debian specific customization or patch I should be aware
>= ; > of?
> > > > Maxium transfer rate (to/from hard disk= ) using the PVOPS
> > 'xen/master' kernel and forward ported xen= ified kernel (2.6.31.12) is
> > bottlenecking at ~1MB/s. On the<= br>> > > > debain lenny xen kernel I am getting ~4.5MB/s.
= > > > >
> > > > I was hoping one could sugges= t options in the .config that might
> > be modified in order to = improve network throughput of a XEN kernel and
> > therefor incr= ease the data
> > > > transfer rates over the netowork to = and from the Xen host.
> > > >
> > > > Tha= nks alot for any help! As always I will be willing to accept
> > any suggestions :)
> > > >= ;
> > > > -M



Live connecte= d with Messenger on your phone Learn more. --_ba2b45a9-d24e-487d-a1c9-45634ae5b702_-- --===============0202768744== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users --===============0202768744==--