* Max. PV and HVM Guests
@ 2009-11-08 11:45 Mr. Teo En Ming (Zhang Enming)
2009-11-08 11:46 ` Mr. Teo En Ming (Zhang Enming)
` (2 more replies)
0 siblings, 3 replies; 16+ messages in thread
From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-08 11:45 UTC (permalink / raw)
To: xen-devel, xen-users; +Cc: space.time.universe
[-- Attachment #1.1: Type: text/plain, Size: 1226 bytes --]
Hi,
I have observed that there is a maximum limit to the number of PV or HVM
virtual machines you can start before dom0 hangs or crashes.
For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the 7th
instance. Max I can start is 6 without crashing.
For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start the 4th
instance. Max I can start is 3 without crashing.
I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on Intel
DQ45CB motherboard.
Are the above limits reasonable considering the hardware specifications of
my computer?
I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels
2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host operating
system is Fedora 11 Linux x86-64.
--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical
Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@gmail.com
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore
[-- Attachment #1.2: Type: text/html, Size: 1539 bytes --]
[-- Attachment #2: Type: text/plain, Size: 138 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
^ permalink raw reply [flat|nested] 16+ messages in thread* Re: Max. PV and HVM Guests 2009-11-08 11:45 Max. PV and HVM Guests Mr. Teo En Ming (Zhang Enming) @ 2009-11-08 11:46 ` Mr. Teo En Ming (Zhang Enming) 2009-11-08 13:01 ` Moi meme 2009-11-08 13:50 ` Pasi Kärkkäinen 2 siblings, 0 replies; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-08 11:46 UTC (permalink / raw) To: xen-devel, xen-users; +Cc: space.time.universe [-- Attachment #1.1: Type: text/plain, Size: 1982 bytes --] Forgot to mention that each of my linux PV guest has 512 MB memory while each of my linux HVM guest has 1024 MB memory. -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sun, Nov 8, 2009 at 7:45 PM, Mr. Teo En Ming (Zhang Enming) < space.time.universe@gmail.com> wrote: > Hi, > > I have observed that there is a maximum limit to the number of PV or HVM > virtual machines you can start before dom0 hangs or crashes. > > For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the 7th > instance. Max I can start is 6 without crashing. > > For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start the > 4th instance. Max I can start is 3 without crashing. > > I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on Intel > DQ45CB motherboard. > > Are the above limits reasonable considering the hardware specifications of > my computer? > > I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels > 2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host operating > system is Fedora 11 Linux x86-64. > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > [-- Attachment #1.2: Type: text/html, Size: 2859 bytes --] [-- Attachment #2: Type: text/plain, Size: 138 bytes --] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Max. PV and HVM Guests 2009-11-08 11:45 Max. PV and HVM Guests Mr. Teo En Ming (Zhang Enming) 2009-11-08 11:46 ` Mr. Teo En Ming (Zhang Enming) @ 2009-11-08 13:01 ` Moi meme 2009-11-09 8:17 ` [Xen-users] " Robert Dunkley 2009-11-08 13:50 ` Pasi Kärkkäinen 2 siblings, 1 reply; 16+ messages in thread From: Moi meme @ 2009-11-08 13:01 UTC (permalink / raw) To: Mr. Teo En Ming (Zhang Enming); +Cc: xen-devel, xen-users Hello, The maximum is a direct function of the available memory, every new machine "eats" some memory and when there is no more memory ...... I had some servers (64bits, 2 quad core and 32Gb Ram) running 19 VM, 2003 server, 2000 Server,Fedora, Debian all in 32bits. In my own system I have tested with upto 10 VMs of 512M each without breaking the system. Regards JP Pozzi Le dimanche 08 novembre 2009 à 19:45 +0800, Mr. Teo En Ming (Zhang Enming) a écrit : > Hi, > > I have observed that there is a maximum limit to the number of PV or > HVM virtual machines you can start before dom0 hangs or crashes. > > For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the > 7th instance. Max I can start is 6 without crashing. > > For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start > the 4th instance. Max I can start is 3 without crashing. > > I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on > Intel DQ45CB motherboard. > > Are the above limits reasonable considering the hardware > specifications of my computer? > > I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels > 2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host > operating system is Fedora 11 Linux x86-64. > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users ^ permalink raw reply [flat|nested] 16+ messages in thread
* RE: [Xen-users] Max. PV and HVM Guests 2009-11-08 13:01 ` Moi meme @ 2009-11-09 8:17 ` Robert Dunkley 2009-11-09 10:52 ` Mr. Teo En Ming (Zhang Enming) 0 siblings, 1 reply; 16+ messages in thread From: Robert Dunkley @ 2009-11-09 8:17 UTC (permalink / raw) To: jp.pozzi, Mr. Teo En Ming (Zhang Enming); +Cc: xen-devel, xen-users There seems to also be a limit imposed by CPU context switching. Ie. Once you have enough VMs trying to grab a cpu core things come to a standstill as the cpu spends most of its time switching rather than processing. The most common bottleneck I find is disk performance but this depends hugely on what your VMs are doing. -----Original Message----- From: xen-users-bounces@lists.xensource.com [mailto:xen-users-bounces@lists.xensource.com] On Behalf Of Moi meme Sent: 08 November 2009 13:02 To: Mr. Teo En Ming (Zhang Enming) Cc: xen-devel@lists.xensource.com; xen-users@lists.xensource.com Subject: Re: [Xen-users] Max. PV and HVM Guests Hello, The maximum is a direct function of the available memory, every new machine "eats" some memory and when there is no more memory ...... I had some servers (64bits, 2 quad core and 32Gb Ram) running 19 VM, 2003 server, 2000 Server,Fedora, Debian all in 32bits. In my own system I have tested with upto 10 VMs of 512M each without breaking the system. Regards JP Pozzi Le dimanche 08 novembre 2009 à 19:45 +0800, Mr. Teo En Ming (Zhang Enming) a écrit : > Hi, > > I have observed that there is a maximum limit to the number of PV or > HVM virtual machines you can start before dom0 hangs or crashes. > > For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the > 7th instance. Max I can start is 6 without crashing. > > For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start > the 4th instance. Max I can start is 3 without crashing. > > I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on > Intel DQ45CB motherboard. > > Are the above limits reasonable considering the hardware > specifications of my computer? > > I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels > 2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host > operating system is Fedora 11 Linux x86-64. > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users The SAQ Group Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ SAQ is the trading name of SEMTEC Limited. Registered in England & Wales Company Number: 06481952 http://www.saqnet.co.uk AS29219 SAQ Group Delivers high quality, honestly priced communication and I.T. services to UK Business. Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : Backups : Managed Networks : Remote Support. ISPA Member ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Max. PV and HVM Guests 2009-11-09 8:17 ` [Xen-users] " Robert Dunkley @ 2009-11-09 10:52 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 11:53 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 11:54 ` [Xen-devel] " Pasi Kärkkäinen 0 siblings, 2 replies; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 10:52 UTC (permalink / raw) To: Robert Dunkley; +Cc: xen-devel, space.time.universe, xen-users [-- Attachment #1.1: Type: text/plain, Size: 4362 bytes --] Hi, Please watch this 4-minute video at http://www.youtube.com/watch?v=LbLaPpwNAx4 I have only started 3 HVM Linux guests with 1 GB ram each. I can't start the 4th HVM guest. If I attempt to start the 4th instance, it will crash dom0. Are there anything in the xm dmesg output that could explain the low limit to the number of VMs that I could start before dom0 becomes unresponsive? Thank you. -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Mon, Nov 9, 2009 at 4:17 PM, Robert Dunkley <Robert@saq.co.uk> wrote: > There seems to also be a limit imposed by CPU context switching. Ie. Once > you have enough VMs trying to grab a cpu core things come to a standstill as > the cpu spends most of its time switching rather than processing. The most > common bottleneck I find is disk performance but this depends hugely on what > your VMs are doing. > > -----Original Message----- > From: xen-users-bounces@lists.xensource.com [mailto: > xen-users-bounces@lists.xensource.com] On Behalf Of Moi meme > Sent: 08 November 2009 13:02 > To: Mr. Teo En Ming (Zhang Enming) > Cc: xen-devel@lists.xensource.com; xen-users@lists.xensource.com > Subject: Re: [Xen-users] Max. PV and HVM Guests > > Hello, > > The maximum is a direct function of the available memory, every new > machine "eats" some memory and when there is no more memory ...... > I had some servers (64bits, 2 quad core and 32Gb Ram) running 19 VM, > 2003 server, 2000 Server,Fedora, Debian all in 32bits. > In my own system I have tested with upto 10 VMs of 512M each without > breaking the system. > > Regards > > JP Pozzi > > Le dimanche 08 novembre 2009 à 19:45 +0800, Mr. Teo En Ming (Zhang > Enming) a écrit : > > Hi, > > > > I have observed that there is a maximum limit to the number of PV or > > HVM virtual machines you can start before dom0 hangs or crashes. > > > > For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the > > 7th instance. Max I can start is 6 without crashing. > > > > For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start > > the 4th instance. Max I can start is 3 without crashing. > > > > I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on > > Intel DQ45CB motherboard. > > > > Are the above limits reasonable considering the hardware > > specifications of my computer? > > > > I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels > > 2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host > > operating system is Fedora 11 Linux x86-64. > > > > -- > > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > > Engineering) > > Alma Maters: > > (1) Singapore Polytechnic > > (2) National University of Singapore > > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > > My Secondary Blog: http://enmingteo.wordpress.com > > My Youtube videos: http://www.youtube.com/user/enmingteo > > Email: space.time.universe@gmail.com > > Mobile Phone (Starhub Prepaid): +65-8369-2618 > > Street: Bedok Reservoir Road > > Country: Singapore > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > The SAQ Group > > Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ > SAQ is the trading name of SEMTEC Limited. Registered in England & Wales > Company Number: 06481952 > > http://www.saqnet.co.uk AS29219 > > SAQ Group Delivers high quality, honestly priced communication and I.T. > services to UK Business. > > Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : > Backups : Managed Networks : Remote Support. > > ISPA Member > > [-- Attachment #1.2: Type: text/html, Size: 6063 bytes --] [-- Attachment #2: Type: text/plain, Size: 137 bytes --] _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Max. PV and HVM Guests 2009-11-09 10:52 ` Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 11:53 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 11:54 ` [Xen-devel] " Pasi Kärkkäinen 1 sibling, 0 replies; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 11:53 UTC (permalink / raw) To: Robert Dunkley; +Cc: xen-devel, space.time.universe, xen-users [-- Attachment #1.1: Type: text/plain, Size: 5253 bytes --] Could it be that my Intel Pentium Dual Core E6300 2.8 GHz processor is not powerful enough? Maybe need to upgrade to Intel Core 2 Quad? -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Mon, Nov 9, 2009 at 6:52 PM, Mr. Teo En Ming (Zhang Enming) < space.time.universe@gmail.com> wrote: > Hi, > > Please watch this 4-minute video at > http://www.youtube.com/watch?v=LbLaPpwNAx4 > > I have only started 3 HVM Linux guests with 1 GB ram each. I can't start > the 4th HVM guest. If I attempt to start the 4th instance, it will crash > dom0. > > Are there anything in the xm dmesg output that could explain the low limit > to the number of VMs that I could start before dom0 becomes unresponsive? > > Thank you. > > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > > On Mon, Nov 9, 2009 at 4:17 PM, Robert Dunkley <Robert@saq.co.uk> wrote: > >> There seems to also be a limit imposed by CPU context switching. Ie. Once >> you have enough VMs trying to grab a cpu core things come to a standstill as >> the cpu spends most of its time switching rather than processing. The most >> common bottleneck I find is disk performance but this depends hugely on what >> your VMs are doing. >> >> -----Original Message----- >> From: xen-users-bounces@lists.xensource.com [mailto: >> xen-users-bounces@lists.xensource.com] On Behalf Of Moi meme >> Sent: 08 November 2009 13:02 >> To: Mr. Teo En Ming (Zhang Enming) >> Cc: xen-devel@lists.xensource.com; xen-users@lists.xensource.com >> Subject: Re: [Xen-users] Max. PV and HVM Guests >> >> Hello, >> >> The maximum is a direct function of the available memory, every new >> machine "eats" some memory and when there is no more memory ...... >> I had some servers (64bits, 2 quad core and 32Gb Ram) running 19 VM, >> 2003 server, 2000 Server,Fedora, Debian all in 32bits. >> In my own system I have tested with upto 10 VMs of 512M each without >> breaking the system. >> >> Regards >> >> JP Pozzi >> >> Le dimanche 08 novembre 2009 à 19:45 +0800, Mr. Teo En Ming (Zhang >> Enming) a écrit : >> > Hi, >> > >> > I have observed that there is a maximum limit to the number of PV or >> > HVM virtual machines you can start before dom0 hangs or crashes. >> > >> > For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the >> > 7th instance. Max I can start is 6 without crashing. >> > >> > For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start >> > the 4th instance. Max I can start is 3 without crashing. >> > >> > I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on >> > Intel DQ45CB motherboard. >> > >> > Are the above limits reasonable considering the hardware >> > specifications of my computer? >> > >> > I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels >> > 2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host >> > operating system is Fedora 11 Linux x86-64. >> > >> > -- >> > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical >> > Engineering) >> > Alma Maters: >> > (1) Singapore Polytechnic >> > (2) National University of Singapore >> > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com >> > My Secondary Blog: http://enmingteo.wordpress.com >> > My Youtube videos: http://www.youtube.com/user/enmingteo >> > Email: space.time.universe@gmail.com >> > Mobile Phone (Starhub Prepaid): +65-8369-2618 >> > Street: Bedok Reservoir Road >> > Country: Singapore >> > _______________________________________________ >> > Xen-users mailing list >> > Xen-users@lists.xensource.com >> > http://lists.xensource.com/xen-users >> >> >> >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> >> The SAQ Group >> >> Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ >> SAQ is the trading name of SEMTEC Limited. Registered in England & Wales >> Company Number: 06481952 >> >> http://www.saqnet.co.uk AS29219 >> >> SAQ Group Delivers high quality, honestly priced communication and I.T. >> services to UK Business. >> >> Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : >> Backups : Managed Networks : Remote Support. >> >> ISPA Member >> >> > > > > [-- Attachment #1.2: Type: text/html, Size: 7598 bytes --] [-- Attachment #2: Type: text/plain, Size: 137 bytes --] _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: [Xen-devel] Re: Max. PV and HVM Guests 2009-11-09 10:52 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 11:53 ` Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 11:54 ` Pasi Kärkkäinen 2009-11-09 12:01 ` Re: [Xen-users] " Mr. Teo En Ming (Zhang Enming) 1 sibling, 1 reply; 16+ messages in thread From: Pasi Kärkkäinen @ 2009-11-09 11:54 UTC (permalink / raw) To: Mr. Teo En Ming (Zhang Enming); +Cc: xen-devel, xen-users, Robert Dunkley On Mon, Nov 09, 2009 at 06:52:37PM +0800, Mr. Teo En Ming (Zhang Enming) wrote: > Hi, > > Please watch this 4-minute video at > [1]http://www.youtube.com/watch?v=LbLaPpwNAx4 > > I have only started 3 HVM Linux guests with 1 GB ram each. I can't start > the 4th HVM guest. If I attempt to start the 4th instance, it will crash > dom0. > > Are there anything in the xm dmesg output that could explain the low limit > to the number of VMs that I could start before dom0 becomes unresponsive? > Have you limited dom0 memory (by specifying dom0_mem=XMB option in grub.conf for xen.gz) ? What does "xm info" say about free memory before starting any guests? -- Pasi ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Re: [Xen-users] Max. PV and HVM Guests 2009-11-09 11:54 ` [Xen-devel] " Pasi Kärkkäinen @ 2009-11-09 12:01 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 12:05 ` Pasi Kärkkäinen 0 siblings, 1 reply; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 12:01 UTC (permalink / raw) To: Pasi Kärkkäinen Cc: jp.pozzi, xen-devel, space.time.universe, xen-users, Robert Dunkley [-- Attachment #1.1: Type: text/plain, Size: 2953 bytes --] No, I didn't limit dom0 memory in grub.conf. Here's my xm info output after I have shutdown all the virtual machines. [root@fedora11-x86-64-host ~]# xm list Name ID Mem VCPUs State Time(s) Domain-0 0 2812 2 r----- 3242.5 [root@fedora11-x86-64-host ~]# xm info host : fedora11-x86-64-host release : 2.6.30-rc3-enming.teo-tip version : #1 SMP Wed Aug 19 23:14:15 SGT 2009 machine : x86_64 nr_cpus : 2 nr_nodes : 1 cores_per_socket : 2 threads_per_core : 1 cpu_mhz : 2800 hw_caps : bfebfbff:20100800:00000000:00000140:0400e3bd:00000000:00000001:00000000 virt_caps : hvm hvm_directio total_memory : 6039 free_memory : 3124 node_to_cpu : node0:0-1 node_to_memory : node0:3124 xen_major : 3 xen_minor : 5 xen_extra : -unstable xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : Tue Sep 01 11:34:31 2009 +0100 20143:a7de5bd776ca xen_commandline : iommu=1 cc_compiler : gcc version 4.4.1 20090725 (Red Hat 4.4.1-2) (GCC) cc_compile_by : root cc_compile_domain : (none) cc_compile_date : Thu Sep 10 07:01:13 SGT 2009 xend_config_format : 4 -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Mon, Nov 9, 2009 at 7:54 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > On Mon, Nov 09, 2009 at 06:52:37PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > Hi, > > > > Please watch this 4-minute video at > > [1]http://www.youtube.com/watch?v=LbLaPpwNAx4 > > > > I have only started 3 HVM Linux guests with 1 GB ram each. I can't > start > > the 4th HVM guest. If I attempt to start the 4th instance, it will > crash > > dom0. > > > > Are there anything in the xm dmesg output that could explain the low > limit > > to the number of VMs that I could start before dom0 becomes > unresponsive? > > > > Have you limited dom0 memory (by specifying dom0_mem=XMB option in > grub.conf for xen.gz) ? > > What does "xm info" say about free memory before starting any guests? > > -- Pasi > > > [-- Attachment #1.2: Type: text/html, Size: 3790 bytes --] [-- Attachment #2: Type: text/plain, Size: 138 bytes --] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Re: [Xen-users] Max. PV and HVM Guests 2009-11-09 12:01 ` Re: [Xen-users] " Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 12:05 ` Pasi Kärkkäinen 2009-11-09 12:14 ` Mr. Teo En Ming (Zhang Enming) 0 siblings, 1 reply; 16+ messages in thread From: Pasi Kärkkäinen @ 2009-11-09 12:05 UTC (permalink / raw) To: Mr. Teo En Ming (Zhang Enming) Cc: jp.pozzi, xen-devel, xen-users, Robert Dunkley On Mon, Nov 09, 2009 at 08:01:00PM +0800, Mr. Teo En Ming (Zhang Enming) wrote: > No, I didn't limit dom0 memory in grub.conf. > You should. If dom0 has all the memory at boot time, you need to balloon down dom0 memory every time you create a new guest - this can (and will) cause problems with the dom0 linux kernel. Linux calculates some internal parameters/buffers/values based on the _boot time_ amount of memory. And when the amount of memory goes down to only a small fraction of that while creating new guests bad things can happen.. It still shouldn't crash though.. I bet your problem will get fixed when you limit the dom0 memory to say dom0_mem=512M and reboot. -- Pasi > Here's my xm info output after I have shutdown all the virtual machines. > > [root@fedora11-x86-64-host ~]# xm list > Name ID Mem VCPUs State > Time(s) > Domain-0 0 2812 2 r----- > 3242.5 > [root@fedora11-x86-64-host ~]# xm info > host : fedora11-x86-64-host > release : 2.6.30-rc3-enming.teo-tip > version : #1 SMP Wed Aug 19 23:14:15 SGT 2009 > machine : x86_64 > nr_cpus : 2 > nr_nodes : 1 > cores_per_socket : 2 > threads_per_core : 1 > cpu_mhz : 2800 > hw_caps : > bfebfbff:20100800:00000000:00000140:0400e3bd:00000000:00000001:00000000 > virt_caps : hvm hvm_directio > total_memory : 6039 > free_memory : 3124 > node_to_cpu : node0:0-1 > node_to_memory : node0:3124 > xen_major : 3 > xen_minor : 5 > xen_extra : -unstable > xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 > hvm-3.0-x86_32p hvm-3.0-x86_64 > xen_scheduler : credit > xen_pagesize : 4096 > platform_params : virt_start=0xffff800000000000 > xen_changeset : Tue Sep 01 11:34:31 2009 +0100 20143:a7de5bd776ca > xen_commandline : iommu=1 > cc_compiler : gcc version 4.4.1 20090725 (Red Hat 4.4.1-2) > (GCC) > cc_compile_by : root > cc_compile_domain : (none) > cc_compile_date : Thu Sep 10 07:01:13 SGT 2009 > xend_config_format : 4 > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: [1]http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: [2]http://enmingteo.wordpress.com > My Youtube videos: [3]http://www.youtube.com/user/enmingteo > Email: [4]space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > > On Mon, Nov 9, 2009 at 7:54 PM, Pasi Kärkkäinen <[5]pasik@iki.fi> wrote: > > On Mon, Nov 09, 2009 at 06:52:37PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > Hi, > > > > Please watch this 4-minute video at > > [1][6]http://www.youtube.com/watch?v=LbLaPpwNAx4 > > > > I have only started 3 HVM Linux guests with 1 GB ram each. I can't > start > > the 4th HVM guest. If I attempt to start the 4th instance, it will > crash > > dom0. > > > > Are there anything in the xm dmesg output that could explain the > low limit > > to the number of VMs that I could start before dom0 becomes > unresponsive? > > > > Have you limited dom0 memory (by specifying dom0_mem=XMB option in > grub.conf for xen.gz) ? > > What does "xm info" say about free memory before starting any guests? > -- Pasi > > References > > Visible links > 1. http://teo-en-ming-aka-zhang-enming.blogspot.com/ > 2. http://enmingteo.wordpress.com/ > 3. http://www.youtube.com/user/enmingteo > 4. mailto:space.time.universe@gmail.com > 5. mailto:pasik@iki.fi > 6. http://www.youtube.com/watch?v=LbLaPpwNAx4 ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Re: [Xen-users] Max. PV and HVM Guests 2009-11-09 12:05 ` Pasi Kärkkäinen @ 2009-11-09 12:14 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 12:18 ` Pasi Kärkkäinen 0 siblings, 1 reply; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 12:14 UTC (permalink / raw) To: Pasi Kärkkäinen Cc: jp.pozzi, xen-devel, space.time.universe, xen-users, Robert Dunkley [-- Attachment #1.1: Type: text/plain, Size: 5225 bytes --] What is a good value for dom0_mem if I want to start X server and run GNOME? Will 512 MB be too little? -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Mon, Nov 9, 2009 at 8:05 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > On Mon, Nov 09, 2009 at 08:01:00PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > No, I didn't limit dom0 memory in grub.conf. > > > > You should. > > If dom0 has all the memory at boot time, you need to balloon down dom0 > memory every time you create a new guest - this can (and will) cause > problems with the dom0 linux kernel. > > Linux calculates some internal parameters/buffers/values based on the > _boot time_ amount of memory. And when the amount of memory goes down to > only a small fraction of that while creating new guests bad things can > happen.. > > It still shouldn't crash though.. I bet your problem will get fixed when > you limit the dom0 memory to say dom0_mem=512M and reboot. > > -- Pasi > > > Here's my xm info output after I have shutdown all the virtual > machines. > > > > [root@fedora11-x86-64-host ~]# xm list > > Name ID Mem VCPUs State > > Time(s) > > Domain-0 0 2812 2 r----- > > 3242.5 > > [root@fedora11-x86-64-host ~]# xm info > > host : fedora11-x86-64-host > > release : 2.6.30-rc3-enming.teo-tip > > version : #1 SMP Wed Aug 19 23:14:15 SGT 2009 > > machine : x86_64 > > nr_cpus : 2 > > nr_nodes : 1 > > cores_per_socket : 2 > > threads_per_core : 1 > > cpu_mhz : 2800 > > hw_caps : > > > bfebfbff:20100800:00000000:00000140:0400e3bd:00000000:00000001:00000000 > > virt_caps : hvm hvm_directio > > total_memory : 6039 > > free_memory : 3124 > > node_to_cpu : node0:0-1 > > node_to_memory : node0:3124 > > xen_major : 3 > > xen_minor : 5 > > xen_extra : -unstable > > xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 > > hvm-3.0-x86_32p hvm-3.0-x86_64 > > xen_scheduler : credit > > xen_pagesize : 4096 > > platform_params : virt_start=0xffff800000000000 > > xen_changeset : Tue Sep 01 11:34:31 2009 +0100 > 20143:a7de5bd776ca > > xen_commandline : iommu=1 > > cc_compiler : gcc version 4.4.1 20090725 (Red Hat 4.4.1-2) > > (GCC) > > cc_compile_by : root > > cc_compile_domain : (none) > > cc_compile_date : Thu Sep 10 07:01:13 SGT 2009 > > xend_config_format : 4 > > > > -- > > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > > Engineering) > > Alma Maters: > > (1) Singapore Polytechnic > > (2) National University of Singapore > > My Primary Blog: [1]http://teo-en-ming-aka-zhang-enming.blogspot.com > > My Secondary Blog: [2]http://enmingteo.wordpress.com > > My Youtube videos: [3]http://www.youtube.com/user/enmingteo > > Email: [4]space.time.universe@gmail.com > > Mobile Phone (Starhub Prepaid): +65-8369-2618 > > Street: Bedok Reservoir Road > > Country: Singapore > > > > On Mon, Nov 9, 2009 at 7:54 PM, Pasi Kärkkäinen <[5]pasik@iki.fi> > wrote: > > > > On Mon, Nov 09, 2009 at 06:52:37PM +0800, Mr. Teo En Ming (Zhang > Enming) > > wrote: > > > Hi, > > > > > > Please watch this 4-minute video at > > > [1][6]http://www.youtube.com/watch?v=LbLaPpwNAx4 > > > > > > I have only started 3 HVM Linux guests with 1 GB ram each. I > can't > > start > > > the 4th HVM guest. If I attempt to start the 4th instance, it > will > > crash > > > dom0. > > > > > > Are there anything in the xm dmesg output that could explain > the > > low limit > > > to the number of VMs that I could start before dom0 becomes > > unresponsive? > > > > > > > Have you limited dom0 memory (by specifying dom0_mem=XMB option in > > grub.conf for xen.gz) ? > > > > What does "xm info" say about free memory before starting any > guests? > > -- Pasi > > > > References > > > > Visible links > > 1. http://teo-en-ming-aka-zhang-enming.blogspot.com/ > > 2. http://enmingteo.wordpress.com/ > > 3. http://www.youtube.com/user/enmingteo > > 4. mailto:space.time.universe@gmail.com > > 5. mailto:pasik@iki.fi > > 6. http://www.youtube.com/watch?v=LbLaPpwNAx4 > [-- Attachment #1.2: Type: text/html, Size: 7148 bytes --] [-- Attachment #2: Type: text/plain, Size: 138 bytes --] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Re: [Xen-users] Max. PV and HVM Guests 2009-11-09 12:14 ` Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 12:18 ` Pasi Kärkkäinen 2009-11-09 13:10 ` Mr. Teo En Ming (Zhang Enming) 0 siblings, 1 reply; 16+ messages in thread From: Pasi Kärkkäinen @ 2009-11-09 12:18 UTC (permalink / raw) To: Mr. Teo En Ming (Zhang Enming) Cc: jp.pozzi, xen-devel, xen-users, Robert Dunkley On Mon, Nov 09, 2009 at 08:14:27PM +0800, Mr. Teo En Ming (Zhang Enming) wrote: > What is a good value for dom0_mem if I want to start X server and run > GNOME? Will 512 MB be too little? > Go for 1024 MB then.. -- Pasi ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Re: [Xen-users] Max. PV and HVM Guests 2009-11-09 12:18 ` Pasi Kärkkäinen @ 2009-11-09 13:10 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 14:37 ` [Xen-devel] " Mr. Teo En Ming (Zhang Enming) 0 siblings, 1 reply; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 13:10 UTC (permalink / raw) To: Pasi Kärkkäinen Cc: jp.pozzi, xen-devel, space.time.universe, xen-users, Robert Dunkley [-- Attachment #1.1: Type: text/plain, Size: 6094 bytes --] Great! After setting dom0_mem=1024M, I can start all 5 nodes of my Rocks HPC cluster without crashing dom0 as compared to the previous limit of 3 nodes when I did not set dom0_mem. Thank you Pasi! Another resource problem solved. Here's my latest grub.conf: # grub.conf generated by anaconda # # Note that you do not have to rerun grub after making changes to this file # NOTICE: You have a /boot partition. This means that # all kernel and initrd paths are relative to /boot/, eg. # root (hd0,0) # kernel /vmlinuz-version ro root=/dev/mapper/vg_fedora11_host-lv_root # initrd /initrd-version.img #boot=/dev/sda default=4 timeout=100 splashimage=(hd0,0)/grub/splash.xpm.gz hiddenmenu title Fedora (2.6.31.5-xen-enming.teo) root (hd0,0) # kernel /vmlinuz-2.6.31.5-xen-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.31.5-xen-enming.teo.img kernel /xen.gz dom0_mem=1024M iommu=1 module /vmlinuz-2.6.31.5-xen-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset module /initrd-2.6.31.5-xen-enming.teo.img title Fedora (2.6.31.4-xen-enming.teo) root (hd0,0) # kernel /vmlinuz-2.6.31.4-xen-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.31.4-xen-enming.teo.img kernel /xen.gz dom0_mem=1024M iommu=1 module /vmlinuz-2.6.31.4-xen-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset module /initrd-2.6.31.4-xen-enming.teo.img title Fedora (2.6.31.1-xen-enming.teo) root (hd0,0) # kernel /vmlinuz-2.6.31.1-xen-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.31.1-xen-enming.teo.img kernel /xen.gz dom0_mem=1024M iommu=1 module /vmlinuz-2.6.31.1-xen-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset module /initrd-2.6.31.1-xen-enming.teo.img title Fedora (2.6.31-enming.teo) root (hd0,0) kernel /vmlinuz-2.6.31-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 initrd /initrd-2.6.31-enming.teo.img title Fedora (2.6.30.5-enming.teo) root (hd0,0) kernel /vmlinuz-2.6.30.5-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 initrd /initrd-2.6.30.5-enming.teo.img title Fedora (2.6.18.8-enming.teo) root (hd0,0) # kernel /vmlinuz-2.6.18.8-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.18.8-enming.teo.img kernel /xen.gz dom0_mem=1024M iommu=1 module /vmlinuz-2.6.18.8-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root module /initrd-2.6.18.8-enming.teo.img title Fedora (2.6.31-rc6-enming.teo) with Serial Console root (hd0,0) # kernel /vmlinuz-2.6.31-rc6-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.31-rc6-enming.teo.img kernel /xen.gz dom0_mem=1024M iommu=1 iommu_inclusive_mapping=1 com1=115200,8n1 console=com1 # module /vmlinuz-2.6.31-rc6-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 xencons=ttyS0 console=ttyS0,115200 module /vmlinuz-2.6.31-rc6-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 console=hvc0 earlyprintk=xen module /initrd-2.6.31-rc6-enming.teo.img title Fedora (2.6.30-rc3-enming.teo-tip) with Serial Console root (hd0,0) # kernel /vmlinuz-2.6.30-rc3-enming.teo-tip ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.30-rc3-enming.teo-tip.img kernel /xen.gz dom0_mem=1024M iommu=1 iommu_inclusive_mapping=1 com1=115200,8n1 console=com1 # module /vmlinuz-2.6.30-rc3-enming.teo-tip ro root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 xencons=ttyS0 console=ttyS0,115200 module /vmlinuz-2.6.30-rc3-enming.teo-tip ro root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 console=hvc0 earlyprintk=xen module /initrd-2.6.30-rc3-enming.teo-tip.img title Fedora (2.6.31-rc6-enming.teo) root (hd0,0) # kernel /vmlinuz-2.6.31-rc6-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.31-rc6-enming.teo.img kernel /xen.gz dom0_mem=1024M iommu=1 module /vmlinuz-2.6.31-rc6-enming.teo ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset module /initrd-2.6.31-rc6-enming.teo.img title Fedora (2.6.30-rc3-enming.teo-tip) root (hd0,0) # kernel /vmlinuz-2.6.30-rc3-enming.teo-tip ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 # initrd /initrd-2.6.30-rc3-enming.teo-tip.img kernel /xen.gz dom0_mem=1024M iommu=1 module /vmlinuz-2.6.30-rc3-enming.teo-tip ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset module /initrd-2.6.30-rc3-enming.teo-tip.img title Fedora (2.6.29.4-167.fc11.x86_64) root (hd0,0) kernel /vmlinuz-2.6.29.4-167.fc11.x86_64 ro root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 initrd /initrd-2.6.29.4-167.fc11.x86_64.img -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Mon, Nov 9, 2009 at 8:18 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > On Mon, Nov 09, 2009 at 08:14:27PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > What is a good value for dom0_mem if I want to start X server and run > > GNOME? Will 512 MB be too little? > > > > Go for 1024 MB then.. > > -- Pasi > > [-- Attachment #1.2: Type: text/html, Size: 6881 bytes --] [-- Attachment #2: Type: text/plain, Size: 138 bytes --] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: [Xen-devel] Re: Max. PV and HVM Guests 2009-11-09 13:10 ` Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 14:37 ` Mr. Teo En Ming (Zhang Enming) 0 siblings, 0 replies; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 14:37 UTC (permalink / raw) To: Pasi Kärkkäinen Cc: xen-devel, space.time.universe, xen-users, Robert Dunkley [-- Attachment #1.1: Type: text/plain, Size: 7849 bytes --] Hi All, I have discovered that setting dom0_mem also solves another problem I am facing. Previously I have complained that, after starting a HVM guest, in any pv-ops dom0 kernels 2.6.31.X, dom0 will be very slow, sluggish, and unresponsive, such that it is nearly impossible to start another HVM virtual machine. Now, after setting dom0_mem, I booted up into pvops dom0 kernel 2.6.31.5, I started all 5 Rocks HPC cluster compute nodes at one go. And guess what? Dom0 is not even sluggish! I could still do desktop screen video capturing! Voila! Setting dom0_mem is really killing two birds with one stone. It raises the number of VMs that I can start and also resolves the sluggishness in dom0 (pvops kernels 2.6.31.X affected; 2.6.30-rc3 is NOT affected) after starting a virtual machine. Setting dom0_mem really does wonders. Thank you Pasi! -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Mon, Nov 9, 2009 at 9:10 PM, Mr. Teo En Ming (Zhang Enming) < space.time.universe@gmail.com> wrote: > Great! After setting dom0_mem=1024M, I can start all 5 nodes of my Rocks > HPC cluster without crashing dom0 as compared to the previous limit of 3 > nodes when I did not set dom0_mem. > > Thank you Pasi! Another resource problem solved. > > Here's my latest grub.conf: > > # grub.conf generated by anaconda > # > # Note that you do not have to rerun grub after making changes to this file > # NOTICE: You have a /boot partition. This means that > # all kernel and initrd paths are relative to /boot/, eg. > # root (hd0,0) > # kernel /vmlinuz-version ro > root=/dev/mapper/vg_fedora11_host-lv_root > # initrd /initrd-version.img > #boot=/dev/sda > default=4 > timeout=100 > splashimage=(hd0,0)/grub/splash.xpm.gz > hiddenmenu > title Fedora (2.6.31.5-xen-enming.teo) > root (hd0,0) > # kernel /vmlinuz-2.6.31.5-xen-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.31.5-xen-enming.teo.img > kernel /xen.gz dom0_mem=1024M iommu=1 > module /vmlinuz-2.6.31.5-xen-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset > module /initrd-2.6.31.5-xen-enming.teo.img > title Fedora (2.6.31.4-xen-enming.teo) > root (hd0,0) > # kernel /vmlinuz-2.6.31.4-xen-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.31.4-xen-enming.teo.img > kernel /xen.gz dom0_mem=1024M iommu=1 > module /vmlinuz-2.6.31.4-xen-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset > module /initrd-2.6.31.4-xen-enming.teo.img > title Fedora (2.6.31.1-xen-enming.teo) > root (hd0,0) > # kernel /vmlinuz-2.6.31.1-xen-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.31.1-xen-enming.teo.img > kernel /xen.gz dom0_mem=1024M iommu=1 > module /vmlinuz-2.6.31.1-xen-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset > module /initrd-2.6.31.1-xen-enming.teo.img > title Fedora (2.6.31-enming.teo) > root (hd0,0) > kernel /vmlinuz-2.6.31-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > initrd /initrd-2.6.31-enming.teo.img > title Fedora (2.6.30.5-enming.teo) > root (hd0,0) > kernel /vmlinuz-2.6.30.5-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > initrd /initrd-2.6.30.5-enming.teo.img > title Fedora (2.6.18.8-enming.teo) > root (hd0,0) > # kernel /vmlinuz-2.6.18.8-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.18.8-enming.teo.img > kernel /xen.gz dom0_mem=1024M iommu=1 > module /vmlinuz-2.6.18.8-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root > module /initrd-2.6.18.8-enming.teo.img > title Fedora (2.6.31-rc6-enming.teo) with Serial Console > root (hd0,0) > # kernel /vmlinuz-2.6.31-rc6-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.31-rc6-enming.teo.img > kernel /xen.gz dom0_mem=1024M iommu=1 iommu_inclusive_mapping=1 > com1=115200,8n1 console=com1 > # module /vmlinuz-2.6.31-rc6-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 xencons=ttyS0 > console=ttyS0,115200 > module /vmlinuz-2.6.31-rc6-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 console=hvc0 > earlyprintk=xen > module /initrd-2.6.31-rc6-enming.teo.img > title Fedora (2.6.30-rc3-enming.teo-tip) with Serial Console > root (hd0,0) > # kernel /vmlinuz-2.6.30-rc3-enming.teo-tip ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.30-rc3-enming.teo-tip.img > kernel /xen.gz dom0_mem=1024M iommu=1 iommu_inclusive_mapping=1 > com1=115200,8n1 console=com1 > # module /vmlinuz-2.6.30-rc3-enming.teo-tip ro > root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 xencons=ttyS0 > console=ttyS0,115200 > module /vmlinuz-2.6.30-rc3-enming.teo-tip ro > root=/dev/mapper/vg_fedora11_host-lv_root selinux=0 console=hvc0 > earlyprintk=xen > module /initrd-2.6.30-rc3-enming.teo-tip.img > > title Fedora (2.6.31-rc6-enming.teo) > root (hd0,0) > # kernel /vmlinuz-2.6.31-rc6-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.31-rc6-enming.teo.img > kernel /xen.gz dom0_mem=1024M iommu=1 > module /vmlinuz-2.6.31-rc6-enming.teo ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset > module /initrd-2.6.31-rc6-enming.teo.img > title Fedora (2.6.30-rc3-enming.teo-tip) > root (hd0,0) > # kernel /vmlinuz-2.6.30-rc3-enming.teo-tip ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > # initrd /initrd-2.6.30-rc3-enming.teo-tip.img > kernel /xen.gz dom0_mem=1024M iommu=1 > module /vmlinuz-2.6.30-rc3-enming.teo-tip ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 nomodeset > module /initrd-2.6.30-rc3-enming.teo-tip.img > title Fedora (2.6.29.4-167.fc11.x86_64) > root (hd0,0) > kernel /vmlinuz-2.6.29.4-167.fc11.x86_64 ro > root=/dev/mapper/vg_fedora11_host-lv_root rhgb quiet selinux=0 > initrd /initrd-2.6.29.4-167.fc11.x86_64.img > > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > > On Mon, Nov 9, 2009 at 8:18 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > >> On Mon, Nov 09, 2009 at 08:14:27PM +0800, Mr. Teo En Ming (Zhang Enming) >> wrote: >> > What is a good value for dom0_mem if I want to start X server and run >> > GNOME? Will 512 MB be too little? >> > >> >> Go for 1024 MB then.. >> >> -- Pasi >> >> > > > > [-- Attachment #1.2: Type: text/html, Size: 9080 bytes --] [-- Attachment #2: Type: text/plain, Size: 137 bytes --] _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: Max. PV and HVM Guests 2009-11-08 11:45 Max. PV and HVM Guests Mr. Teo En Ming (Zhang Enming) 2009-11-08 11:46 ` Mr. Teo En Ming (Zhang Enming) 2009-11-08 13:01 ` Moi meme @ 2009-11-08 13:50 ` Pasi Kärkkäinen 2009-11-08 16:30 ` [Xen-devel] " Grant McWilliams 2009-11-09 3:35 ` Mr. Teo En Ming (Zhang Enming) 2 siblings, 2 replies; 16+ messages in thread From: Pasi Kärkkäinen @ 2009-11-08 13:50 UTC (permalink / raw) To: Mr. Teo En Ming (Zhang Enming); +Cc: xen-devel, xen-users On Sun, Nov 08, 2009 at 07:45:01PM +0800, Mr. Teo En Ming (Zhang Enming) wrote: > Hi, > > I have observed that there is a maximum limit to the number of PV or HVM > virtual machines you can start before dom0 hangs or crashes. > > For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the 7th > instance. Max I can start is 6 without crashing. > > For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start the > 4th instance. Max I can start is 3 without crashing. > > I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on > Intel DQ45CB motherboard. > > Are the above limits reasonable considering the hardware specifications of > my computer? > > I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels > 2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host > operating system is Fedora 11 Linux x86-64. > Dom0 or Xen shouldn't crash for starting guests. Sounds like a bug somewhere. Any errors/tracebacks? Do you have serial console configured? -- Pasi ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: [Xen-devel] Max. PV and HVM Guests 2009-11-08 13:50 ` Pasi Kärkkäinen @ 2009-11-08 16:30 ` Grant McWilliams 2009-11-09 3:35 ` Mr. Teo En Ming (Zhang Enming) 1 sibling, 0 replies; 16+ messages in thread From: Grant McWilliams @ 2009-11-08 16:30 UTC (permalink / raw) To: Pasi Kärkkäinen Cc: xen-devel, Mr. Teo En Ming (Zhang Enming), xen-users [-- Attachment #1.1: Type: text/plain, Size: 605 bytes --] On Sun, Nov 8, 2009 at 5:50 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > On Sun, Nov 08, 2009 at 07:45:01PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > Hi, > > > > I have observed that there is a maximum limit to the number of PV or > HVM > > virtual machines you can start before dom0 hangs or crashes. > > > Mr. Teo En Ming, I have a CentOS 5.3 x86_64 machine with 16GB of ram currently running 41 PV DomUs. Each DomU has 300 MB of ram. I have to admit weird things do happen if I decide to start them all at the same time but the machine never crashes. Grant [-- Attachment #1.2: Type: text/html, Size: 911 bytes --] [-- Attachment #2: Type: text/plain, Size: 137 bytes --] _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users ^ permalink raw reply [flat|nested] 16+ messages in thread
* Re: [Xen-devel] Max. PV and HVM Guests 2009-11-08 13:50 ` Pasi Kärkkäinen 2009-11-08 16:30 ` [Xen-devel] " Grant McWilliams @ 2009-11-09 3:35 ` Mr. Teo En Ming (Zhang Enming) 1 sibling, 0 replies; 16+ messages in thread From: Mr. Teo En Ming (Zhang Enming) @ 2009-11-09 3:35 UTC (permalink / raw) To: Pasi Kärkkäinen; +Cc: xen-devel, space.time.universe, xen-users [-- Attachment #1.1: Type: text/plain, Size: 1777 bytes --] Yes. I will try to see if there's a traceback. -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sun, Nov 8, 2009 at 9:50 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > On Sun, Nov 08, 2009 at 07:45:01PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > Hi, > > > > I have observed that there is a maximum limit to the number of PV or > HVM > > virtual machines you can start before dom0 hangs or crashes. > > > > For Fedora 11 Linux x86-64 PV guests, dom0 will crash when I start the > 7th > > instance. Max I can start is 6 without crashing. > > > > For CentOS 5.2 Linux x86-64 HVM guests, dom0 will crash when I start > the > > 4th instance. Max I can start is 3 without crashing. > > > > I have 6 GB of DDR2-800 with Intel Pentium Dual Core E6300 2.8 GHz on > > Intel DQ45CB motherboard. > > > > Are the above limits reasonable considering the hardware > specifications of > > my computer? > > > > I am using Xen 3.5-unstable changeset 20143 with pv-ops dom0 kernels > > 2.6.30-rc3, 2.6.31-rc6, 2.6.31.1, 2.6.31.4, and 2.6.31.5. My host > > operating system is Fedora 11 Linux x86-64. > > > > Dom0 or Xen shouldn't crash for starting guests. > Sounds like a bug somewhere. > > Any errors/tracebacks? Do you have serial console configured? > > -- Pasi > > [-- Attachment #1.2: Type: text/html, Size: 2459 bytes --] [-- Attachment #2: Type: text/plain, Size: 137 bytes --] _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users ^ permalink raw reply [flat|nested] 16+ messages in thread
end of thread, other threads:[~2009-11-09 14:37 UTC | newest] Thread overview: 16+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2009-11-08 11:45 Max. PV and HVM Guests Mr. Teo En Ming (Zhang Enming) 2009-11-08 11:46 ` Mr. Teo En Ming (Zhang Enming) 2009-11-08 13:01 ` Moi meme 2009-11-09 8:17 ` [Xen-users] " Robert Dunkley 2009-11-09 10:52 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 11:53 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 11:54 ` [Xen-devel] " Pasi Kärkkäinen 2009-11-09 12:01 ` Re: [Xen-users] " Mr. Teo En Ming (Zhang Enming) 2009-11-09 12:05 ` Pasi Kärkkäinen 2009-11-09 12:14 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 12:18 ` Pasi Kärkkäinen 2009-11-09 13:10 ` Mr. Teo En Ming (Zhang Enming) 2009-11-09 14:37 ` [Xen-devel] " Mr. Teo En Ming (Zhang Enming) 2009-11-08 13:50 ` Pasi Kärkkäinen 2009-11-08 16:30 ` [Xen-devel] " Grant McWilliams 2009-11-09 3:35 ` Mr. Teo En Ming (Zhang Enming)
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.