FreeBSD/Xen kernel

FreeBSD/Xen kernel

[Derrik Pates]

All,

Due to interest in the company I work for regarding offering Virtual 
Private Servers based on Xen (by the way, I've been playing with it, and 
have been very pleased), I'd been seeking information on the port of the 
FreeBSD to the Xen hypervisor. I've successfully run various Linux 
distributions (FC2, FC3, Debian, Gentoo) and NetBSD on top of it, so 
far. I finally did find a reference to FreeBSD guests in the list 
archive; unfortunately, so far I've not had any luck trying to boot one. 
So far, the log messages I see when I do 'xm create -c FreeBSDTest' are 
as follows:

Using config file "/etc/xen/FreeBSDTest".
Started domain FreeBSDTest, console on port 9623
************ REMOTE CONSOLE: CTRL-] TO QUIT ********
WARNING: loader(8) metadata is missing!
start_info 0xc02c3000
start_info->nr_pages 32768
Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
         The Regents of the University of California. All rights reserved.
FreeBSD 5.2.1-RELEASE #338: Sat Oct 30 21:56:31 PDT 2004
 
kmacy@freebird.eng.netapp.com:/t/niners/users/xen/bsd/sys/i386-xeno.tot/compile/XENCONF
Timecounter "ixen" frequency 2393261000 Hz quality 0
CPU: Intel(R) Celeron(R) CPU 2.40GHz (2393.26-MHz 686-class CPU)
   Origin = "GenuineIntel"  Id = 0xf34  Stepping = 4
 
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
real memory  = 131129344 (125 MB)
Physical memory chunk(s):
0x00000000002e9000 - 0x0000000007ac9fff, 125702144 bytes (30689 pages)
avail memory = 123846656 (118 MB)
random: <entropy source>
null: <null device, zero device>
mem: <memory & I/O>
Device configuration finished.
procfs registered
Timecounters tick every 10.000 msec
xc0: <Xen Console> on motherboard
xn0: bpf attached
GEOM: create disk xbd0 dp=0xc1e70e84
GEOM: new disk xbd0
[0] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
[1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
[2] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
[3] f:80 typ:165 s(CHS):0/0/1 e(CHS):1023/254/63 s:0 l:50000
GEOM: Configure xbd0a, start 0 length 4423680 end 4423679
GEOM: Configure xbd0c, start 0 length 4423680 end 4423679
lo0: bpf

So far, this is only using the binary kernel that's at 
http://www.bsdclusters.com/xenofreebsd/ ; I'm going to try building the 
kernel on my FreeBSD 5.2.1 install in VMware, but I was hoping someone 
might have some insight as to what is happening. I am running it on top 
of the Xen 2.0.1 hypervisor, with Debian 3.1 (sarge) as the domain0 
instance, using a 2.6.9 kernel (with Xen support added, of course). The 
configuration file for the domain is as follows:

kernel = "/boot/freebsd-5.2.1-xenU"
memory = 128
name = "FreeBSDTest"
disk = [ 'file:/tmp/mfsroot,hda1,w' ]
hostname = "FreeBSDTest"
extra = "vfs.root.mountfrom=ufs:/dev/xbd0c,boot_verbose=yes"
restart = "onreboot"

If anyone has any thoughts or suggestions, they'd be much appreciated.

-- 
Derrik Pates
dpates@dsdk12.net


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Kip Macy]

I've had a large number of downloads, but this is the first bit of
feedback I've gotten. There have been a number of fixes that have gone
into my local tree, so I should post a new binary - although none have
been related to the problem you are seeing.

Are you using an uncompressed copy of the mdroot I posted?


				-Kip



On Wed, 15 Dec 2004, Derrik Pates wrote:

> All,
>
> Due to interest in the company I work for regarding offering Virtual
> Private Servers based on Xen (by the way, I've been playing with it, and
> have been very pleased), I'd been seeking information on the port of the
> FreeBSD to the Xen hypervisor. I've successfully run various Linux
> distributions (FC2, FC3, Debian, Gentoo) and NetBSD on top of it, so
> far. I finally did find a reference to FreeBSD guests in the list
> archive; unfortunately, so far I've not had any luck trying to boot one.
> So far, the log messages I see when I do 'xm create -c FreeBSDTest' are
> as follows:
>
> Using config file "/etc/xen/FreeBSDTest".
> Started domain FreeBSDTest, console on port 9623
> ************ REMOTE CONSOLE: CTRL-] TO QUIT ********
> WARNING: loader(8) metadata is missing!
> start_info 0xc02c3000
> start_info->nr_pages 32768
> Copyright (c) 1992-2004 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>          The Regents of the University of California. All rights reserved.
> FreeBSD 5.2.1-RELEASE #338: Sat Oct 30 21:56:31 PDT 2004
>
> kmacy@freebird.eng.netapp.com:/t/niners/users/xen/bsd/sys/i386-xeno.tot/compile/XENCONF
> Timecounter "ixen" frequency 2393261000 Hz quality 0
> CPU: Intel(R) Celeron(R) CPU 2.40GHz (2393.26-MHz 686-class CPU)
>    Origin = "GenuineIntel"  Id = 0xf34  Stepping = 4
>
> Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> real memory  = 131129344 (125 MB)
> Physical memory chunk(s):
> 0x00000000002e9000 - 0x0000000007ac9fff, 125702144 bytes (30689 pages)
> avail memory = 123846656 (118 MB)
> random: <entropy source>
> null: <null device, zero device>
> mem: <memory & I/O>
> Device configuration finished.
> procfs registered
> Timecounters tick every 10.000 msec
> xc0: <Xen Console> on motherboard
> xn0: bpf attached
> GEOM: create disk xbd0 dp=0xc1e70e84
> GEOM: new disk xbd0
> [0] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
> [1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
> [2] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
> [3] f:80 typ:165 s(CHS):0/0/1 e(CHS):1023/254/63 s:0 l:50000
> GEOM: Configure xbd0a, start 0 length 4423680 end 4423679
> GEOM: Configure xbd0c, start 0 length 4423680 end 4423679
> lo0: bpf
>
> So far, this is only using the binary kernel that's at
> http://www.bsdclusters.com/xenofreebsd/ ; I'm going to try building the
> kernel on my FreeBSD 5.2.1 install in VMware, but I was hoping someone
> might have some insight as to what is happening. I am running it on top
> of the Xen 2.0.1 hypervisor, with Debian 3.1 (sarge) as the domain0
> instance, using a 2.6.9 kernel (with Xen support added, of course). The
> configuration file for the domain is as follows:
>
> kernel = "/boot/freebsd-5.2.1-xenU"
> memory = 128
> name = "FreeBSDTest"
> disk = [ 'file:/tmp/mfsroot,hda1,w' ]
> hostname = "FreeBSDTest"
> extra = "vfs.root.mountfrom=ufs:/dev/xbd0c,boot_verbose=yes"
> restart = "onreboot"
>
> If anyone has any thoughts or suggestions, they'd be much appreciated.
>
> --
> Derrik Pates
> dpates@dsdk12.net
>
>
> -------------------------------------------------------
> SF email is sponsored by - The IT Product Guide
> Read honest & candid reviews on hundreds of IT Products from real users.
> Discover which products truly live up to the hype. Start reading now.
> http://productguide.itmanagersjournal.com/
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xen-devel
>


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Kip Macy]

>
> Are you using an uncompressed copy of the mdroot I posted?

Duh - obviously. The only thing I can think of is that the mdroot is
corrupted. I'll double check the bits I've posted.

			-Kip


>
>
> On Wed, 15 Dec 2004, Derrik Pates wrote:
>
> > All,
> >
> > Due to interest in the company I work for regarding offering Virtual
> > Private Servers based on Xen (by the way, I've been playing with it, and
> > have been very pleased), I'd been seeking information on the port of the
> > FreeBSD to the Xen hypervisor. I've successfully run various Linux
> > distributions (FC2, FC3, Debian, Gentoo) and NetBSD on top of it, so
> > far. I finally did find a reference to FreeBSD guests in the list
> > archive; unfortunately, so far I've not had any luck trying to boot one.
> > So far, the log messages I see when I do 'xm create -c FreeBSDTest' are
> > as follows:
> >
> > Using config file "/etc/xen/FreeBSDTest".
> > Started domain FreeBSDTest, console on port 9623
> > ************ REMOTE CONSOLE: CTRL-] TO QUIT ********
> > WARNING: loader(8) metadata is missing!
> > start_info 0xc02c3000
> > start_info->nr_pages 32768
> > Copyright (c) 1992-2004 The FreeBSD Project.
> > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> >          The Regents of the University of California. All rights reserved.
> > FreeBSD 5.2.1-RELEASE #338: Sat Oct 30 21:56:31 PDT 2004
> >
> > kmacy@freebird.eng.netapp.com:/t/niners/users/xen/bsd/sys/i386-xeno.tot/compile/XENCONF
> > Timecounter "ixen" frequency 2393261000 Hz quality 0
> > CPU: Intel(R) Celeron(R) CPU 2.40GHz (2393.26-MHz 686-class CPU)
> >    Origin = "GenuineIntel"  Id = 0xf34  Stepping = 4
> >
> > Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> > real memory  = 131129344 (125 MB)
> > Physical memory chunk(s):
> > 0x00000000002e9000 - 0x0000000007ac9fff, 125702144 bytes (30689 pages)
> > avail memory = 123846656 (118 MB)
> > random: <entropy source>
> > null: <null device, zero device>
> > mem: <memory & I/O>
> > Device configuration finished.
> > procfs registered
> > Timecounters tick every 10.000 msec
> > xc0: <Xen Console> on motherboard
> > xn0: bpf attached
> > GEOM: create disk xbd0 dp=0xc1e70e84
> > GEOM: new disk xbd0
> > [0] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
> > [1] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
> > [2] f:00 typ:0 s(CHS):0/0/0 e(CHS):0/0/0 s:0 l:0
> > [3] f:80 typ:165 s(CHS):0/0/1 e(CHS):1023/254/63 s:0 l:50000
> > GEOM: Configure xbd0a, start 0 length 4423680 end 4423679
> > GEOM: Configure xbd0c, start 0 length 4423680 end 4423679
> > lo0: bpf
> >
> > So far, this is only using the binary kernel that's at
> > http://www.bsdclusters.com/xenofreebsd/ ; I'm going to try building the
> > kernel on my FreeBSD 5.2.1 install in VMware, but I was hoping someone
> > might have some insight as to what is happening. I am running it on top
> > of the Xen 2.0.1 hypervisor, with Debian 3.1 (sarge) as the domain0
> > instance, using a 2.6.9 kernel (with Xen support added, of course). The
> > configuration file for the domain is as follows:
> >
> > kernel = "/boot/freebsd-5.2.1-xenU"
> > memory = 128
> > name = "FreeBSDTest"
> > disk = [ 'file:/tmp/mfsroot,hda1,w' ]
> > hostname = "FreeBSDTest"
> > extra = "vfs.root.mountfrom=ufs:/dev/xbd0c,boot_verbose=yes"
> > restart = "onreboot"
> >
> > If anyone has any thoughts or suggestions, they'd be much appreciated.
> >
> > --
> > Derrik Pates
> > dpates@dsdk12.net
> >
> >
> > -------------------------------------------------------
> > SF email is sponsored by - The IT Product Guide
> > Read honest & candid reviews on hundreds of IT Products from real users.
> > Discover which products truly live up to the hype. Start reading now.
> > http://productguide.itmanagersjournal.com/
> > _______________________________________________
> > Xen-devel mailing list
> > Xen-devel@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/xen-devel
> >
>
>
> -------------------------------------------------------
> SF email is sponsored by - The IT Product Guide
> Read honest & candid reviews on hundreds of IT Products from real users.
> Discover which products truly live up to the hype. Start reading now.
> http://productguide.itmanagersjournal.com/
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xen-devel
>


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Chris Andrews]

On 16 Dec 2004, at 19:20, Kip Macy wrote:
>>
>> Are you using an uncompressed copy of the mdroot I posted?
>
> Duh - obviously. The only thing I can think of is that the mdroot is
> corrupted. I'll double check the bits I've posted.

I got exactly these symptoms with the posted mdroot, and we fixed
it with a slightly different block device export. I'm using this
as my domain definition:

kernel = "/boot/freebsd-5.2.1-xenU"
memory = 64
cpu = -1
name = "XXVIII"
nics=1
vif = [ 'mac=aa:00:00:00:00:28, bridge=xen-br0' ]
disk = [ 'phy:munkyII/vm-XXVIII,loopa,w' ]
extra = "boot.netif.ip=10.1.70.28"
extra += ",boot.netif.netmask=255.255.255.240"
extra += ",boot.netif.gateway=10.1.70.17"
extra += ",vfs.root.mountfrom=ufs:/dev/xbd0a"
extra += ",boot_verbose=yes"

I've put the mdroot image on a devicemapper device, 
/dev/munkyII/vm-XXVIII.
This domain boots fine, although I do get this kind of log message to
the console after a while:

Expensive timeout(9) function: 0xc008c730(0) 0.010000091 s

and the domain chews through CPU time as indicated by 'xm list' even 
when
apparently idle. I haven't played much beyond that though.

Cheers,
Chris.



-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Derrik Pates]

Kip Macy wrote:
>>Are you using an uncompressed copy of the mdroot I posted?
> 
> Duh - obviously. The only thing I can think of is that the mdroot is
> corrupted. I'll double check the bits I've posted.

I tried an uncompressed mfsroot install image, and the mdroot you 
provided on the site (uncompressed, yes). If there is any other 
information that I can provide (Xen's dmesg output or any other info), 
please let me know. There is definite interest at my place of business 
in FreeBSD as a Xen guest, for providing as part of a VPS solution to 
customers.

Also, I tried to install the latest version of the BitKeeper client on 
FreeBSD 5.2.1 inside VMware on my office workstation. Unfortunately, it 
tells me there's something wrong with the license, but I followed what 
instructions exist as far as installing BitKeeper, so it seems like it 
should work; I've installed it on my PowerBook (running Debian Linux) 
before, and it worked, so I'm not really sure what I'm doing wrong. Any 
thoughts or suggestions?

-- 
Derrik Pates
dpates@dsdk12.net


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Derrik Pates]

Chris Andrews wrote:
> I got exactly these symptoms with the posted mdroot, and we fixed
> it with a slightly different block device export. I'm using this
> as my domain definition:

> disk = [ 'phy:munkyII/vm-XXVIII,loopa,w' ]

When I tried to change the exported device part of the disk line 
("loopa") to what you used, I get "Error: Error creating domain: vbd: 
Device not found: loopa". Are you using a different domain builder? I 
don't really know much about the domain builder stuff; I haven't had to 
play with it with either the Linux or NetBSD domains I've set up.

-- 
Derrik Pates
dpates@dsdk12.net


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Kip Macy]

Like I said in my initial post - any feedback would be *much
appreciated* :-).


			-Kip


On Thu, 16 Dec 2004, Chris Andrews wrote:

>
> On 16 Dec 2004, at 19:20, Kip Macy wrote:
> >>
> >> Are you using an uncompressed copy of the mdroot I posted?
> >
> > Duh - obviously. The only thing I can think of is that the mdroot is
> > corrupted. I'll double check the bits I've posted.
>
> I got exactly these symptoms with the posted mdroot, and we fixed
> it with a slightly different block device export. I'm using this
> as my domain definition:
>
> kernel = "/boot/freebsd-5.2.1-xenU"
> memory = 64
> cpu = -1
> name = "XXVIII"
> nics=1
> vif = [ 'mac=aa:00:00:00:00:28, bridge=xen-br0' ]
> disk = [ 'phy:munkyII/vm-XXVIII,loopa,w' ]
> extra = "boot.netif.ip=10.1.70.28"
> extra += ",boot.netif.netmask=255.255.255.240"
> extra += ",boot.netif.gateway=10.1.70.17"
> extra += ",vfs.root.mountfrom=ufs:/dev/xbd0a"
> extra += ",boot_verbose=yes"
>
> I've put the mdroot image on a devicemapper device,
> /dev/munkyII/vm-XXVIII.
> This domain boots fine, although I do get this kind of log message to
> the console after a while:
>
> Expensive timeout(9) function: 0xc008c730(0) 0.010000091 s
>
> and the domain chews through CPU time as indicated by 'xm list' even
> when
> apparently idle. I haven't played much beyond that though.
>
> Cheers,
> Chris.
>
>
>
> -------------------------------------------------------
> SF email is sponsored by - The IT Product Guide
> Read honest & candid reviews on hundreds of IT Products from real users.
> Discover which products truly live up to the hype. Start reading now.
> http://productguide.itmanagersjournal.com/
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xen-devel
>


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Chris Andrews]

Derrik Pates wrote on 17/12/04 02:03:
> Chris Andrews wrote:
> 
>> I got exactly these symptoms with the posted mdroot, and we fixed
>> it with a slightly different block device export. I'm using this
>> as my domain definition:
> 
> 
>> disk = [ 'phy:munkyII/vm-XXVIII,loopa,w' ]
> 
> 
> When I tried to change the exported device part of the disk line 
> ("loopa") to what you used, I get "Error: Error creating domain: vbd: 
> Device not found: loopa". 

In my domain0 /dev/loopa is a symlink to /dev/loop0 - try replacing loopa 
with loop0 in the disk= statement?


Chris.


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/

Re: FreeBSD/Xen kernel

[Derrik Pates]

Chris Andrews wrote:
> In my domain0 /dev/loopa is a symlink to /dev/loop0 - try replacing 
> loopa with loop0 in the disk= statement?

Unfortunately that didn't solve the problem; it stops the same way as 
before. Any further suggestions?

-- 
Derrik Pates
dpates@dsdk12.net


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. 
http://productguide.itmanagersjournal.com/