no console when using xl toolstack xen 4.1.2

no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

Hello!

I was asking for help on the Freenode channel, and I was pointed here.

I have a situation where, using xl, I can create a functional PV domU, with or without pv-grub, but I cannot access the console.   Firing up xend and using xm works without trouble.    Since xend and company is being deprecated, I would like to transition to using the xl toolstack.

The system is an Arch Linux system running under VMWare Fusion-- I normally build and test packages this way before I test them on my dev hardware as my dev hardware is a rather loud HP server.   I'm compiling Xen in a package, based off of the one in AUR but with some changes (the AUR package doesn't compile pv-grub, for instance).   It's Xen 4.1.2, and my linux kernel is the standard Arch Linux kernel  version 3.3.2, and it is very near the stock kernel.   Clearly, I have done no HVM testing yet.


Here's what it looks like when I try xl:
__START__
[root@xentest2012 noauto]# xl create -c finnix.cfg 
Parsing config file finnix.cfg
Unable to attach console
Daemon running with PID 851
[root@xentest2012 noauto]# xl console finnix
Unable to attach console
[root@xentest2012 noauto]# ls
domutest.cfg  finnix.cfg
[root@xentest2012 noauto]# xl create -c domutest.cfg 
Parsing config file domutest.cfg
xc: error: panic: xc_dom_bzimageloader.c:556: xc_dom_probe_bzimage_kernel: kernel is not a bzImage: Invalid kernel
Unable to attach console
Daemon running with PID 916
[root@xentest2012 noauto]# xl console domutest
Unable to attach console
[root@xentest2012 noauto]# 
__END__

Firing up xend, it works just as you would expect.


Here are the configuration files:

finnix.cfg:
__START__
kernel = "/var/finnix/linux64"
ramdisk = "/var/finnix/initrd.xz"
name = "finnix"
memory = "128"
disk = [ 'file:/var/finnix/finnix-104.iso,xvda,r', ]
vif = [ 'bridge=outer0', ]
__END__

domutest.cfg:
__START__
kernel = "/usr/lib/xen/boot/pv-grub-x86_64.gz"
extra = "(hd0)/boot/grub/menu.lst"

memory = 512
vcpus  = 4
name   = "domutest"
disk   = [ "phy:/dev/xtG0/domutest-root,xvda1,w",
           "phy:/dev/xtG0/domutest-swap,xvda2,w" ]
vif     = [ "bridge=outer0" ]
vfb    = [ "type=vnc,vnclisten=0.0.0.0,vncdisplay=5,vncpasswd=smeghead" ]
__END__

I can see finnix ask for a DHCP address, and I can connect to domutest using the VNC vfb and use it as normal, so I've concluded that the domUs are running.


And now for some other information:

xen-hotplug.log
__START__
RTNETLINK answers: Operation not supported
RTNETLINK answers: Operation not supported
__END__

qemu-dm-finnix.log   
__START__
domid: 1
Warning: vlan 0 is not connected to host network
-videoram option does not work with cirrus vga device model. Videoram set to 4M.
/home/sam/build/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628: Init blktap pipes
/home/sam/build/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:603: Created /var/run/tap directory
Could not open /var/run/tap/qemu-read-1
char device redirected to /dev/pts/2
xs_read(): target get error. /local/domain/1/target.
(qemu) (qemu) 
__END__

qemu-dm-domutest.log 
__START__
domid: 2
Warning: vlan 0 is not connected to host network
-videoram option does not work with cirrus vga device model. Videoram set to 4M.
/home/sam/build/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628: Init blktap pipes
Could not open /var/run/tap/qemu-read-2
char device redirected to /dev/pts/3
xs_read(): target get error. /local/domain/2/target.
Key lost : keysym=0xffe7(65511)
Key lost : keysym=0xffe7(65511)
__END__



Here's running xl create on domutest with the -v option:
__START__
[root@xentest2012 noauto]# xl -v create -c domutest.cfg 
Parsing config file domutest.cfg
domainbuilder: detail: xc_dom_allocate: cmdline="(hd0)/boot/grub/menu.lst", features="(null)"
domainbuilder: detail: xc_dom_kernel_file: filename="/usr/lib/xen/boot/pv-grub-x86_64.gz"
domainbuilder: detail: xc_dom_malloc_filemap    : 1130 kB
domainbuilder: detail: xc_dom_malloc            : 14779 kB
domainbuilder: detail: xc_dom_do_gunzip: unzip ok, 0x11a833 -> 0xe6effa
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.1, caps xen-3.0-x86_64 xen-3.0-x86_32p 
domainbuilder: detail: xc_dom_parse_image: called
domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ... 
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ... 
xc: error: panic: xc_dom_bzimageloader.c:556: xc_dom_probe_bzimage_kernel: kernel is not a bzImage: Invalid kerne
l
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ... 
domainbuilder: detail: loader probe OK
xc: detail: elf_parse_binary: phdr: paddr=0x0 memsz=0x99ff60
xc: detail: elf_parse_binary: memory: 0x0 -> 0x99ff60
xc: detail: elf_xen_parse: __xen_guest: "GUEST_OS=Mini-OS,XEN_VER=xen-3.0,VIRT_BASE=0x0,ELF_PADDR_OFFSET=0x0,HYPE
RCALL_PAGE=0x2,LOADER=generic"
xc: detail: elf_xen_parse_guest_info: GUEST_OS="Mini-OS"
xc: detail: elf_xen_parse_guest_info: XEN_VER="xen-3.0"
xc: detail: elf_xen_parse_guest_info: VIRT_BASE="0x0"
xc: detail: elf_xen_parse_guest_info: ELF_PADDR_OFFSET="0x0"
xc: detail: elf_xen_parse_guest_info: HYPERCALL_PAGE="0x2"
xc: detail: elf_xen_parse_guest_info: LOADER="generic"
xc: detail: elf_xen_addr_calc_check: addresses:
xc: detail:     virt_base        = 0x0
xc: detail:     elf_paddr_offset = 0x0
xc: detail:     virt_offset      = 0x0
xc: detail:     virt_kstart      = 0x0
xc: detail:     virt_kend        = 0x99ff60
xc: detail:     virt_entry       = 0x0
xc: detail:     p2m_base         = 0xffffffffffffffff
domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_64: 0x0 -> 0x99ff60
domainbuilder: detail: xc_dom_mem_init: mem 512 MB, pages 0x20000 pages, 4k each
domainbuilder: detail: xc_dom_mem_init: 0x20000 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: x86_compat: guest xen-3.0-x86_64, address size 64
domainbuilder: detail: xc_dom_malloc            : 1024 kB
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_alloc_segment:   kernel       : 0x0 -> 0x9a0000  (pfn 0x0 + 0x9a0 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x0+0x9a0 at 0x7f18be2e9000
xc: detail: elf_load_binary: phdr 0 at 0x0x7f18be2e9000 -> 0x0x7f18bec88f60
domainbuilder: detail: xc_dom_alloc_segment:   phys2mach    : 0x9a0000 -> 0xaa0000  (pfn 0x9a0 + 0x100 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x9a0+0x100 at 0x7f18be1e9000
domainbuilder: detail: xc_dom_alloc_page   :   start info   : 0xaa0000 (pfn 0xaa0)
domainbuilder: detail: xc_dom_alloc_page   :   xenstore     : 0xaa1000 (pfn 0xaa1)
domainbuilder: detail: xc_dom_alloc_page   :   console      : 0xaa2000 (pfn 0xaa2)
domainbuilder: detail: nr_page_tables: 0x0000ffffffffffff/48: 0x0000000000000000 -> 0x0000ffffffffffff, 1 table(s
)
domainbuilder: detail: nr_page_tables: 0x0000007fffffffff/39: 0x0000000000000000 -> 0x0000007fffffffff, 1 table(s
)
domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x0000000000000000 -> 0x000000003fffffff, 1 table(s
)
domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x0000000000000000 -> 0x0000000000bfffff, 6 table(s
)
domainbuilder: detail: xc_dom_alloc_segment:   page tables  : 0xaa3000 -> 0xaac000  (pfn 0xaa3 + 0x9 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0xaa3+0x9 at 0x7f18be1e0000
domainbuilder: detail: xc_dom_alloc_page   :   boot stack   : 0xaac000 (pfn 0xaac)
domainbuilder: detail: xc_dom_build_image  : virt_alloc_end : 0xaad000
domainbuilder: detail: xc_dom_build_image  : virt_pgtab_end : 0xc00000
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: arch_setup_bootearly: doing nothing
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64 <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p
domainbuilder: detail: xc_dom_update_guest_p2m: dst 64bit, pages 0x20000
domainbuilder: detail: clear_page: pfn 0xaa2, mfn 0x5dd0c
domainbuilder: detail: clear_page: pfn 0xaa1, mfn 0x5dd0d
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0xaa0+0x1 at 0x7f18be1df000
domainbuilder: detail: start_info_x86_64: called
domainbuilder: detail: setup_hypercall_page: vaddr=0x2000 pfn=0x2
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail:    allocated
domainbuilder: detail:       malloc             : 15870 kB
domainbuilder: detail:       anon mmap          : 0 bytes
domainbuilder: detail:    mapped
domainbuilder: detail:       file mmap          : 1130 kB
domainbuilder: detail:       domU mmap          : 10920 kB
domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0x587bb
domainbuilder: detail: shared_info_x86_64: called
domainbuilder: detail: vcpu_x86_64: called
domainbuilder: detail: vcpu_x86_64: cr3: pfn 0xaa3 mfn 0x5dd0b
domainbuilder: detail: launch_vm: called, ctxt=0x7fffa9ec8e90
domainbuilder: detail: xc_dom_release: called
Unable to attach console
Daemon running with PID 1395
__END__

And the output of xl info:
__START__
host                   : xentest2012
release                : 3.3.2-1-ARCH
version                : #1 SMP PREEMPT Sat Apr 14 09:48:37 CEST 2012
machine                : x86_64
nr_cpus                : 4
nr_nodes               : 1
cores_per_socket       : 1
threads_per_core       : 1
cpu_mhz                : 2403
hw_caps                : 0febfbff:20100800:00000000:00000940:80002201:00000000:00000001:00000000
virt_caps              :
total_memory           : 2047
free_memory            : 870
free_cpus              : 0
xen_major              : 4
xen_minor              : 1
xen_extra              : .2
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p 
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          : unavailable
xen_commandline        : dom0_mem=512M loglvl=all guest_loglvl=all com1=115200,8n1 console=com1
cc_compiler            : gcc version 4.7.0 20120414 (prerelease) (GCC) 
cc_compile_by          : sam
cc_compile_domain      : (none)
cc_compile_date        : Sun Apr 22 19:02:17 PDT 2012
xend_config_format     : 4
__END__

The xl logs have a single line in them:

xl-domutest.log:
Waiting for domain domutest (domid 6) to die [pid 1696]

xl-finnix.log :
Waiting for domain finnix (domid 7) to die [pid 1763]


That's what I've got.   Any pointers would help.   Thanks!


-Sam

Re: no console when using xl toolstack xen 4.1.2

[Ian Campbell]

On Tue, 2012-04-24 at 09:37 +0100, Sam Mulvey wrote:
> Hello!
> 
> I was asking for help on the Freenode channel, and I was pointed here.
> 
> I have a situation where, using xl, I can create a functional PV domU,
> with or without pv-grub, but I cannot access the console.   Firing up
> xend and using xm works without trouble.    Since xend and company is
> being deprecated, I would like to transition to using the xl
> toolstack.

Thanks, it's good to see people trying the transition.

Are you able to try xen-unstable? A lot of this stuff (particularly
relating to pv consoles and pygrub etc) is much improved in the 4.2
version of xl and if not then we should be much more able to fix things
there than in 4.1 (where I suspect any fix would be far too invasive for
a stable backport).

Thanks,
Ian.

> The system is an Arch Linux system running under VMWare Fusion-- I
> normally build and test packages this way before I test them on my dev
> hardware as my dev hardware is a rather loud HP server.   I'm
> compiling Xen in a package, based off of the one in AUR but with some
> changes (the AUR package doesn't compile pv-grub, for instance).
> It's Xen 4.1.2, and my linux kernel is the standard Arch Linux kernel
> version 3.3.2, and it is very near the stock kernel.   Clearly, I have
> done no HVM testing yet.
> 
> 
> Here's what it looks like when I try xl:
> __START__
> [root@xentest2012 noauto]# xl create -c finnix.cfg
> Parsing config file finnix.cfg
> Unable to attach console
> Daemon running with PID 851
> [root@xentest2012 noauto]# xl console finnix
> Unable to attach console
> [root@xentest2012 noauto]# ls
> domutest.cfg  finnix.cfg
> [root@xentest2012 noauto]# xl create -c domutest.cfg
> Parsing config file domutest.cfg
> xc: error: panic: xc_dom_bzimageloader.c:556: xc_dom_probe_bzimage_kernel: kernel is not a bzImage: Invalid kernel
> Unable to attach console
> Daemon running with PID 916
> [root@xentest2012 noauto]# xl console domutest
> Unable to attach console
> [root@xentest2012 noauto]#
> __END__
> 
> Firing up xend, it works just as you would expect.
> 
> 
> Here are the configuration files:
> 
> finnix.cfg:
> __START__
> kernel = "/var/finnix/linux64"
> ramdisk = "/var/finnix/initrd.xz"
> name = "finnix"
> memory = "128"
> disk = [ 'file:/var/finnix/finnix-104.iso,xvda,r', ]
> vif = [ 'bridge=outer0', ]
> __END__
> 
> domutest.cfg:
> __START__
> kernel = "/usr/lib/xen/boot/pv-grub-x86_64.gz"
> extra = "(hd0)/boot/grub/menu.lst"
> 
> memory = 512
> vcpus  = 4
> name   = "domutest"
> disk   = [ "phy:/dev/xtG0/domutest-root,xvda1,w",
>            "phy:/dev/xtG0/domutest-swap,xvda2,w" ]
> vif     = [ "bridge=outer0" ]
> vfb    = [ "type=vnc,vnclisten=0.0.0.0,vncdisplay=5,vncpasswd=smeghead" ]
> __END__
> 
> I can see finnix ask for a DHCP address, and I can connect to domutest using the VNC vfb and use it as normal, so I've concluded that the domUs are running.
> 
> 
> And now for some other information:
> 
> xen-hotplug.log
> __START__
> RTNETLINK answers: Operation not supported
> RTNETLINK answers: Operation not supported
> __END__
> 
> qemu-dm-finnix.log
> __START__
> domid: 1
> Warning: vlan 0 is not connected to host network
> -videoram option does not work with cirrus vga device model. Videoram set to 4M.
> /home/sam/build/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628: Init blktap pipes
> /home/sam/build/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:603: Created /var/run/tap directory
> Could not open /var/run/tap/qemu-read-1
> char device redirected to /dev/pts/2
> xs_read(): target get error. /local/domain/1/target.
> (qemu) (qemu)
> __END__
> 
> qemu-dm-domutest.log
> __START__
> domid: 2
> Warning: vlan 0 is not connected to host network
> -videoram option does not work with cirrus vga device model. Videoram set to 4M.
> /home/sam/build/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628: Init blktap pipes
> Could not open /var/run/tap/qemu-read-2
> char device redirected to /dev/pts/3
> xs_read(): target get error. /local/domain/2/target.
> Key lost : keysym=0xffe7(65511)
> Key lost : keysym=0xffe7(65511)
> __END__
> 
> 
> 
> Here's running xl create on domutest with the -v option:
> __START__
> [root@xentest2012 noauto]# xl -v create -c domutest.cfg
> Parsing config file domutest.cfg
> domainbuilder: detail: xc_dom_allocate: cmdline="(hd0)/boot/grub/menu.lst", features="(null)"
> domainbuilder: detail: xc_dom_kernel_file: filename="/usr/lib/xen/boot/pv-grub-x86_64.gz"
> domainbuilder: detail: xc_dom_malloc_filemap    : 1130 kB
> domainbuilder: detail: xc_dom_malloc            : 14779 kB
> domainbuilder: detail: xc_dom_do_gunzip: unzip ok, 0x11a833 -> 0xe6effa
> domainbuilder: detail: xc_dom_boot_xen_init: ver 4.1, caps xen-3.0-x86_64 xen-3.0-x86_32p
> domainbuilder: detail: xc_dom_parse_image: called
> domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
> domainbuilder: detail: loader probe failed
> domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ...
> xc: error: panic: xc_dom_bzimageloader.c:556: xc_dom_probe_bzimage_kernel: kernel is not a bzImage: Invalid kerne
> l
> domainbuilder: detail: loader probe failed
> domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ...
> domainbuilder: detail: loader probe OK
> xc: detail: elf_parse_binary: phdr: paddr=0x0 memsz=0x99ff60
> xc: detail: elf_parse_binary: memory: 0x0 -> 0x99ff60
> xc: detail: elf_xen_parse: __xen_guest: "GUEST_OS=Mini-OS,XEN_VER=xen-3.0,VIRT_BASE=0x0,ELF_PADDR_OFFSET=0x0,HYPE
> RCALL_PAGE=0x2,LOADER=generic"
> xc: detail: elf_xen_parse_guest_info: GUEST_OS="Mini-OS"
> xc: detail: elf_xen_parse_guest_info: XEN_VER="xen-3.0"
> xc: detail: elf_xen_parse_guest_info: VIRT_BASE="0x0"
> xc: detail: elf_xen_parse_guest_info: ELF_PADDR_OFFSET="0x0"
> xc: detail: elf_xen_parse_guest_info: HYPERCALL_PAGE="0x2"
> xc: detail: elf_xen_parse_guest_info: LOADER="generic"
> xc: detail: elf_xen_addr_calc_check: addresses:
> xc: detail:     virt_base        = 0x0
> xc: detail:     elf_paddr_offset = 0x0
> xc: detail:     virt_offset      = 0x0
> xc: detail:     virt_kstart      = 0x0
> xc: detail:     virt_kend        = 0x99ff60
> xc: detail:     virt_entry       = 0x0
> xc: detail:     p2m_base         = 0xffffffffffffffff
> domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_64: 0x0 -> 0x99ff60
> domainbuilder: detail: xc_dom_mem_init: mem 512 MB, pages 0x20000 pages, 4k each
> domainbuilder: detail: xc_dom_mem_init: 0x20000 pages
> domainbuilder: detail: xc_dom_boot_mem_init: called
> domainbuilder: detail: x86_compat: guest xen-3.0-x86_64, address size 64
> domainbuilder: detail: xc_dom_malloc            : 1024 kB
> domainbuilder: detail: xc_dom_build_image: called
> domainbuilder: detail: xc_dom_alloc_segment:   kernel       : 0x0 -> 0x9a0000  (pfn 0x0 + 0x9a0 pages)
> domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x0+0x9a0 at 0x7f18be2e9000
> xc: detail: elf_load_binary: phdr 0 at 0x0x7f18be2e9000 -> 0x0x7f18bec88f60
> domainbuilder: detail: xc_dom_alloc_segment:   phys2mach    : 0x9a0000 -> 0xaa0000  (pfn 0x9a0 + 0x100 pages)
> domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x9a0+0x100 at 0x7f18be1e9000
> domainbuilder: detail: xc_dom_alloc_page   :   start info   : 0xaa0000 (pfn 0xaa0)
> domainbuilder: detail: xc_dom_alloc_page   :   xenstore     : 0xaa1000 (pfn 0xaa1)
> domainbuilder: detail: xc_dom_alloc_page   :   console      : 0xaa2000 (pfn 0xaa2)
> domainbuilder: detail: nr_page_tables: 0x0000ffffffffffff/48: 0x0000000000000000 -> 0x0000ffffffffffff, 1 table(s
> )
> domainbuilder: detail: nr_page_tables: 0x0000007fffffffff/39: 0x0000000000000000 -> 0x0000007fffffffff, 1 table(s
> )
> domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x0000000000000000 -> 0x000000003fffffff, 1 table(s
> )
> domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x0000000000000000 -> 0x0000000000bfffff, 6 table(s
> )
> domainbuilder: detail: xc_dom_alloc_segment:   page tables  : 0xaa3000 -> 0xaac000  (pfn 0xaa3 + 0x9 pages)
> domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0xaa3+0x9 at 0x7f18be1e0000
> domainbuilder: detail: xc_dom_alloc_page   :   boot stack   : 0xaac000 (pfn 0xaac)
> domainbuilder: detail: xc_dom_build_image  : virt_alloc_end : 0xaad000
> domainbuilder: detail: xc_dom_build_image  : virt_pgtab_end : 0xc00000
> domainbuilder: detail: xc_dom_boot_image: called
> domainbuilder: detail: arch_setup_bootearly: doing nothing
> domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64 <= matches
> domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p
> domainbuilder: detail: xc_dom_update_guest_p2m: dst 64bit, pages 0x20000
> domainbuilder: detail: clear_page: pfn 0xaa2, mfn 0x5dd0c
> domainbuilder: detail: clear_page: pfn 0xaa1, mfn 0x5dd0d
> domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0xaa0+0x1 at 0x7f18be1df000
> domainbuilder: detail: start_info_x86_64: called
> domainbuilder: detail: setup_hypercall_page: vaddr=0x2000 pfn=0x2
> domainbuilder: detail: domain builder memory footprint
> domainbuilder: detail:    allocated
> domainbuilder: detail:       malloc             : 15870 kB
> domainbuilder: detail:       anon mmap          : 0 bytes
> domainbuilder: detail:    mapped
> domainbuilder: detail:       file mmap          : 1130 kB
> domainbuilder: detail:       domU mmap          : 10920 kB
> domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0x587bb
> domainbuilder: detail: shared_info_x86_64: called
> domainbuilder: detail: vcpu_x86_64: called
> domainbuilder: detail: vcpu_x86_64: cr3: pfn 0xaa3 mfn 0x5dd0b
> domainbuilder: detail: launch_vm: called, ctxt=0x7fffa9ec8e90
> domainbuilder: detail: xc_dom_release: called
> Unable to attach console
> Daemon running with PID 1395
> __END__
> 
> And the output of xl info:
> __START__
> host                   : xentest2012
> release                : 3.3.2-1-ARCH
> version                : #1 SMP PREEMPT Sat Apr 14 09:48:37 CEST 2012
> machine                : x86_64
> nr_cpus                : 4
> nr_nodes               : 1
> cores_per_socket       : 1
> threads_per_core       : 1
> cpu_mhz                : 2403
> hw_caps                : 0febfbff:20100800:00000000:00000940:80002201:00000000:00000001:00000000
> virt_caps              :
> total_memory           : 2047
> free_memory            : 870
> free_cpus              : 0
> xen_major              : 4
> xen_minor              : 1
> xen_extra              : .2
> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p
> xen_scheduler          : credit
> xen_pagesize           : 4096
> platform_params        : virt_start=0xffff800000000000
> xen_changeset          : unavailable
> xen_commandline        : dom0_mem=512M loglvl=all guest_loglvl=all com1=115200,8n1 console=com1
> cc_compiler            : gcc version 4.7.0 20120414 (prerelease) (GCC)
> cc_compile_by          : sam
> cc_compile_domain      : (none)
> cc_compile_date        : Sun Apr 22 19:02:17 PDT 2012
> xend_config_format     : 4
> __END__
> 
> The xl logs have a single line in them:
> 
> xl-domutest.log:
> Waiting for domain domutest (domid 6) to die [pid 1696]
> 
> xl-finnix.log :
> Waiting for domain finnix (domid 7) to die [pid 1763]
> 
> 
> That's what I've got.   Any pointers would help.   Thanks!
> 
> 
> -Sam
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 1204 bytes --]


On Apr 24, 2012, at 3:31 AM, Ian Campbell wrote:

> Thanks, it's good to see people trying the transition.
> 
> Are you able to try xen-unstable? A lot of this stuff (particularly
> relating to pv consoles and pygrub etc) is much improved in the 4.2
> version of xl and if not then we should be much more able to fix things
> there than in 4.1 (where I suspect any fix would be far too invasive for
> a stable backport).
> 
> Thanks,
> Ian.

I can.   There's a couple things that have occurred to me that I'd like to try out, but I can certainly give it a try.

The packages I'm working on are eventually destined for a production server.    I started out on this process when my production machine started crashing when I'd load up on domUs.  You can see <http://www.gossamer-threads.com/lists/xen/users/241986> for more info on that one.   That's running a pull from mercurial from some months ago before 4.1.2 was released, so I thought I would make fresh go of Xen, and if I still had the problem I'd feel better about filing bug reports.

So for the purposes of production blah, I thought I'd use the stable releases, but if tracking unstable is preferable, I can do that.

-Sam

[-- Attachment #1.2: Type: text/html, Size: 2152 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Ian Campbell]

On Tue, 2012-04-24 at 12:55 +0100, Sam Mulvey wrote:
> 
> On Apr 24, 2012, at 3:31 AM, Ian Campbell wrote:
> 
> > Thanks, it's good to see people trying the transition.
> > 
> > Are you able to try xen-unstable? A lot of this stuff (particularly
> > relating to pv consoles and pygrub etc) is much improved in the 4.2
> > version of xl and if not then we should be much more able to fix
> > things
> > there than in 4.1 (where I suspect any fix would be far too invasive
> > for
> > a stable backport).
> > 
> > Thanks,
> > Ian.
> 
> I can.   There's a couple things that have occurred to me that I'd
> like to try out, but I can certainly give it a try.

Thanks.

> The packages I'm working on are eventually destined for a production
> server.    I started out on this process when my production machine
> started crashing when I'd load up on domUs.  You can see
> <http://www.gossamer-threads.com/lists/xen/users/241986> for more info
> on that one.   That's running a pull from mercurial from some months
> ago before 4.1.2 was released,

Are you sure? The stack trace indicates that this is "Xen-4.2-unstable"
not 4.1.x. (note to self, we really ought to print the hg cset in the
panic log if it is available...)

>  so I thought I would make fresh go of Xen, and if I still had the
> problem I'd feel better about filing bug reports.
> 
> 
> So for the purposes of production blah, I thought I'd use the stable
> releases, but if tracking unstable is preferable, I can do that.

For your production uses I think the best advice right now would be to
use 4.1 with xend (unless Stefano can diagnose your xl console issue in
the other subthread). However it would also be useful to evaluate your
use case using xen-unstable and xl so that we can be reasonably sure
that when 4.2 is released you will be able to deploy that without issue.

Ian.

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

> Are you sure? The stack trace indicates that this is "Xen-4.2-unstable"
> not 4.1.x. (note to self, we really ought to print the hg cset in the
> panic log if it is available…)

Not that sure.   I was working on this last October, and it looks like 4.1.2 was released right around the time I wrapped up the last set of packages.   I was working with 4.1.1, and then I switched to unstable when I ran into trouble getting HVM going.

> 
>> so I thought I would make fresh go of Xen, and if I still had the
>> problem I'd feel better about filing bug reports.
>> 
>> 
>> So for the purposes of production blah, I thought I'd use the stable
>> releases, but if tracking unstable is preferable, I can do that.
> 
> For your production uses I think the best advice right now would be to
> use 4.1 with xend (unless Stefano can diagnose your xl console issue in
> the other subthread). However it would also be useful to evaluate your
> use case using xen-unstable and xl so that we can be reasonably sure
> that when 4.2 is released you will be able to deploy that without issue.


Suits me.   I may take this opportunity to work on the Xen wiki page for Arch Linux to document start-to-finish domU configuration, so having it ready to roll for 4.2 will be helpful.   I've also been submitting patches to make the Xen init scripts fit in Arch's somewhat non-standard init.  


-Sam

Re: no console when using xl toolstack xen 4.1.2

[Ian Campbell]

On Tue, 2012-04-24 at 15:50 +0100, Sam Mulvey wrote:
> I may take this opportunity to work on the Xen wiki page for Arch
> Linux to document start-to-finish domU configuration, so having it
> ready to roll for 4.2 will be helpful.

That would be really great!

This is the page linked from http://wiki.xen.org/wiki/Distro_Resources ?
(you just missed a Xen document day yesterday, not that writing docs
should be restricted to one day a month ;-))

>    I've also been submitting patches to make the Xen init scripts fit
> in Arch's somewhat non-standard init.  

Sounds good, I guess you've been submitting them to Arch rather than
here (or else I've been asleep at the wheel again)?

Ian.

Re: no console when using xl toolstack xen 4.1.2

[Stefano Stabellini]

On Tue, 24 Apr 2012, Sam Mulvey wrote:
> Hello!
> 
> I was asking for help on the Freenode channel, and I was pointed here.
> 
> I have a situation where, using xl, I can create a functional PV domU, with or without pv-grub, but I cannot access the console.   Firing up xend and using xm works without trouble.    Since xend and company is being deprecated, I would like to transition to using the xl toolstack.
> 
> The system is an Arch Linux system running under VMWare Fusion-- I normally build and test packages this way before I test them on my dev hardware as my dev hardware is a rather loud HP server.   I'm compiling Xen in a package, based off of the one in AUR but with some changes (the AUR package doesn't compile pv-grub, for instance).   It's Xen 4.1.2, and my linux kernel is the standard Arch Linux kernel  version 3.3.2, and it is very near the stock kernel.   Clearly, I have done no HVM testing yet.
> 
> 
> Here's what it looks like when I try xl:
> __START__
> [root@xentest2012 noauto]# xl create -c finnix.cfg
> Parsing config file finnix.cfg
> Unable to attach console
> Daemon running with PID 851
> [root@xentest2012 noauto]# xl console finnix
> Unable to attach console
> [root@xentest2012 noauto]# ls
> domutest.cfg  finnix.cfg
> [root@xentest2012 noauto]# xl create -c domutest.cfg
> Parsing config file domutest.cfg
> xc: error: panic: xc_dom_bzimageloader.c:556: xc_dom_probe_bzimage_kernel: kernel is not a bzImage: Invalid kernel
> Unable to attach console
> Daemon running with PID 916
> [root@xentest2012 noauto]# xl console domutest
> Unable to attach console
> [root@xentest2012 noauto]#
> __END__
> 
> Firing up xend, it works just as you would expect.
> 
> 
> Here are the configuration files:
> 
> finnix.cfg:
> __START__
> kernel = "/var/finnix/linux64"
> ramdisk = "/var/finnix/initrd.xz"
> name = "finnix"
> memory = "128"
> disk = [ 'file:/var/finnix/finnix-104.iso,xvda,r', ]
> vif = [ 'bridge=outer0', ]
> __END__
> 
> domutest.cfg:
> __START__
> kernel = "/usr/lib/xen/boot/pv-grub-x86_64.gz"
> extra = "(hd0)/boot/grub/menu.lst"
> 
> memory = 512
> vcpus  = 4
> name   = "domutest"
> disk   = [ "phy:/dev/xtG0/domutest-root,xvda1,w",
>            "phy:/dev/xtG0/domutest-swap,xvda2,w" ]
> vif     = [ "bridge=outer0" ]
> vfb    = [ "type=vnc,vnclisten=0.0.0.0,vncdisplay=5,vncpasswd=smeghead" ]
> __END__
> 
> I can see finnix ask for a DHCP address, and I can connect to domutest using the VNC vfb and use it as normal, so I've concluded that the domUs are running.
> 
> 
> That's what I've got.   Any pointers would help.   Thanks!

I couldn't find any clues in the logs you posted. Maybe the output of
xenstore-ls would be useful.

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 9649 bytes --]


On Apr 24, 2012, at 3:37 AM, Stefano Stabellini wrote:

> I couldn't find any clues in the logs you posted. Maybe the output of
> xenstore-ls would be useful.


Done and done.

tool = ""
 xenstored = ""
local = ""
 domain = ""
  0 = ""
   name = "Domain-0"
   memory = ""
    target = "523904"
    static-max = "4294967292"
    freemem-slack = "314505"
   backend = ""
    console = ""
     1 = ""
      0 = ""
       frontend = "/local/domain/1/console"
       frontend-id = "1"
       online = "0"
       state = "5"
       domain = "finnix"
       protocol = "vt100"
       hotplug-status = "connected"
     2 = ""
      0 = ""
       frontend = "/local/domain/2/console"
       frontend-id = "2"
       online = "0"
       state = "5"
       domain = "domutest"
       protocol = "vt100"
       hotplug-status = "connected"
     3 = ""
      0 = ""
       frontend = "/local/domain/3/console"
       frontend-id = "3"
       online = "0"
       state = "5"
       domain = "finnix"
       protocol = "vt100"
       hotplug-status = "connected"
     4 = ""
      0 = ""
       frontend = "/local/domain/4/console"
       frontend-id = "4"
       online = "0"
       state = "5"
       domain = "finnix"
       protocol = "vt100"
       hotplug-status = "connected"
     5 = ""
      0 = ""
       frontend = "/local/domain/5/console"
       frontend-id = "5"
       online = "0"
       state = "5"
       domain = "domutest"
       protocol = "vt100"
       hotplug-status = "connected"
     6 = ""
      0 = ""
       frontend = "/local/domain/6/console"
       frontend-id = "6"
       online = "1"
       state = "4"
       domain = "domutest"
       protocol = "vt100"
       hotplug-status = "connected"
     7 = ""
      0 = ""
       frontend = "/local/domain/7/console"
       frontend-id = "7"
       online = "1"
       state = "4"
       domain = "finnix"
       protocol = "vt100"
       hotplug-status = "connected"
    vfb = ""
     5 = ""
      0 = ""
       frontend = "/local/domain/5/device/vfb/0"
       frontend-id = "5"
       online = "0"
       state = "5"
       domain = "domutest"
       vnc = "1"
       vnclisten = "0.0.0.0"
       vncpasswd = ""
       vncdisplay = "5"
       vncunused = "1"
       sdl = "0"
       opengl = "0"
       feature-resize = "1"
       hotplug-status = "connected"
       request-update = "1"
     6 = ""
      0 = ""
       frontend = "/local/domain/6/device/vfb/0"
       frontend-id = "6"
       online = "1"
       state = "4"
       domain = "domutest"
       vnc = "1"
       vnclisten = "0.0.0.0"
       vncpasswd = ""
       vncdisplay = "5"
       vncunused = "1"
       sdl = "0"
       opengl = "0"
       feature-resize = "1"
       hotplug-status = "connected"
       request-update = "1"
    vkbd = ""
     5 = ""
      0 = ""
       frontend = "/local/domain/5/device/vkbd/0"
       frontend-id = "5"
       online = "0"
       state = "5"
       domain = "domutest"
       feature-abs-pointer = "1"
       hotplug-status = "connected"
     6 = ""
      0 = ""
       frontend = "/local/domain/6/device/vkbd/0"
       frontend-id = "6"
       online = "1"
       state = "4"
       domain = "domutest"
       feature-abs-pointer = "1"
       hotplug-status = "connected"
    vbd = ""
     6 = ""
      51713 = ""
       frontend = "/local/domain/6/device/vbd/51713"
       physical-device = "fe:2"
       params = "/dev/xtG0/domutest-root"
       frontend-id = "6"
       online = "1"
       removable = "0"
       bootable = "1"
       state = "4"
       dev = "xvda1"
       type = "phy"
       mode = "w"
       feature-flush-cache = "0"
       discard-secure = "0"
       feature-discard = "0"
       feature-barrier = "0"
       sectors = "6291456"
       info = "0"
       sector-size = "512"
      51714 = ""
       frontend = "/local/domain/6/device/vbd/51714"
       physical-device = "fe:3"
       params = "/dev/xtG0/domutest-swap"
       frontend-id = "6"
       online = "1"
       removable = "0"
       bootable = "1"
       state = "4"
       dev = "xvda2"
       type = "phy"
       mode = "w"
       feature-flush-cache = "0"
       discard-secure = "0"
       feature-discard = "0"
       feature-barrier = "0"
       sectors = "1048576"
       info = "0"
       sector-size = "512"
    vif = ""
     6 = ""
      0 = ""
       frontend = "/local/domain/6/device/vif/0"
       frontend-id = "6"
       online = "1"
       state = "4"
       script = "/etc/xen/scripts/vif-bridge"
       mac = "00:16:3e:0c:49:8e"
       bridge = "outer0"
       handle = "0"
       feature-sg = "1"
       feature-gso-tcpv4 = "1"
       feature-rx-copy = "1"
       feature-rx-flip = "0"
       hotplug-status = "connected"
     7 = ""
      0 = ""
       frontend = "/local/domain/7/device/vif/0"
       frontend-id = "7"
       online = "1"
       state = "2"
       script = "/etc/xen/scripts/vif-bridge"
       mac = "00:16:3e:10:6a:f4"
       bridge = "outer0"
       handle = "0"
       feature-sg = "1"
       feature-gso-tcpv4 = "1"
       feature-rx-copy = "1"
       feature-rx-flip = "0"
       hotplug-status = "connected"
    qdisk = ""
     7 = ""
      51712 = ""
       frontend = "/local/domain/7/device/vbd/51712"
       params = "aio:/var/finnix/finnix-104.iso"
       frontend-id = "7"
       online = "1"
       removable = "0"
       bootable = "1"
       state = "2"
       dev = "xvda"
       type = "tap"
       mode = "r"
       feature-barrier = "1"
       info = "4"
       sector-size = "512"
       sectors = "237712"
       hotplug-status = "connected"
   device-model = ""
    6 = ""
     disable_pf = "1"
     state = "running"
    7 = ""
     disable_pf = "1"
     state = "running"
  6 = ""
   vm = "/vm/d7ea3f07-f491-493f-8989-749d7a76a4f4"
   name = "domutest"
   control = ""
    shutdown = ""
    platform-feature-multiprocessor-suspend = "1"
   device = ""
    suspend = ""
     event-channel = ""
    vbd = ""
     51713 = ""
      backend = "/local/domain/0/backend/vbd/6/51713"
      backend-id = "0"
      state = "4"
      virtual-device = "51713"
      device-type = "disk"
      ring-ref = "8"
      event-channel = "23"
      protocol = "x86_64-abi"
     51714 = ""
      backend = "/local/domain/0/backend/vbd/6/51714"
      backend-id = "0"
      state = "4"
      virtual-device = "51714"
      device-type = "disk"
      ring-ref = "9"
      event-channel = "24"
      protocol = "x86_64-abi"
    vif = ""
     0 = ""
      backend = "/local/domain/0/backend/vif/6/0"
      backend-id = "0"
      state = "4"
      handle = "0"
      mac = "00:16:3e:0c:49:8e"
      tx-ring-ref = "10"
      rx-ring-ref = "11"
      event-channel = "25"
      request-rx-copy = "1"
      feature-rx-notify = "1"
      feature-sg = "1"
      feature-gso-tcpv4 = "1"
    vfb = ""
     0 = ""
      backend = "/local/domain/0/backend/vfb/6/0"
      backend-id = "0"
      state = "4"
      page-ref = "367826"
      event-channel = "27"
      protocol = "x86_64-abi"
      feature-update = "1"
    vkbd = ""
     0 = ""
      backend = "/local/domain/0/backend/vkbd/6/0"
      backend-id = "0"
      state = "4"
      request-abs-pointer = "1"
      page-ref = "284662"
      page-gref = "14"
      event-channel = "26"
   data = ""
   cpu = ""
    0 = ""
     availability = "online"
    1 = ""
     availability = "online"
    2 = ""
     availability = "online"
    3 = ""
     availability = "online"
   memory = ""
    static-max = "524288"
    target = "524288"
    videoram = "0"
   error = ""
   drivers = ""
   attr = ""
   messages = ""
   domid = "6"
   store = ""
    port = "1"
    ring-ref = "369971"
   console = ""
    backend = "/local/domain/0/backend/console/6/0"
    backend-id = "0"
    limit = "1048576"
    type = "ioemu"
    output = "pty"
    port = "2"
    ring-ref = "369970"
    tty = "/dev/pts/2"
    vnc-port = "5905"
    vnc-listen = "0.0.0.0"
    vnc-pass = ""
   image = ""
    device-model-pid = "1684"
  7 = ""
   vm = "/vm/bf8f3948-e089-44fd-88be-140479840e93"
   name = "finnix"
   control = ""
    shutdown = ""
    platform-feature-multiprocessor-suspend = "1"
   device = ""
    suspend = ""
     event-channel = ""
    vbd = ""
     51712 = ""
      backend = "/local/domain/0/backend/qdisk/7/51712"
      backend-id = "0"
      state = "1"
      virtual-device = "51712"
      device-type = "disk"
    vif = ""
     0 = ""
      backend = "/local/domain/0/backend/vif/7/0"
      backend-id = "0"
      state = "1"
      handle = "0"
      mac = "00:16:3e:10:6a:f4"
   data = ""
   cpu = ""
    0 = ""
     availability = "online"
   memory = ""
    static-max = "131072"
    target = "131072"
    videoram = "0"
   error = ""
   drivers = ""
   attr = ""
   messages = ""
   domid = "7"
   store = ""
    port = "1"
    ring-ref = "265286"
   console = ""
    backend = "/local/domain/0/backend/console/7/0"
    backend-id = "0"
    limit = "1048576"
    type = "ioemu"
    output = "pty"
    port = "2"
    ring-ref = "265285"
    tty = "/dev/pts/3"
   image = ""
    device-model-pid = "1725"
vm = ""
 d7ea3f07-f491-493f-8989-749d7a76a4f4 = ""
  uuid = "d7ea3f07-f491-493f-8989-749d7a76a4f4"
  name = "domutest"
  pool_name = "Pool-0"
  image = ""
   ostype = "linux"
   kernel = "/usr/lib/xen/boot/pv-grub-x86_64.gz"
   cmdline = "(hd0)/boot/grub/menu.lst"
  start_time = "1335231372.76"
  vncpasswd = "\000"
 bf8f3948-e089-44fd-88be-140479840e93 = ""
  uuid = "bf8f3948-e089-44fd-88be-140479840e93"
  name = "finnix"
  pool_name = "Pool-0"
  image = ""
   ostype = "linux"
   kernel = "/var/finnix/linux64"
   ramdisk = "/var/finnix/initrd.xz"
   cmdline = ""
  start_time = "1335231379.11"


[-- Attachment #1.2: Type: text/html, Size: 20410 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Stefano Stabellini]

[-- Attachment #1: Type: text/plain, Size: 11728 bytes --]

On Tue, 24 Apr 2012, Sam Mulvey wrote:
> tool = ""
>  xenstored = ""
> local = ""
>  domain = ""
>   0 = ""
>    name = "Domain-0"
>    memory = ""
>     target = "523904"
>     static-max = "4294967292"
>     freemem-slack = "314505"
>    backend = ""
>     console = ""
>      1 = ""
>       0 = ""
>        frontend = "/local/domain/1/console"
>        frontend-id = "1"
>        online = "0"
>        state = "5"
>        domain = "finnix"
>        protocol = "vt100"
>        hotplug-status = "connected"
>      2 = ""
>       0 = ""
>        frontend = "/local/domain/2/console"
>        frontend-id = "2"
>        online = "0"
>        state = "5"
>        domain = "domutest"
>        protocol = "vt100"
>        hotplug-status = "connected"
>      3 = ""
>       0 = ""
>        frontend = "/local/domain/3/console"
>        frontend-id = "3"
>        online = "0"
>        state = "5"
>        domain = "finnix"
>        protocol = "vt100"
>        hotplug-status = "connected"
>      4 = ""
>       0 = ""
>        frontend = "/local/domain/4/console"
>        frontend-id = "4"
>        online = "0"
>        state = "5"
>        domain = "finnix"
>        protocol = "vt100"
>        hotplug-status = "connected"
>      5 = ""
>       0 = ""
>        frontend = "/local/domain/5/console"
>        frontend-id = "5"
>        online = "0"
>        state = "5"
>        domain = "domutest"
>        protocol = "vt100"
>        hotplug-status = "connected"
>      6 = ""
>       0 = ""
>        frontend = "/local/domain/6/console"
>        frontend-id = "6"
>        online = "1"
>        state = "4"
>        domain = "domutest"
>        protocol = "vt100"
>        hotplug-status = "connected"
>      7 = ""
>       0 = ""
>        frontend = "/local/domain/7/console"
>        frontend-id = "7"
>        online = "1"
>        state = "4"
>        domain = "finnix"
>        protocol = "vt100"
>        hotplug-status = "connected"
>     vfb = ""
>      5 = ""
>       0 = ""
>        frontend = "/local/domain/5/device/vfb/0"
>        frontend-id = "5"
>        online = "0"
>        state = "5"
>        domain = "domutest"
>        vnc = "1"
>        vnclisten = "0.0.0.0"
>        vncpasswd = ""
>        vncdisplay = "5"
>        vncunused = "1"
>        sdl = "0"
>        opengl = "0"
>        feature-resize = "1"
>        hotplug-status = "connected"
>        request-update = "1"
>      6 = ""
>       0 = ""
>        frontend = "/local/domain/6/device/vfb/0"
>        frontend-id = "6"
>        online = "1"
>        state = "4"
>        domain = "domutest"
>        vnc = "1"
>        vnclisten = "0.0.0.0"
>        vncpasswd = ""
>        vncdisplay = "5"
>        vncunused = "1"
>        sdl = "0"
>        opengl = "0"
>        feature-resize = "1"
>        hotplug-status = "connected"
>        request-update = "1"
>     vkbd = ""
>      5 = ""
>       0 = ""
>        frontend = "/local/domain/5/device/vkbd/0"
>        frontend-id = "5"
>        online = "0"
>        state = "5"
>        domain = "domutest"
>        feature-abs-pointer = "1"
>        hotplug-status = "connected"
>      6 = ""
>       0 = ""
>        frontend = "/local/domain/6/device/vkbd/0"
>        frontend-id = "6"
>        online = "1"
>        state = "4"
>        domain = "domutest"
>        feature-abs-pointer = "1"
>        hotplug-status = "connected"
>     vbd = ""
>      6 = ""
>       51713 = ""
>        frontend = "/local/domain/6/device/vbd/51713"
>        physical-device = "fe:2"
>        params = "/dev/xtG0/domutest-root"
>        frontend-id = "6"
>        online = "1"
>        removable = "0"
>        bootable = "1"
>        state = "4"
>        dev = "xvda1"
>        type = "phy"
>        mode = "w"
>        feature-flush-cache = "0"
>        discard-secure = "0"
>        feature-discard = "0"
>        feature-barrier = "0"
>        sectors = "6291456"
>        info = "0"
>        sector-size = "512"
>       51714 = ""
>        frontend = "/local/domain/6/device/vbd/51714"
>        physical-device = "fe:3"
>        params = "/dev/xtG0/domutest-swap"
>        frontend-id = "6"
>        online = "1"
>        removable = "0"
>        bootable = "1"
>        state = "4"
>        dev = "xvda2"
>        type = "phy"
>        mode = "w"
>        feature-flush-cache = "0"
>        discard-secure = "0"
>        feature-discard = "0"
>        feature-barrier = "0"
>        sectors = "1048576"
>        info = "0"
>        sector-size = "512"
>     vif = ""
>      6 = ""
>       0 = ""
>        frontend = "/local/domain/6/device/vif/0"
>        frontend-id = "6"
>        online = "1"
>        state = "4"
>        script = "/etc/xen/scripts/vif-bridge"
>        mac = "00:16:3e:0c:49:8e"
>        bridge = "outer0"
>        handle = "0"
>        feature-sg = "1"
>        feature-gso-tcpv4 = "1"
>        feature-rx-copy = "1"
>        feature-rx-flip = "0"
>        hotplug-status = "connected"
>      7 = ""
>       0 = ""
>        frontend = "/local/domain/7/device/vif/0"
>        frontend-id = "7"
>        online = "1"
>        state = "2"
>        script = "/etc/xen/scripts/vif-bridge"
>        mac = "00:16:3e:10:6a:f4"
>        bridge = "outer0"
>        handle = "0"
>        feature-sg = "1"
>        feature-gso-tcpv4 = "1"
>        feature-rx-copy = "1"
>        feature-rx-flip = "0"
>        hotplug-status = "connected"
>     qdisk = ""
>      7 = ""
>       51712 = ""
>        frontend = "/local/domain/7/device/vbd/51712"
>        params = "aio:/var/finnix/finnix-104.iso"
>        frontend-id = "7"
>        online = "1"
>        removable = "0"
>        bootable = "1"
>        state = "2"
>        dev = "xvda"
>        type = "tap"
>        mode = "r"
>        feature-barrier = "1"
>        info = "4"
>        sector-size = "512"
>        sectors = "237712"
>        hotplug-status = "connected"
>    device-model = ""
>     6 = ""
>      disable_pf = "1"
>      state = "running"
>     7 = ""
>      disable_pf = "1"
>      state = "running"
>   6 = ""
>    vm = "/vm/d7ea3f07-f491-493f-8989-749d7a76a4f4"
>    name = "domutest"
>    control = ""
>     shutdown = ""
>     platform-feature-multiprocessor-suspend = "1"
>    device = ""
>     suspend = ""
>      event-channel = ""
>     vbd = ""
>      51713 = ""
>       backend = "/local/domain/0/backend/vbd/6/51713"
>       backend-id = "0"
>       state = "4"
>       virtual-device = "51713"
>       device-type = "disk"
>       ring-ref = "8"
>       event-channel = "23"
>       protocol = "x86_64-abi"
>      51714 = ""
>       backend = "/local/domain/0/backend/vbd/6/51714"
>       backend-id = "0"
>       state = "4"
>       virtual-device = "51714"
>       device-type = "disk"
>       ring-ref = "9"
>       event-channel = "24"
>       protocol = "x86_64-abi"
>     vif = ""
>      0 = ""
>       backend = "/local/domain/0/backend/vif/6/0"
>       backend-id = "0"
>       state = "4"
>       handle = "0"
>       mac = "00:16:3e:0c:49:8e"
>       tx-ring-ref = "10"
>       rx-ring-ref = "11"
>       event-channel = "25"
>       request-rx-copy = "1"
>       feature-rx-notify = "1"
>       feature-sg = "1"
>       feature-gso-tcpv4 = "1"
>     vfb = ""
>      0 = ""
>       backend = "/local/domain/0/backend/vfb/6/0"
>       backend-id = "0"
>       state = "4"
>       page-ref = "367826"
>       event-channel = "27"
>       protocol = "x86_64-abi"
>       feature-update = "1"
>     vkbd = ""
>      0 = ""
>       backend = "/local/domain/0/backend/vkbd/6/0"
>       backend-id = "0"
>       state = "4"
>       request-abs-pointer = "1"
>       page-ref = "284662"
>       page-gref = "14"
>       event-channel = "26"
>    data = ""
>    cpu = ""
>     0 = ""
>      availability = "online"
>     1 = ""
>      availability = "online"
>     2 = ""
>      availability = "online"
>     3 = ""
>      availability = "online"
>    memory = ""
>     static-max = "524288"
>     target = "524288"
>     videoram = "0"
>    error = ""
>    drivers = ""
>    attr = ""
>    messages = ""
>    domid = "6"
>    store = ""
>     port = "1"
>     ring-ref = "369971"
>    console = ""
>     backend = "/local/domain/0/backend/console/6/0"
>     backend-id = "0"
>     limit = "1048576"
>     type = "ioemu"
>     output = "pty"
>     port = "2"
>     ring-ref = "369970"
>     tty = "/dev/pts/2"
>     vnc-port = "5905"
>     vnc-listen = "0.0.0.0"
>     vnc-pass = ""
>    image = ""
>     device-model-pid = "1684"
>   7 = ""
>    vm = "/vm/bf8f3948-e089-44fd-88be-140479840e93"
>    name = "finnix"
>    control = ""
>     shutdown = ""
>     platform-feature-multiprocessor-suspend = "1"
>    device = ""
>     suspend = ""
>      event-channel = ""
>     vbd = ""
>      51712 = ""
>       backend = "/local/domain/0/backend/qdisk/7/51712"
>       backend-id = "0"
>       state = "1"
>       virtual-device = "51712"
>       device-type = "disk"
>     vif = ""
>      0 = ""
>       backend = "/local/domain/0/backend/vif/7/0"
>       backend-id = "0"
>       state = "1"
>       handle = "0"
>       mac = "00:16:3e:10:6a:f4"
>    data = ""
>    cpu = ""
>     0 = ""
>      availability = "online"
>    memory = ""
>     static-max = "131072"
>     target = "131072"
>     videoram = "0"
>    error = ""
>    drivers = ""
>    attr = ""
>    messages = ""
>    domid = "7"
>    store = ""
>     port = "1"
>     ring-ref = "265286"
>    console = ""
>     backend = "/local/domain/0/backend/console/7/0"
>     backend-id = "0"
>     limit = "1048576"
>     type = "ioemu"
>     output = "pty"
>     port = "2"
>     ring-ref = "265285"
>     tty = "/dev/pts/3"
>    image = ""
>     device-model-pid = "1725"
> vm = ""
>  d7ea3f07-f491-493f-8989-749d7a76a4f4 = ""
>   uuid = "d7ea3f07-f491-493f-8989-749d7a76a4f4"
>   name = "domutest"
>   pool_name = "Pool-0"
>   image = ""
>    ostype = "linux"
>    kernel = "/usr/lib/xen/boot/pv-grub-x86_64.gz"
>    cmdline = "(hd0)/boot/grub/menu.lst"
>   start_time = "1335231372.76"
>   vncpasswd = "\000"
>  bf8f3948-e089-44fd-88be-140479840e93 = ""
>   uuid = "bf8f3948-e089-44fd-88be-140479840e93"
>   name = "finnix"
>   pool_name = "Pool-0"
>   image = ""
>    ostype = "linux"
>    kernel = "/var/finnix/linux64"
>    ramdisk = "/var/finnix/initrd.xz"
>    cmdline = ""
>   start_time = "1335231379.11"

According to xenstore the console is connected for both domains and you
should be able to access them using /dev/pts/2 and /dev/pts/3.
The only issue I can see is that the disk for "finnix" is not
connected. Maybe an disk open error?

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 792 bytes --]


On Apr 24, 2012, at 6:02 AM, Stefano Stabellini wrote:

> According to xenstore the console is connected for both domains and you
> should be able to access them using /dev/pts/2 and /dev/pts/3.
> The only issue I can see is that the disk for "finnix" is not
> connected. Maybe an disk open error?

Sure enough, you are right in both cases.   Connecting to the pty with screen gives me access to the console.   

domutest is an archlinux instance which is using a LVM partition appears to work.   The finnix domU is using an ISO file and it does not appear to find it on boot up and I can't force it to find it, so running "xl create" doesn't work in that mode as well as I thought it had.     Running it with xend/xm, it works fine

Anything I should be looking at next?

-Sam

[-- Attachment #1.2: Type: text/html, Size: 1666 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Stefano Stabellini]

[-- Attachment #1: Type: text/plain, Size: 3707 bytes --]

On Tue, 24 Apr 2012, Sam Mulvey wrote:
> On Apr 24, 2012, at 6:02 AM, Stefano Stabellini wrote:
> 
>       According to xenstore the console is connected for both domains and you
>       should be able to access them using /dev/pts/2 and /dev/pts/3.
>       The only issue I can see is that the disk for "finnix" is not
>       connected. Maybe an disk open error?
> 
> 
> Sure enough, you are right in both cases.   Connecting to the pty with screen gives me access to the console.   

That means there is still a bug in xl or xenconsole because "xl console"
should work.


> domutest is an archlinux instance which is using a LVM partition appears to work.   The finnix domU is using an ISO file
> and it does not appear to find it on boot up and I can't force it to find it, so running "xl create" doesn't work in that
> mode as well as I thought it had.     Running it with xend/xm, it works fine
> 
> Anything I should be looking at next?

Is the file you are trying to open on NFS by any chance?
My guess is that the file open is failing, maybe because of an opening flag.
We need to add some tracing to xen_disk.c in qemu to find out.
Could you please apply the appended patch to the qemu tree and then post
the qemu log file again?

---


diff --git a/hw/xen_disk.c b/hw/xen_disk.c
index 6aebb77..5c4828d 100644
--- a/hw/xen_disk.c
+++ b/hw/xen_disk.c
@@ -584,6 +584,7 @@ static int blk_init(struct XenDevice *xendev)
     int mode, qflags, have_barriers, info = 0;
     char *h = NULL;
 
+    printf("DEBUG %s %d\n",__func__,__LINE__);
     /* read xenstore entries */
     if (blkdev->params == NULL) {
 	blkdev->params = xenstore_read_be_str(&blkdev->xendev, "params");
@@ -598,6 +599,7 @@ static int blk_init(struct XenDevice *xendev)
 	    blkdev->filename  = blkdev->params;
 	}
     }
+    printf("DEBUG %s %d filename=%s\n",__func__,__LINE__,blkdev->filename);
     if (!strcmp("aio", blkdev->fileproto))
         blkdev->fileproto = "raw";
     if (blkdev->mode == NULL)
@@ -608,6 +610,7 @@ static int blk_init(struct XenDevice *xendev)
 	blkdev->dev = xenstore_read_be_str(&blkdev->xendev, "dev");
     if (blkdev->devtype == NULL)
 	blkdev->devtype = xenstore_read_be_str(&blkdev->xendev, "device-type");
+    printf("DEBUG %s %d protocol=%s\n",__func__,__LINE__,blkdev->fileproto);
 
     /* do we have all we need? */
     if (blkdev->params == NULL ||
@@ -616,6 +619,7 @@ static int blk_init(struct XenDevice *xendev)
 	blkdev->dev == NULL)
 	return -1;
 
+    printf("DEBUG %s %d\n",__func__,__LINE__);
     /* read-only ? */
     if (strcmp(blkdev->mode, "w") == 0) {
 	mode   = O_RDWR;
@@ -630,6 +634,7 @@ static int blk_init(struct XenDevice *xendev)
     if (blkdev->devtype && !strcmp(blkdev->devtype, "cdrom"))
 	info  |= VDISK_CDROM;
 
+    printf("DEBUG %s %d\n",__func__,__LINE__);
     /* init qemu block driver */
     blkdev->index = (blkdev->xendev.dev - 202 * 256) / 16;
     blkdev->index = drive_get_index(IF_XEN, 0, blkdev->index);
@@ -640,6 +645,7 @@ static int blk_init(struct XenDevice *xendev)
 	if (blkdev->bs) {
 	    if (bdrv_open2(blkdev->bs, blkdev->filename, qflags,
                            bdrv_find_format(blkdev->fileproto)) != 0) {
+                printf("DEBUG %s %d errno=%d\n",__func__,__LINE__,errno);
 		bdrv_delete(blkdev->bs);
 		blkdev->bs = NULL;
 	    }
@@ -651,6 +657,7 @@ static int blk_init(struct XenDevice *xendev)
         xen_be_printf(&blkdev->xendev, 2, "get configured bdrv (cmdline setup)\n");
 	blkdev->bs = drives_table[blkdev->index].bdrv;
     }
+    printf("DEBUG %s %d\n",__func__,__LINE__);
     blkdev->file_blk  = BLOCK_SIZE;
     blkdev->file_size = bdrv_getlength(blkdev->bs);
     if (blkdev->file_size < 0) {

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 628 bytes --]


On Apr 24, 2012, at 10:03 AM, Stefano Stabellini wrote:

> Is the file you are trying to open on NFS by any chance?

No, it's an XFS filesystem on an LVM partition.

> My guess is that the file open is failing, maybe because of an opening flag.
> We need to add some tracing to xen_disk.c in qemu to find out.
> Could you please apply the appended patch to the qemu tree and then post
> the qemu log file again?

The patch didn't take… I can make the changes by hand, but I want to make sure I'm using the right things.   So far I'm using the 4.1.2 tarball.  Is there a different tree I should be using?

-Sam


[-- Attachment #1.2: Type: text/html, Size: 2041 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 956 bytes --]


On Apr 24, 2012, at 10:03 AM, Stefano Stabellini wrote:

> Could you please apply the appended patch to the qemu tree and then post
> the qemu log file again?


Meanwhile, here's said log with patch applied:

[root@xentest2012 xen]# more qemu-dm-finnix.log 
domid: 1
Warning: vlan 0 is not connected to host network
-videoram option does not work with cirrus vga device model. Videoram set to 4M.
/home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628
: Init blktap pipes
/home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:603
: Created /var/run/tap directory
Could not open /var/run/tap/qemu-read-1
char device redirected to /dev/pts/2
DEBUG blk_init 587
DEBUG blk_init 602 filename=/var/finnix/finnix-104.iso
DEBUG blk_init 613 protocol=raw
DEBUG blk_init 622
DEBUG blk_init 636
DEBUG blk_init 659
xs_read(): target get error. /local/domain/1/target.
(qemu) (qemu) 


-Sam

[-- Attachment #1.2: Type: text/html, Size: 1982 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Stefano Stabellini]

[-- Attachment #1: Type: text/plain, Size: 1560 bytes --]

On Tue, 24 Apr 2012, Sam Mulvey wrote:
> On Apr 24, 2012, at 10:03 AM, Stefano Stabellini wrote:
> 
>       Could you please apply the appended patch to the qemu tree and then post
>       the qemu log file again?
> 
> 
> 
> Meanwhile, here's said log with patch applied:
> 
> [root@xentest2012 xen]# more qemu-dm-finnix.log 
> domid: 1
> Warning: vlan 0 is not connected to host network
> -videoram option does not work with cirrus vga device model. Videoram set to 4M.
> /home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628
> : Init blktap pipes
> /home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:603
> : Created /var/run/tap directory
> Could not open /var/run/tap/qemu-read-1
> char device redirected to /dev/pts/2
> DEBUG blk_init 587
> DEBUG blk_init 602 filename=/var/finnix/finnix-104.iso
> DEBUG blk_init 613 protocol=raw
> DEBUG blk_init 622
> DEBUG blk_init 636
> DEBUG blk_init 659
> xs_read(): target get error. /local/domain/1/target.
> (qemu) (qemu) 

It looks like the disk was opened correctly, maybe more logging will
tell us what is going wrong.
Could you please try the following patch?



diff --git a/hw/xen_backend.c b/hw/xen_backend.c
index 64dc93a..f564667 100644
--- a/hw/xen_backend.c
+++ b/hw/xen_backend.c
@@ -50,7 +50,7 @@ const char *xen_protocol;
 
 /* private */
 static TAILQ_HEAD(XenDeviceHead, XenDevice) xendevs = TAILQ_HEAD_INITIALIZER(xendevs);
-static int debug = 0;
+static int debug = 9;
 
 /* ------------------------------------------------------------- */
 

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 2617 bytes --]


On Apr 25, 2012, at 8:50 AM, Stefano Stabellini wrote:

> It looks like the disk was opened correctly, maybe more logging will
> tell us what is going wrong.
> Could you please try the following patch?
> 


domid: 1
Warning: vlan 0 is not connected to host network
-videoram option does not work with cirrus vga device model. Videoram set to 4M.
/home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628: Init blktap pipes
/home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:603: Created /var/run/tap directory
Could not open /var/run/tap/qemu-read-1
xen be: console-0: backend state: Unknown -> Initialising
char device redirected to /dev/pts/2
xen be: console-0: backend state: Initialising -> InitWait
xen be: console-0: frontend not ready, ignoring
xen be: console-0: bind evtchn port 70
xen be: console-0: ring mfn 412787, remote port 2, local port 70, limit 1048576
xen be: console-0: backend state: InitWait -> Connected
xen be: qdisk-51712: backend state: Unknown -> Initialising
xen be: qdisk-51712: frontend state: Unknown -> Initialising
DEBUG blk_init 587
DEBUG blk_init 602 filename=/var/finnix/finnix-104.iso
DEBUG blk_init 613 protocol=raw
DEBUG blk_init 622
DEBUG blk_init 636
xen be: qdisk-51712: create new bdrv (xenbus setup)
DEBUG blk_init 659
xen be: qdisk-51712: type "tap", fileproto "raw", filename "/var/finnix/finnix-104.iso", size 121708544 (116 MB)
xen be: qdisk-51712: backend state: Initialising -> InitWait
xen be: qdisk-51712: frontend not ready (yet)
xs_read(): target get error. /local/domain/1/target.
xen be: console-0: backend update: state
xen be: console-0: frontend update: tty
xen be: console-0: backend update: hotplug-status
xen be: console-0: backend update: state
xen be: console-0: backend update: state
xen be: qdisk-51712: backend update: state
xen be: qdisk-51712: frontend not ready (yet)
xen be: qdisk-51712: backend update: feature-barrier
xen be: qdisk-51712: frontend not ready (yet)
xen be: qdisk-51712: backend update: info
xen be: qdisk-51712: frontend not ready (yet)
xen be: qdisk-51712: backend update: sector-size
xen be: qdisk-51712: frontend not ready (yet)
xen be: qdisk-51712: backend update: sectors
xen be: qdisk-51712: frontend not ready (yet)
xen be: qdisk-51712: backend update: hotplug-status
xen be: qdisk-51712: frontend not ready (yet)
xen be: qdisk-51712: backend update: state
xen be: qdisk-51712: frontend not ready (yet)
xen be core: displaystate setup failed
(qemu) (qemu) xen be: console-0: backlog piling up, nobody listening?



[-- Attachment #1.2: Type: text/html, Size: 3879 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: no console when using xl toolstack xen 4.1.2

[Stefano Stabellini]

On Thu, 26 Apr 2012, Sam Mulvey wrote:
> On Apr 25, 2012, at 8:50 AM, Stefano Stabellini wrote:
> 
>       It looks like the disk was opened correctly, maybe more logging will
>       tell us what is going wrong.
>       Could you please try the following patch?
> 
> domid: 1
> Warning: vlan 0 is not connected to host network
> -videoram option does not work with cirrus vga device model. Videoram set to 4M.
> /home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:628: Init blktap pipes
> /home/sam/build/debug/xen/src/xen-4.1.2/tools/ioemu-qemu-xen/hw/xen_blktap.c:603: Created /var/run/tap directory
> Could not open /var/run/tap/qemu-read-1
> xen be: console-0: backend state: Unknown -> Initialising
> char device redirected to /dev/pts/2
> xen be: console-0: backend state: Initialising -> InitWait
> xen be: console-0: frontend not ready, ignoring
> xen be: console-0: bind evtchn port 70
> xen be: console-0: ring mfn 412787, remote port 2, local port 70, limit 1048576
> xen be: console-0: backend state: InitWait -> Connected
> xen be: qdisk-51712: backend state: Unknown -> Initialising
> xen be: qdisk-51712: frontend state: Unknown -> Initialising
> DEBUG blk_init 587
> DEBUG blk_init 602 filename=/var/finnix/finnix-104.iso
> DEBUG blk_init 613 protocol=raw
> DEBUG blk_init 622
> DEBUG blk_init 636
> xen be: qdisk-51712: create new bdrv (xenbus setup)
> DEBUG blk_init 659
> xen be: qdisk-51712: type "tap", fileproto "raw", filename "/var/finnix/finnix-104.iso", size 121708544 (116 MB)
> xen be: qdisk-51712: backend state: Initialising -> InitWait
> xen be: qdisk-51712: frontend not ready (yet)
> xs_read(): target get error. /local/domain/1/target.
> xen be: console-0: backend update: state
> xen be: console-0: frontend update: tty
> xen be: console-0: backend update: hotplug-status
> xen be: console-0: backend update: state
> xen be: console-0: backend update: state
> xen be: qdisk-51712: backend update: state
> xen be: qdisk-51712: frontend not ready (yet)
> xen be: qdisk-51712: backend update: feature-barrier
> xen be: qdisk-51712: frontend not ready (yet)
> xen be: qdisk-51712: backend update: info
> xen be: qdisk-51712: frontend not ready (yet)
> xen be: qdisk-51712: backend update: sector-size
> xen be: qdisk-51712: frontend not ready (yet)
> xen be: qdisk-51712: backend update: sectors
> xen be: qdisk-51712: frontend not ready (yet)
> xen be: qdisk-51712: backend update: hotplug-status
> xen be: qdisk-51712: frontend not ready (yet)
> xen be: qdisk-51712: backend update: state
> xen be: qdisk-51712: frontend not ready (yet)
> xen be core: displaystate setup failed
> (qemu) (qemu) xen be: console-0: backlog piling up, nobody listening?
 
It looks like the backend (QEMU) is waiting for the client to connect,
but it never happens.
Are you sure that blkfront is compiled in the guest's kernel?
I fail to see how this could work with XenD but not with Xl.

Re: no console when using xl toolstack xen 4.1.2

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 527 bytes --]


On Apr 26, 2012, at 5:18 AM, Stefano Stabellini wrote:

> It looks like the backend (QEMU) is waiting for the client to connect,
> but it never happens.
> Are you sure that blkfront is compiled in the guest's kernel?
> I fail to see how this could work with XenD but not with Xl.

It loads as a module in the initrd.    This guest is Finnix, a livecd which explicitly supports Xen.   I use it pretty frequently for testing or occasionally recovery stuff.

http://www.finnix.org/Finnix_for_VPS_providers#Xen


-Sam

[-- Attachment #1.2: Type: text/html, Size: 1446 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Xen 4.2.1, Linux 3.3.4 kernel crash

[Sam Mulvey]

Hey folks...

This is with the same packages and such that I've been work on with Arch, and I encountered an odd crash.   If I need to move this thread to Xen-users or whatnot, apologies and please let me know.

The packages that I've been working with functioned great in the desktop VM, and worked wonderfully in PV and HVM on my test hardware (an HP server with Intel Xeons), but crashes right out of the gate on my production server (Tyan motherboard with Opteron 8356s).   When I move the kernel back to a 2.6.32.18 pvops kernel I had been using, I can boot and run VMs without trouble.

Incidentally, I can now boot as many VMs as I like as long as the memory holds out, so the initial trouble that got all of this started looks like it's been fixed.


Everything looks normal until Xen hands off to the kernel, then I get this:

[    0.000000] Cannot find 20480 bytes in node 1
[    0.000000] BUG: unable to handle kernel NULL pointer dereference at           (null)
[    0.000000] IP: [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
[    0.000000] PGD 0 
[    0.000000] Oops: 0000 [#1] PREEMPT SMP 
[    0.000000] CPU 0 
[    0.000000] Modules linked in:
[    0.000000] 
[    0.000000] Pid: 0, comm: swapper Not tainted 3.3.4-1-ARCH #1 empty empty/S3992
[    0.000000] RIP: e030:[<ffffffff818d5704>]  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
[    0.000000] RSP: e02b:ffffffff81801de8  EFLAGS: 00010046
[    0.000000] RAX: 0000000000000000 RBX: 0000000000000378 RCX: 0000000000000000
[    0.000000] RDX: 0000000000000040 RSI: 0000000000000378 RDI: 0000000000000000
[    0.000000] RBP: ffffffff81801e08 R08: 0000000000000000 R09: ffffffff81801d98
[    0.000000] R10: ffffffff81801d88 R11: ffffffff81801d90 R12: 0000000000000040
[    0.000000] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001
[    0.000000] FS:  0000000000000000(0000) GS:ffffffff8189f000(0000) knlGS:0000000000000000
[    0.000000] CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.000000] CR2: 0000000000000000 CR3: 0000000001805000 CR4: 0000000000000660
[    0.000000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    0.000000] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000
[    0.000000] Process swapper (pid: 0, threadinfo ffffffff81800000, task ffffffff8180d020)
[    0.000000] Stack:
[    0.000000]  0000000000080000 0000000000000378 000000000000003c ffff88003fbfa000
[    0.000000]  ffffffff81801e68 ffffffff818d63f0 ffffffff81801e48 00000001818d53bc
[    0.000000]  ffff88003fbf9fe0 0000000000000000 000000000282c000 ffff88003fbfa000
[    0.000000] Call Trace:
[    0.000000]  [<ffffffff818d63f0>] sparse_early_usemaps_alloc_node+0x63/0x1c4
[    0.000000]  [<ffffffff818d677b>] sparse_init+0xf8/0x2c8
[    0.000000]  [<ffffffff818ca4d2>] paging_init+0x13/0x22
[    0.000000]  [<ffffffff818b9dca>] setup_arch+0x9f2/0xac0
[    0.000000]  [<ffffffff814562d2>] ? printk+0x41/0x43
[    0.000000]  [<ffffffff818b491b>] start_kernel+0xd4/0x3d1
[    0.000000]  [<ffffffff818b4346>] x86_64_start_reservations+0x131/0x135
[    0.000000]  [<ffffffff818b69c9>] xen_start_kernel+0x598/0x59f
[    0.000000] Code: 4c 89 e9 4c 89 e2 48 89 de bf 40 00 00 00 e8 0f fc ff ff eb 34 41 8b 96 a0 40 00 00 be 00 80 00 00 48 89 d 
[    0.000000] RIP  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
[    0.000000]  RSP <ffffffff81801de8>
[    0.000000] CR2: 0000000000000000
[    0.000000] ---[ end trace a7919e7f17c0a725 ]---
[    0.000000] Kernel panic - not syncing: Attempted to kill the idle task!
(XEN) Domain 0 crashed: rebooting machine in 5 seconds.

----

This is the same kernel I've been using in the two testing machines.    The server is, incidentally, the same server that houses the mail server I'm on, so I'm cc'ing a gmail address, if you could include it in your replies, I'd appreciate it.

Thanks!

-- 
Sam Mulvey
Tacoma Telematics
sam@tacomatelematics.com
(253) 883-3030 x110

Re: Xen 4.2.1, Linux 3.3.4 kernel crash

[Konrad Rzeszutek Wilk]

On Thu, May 03, 2012 at 08:37:16AM -0700, Sam Mulvey wrote:
> 
> Hey folks...
> 
> This is with the same packages and such that I've been work on with Arch, and I encountered an odd crash.   If I need to move this thread to Xen-users or whatnot, apologies and please let me know.
> 
> The packages that I've been working with functioned great in the desktop VM, and worked wonderfully in PV and HVM on my test hardware (an HP server with Intel Xeons), but crashes right out of the gate on my production server (Tyan motherboard with Opteron 8356s).   When I move the kernel back to a 2.6.32.18 pvops kernel I had been using, I can boot and run VMs without trouble.
> 
> Incidentally, I can now boot as many VMs as I like as long as the memory holds out, so the initial trouble that got all of this started looks like it's been fixed.
> 
> 
> Everything looks normal until Xen hands off to the kernel, then I get this:

This looks like an E820 alignment issue. Can you provide the full serial output please.


> 
> [    0.000000] Cannot find 20480 bytes in node 1
> [    0.000000] BUG: unable to handle kernel NULL pointer dereference at           (null)
> [    0.000000] IP: [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
> [    0.000000] PGD 0 
> [    0.000000] Oops: 0000 [#1] PREEMPT SMP 
> [    0.000000] CPU 0 
> [    0.000000] Modules linked in:
> [    0.000000] 
> [    0.000000] Pid: 0, comm: swapper Not tainted 3.3.4-1-ARCH #1 empty empty/S3992
> [    0.000000] RIP: e030:[<ffffffff818d5704>]  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
> [    0.000000] RSP: e02b:ffffffff81801de8  EFLAGS: 00010046
> [    0.000000] RAX: 0000000000000000 RBX: 0000000000000378 RCX: 0000000000000000
> [    0.000000] RDX: 0000000000000040 RSI: 0000000000000378 RDI: 0000000000000000
> [    0.000000] RBP: ffffffff81801e08 R08: 0000000000000000 R09: ffffffff81801d98
> [    0.000000] R10: ffffffff81801d88 R11: ffffffff81801d90 R12: 0000000000000040
> [    0.000000] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001
> [    0.000000] FS:  0000000000000000(0000) GS:ffffffff8189f000(0000) knlGS:0000000000000000
> [    0.000000] CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    0.000000] CR2: 0000000000000000 CR3: 0000000001805000 CR4: 0000000000000660
> [    0.000000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [    0.000000] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000
> [    0.000000] Process swapper (pid: 0, threadinfo ffffffff81800000, task ffffffff8180d020)
> [    0.000000] Stack:
> [    0.000000]  0000000000080000 0000000000000378 000000000000003c ffff88003fbfa000
> [    0.000000]  ffffffff81801e68 ffffffff818d63f0 ffffffff81801e48 00000001818d53bc
> [    0.000000]  ffff88003fbf9fe0 0000000000000000 000000000282c000 ffff88003fbfa000
> [    0.000000] Call Trace:
> [    0.000000]  [<ffffffff818d63f0>] sparse_early_usemaps_alloc_node+0x63/0x1c4
> [    0.000000]  [<ffffffff818d677b>] sparse_init+0xf8/0x2c8
> [    0.000000]  [<ffffffff818ca4d2>] paging_init+0x13/0x22
> [    0.000000]  [<ffffffff818b9dca>] setup_arch+0x9f2/0xac0
> [    0.000000]  [<ffffffff814562d2>] ? printk+0x41/0x43
> [    0.000000]  [<ffffffff818b491b>] start_kernel+0xd4/0x3d1
> [    0.000000]  [<ffffffff818b4346>] x86_64_start_reservations+0x131/0x135
> [    0.000000]  [<ffffffff818b69c9>] xen_start_kernel+0x598/0x59f
> [    0.000000] Code: 4c 89 e9 4c 89 e2 48 89 de bf 40 00 00 00 e8 0f fc ff ff eb 34 41 8b 96 a0 40 00 00 be 00 80 00 00 48 89 d 
> [    0.000000] RIP  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
> [    0.000000]  RSP <ffffffff81801de8>
> [    0.000000] CR2: 0000000000000000
> [    0.000000] ---[ end trace a7919e7f17c0a725 ]---
> [    0.000000] Kernel panic - not syncing: Attempted to kill the idle task!
> (XEN) Domain 0 crashed: rebooting machine in 5 seconds.
> 
> ----
> 
> This is the same kernel I've been using in the two testing machines.    The server is, incidentally, the same server that houses the mail server I'm on, so I'm cc'ing a gmail address, if you could include it in your replies, I'd appreciate it.
> 
> Thanks!
> 
> -- 
> Sam Mulvey
> Tacoma Telematics
> sam@tacomatelematics.com
> (253) 883-3030 x110
> 
> 
> 
> 
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

Re: Xen 4.2.1, Linux 3.3.4 kernel crash

[Sam Mulvey]

On May 3, 2012, at 10:24 AM, Konrad Rzeszutek Wilk wrote:
> 
> This looks like an E820 alignment issue. Can you provide the full serial output please.

Coming right up!

__  __            _  _    _   ____  
 \ \/ /___ _ __   | || |  / | |___ \ 
  \  // _ \ '_ \  | || |_ | |   __) |
  /  \  __/ | | | |__   _|| |_ / __/ 
 /_/\_\___|_| |_|    |_|(_)_(_)_____|
                                     
(XEN) Xen version 4.1.2 (sam@localdomain) (gcc version 4.7.0 20120414 (prerelease) (GCC) ) Wed May  2 19:51:21 PDT 2012
(XEN) Latest ChangeSet: unavailable
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: dom0_mem=1G loglvl=all guest_loglvl=all com1=115200,8n1 console=com1
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 2 seconds
(XEN) Disc information:
(XEN)  Found 3 MBR signatures
(XEN)  Found 3 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009d000 (usable)
(XEN)  000000000009d000 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000bfff0000 (usable)
(XEN)  00000000bfff0000 - 00000000bfffe000 (ACPI data)
(XEN)  00000000bfffe000 - 00000000c0000000 (ACPI NVS)
(XEN)  00000000fec00000 - 00000000fec03000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  0000000100000000 - 0000000380000000 (usable)
(XEN) ACPI: RSDP 000F83C0, 0024 (r2 ACPIAM)
(XEN) ACPI: XSDT BFFF0100, 004C (r1 071008 XSDT0948 20080710 MSFT       97)
(XEN) ACPI: FACP BFFF0290, 00F4 (r3 071008 FACP0948 20080710 MSFT       97)
(XEN) ACPI: DSDT BFFF04A0, 3B68 (r1  0AAAA 0AAAA000        0 INTL  2002026)
(XEN) ACPI: FACS BFFFE000, 0040
(XEN) ACPI: APIC BFFF0390, 00CA (r1 071008 APIC0948 20080710 MSFT       97)
(XEN) ACPI: MCFG BFFF0460, 003C (r1 071008 OEMMCFG  20080710 MSFT       97)
(XEN) ACPI: OEMB BFFFE040, 0056 (r1 071008 OEMB0948 20080710 MSFT       97)
(XEN) ACPI: SRAT BFFF4010, 0150 (r1 AMD    HAMMER          1 AMD         1)
(XEN) System RAM: 13311MB (13631028kB)
(XEN) SRAT: PXM 0 -> APIC 0 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 1 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 2 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 3 -> Node 0
(XEN) SRAT: PXM 1 -> APIC 4 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 5 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 6 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 7 -> Node 1
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-c0000000
(XEN) SRAT: Node 0 PXM 0 100000000-1e0000000
(XEN) SRAT: Node 1 PXM 1 1e0000000-380000000
(XEN) NUMA: Allocated memnodemap from 37e5f5000 - 37e5f9000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised DMA width 30 bits
(XEN) found SMP MP-table at 000ff780
(XEN) DMI 2.3 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x508
(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[544,504], pm1x_evt[540,500]
(XEN) ACPI:                  wakeup_vec[bfffe00c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) Processor #0 0:2 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
(XEN) Processor #1 0:2 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
(XEN) Processor #2 0:2 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
(XEN) Processor #3 0:2 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x04] enabled)
(XEN) Processor #4 0:2 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)
(XEN) Processor #5 0:2 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x06] enabled)
(XEN) Processor #6 0:2 APIC version 16
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] enabled)
(XEN) Processor #7 0:2 APIC version 16
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 8, version 17, address 0xfec00000, GSI 0-15
(XEN) ACPI: IOAPIC (id[0x09] address[0xfec01000] gsi_base[16])
(XEN) IOAPIC[1]: apic_id 9, version 17, address 0xfec01000, GSI 16-31
(XEN) ACPI: IOAPIC (id[0x0a] address[0xfec02000] gsi_base[32])
(XEN) IOAPIC[2]: apic_id 10, version 17, address 0xfec02000, GSI 32-47
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 3 I/O APICs
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
(XEN) PCI: Not using MMCONFIG.
(XEN) Table is not found!
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) IRQ limits: 48 GSI, 1504 MSI/MSI-X
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2294.308 MHz processor.
(XEN) Initing memory sharing.
(XEN) AMD Fam10h machine check reporting enabled
(XEN) AMD-Vi: IOMMU not found!
(XEN) I/O virtualisation disabled
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Platform timer appears to have unexpectedly wrapped 10 or more times.
(XEN) Platform timer is 3.579MHz ACPI PM Timer
ˇ(XEN) Allocated console ring of 64 KiB.
(XEN) HVM: ASIDs enabled.
(XEN) SVM: Supported advanced features:
(XEN)  - Nested Page Tables (NPT)
(XEN)  - Last Branch Record (LBR) Virtualisation
(XEN) HVM: SVM enabled
(XEN) HVM: Hardware Assisted Paging detected.
(XEN) Brought up 8 CPUs
(XEN) CPUIDLE: disabled due to no HPET. Force enable with 'cpuidle'.
(XEN) ACPI sleep modes: S3
(XEN) MCA: Use hw thresholding to adjust polling frequency
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1eb8000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000370000000->0000000374000000 (243340 pages to be allocated)
(XEN)  Init. ramdisk: 000000037f68c000->000000037ffffe00
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff81eb8000
(XEN)  Init. ramdisk: ffffffff81eb8000->ffffffff8282be00
(XEN)  Phys-Mach map: ffffffff8282c000->ffffffff82a2c000
(XEN)  Start info:    ffffffff82a2c000->ffffffff82a2c4b4
(XEN)  Page tables:   ffffffff82a2d000->ffffffff82a46000
(XEN)  Boot stack:    ffffffff82a46000->ffffffff82a47000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82c00000
(XEN)  ENTRY ADDRESS: ffffffff818b4200
(XEN) Dom0 has maximum 8 VCPUs
(XEN) Scrubbing Free RAM: ..........................................................................................................................done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 228kB init memory.
mapping kernel into physical memory
Xen: setup ISA identity maps
about to get started...
[    0.000000] Cannot find 20480 bytes in node 1
[    0.000000] BUG: unable to handle kernel NULL pointer dereference at           (null)
[    0.000000] IP: [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
[    0.000000] PGD 0 
[    0.000000] Oops: 0000 [#1] PREEMPT SMP 
[    0.000000] CPU 0 
[    0.000000] Modules linked in:
[    0.000000] 
[    0.000000] Pid: 0, comm: swapper Not tainted 3.3.4-2-ARCH #1 empty empty/S3992
[    0.000000] RIP: e030:[<ffffffff818d5704>]  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
[    0.000000] RSP: e02b:ffffffff81801de8  EFLAGS: 00010046
[    0.000000] RAX: 0000000000000000 RBX: 0000000000000378 RCX: 0000000000000000
[    0.000000] RDX: 0000000000000040 RSI: 0000000000000378 RDI: 0000000000000000
[    0.000000] RBP: ffffffff81801e08 R08: 0000000000000000 R09: ffffffff81801d98
[    0.000000] R10: ffffffff81801d88 R11: ffffffff81801d90 R12: 0000000000000040
[    0.000000] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001
[    0.000000] FS:  0000000000000000(0000) GS:ffffffff8189f000(0000) knlGS:0000000000000000
[    0.000000] CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
[    0.000000] CR2: 0000000000000000 CR3: 0000000001805000 CR4: 0000000000000660
[    0.000000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    0.000000] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000
[    0.000000] Process swapper (pid: 0, threadinfo ffffffff81800000, task ffffffff8180d020)
[    0.000000] Stack:
[    0.000000]  0000000000080000 0000000000000378 000000000000003c ffff88003fbfa000
[    0.000000]  ffffffff81801e68 ffffffff818d63f0 ffffffff81801e48 00000001818d53bc
[    0.000000]  ffff88003fbf9fe0 0000000000000000 000000000282c000 ffff88003fbfa000
[    0.000000] Call Trace:
[    0.000000]  [<ffffffff818d63f0>] sparse_early_usemaps_alloc_node+0x63/0x1c4
[    0.000000]  [<ffffffff818d677b>] sparse_init+0xf8/0x2c8
[    0.000000]  [<ffffffff818ca4d2>] paging_init+0x13/0x22
[    0.000000]  [<ffffffff818b9dca>] setup_arch+0x9f2/0xac0
[    0.000000]  [<ffffffff814562d2>] ? printk+0x41/0x43
[    0.000000]  [<ffffffff818b491b>] start_kernel+0xd4/0x3d1
[    0.000000]  [<ffffffff818b4346>] x86_64_start_reservations+0x131/0x135
[    0.000000]  [<ffffffff818b69c9>] xen_start_kernel+0x598/0x59f
[    0.000000] Code: 4c 89 e9 4c 89 e2 48 89 de bf 40 00 00 00 e8 0f fc ff ff eb 34 41 8b 96 a0 40 00 00 be 00 80 00 00 48 89 df e8 1e 11 88 ff eb 1e <41> 8b be a0 40 00 00 49 83 c8 ff 4c 89 e9 4c 89 e2 48 89 de e8 
[    0.000000] RIP  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
[    0.000000]  RSP <ffffffff81801de8>
[    0.000000] CR2: 0000000000000000
[    0.000000] ---[ end trace a7919e7f17c0a725 ]---
[    0.000000] Kernel panic - not syncing: Attempted to kill the idle task!
(XEN) Domain 0 crashed: rebooting machine in 5 seconds.


Thanks!


-- 
Sam Mulvey
Tacoma Telematics
sam@tacomatelematics.com
(253) 883-3030 x110





_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Xen 4.2.1, Linux 3.3.4 kernel crash

[Konrad Rzeszutek Wilk]

On Thu, May 03, 2012 at 11:02:02AM -0700, Sam Mulvey wrote:
> 
> On May 3, 2012, at 10:24 AM, Konrad Rzeszutek Wilk wrote:
> > 
> > This looks like an E820 alignment issue. Can you provide the full serial output please.
> 
> Coming right up!

Hm, there is nothing here that looks wrong, per say. I would suggest
you do: dom0_mem=max:1G instead of dom0_mem=1G (otherwise you end up
having dom0 contain pages for the full 13GB).

Besides that, can you do redo this with on Linux command line be:

'earlyprintk=xen console=hvc0 debug memblock=debug loglevel=8 initcall_debug"

And add on the Xen line: "sync_console".

Hopefully that will provide some idea of why this is not working right.

> 
> __  __            _  _    _   ____  
>  \ \/ /___ _ __   | || |  / | |___ \ 
>   \  // _ \ '_ \  | || |_ | |   __) |
>   /  \  __/ | | | |__   _|| |_ / __/ 
>  /_/\_\___|_| |_|    |_|(_)_(_)_____|
>                                      
> (XEN) Xen version 4.1.2 (sam@localdomain) (gcc version 4.7.0 20120414 (prerelease) (GCC) ) Wed May  2 19:51:21 PDT 2012
> (XEN) Latest ChangeSet: unavailable
> (XEN) Bootloader: GNU GRUB 0.97
> (XEN) Command line: dom0_mem=1G loglvl=all guest_loglvl=all com1=115200,8n1 console=com1
> (XEN) Video information:
> (XEN)  VGA is text mode 80x25, font 8x16
> (XEN)  VBE/DDC methods: V2; EDID transfer time: 2 seconds
> (XEN) Disc information:
> (XEN)  Found 3 MBR signatures
> (XEN)  Found 3 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN)  0000000000000000 - 000000000009d000 (usable)
> (XEN)  000000000009d000 - 00000000000a0000 (reserved)
> (XEN)  00000000000e0000 - 0000000000100000 (reserved)
> (XEN)  0000000000100000 - 00000000bfff0000 (usable)
> (XEN)  00000000bfff0000 - 00000000bfffe000 (ACPI data)
> (XEN)  00000000bfffe000 - 00000000c0000000 (ACPI NVS)
> (XEN)  00000000fec00000 - 00000000fec03000 (reserved)
> (XEN)  00000000fee00000 - 00000000fee01000 (reserved)
> (XEN)  0000000100000000 - 0000000380000000 (usable)
> (XEN) ACPI: RSDP 000F83C0, 0024 (r2 ACPIAM)
> (XEN) ACPI: XSDT BFFF0100, 004C (r1 071008 XSDT0948 20080710 MSFT       97)
> (XEN) ACPI: FACP BFFF0290, 00F4 (r3 071008 FACP0948 20080710 MSFT       97)
> (XEN) ACPI: DSDT BFFF04A0, 3B68 (r1  0AAAA 0AAAA000        0 INTL  2002026)
> (XEN) ACPI: FACS BFFFE000, 0040
> (XEN) ACPI: APIC BFFF0390, 00CA (r1 071008 APIC0948 20080710 MSFT       97)
> (XEN) ACPI: MCFG BFFF0460, 003C (r1 071008 OEMMCFG  20080710 MSFT       97)
> (XEN) ACPI: OEMB BFFFE040, 0056 (r1 071008 OEMB0948 20080710 MSFT       97)
> (XEN) ACPI: SRAT BFFF4010, 0150 (r1 AMD    HAMMER          1 AMD         1)
> (XEN) System RAM: 13311MB (13631028kB)
> (XEN) SRAT: PXM 0 -> APIC 0 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 1 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 2 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 3 -> Node 0
> (XEN) SRAT: PXM 1 -> APIC 4 -> Node 1
> (XEN) SRAT: PXM 1 -> APIC 5 -> Node 1
> (XEN) SRAT: PXM 1 -> APIC 6 -> Node 1
> (XEN) SRAT: PXM 1 -> APIC 7 -> Node 1
> (XEN) SRAT: Node 0 PXM 0 0-a0000
> (XEN) SRAT: Node 0 PXM 0 100000-c0000000
> (XEN) SRAT: Node 0 PXM 0 100000000-1e0000000
> (XEN) SRAT: Node 1 PXM 1 1e0000000-380000000
> (XEN) NUMA: Allocated memnodemap from 37e5f5000 - 37e5f9000
> (XEN) NUMA: Using 8 for the hash shift.
> (XEN) Domain heap initialised DMA width 30 bits
> (XEN) found SMP MP-table at 000ff780
> (XEN) DMI 2.3 present.
> (XEN) Using APIC driver default
> (XEN) ACPI: PM-Timer IO Port: 0x508
> (XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[544,504], pm1x_evt[540,500]
> (XEN) ACPI:                  wakeup_vec[bfffe00c], vec_size[20]
> (XEN) ACPI: Local APIC address 0xfee00000
> (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
> (XEN) Processor #0 0:2 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
> (XEN) Processor #1 0:2 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
> (XEN) Processor #2 0:2 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
> (XEN) Processor #3 0:2 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x04] enabled)
> (XEN) Processor #4 0:2 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)
> (XEN) Processor #5 0:2 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x06] enabled)
> (XEN) Processor #6 0:2 APIC version 16
> (XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] enabled)
> (XEN) Processor #7 0:2 APIC version 16
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
> (XEN) ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 8, version 17, address 0xfec00000, GSI 0-15
> (XEN) ACPI: IOAPIC (id[0x09] address[0xfec01000] gsi_base[16])
> (XEN) IOAPIC[1]: apic_id 9, version 17, address 0xfec01000, GSI 16-31
> (XEN) ACPI: IOAPIC (id[0x0a] address[0xfec02000] gsi_base[32])
> (XEN) IOAPIC[2]: apic_id 10, version 17, address 0xfec02000, GSI 32-47
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
> (XEN) ACPI: IRQ0 used by override.
> (XEN) ACPI: IRQ2 used by override.
> (XEN) Enabling APIC mode:  Flat.  Using 3 I/O APICs
> (XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
> (XEN) PCI: Not using MMCONFIG.
> (XEN) Table is not found!
> (XEN) Using ACPI (MADT) for SMP configuration information
> (XEN) IRQ limits: 48 GSI, 1504 MSI/MSI-X
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Detected 2294.308 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) AMD Fam10h machine check reporting enabled
> (XEN) AMD-Vi: IOMMU not found!
> (XEN) I/O virtualisation disabled
> (XEN) ENABLING IO-APIC IRQs
> (XEN)  -> Using new ACK method
> (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
> (XEN) Platform timer appears to have unexpectedly wrapped 10 or more times.
> (XEN) Platform timer is 3.579MHz ACPI PM Timer
> ˇ(XEN) Allocated console ring of 64 KiB.
> (XEN) HVM: ASIDs enabled.
> (XEN) SVM: Supported advanced features:
> (XEN)  - Nested Page Tables (NPT)
> (XEN)  - Last Branch Record (LBR) Virtualisation
> (XEN) HVM: SVM enabled
> (XEN) HVM: Hardware Assisted Paging detected.
> (XEN) Brought up 8 CPUs
> (XEN) CPUIDLE: disabled due to no HPET. Force enable with 'cpuidle'.
> (XEN) ACPI sleep modes: S3
> (XEN) MCA: Use hw thresholding to adjust polling frequency
> (XEN) mcheck_poll: Machine check polling timer started.
> (XEN) *** LOADING DOMAIN 0 ***
> (XEN)  Xen  kernel: 64-bit, lsb, compat32
> (XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1eb8000
> (XEN) PHYSICAL MEMORY ARRANGEMENT:
> (XEN)  Dom0 alloc.:   0000000370000000->0000000374000000 (243340 pages to be allocated)
> (XEN)  Init. ramdisk: 000000037f68c000->000000037ffffe00
> (XEN) VIRTUAL MEMORY ARRANGEMENT:
> (XEN)  Loaded kernel: ffffffff81000000->ffffffff81eb8000
> (XEN)  Init. ramdisk: ffffffff81eb8000->ffffffff8282be00
> (XEN)  Phys-Mach map: ffffffff8282c000->ffffffff82a2c000
> (XEN)  Start info:    ffffffff82a2c000->ffffffff82a2c4b4
> (XEN)  Page tables:   ffffffff82a2d000->ffffffff82a46000
> (XEN)  Boot stack:    ffffffff82a46000->ffffffff82a47000
> (XEN)  TOTAL:         ffffffff80000000->ffffffff82c00000
> (XEN)  ENTRY ADDRESS: ffffffff818b4200
> (XEN) Dom0 has maximum 8 VCPUs
> (XEN) Scrubbing Free RAM: ..........................................................................................................................done.
> (XEN) Xen trace buffers: disabled
> (XEN) Std. Loglevel: All
> (XEN) Guest Loglevel: All
> (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
> (XEN) Freed 228kB init memory.
> mapping kernel into physical memory
> Xen: setup ISA identity maps
> about to get started...
> [    0.000000] Cannot find 20480 bytes in node 1
> [    0.000000] BUG: unable to handle kernel NULL pointer dereference at           (null)
> [    0.000000] IP: [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
> [    0.000000] PGD 0 
> [    0.000000] Oops: 0000 [#1] PREEMPT SMP 
> [    0.000000] CPU 0 
> [    0.000000] Modules linked in:
> [    0.000000] 
> [    0.000000] Pid: 0, comm: swapper Not tainted 3.3.4-2-ARCH #1 empty empty/S3992
> [    0.000000] RIP: e030:[<ffffffff818d5704>]  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
> [    0.000000] RSP: e02b:ffffffff81801de8  EFLAGS: 00010046
> [    0.000000] RAX: 0000000000000000 RBX: 0000000000000378 RCX: 0000000000000000
> [    0.000000] RDX: 0000000000000040 RSI: 0000000000000378 RDI: 0000000000000000
> [    0.000000] RBP: ffffffff81801e08 R08: 0000000000000000 R09: ffffffff81801d98
> [    0.000000] R10: ffffffff81801d88 R11: ffffffff81801d90 R12: 0000000000000040
> [    0.000000] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001
> [    0.000000] FS:  0000000000000000(0000) GS:ffffffff8189f000(0000) knlGS:0000000000000000
> [    0.000000] CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    0.000000] CR2: 0000000000000000 CR3: 0000000001805000 CR4: 0000000000000660
> [    0.000000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [    0.000000] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000
> [    0.000000] Process swapper (pid: 0, threadinfo ffffffff81800000, task ffffffff8180d020)
> [    0.000000] Stack:
> [    0.000000]  0000000000080000 0000000000000378 000000000000003c ffff88003fbfa000
> [    0.000000]  ffffffff81801e68 ffffffff818d63f0 ffffffff81801e48 00000001818d53bc
> [    0.000000]  ffff88003fbf9fe0 0000000000000000 000000000282c000 ffff88003fbfa000
> [    0.000000] Call Trace:
> [    0.000000]  [<ffffffff818d63f0>] sparse_early_usemaps_alloc_node+0x63/0x1c4
> [    0.000000]  [<ffffffff818d677b>] sparse_init+0xf8/0x2c8
> [    0.000000]  [<ffffffff818ca4d2>] paging_init+0x13/0x22
> [    0.000000]  [<ffffffff818b9dca>] setup_arch+0x9f2/0xac0
> [    0.000000]  [<ffffffff814562d2>] ? printk+0x41/0x43
> [    0.000000]  [<ffffffff818b491b>] start_kernel+0xd4/0x3d1
> [    0.000000]  [<ffffffff818b4346>] x86_64_start_reservations+0x131/0x135
> [    0.000000]  [<ffffffff818b69c9>] xen_start_kernel+0x598/0x59f
> [    0.000000] Code: 4c 89 e9 4c 89 e2 48 89 de bf 40 00 00 00 e8 0f fc ff ff eb 34 41 8b 96 a0 40 00 00 be 00 80 00 00 48 89 df e8 1e 11 88 ff eb 1e <41> 8b be a0 40 00 00 49 83 c8 ff 4c 89 e9 4c 89 e2 48 89 de e8 
> [    0.000000] RIP  [<ffffffff818d5704>] __alloc_bootmem_node+0x72/0x99
> [    0.000000]  RSP <ffffffff81801de8>
> [    0.000000] CR2: 0000000000000000
> [    0.000000] ---[ end trace a7919e7f17c0a725 ]---
> [    0.000000] Kernel panic - not syncing: Attempted to kill the idle task!
> (XEN) Domain 0 crashed: rebooting machine in 5 seconds.
> 
> 
> Thanks!
> 
> 
> -- 
> Sam Mulvey
> Tacoma Telematics
> sam@tacomatelematics.com
> (253) 883-3030 x110
> 
> 
> 
> 
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Xen 4.2.1, Linux 3.3.4 kernel crash

[Sam Mulvey]

[-- Attachment #1.1: Type: text/plain, Size: 1023 bytes --]


On May 3, 2012, at 11:56 AM, Konrad Rzeszutek Wilk wrote:
> 
> Hm, there is nothing here that looks wrong, per say. I would suggest
> you do: dom0_mem=max:1G instead of dom0_mem=1G (otherwise you end up
> having dom0 contain pages for the full 13GB).
> 
> Besides that, can you do redo this with on Linux command line be:
> 
> 'earlyprintk=xen console=hvc0 debug memblock=debug loglevel=8 initcall_debug"
> 
> And add on the Xen line: "sync_console".
> 
> Hopefully that will provide some idea of why this is not working right.


It absolutely did.  It wasn't working right because my brain is wrong.   Your boot flags reminded me that I was specifying my console output incorrectly, trying to use the serial console directly rather than going through hvc0.   

Pardon me while I go soak my head.  

Anyway, thanks for the help, and for the information about dom0 memory allocation.  I'm going to nap now.


-- 
Sam Mulvey
Tacoma Telematics
sam@tacomatelematics.com
(253) 883-3030 x110





[-- Attachment #1.2: Type: text/html, Size: 3322 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel