upgrading Xen3.0.4-1 to Xen-unstable ...

upgrading Xen3.0.4-1 to Xen-unstable ...

[Parissa Heidari]

Hi,
I have a problem for upgrading Xen3.0.4-1 to Xen-unstable and as no one on 
users mailing list could help me, I am asking it from developers.

I have Xen3.0.4-1 Installed and it works very well. Now I need to upgrade it 
to Xen unstable. It is compiled and installed successfully (at least it seems 
to be) and I'm able to boot and run dom0.

But Xend does not work. "xend start" gives no warning or error but running "xm 
list" I see:
Error: Unable to connect to xend: No such file or directory. Is xend running?

It seems that xend is updated in /etc/init.d and usr/sbin. Regarding to some 
previous posts on the users mailing-list I have deleted /lib/usr/python/xen 
and rerun make install but there is no improvement.
Also I have rerun make all, make install in the tools directory but still no 
improvement!
Is there any other solution for this?

Thanks in advance,
Parissa.

Re: upgrading Xen3.0.4-1 to Xen-unstable ...

[Keir Fraser]

On 16/3/07 23:38, "Parissa Heidari" <parisa.heidari@polymtl.ca> wrote:

> It seems that xend is updated in /etc/init.d and usr/sbin. Regarding to some
> previous posts on the users mailing-list I have deleted /lib/usr/python/xen
> and rerun make install but there is no improvement.
> Also I have rerun make all, make install in the tools directory but still no
> improvement!
> Is there any other solution for this?

Have you also tried deleting /etc/xen (assuming you have no manual config
updates in there that you want to keep)?

You can also look in /var/log/xen/xend.log to see if xend had anything to
say about why it didn't start up.

 -- Keir

Re: upgrading Xen3.0.4-1 to Xen-unstable ...

[Parissa Heidari]

On Friday 16 March 2007 20:10, Keir Fraser wrote:
> On 16/3/07 23:38, "Parissa Heidari" <parisa.heidari@polymtl.ca> wrote:
> > It seems that xend is updated in /etc/init.d and usr/sbin. Regarding to
> > some previous posts on the users mailing-list I have deleted
> > /lib/usr/python/xen and rerun make install but there is no improvement.
> > Also I have rerun make all, make install in the tools directory but still
> > no improvement!
> > Is there any other solution for this?
>
> Have you also tried deleting /etc/xen (assuming you have no manual config
> updates in there that you want to keep)?
>
yes, but it didn't help.
> You can also look in /var/log/xen/xend.log to see if xend had anything to
> say about why it didn't start up.

Oh! It seems I have found some thing! /var/log/xen/xend.log is empty but there  
are a lot of lines in /var/log/xen/xend-debug.log. It says somthing 
about  /usr/lib/python2.4 and as I see the contents of this directory are not 
updated from last february (when I installed xen3.0.4). What is going wrong? 
what should I do to make it updated?
I tried to rename it and rerun "sh install.sh" in dist directory but it caused 
some error messages!

Great thanks for your helps and here's what I see in  xend-debug.log:

Xend started at Fri Mar 16 20:24:58 2007.
Exception starting xend: list index out of range
Traceback (most recent call last):
  File "/usr/sbin/xend", line 130, in ?
    sys.exit(main())
  File "/usr/sbin/xend", line 108, in main
    return daemon.start()
  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
line 232, in start
    self.run(w and os.fdopen(w, 'w') or None)
  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
line 344, in run
    log.exception("Exception starting xend (%s)" % ex)
  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1005, in 
exception

  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 999, in 
error

  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1072, in 
_log

  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/XendLogging.py", 
line 50, in findCaller
    frames = inspect.stack()
  File "/usr/lib/python2.4/inspect.py", line 812, in stack
    return getouterframes(sys._getframe(1), context)
  File "/usr/lib/python2.4/inspect.py", line 793, in getouterframes
    framelist.append((frame,) + getframeinfo(frame, context))
  File "/usr/lib/python2.4/inspect.py", line 768, in getframeinfo
    lines, lnum = findsource(frame)
  File "/usr/lib/python2.4/inspect.py", line 437, in findsource
    if pat.match(lines[lnum]): break
IndexError: list index out of range
Traceback (most recent call last):
  File "/usr/sbin/xend", line 130, in ?
sys.exit(main())
  File "/usr/sbin/xend", line 108, in main
    return daemon.start()
  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
line 218, in start
    log.info('Xend exited with status %d.', code)
  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 969, in info

  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1072, in 
_log

  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/XendLogging.py", 
line 50, in findCaller
    frames = inspect.stack()
  File "/usr/lib/python2.4/inspect.py", line 812, in stack
    return getouterframes(sys._getframe(1), context)
  File "/usr/lib/python2.4/inspect.py", line 793, in getouterframes
    framelist.append((frame,) + getframeinfo(frame, context))
  File "/usr/lib/python2.4/inspect.py", line 768, in getframeinfo
    lines, lnum = findsource(frame)
  File "/usr/lib/python2.4/inspect.py", line 437, in findsource
    if pat.match(lines[lnum]): break
IndexError: list index out of range
Xend started at Fri Mar 16 20:26:05 2007.
Exception starting xend: list index out of range
Traceback (most recent call last):
  File "/usr/sbin/xend", line 130, in ?
    sys.exit(main())
  File "/usr/sbin/xend", line 108, in main
    return daemon.start()
  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
line 232, in start
    self.run(w and os.fdopen(w, 'w') or None)
  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
line 344, in run
    log.exception("Exception starting xend (%s)" % ex)
 File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1005, in 
exception

  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 999, in 
error

  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1072, in 
_log

  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/XendLogging.py", 
line 50, in findCaller
    frames = inspect.stack()
  File "/usr/lib/python2.4/inspect.py", line 812, in stack
    return getouterframes(sys._getframe(1), context)
  File "/usr/lib/python2.4/inspect.py", line 793, in getouterframes
    framelist.append((frame,) + getframeinfo(frame, context))
  File "/usr/lib/python2.4/inspect.py", line 768, in getframeinfo
    lines, lnum = findsource(frame)
  File "/usr/lib/python2.4/inspect.py", line 437, in findsource
    if pat.match(lines[lnum]): break
IndexError: list index out of range
Traceback (most recent call last):
  File "/usr/sbin/xend", line 130, in ?
    sys.exit(main())
  File "/usr/sbin/xend", line 108, in main
    return daemon.start()
  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
line 218, in start
    log.info('Xend exited with status %d.', code)
  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 969, in info

  File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1072, in 
_log

  
File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/XendLogging.py", 
line 50, in findCaller
 frames = inspect.stack()
  File "/usr/lib/python2.4/inspect.py", line 812, in stack
    return getouterframes(sys._getframe(1), context)
  File "/usr/lib/python2.4/inspect.py", line 793, in getouterframes
    framelist.append((frame,) + getframeinfo(frame, context))
  File "/usr/lib/python2.4/inspect.py", line 768, in getframeinfo
    lines, lnum = findsource(frame)
  File "/usr/lib/python2.4/inspect.py", line 437, in findsource
    if pat.match(lines[lnum]): break
IndexError: list index out of range
>  -- Keir

Re: upgrading Xen3.0.4-1 to Xen-unstable ...

[Keir Fraser]

On 17/3/07 00:45, "Parissa Heidari" <parisa.heidari@polymtl.ca> wrote:

> Oh! It seems I have found some thing! /var/log/xen/xend.log is empty but there
> are a lot of lines in /var/log/xen/xend-debug.log. It says somthing
> about  /usr/lib/python2.4 and as I see the contents of this directory are not
> updated from last february (when I installed xen3.0.4). What is going wrong?
> what should I do to make it updated?
> I tried to rename it and rerun "sh install.sh" in dist directory but it caused
> some error messages!
> 
> Great thanks for your helps and here's what I see in  xend-debug.log:

Your python environment seems very broken, to the extent you appear to be
taking exceptions while handling exceptions. Do you mean to be running xend
out of your build directory?

 -- Keir

Re: upgrading Xen3.0.4-1 to Xen-unstable ...

[Ewan Mellor]

On Fri, Mar 16, 2007 at 08:45:59PM -0400, Parissa Heidari wrote:

> On Friday 16 March 2007 20:10, Keir Fraser wrote:
> > On 16/3/07 23:38, "Parissa Heidari" <parisa.heidari@polymtl.ca> wrote:
> > > It seems that xend is updated in /etc/init.d and usr/sbin. Regarding to
> > > some previous posts on the users mailing-list I have deleted
> > > /lib/usr/python/xen and rerun make install but there is no improvement.
> > > Also I have rerun make all, make install in the tools directory but still
> > > no improvement!
> > > Is there any other solution for this?
> >
> > Have you also tried deleting /etc/xen (assuming you have no manual config
> > updates in there that you want to keep)?
> >
> yes, but it didn't help.
> > You can also look in /var/log/xen/xend.log to see if xend had anything to
> > say about why it didn't start up.
> 
> Oh! It seems I have found some thing! /var/log/xen/xend.log is empty but there  
> are a lot of lines in /var/log/xen/xend-debug.log. It says somthing 
> about  /usr/lib/python2.4 and as I see the contents of this directory are not 
> updated from last february (when I installed xen3.0.4). What is going wrong? 
> what should I do to make it updated?
> I tried to rename it and rerun "sh install.sh" in dist directory but it caused 
> some error messages!
> 
> Great thanks for your helps and here's what I see in  xend-debug.log:
> 
> Xend started at Fri Mar 16 20:24:58 2007.
> Exception starting xend: list index out of range
> Traceback (most recent call last):
>   File "/usr/sbin/xend", line 130, in ?
>     sys.exit(main())
>   File "/usr/sbin/xend", line 108, in main
>     return daemon.start()
>   
> File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
> line 232, in start
>     self.run(w and os.fdopen(w, 'w') or None)
>   
> File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/server/SrvDaemon.py", 
> line 344, in run
>     log.exception("Exception starting xend (%s)" % ex)
>   File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1005, in 
> exception
> 
>   File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 999, in 
> error
> 
>   File "/usr/lib/python2.4/site-packages/cairo/__init__.py", line 1072, in 
> _log
> 
>   
> File "/home/parisa/XenoLTTng/xen-unstable-lttng.hg/dist/install/usr/lib/python/xen/xend/XendLogging.py", 
> line 50, in findCaller
>     frames = inspect.stack()
>   File "/usr/lib/python2.4/inspect.py", line 812, in stack
>     return getouterframes(sys._getframe(1), context)
>   File "/usr/lib/python2.4/inspect.py", line 793, in getouterframes
>     framelist.append((frame,) + getframeinfo(frame, context))
>   File "/usr/lib/python2.4/inspect.py", line 768, in getframeinfo
>     lines, lnum = findsource(frame)
>   File "/usr/lib/python2.4/inspect.py", line 437, in findsource
>     if pat.match(lines[lnum]): break
> IndexError: list index out of range
> Traceback (most recent call last):
>   File "/usr/sbin/xend", line 130, in ?
> sys.exit(main())
>   File "/usr/sbin/xend", line 108, in main
>     return daemon.start()

Does this patch help?  Let me know whether this fixes the problem, or changes
the error output in some way.  If it helps, I'll check this in.

Ewan.


diff -r 1e592e4557c1 tools/python/xen/xend/XendLogging.py
--- a/tools/python/xen/xend/XendLogging.py	Fri Mar 16 18:06:43 2007 +0000
+++ b/tools/python/xen/xend/XendLogging.py	Sat Mar 17 11:09:24 2007 +0000
@@ -58,6 +58,18 @@ if 'TRACE' not in logging.__dict__:
                 else:
                     return filename, frame[2]
     logging.Logger.findCaller = findCaller
+
+    # Work around a bug in Python's inspect module: findsource is supposed to
+    # raise IOError if it fails, with other functions in that module coping
+    # with that, but some people are seeing IndexError raised from there.
+    if hasattr(inspect, 'findsource'):
+        real_findsource = getattr(inspect, 'findsource')
+        def findsource(*args, **kwargs):
+            try:
+                return real_findsource(*args, **kwargs)
+            except IndexError, exn:
+                raise IOError(exn)
+        inspect.findsource = findsource
 
 
 log = logging.getLogger("xend")

Re: upgrading Xen3.0.4-1 to Xen-unstable ...

[Ewan Mellor]

On Sat, Mar 17, 2007 at 12:14:11PM -0400, Parissa Heidari wrote:

> Hi Ewan,
> 
> Yes it works. It's perfect!
> After more than 10 days my xen-unstable is working well. Thanks a lot.
> This could help many of Xen-users too.

Great news, thanks.  I think that this is a Python bug (though it's
arguable); I'll discuss it with the Python guys, but for now I'll check this
workaround into xen-unstable.

Cheers,

Ewan.