All of lore.kernel.org
 help / color / mirror / Atom feed
* [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
@ 2014-04-25 12:13 Jan Beulich
  2014-05-01 13:39 ` Tim Deegan
  2014-05-30  2:07 ` Liu, SongtaoX
  0 siblings, 2 replies; 16+ messages in thread
From: Jan Beulich @ 2014-04-25 12:13 UTC (permalink / raw)
  To: xen-devel; +Cc: Keir Fraser, Kevin Tian, Eddie Dong, Jun Nakajima, Tim Deegan

[-- Attachment #1: Type: text/plain, Size: 1902 bytes --]

While generally such guest side changes ought to be followed by guest
initiated flushes, we're flushing the cache under similar conditions
elsewhere (e.g. when the guest sets CR0.CD), so let's do so here too.

Signed-off-by: Jan Beulich <jbeulich@suse.com>
---
Note that this goes on top of the still pending series titled
"x86/EPT: miscellaneous further fixes to EMT determination" (see
http://lists.xenproject.org/archives/html/xen-devel/2014-04/msg02932.html).

It would need to be determined whether we should gate all of these
flushes on need_iommu() and/or cache_flush_permitted(). Otoh the
changes they hang off of are infrequent, so there's no severe
performance penalty.

--- a/xen/arch/x86/hvm/mtrr.c
+++ b/xen/arch/x86/hvm/mtrr.c
@@ -649,8 +649,11 @@ int32_t hvm_set_mem_pinned_cacheattr(
             {
                 rcu_read_unlock(&pinned_cacheattr_rcu_lock);
                 list_del_rcu(&range->list);
+                type = range->type;
                 call_rcu(&range->rcu, free_pinned_cacheattr_entry);
                 p2m_memory_type_changed(d);
+                if ( type != PAT_TYPE_UNCACHABLE )
+                    flush_all(FLUSH_CACHE);
                 return 0;
             }
         rcu_read_unlock(&pinned_cacheattr_rcu_lock);
@@ -697,6 +700,8 @@ int32_t hvm_set_mem_pinned_cacheattr(
 
     list_add_rcu(&range->list, &d->arch.hvm_domain.pinned_cacheattr_ranges);
     p2m_memory_type_changed(d);
+    if ( type != PAT_TYPE_WRBACK )
+        flush_all(FLUSH_CACHE);
 
     return 0;
 }
@@ -786,7 +791,10 @@ HVM_REGISTER_SAVE_RESTORE(MTRR, hvm_save
 void memory_type_changed(struct domain *d)
 {
     if ( iommu_enabled && d->vcpu && d->vcpu[0] )
+    {
         p2m_memory_type_changed(d);
+        flush_all(FLUSH_CACHE);
+    }
 }
 
 int epte_get_entry_emt(struct domain *d, unsigned long gfn, mfn_t mfn,




[-- Attachment #2: EPT-flush-cache.patch --]
[-- Type: text/plain, Size: 1960 bytes --]

x86/EPT: flush cache when (potentially) limiting cachability

While generally such guest side changes ought to be followed by guest
initiated flushes, we're flushing the cache under similar conditions
elsewhere (e.g. when the guest sets CR0.CD), so let's do so here too.

Signed-off-by: Jan Beulich <jbeulich@suse.com>
---
Note that this goes on top of the still pending series titled
"x86/EPT: miscellaneous further fixes to EMT determination" (see
http://lists.xenproject.org/archives/html/xen-devel/2014-04/msg02932.html).

It would need to be determined whether we should gate all of these
flushes on need_iommu() and/or cache_flush_permitted(). Otoh the
changes they hang off of are infrequent, so there's no severe
performance penalty.

--- a/xen/arch/x86/hvm/mtrr.c
+++ b/xen/arch/x86/hvm/mtrr.c
@@ -649,8 +649,11 @@ int32_t hvm_set_mem_pinned_cacheattr(
             {
                 rcu_read_unlock(&pinned_cacheattr_rcu_lock);
                 list_del_rcu(&range->list);
+                type = range->type;
                 call_rcu(&range->rcu, free_pinned_cacheattr_entry);
                 p2m_memory_type_changed(d);
+                if ( type != PAT_TYPE_UNCACHABLE )
+                    flush_all(FLUSH_CACHE);
                 return 0;
             }
         rcu_read_unlock(&pinned_cacheattr_rcu_lock);
@@ -697,6 +700,8 @@ int32_t hvm_set_mem_pinned_cacheattr(
 
     list_add_rcu(&range->list, &d->arch.hvm_domain.pinned_cacheattr_ranges);
     p2m_memory_type_changed(d);
+    if ( type != PAT_TYPE_WRBACK )
+        flush_all(FLUSH_CACHE);
 
     return 0;
 }
@@ -786,7 +791,10 @@ HVM_REGISTER_SAVE_RESTORE(MTRR, hvm_save
 void memory_type_changed(struct domain *d)
 {
     if ( iommu_enabled && d->vcpu && d->vcpu[0] )
+    {
         p2m_memory_type_changed(d);
+        flush_all(FLUSH_CACHE);
+    }
 }
 
 int epte_get_entry_emt(struct domain *d, unsigned long gfn, mfn_t mfn,

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-04-25 12:13 [PATCH] x86/EPT: flush cache when (potentially) limiting cachability Jan Beulich
@ 2014-05-01 13:39 ` Tim Deegan
  2014-05-30  2:07 ` Liu, SongtaoX
  1 sibling, 0 replies; 16+ messages in thread
From: Tim Deegan @ 2014-05-01 13:39 UTC (permalink / raw)
  To: Jan Beulich; +Cc: xen-devel, Kevin Tian, Keir Fraser, Eddie Dong, Jun Nakajima

At 13:13 +0100 on 25 Apr (1398427985), Jan Beulich wrote:
> While generally such guest side changes ought to be followed by guest
> initiated flushes, we're flushing the cache under similar conditions
> elsewhere (e.g. when the guest sets CR0.CD), so let's do so here too.
> 
> Signed-off-by: Jan Beulich <jbeulich@suse.com>

Reviewed-by: Tim Deegan <tim@xen.org>

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-04-25 12:13 [PATCH] x86/EPT: flush cache when (potentially) limiting cachability Jan Beulich
  2014-05-01 13:39 ` Tim Deegan
@ 2014-05-30  2:07 ` Liu, SongtaoX
  2014-05-30  6:26   ` Jan Beulich
  1 sibling, 1 reply; 16+ messages in thread
From: Liu, SongtaoX @ 2014-05-30  2:07 UTC (permalink / raw)
  To: Jan Beulich, xen-devel
  Cc: Tian, Kevin, Keir Fraser, Tim Deegan, Dong, Eddie, Nakajima, Jun,
	Zhang, Yang Z, Hu, Robert, Pang, LongtaoX

Hi, Jan
The following patch leads nested (Xen on Xen ,KVM on Xen) L2 guest failed to boot up with default EPT option "hap=1".
L2 guest with "hap=0" still works.

Regards
Songtao

> -----Original Message-----
> From: xen-devel-bounces@lists.xen.org
> [mailto:xen-devel-bounces@lists.xen.org] On Behalf Of Jan Beulich
> Sent: Friday, April 25, 2014 8:13 PM
> To: xen-devel
> Cc: Keir Fraser; Tian, Kevin; Dong, Eddie; Nakajima, Jun; Tim Deegan
> Subject: [Xen-devel] [PATCH] x86/EPT: flush cache when (potentially) limiting
> cachability
> 
> While generally such guest side changes ought to be followed by guest initiated
> flushes, we're flushing the cache under similar conditions elsewhere (e.g. when
> the guest sets CR0.CD), so let's do so here too.
> 
> Signed-off-by: Jan Beulich <jbeulich@suse.com>
> ---
> Note that this goes on top of the still pending series titled
> "x86/EPT: miscellaneous further fixes to EMT determination" (see
> http://lists.xenproject.org/archives/html/xen-devel/2014-04/msg02932.html).
> 
> It would need to be determined whether we should gate all of these flushes on
> need_iommu() and/or cache_flush_permitted(). Otoh the changes they hang off
> of are infrequent, so there's no severe performance penalty.
> 
> --- a/xen/arch/x86/hvm/mtrr.c
> +++ b/xen/arch/x86/hvm/mtrr.c
> @@ -649,8 +649,11 @@ int32_t hvm_set_mem_pinned_cacheattr(
>              {
>                  rcu_read_unlock(&pinned_cacheattr_rcu_lock);
>                  list_del_rcu(&range->list);
> +                type = range->type;
>                  call_rcu(&range->rcu, free_pinned_cacheattr_entry);
>                  p2m_memory_type_changed(d);
> +                if ( type != PAT_TYPE_UNCACHABLE )
> +                    flush_all(FLUSH_CACHE);
>                  return 0;
>              }
>          rcu_read_unlock(&pinned_cacheattr_rcu_lock);
> @@ -697,6 +700,8 @@ int32_t hvm_set_mem_pinned_cacheattr(
> 
>      list_add_rcu(&range->list,
> &d->arch.hvm_domain.pinned_cacheattr_ranges);
>      p2m_memory_type_changed(d);
> +    if ( type != PAT_TYPE_WRBACK )
> +        flush_all(FLUSH_CACHE);
> 
>      return 0;
>  }
> @@ -786,7 +791,10 @@ HVM_REGISTER_SAVE_RESTORE(MTRR, hvm_save
> void memory_type_changed(struct domain *d)  {
>      if ( iommu_enabled && d->vcpu && d->vcpu[0] )
> +    {
>          p2m_memory_type_changed(d);
> +        flush_all(FLUSH_CACHE);
> +    }
>  }
> 
>  int epte_get_entry_emt(struct domain *d, unsigned long gfn, mfn_t mfn,
> 
> 

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-05-30  2:07 ` Liu, SongtaoX
@ 2014-05-30  6:26   ` Jan Beulich
  2014-05-30  7:02     ` Jan Beulich
  0 siblings, 1 reply; 16+ messages in thread
From: Jan Beulich @ 2014-05-30  6:26 UTC (permalink / raw)
  To: songtaox.liu, xen-devel
  Cc: kevin.tian, keir, tim, eddie.dong, jun.nakajima, yang.z.zhang,
	robert.hu, longtaox.pang

>>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 4:07 AM >>>
>The following patch leads nested (Xen on Xen ,KVM on Xen) L2 guest failed
>to boot up with default EPT option "hap=1". L2 guest with "hap=0" still works.

That's way to vague a problem description. In what way does it fail? Are there
any relevant log messages anywhere? Without suitable detail, how am I (or is
anyone else) supposed to help with this?

Jan

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-05-30  6:26   ` Jan Beulich
@ 2014-05-30  7:02     ` Jan Beulich
  2014-05-30  7:34       ` Liu, SongtaoX
  0 siblings, 1 reply; 16+ messages in thread
From: Jan Beulich @ 2014-05-30  7:02 UTC (permalink / raw)
  To: songtaox.liu, xen-devel
  Cc: kevin.tian, keir, tim, eddie.dong, jun.nakajima, yang.z.zhang,
	robert.hu, longtaox.pang

>>>> "Jan Beulich" <jbeulich@suse.com> 05/30/14 8:28 AM >>>
>>>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 4:07 AM >>>
>>The following patch leads nested (Xen on Xen ,KVM on Xen) L2 guest failed
>>to boot up with default EPT option "hap=1". L2 guest with "hap=0" still works.
>
>That's way to vague a problem description. In what way does it fail? Are there
>any relevant log messages anywhere? Without suitable detail, how am I (or is
>anyone else) supposed to help with this?

I should have added that the patch here solely adding cache flushes, it can't
reasonable have affected correctness. Hence unless it introduces a live lock of
some sort, the only possibility I see is that it uncovered some other previously
latent/hidden problem.

Jan

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-05-30  7:02     ` Jan Beulich
@ 2014-05-30  7:34       ` Liu, SongtaoX
  2014-05-30 11:20         ` Jan Beulich
  0 siblings, 1 reply; 16+ messages in thread
From: Liu, SongtaoX @ 2014-05-30  7:34 UTC (permalink / raw)
  To: Jan Beulich, xen-devel
  Cc: Tian, Kevin, keir, tim, Dong, Eddie, Nakajima, Jun, Zhang,
	Yang Z, Hu, Robert, Pang, LongtaoX

Sorry to update.
The bug refers to http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
L2 guest vnc console hangs at black screen with cursor flashing at the top left corner.
After several minutes, the Seabios screen shows up, but the screen still flush slowly, the guest could not boot up.
For the good point(L0 git:06bbcaf48d09c18a41c482866941ddd5d2846b44), the L2 rhel_x64 could boot up less in than 90s.

Regards
Songtao
> -----Original Message-----
> From: Jan Beulich [mailto:jbeulich@suse.com]
> Sent: Friday, May 30, 2014 3:02 PM
> To: Liu, SongtaoX; xen-devel@lists.xenproject.org
> Cc: Dong, Eddie; Nakajima, Jun; Tian, Kevin; Pang, LongtaoX; Hu, Robert; Zhang,
> Yang Z; keir@xen.org; tim@xen.org
> Subject: Re: [Xen-devel] [PATCH] x86/EPT: flush cache when (potentially)
> limiting cachability
> 
> >>>> "Jan Beulich" <jbeulich@suse.com> 05/30/14 8:28 AM >>> "Liu,
> >>>> SongtaoX" <songtaox.liu@intel.com> 05/30/14 4:07 AM >>>
> >>The following patch leads nested (Xen on Xen ,KVM on Xen) L2 guest
> >>failed to boot up with default EPT option "hap=1". L2 guest with "hap=0" still
> works.
> >
> >That's way to vague a problem description. In what way does it fail?
> >Are there any relevant log messages anywhere? Without suitable detail,
> >how am I (or is anyone else) supposed to help with this?
> 
> I should have added that the patch here solely adding cache flushes, it can't
> reasonable have affected correctness. Hence unless it introduces a live lock of
> some sort, the only possibility I see is that it uncovered some other previously
> latent/hidden problem.
> 
> Jan

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-05-30  7:34       ` Liu, SongtaoX
@ 2014-05-30 11:20         ` Jan Beulich
  2014-06-12  1:28           ` Liu, SongtaoX
  0 siblings, 1 reply; 16+ messages in thread
From: Jan Beulich @ 2014-05-30 11:20 UTC (permalink / raw)
  To: songtaox.liu, xen-devel
  Cc: kevin.tian, keir, tim, eddie.dong, jun.nakajima, yang.z.zhang,
	robert.hu, longtaox.pang

>>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 9:35 AM >>>
>Sorry to update.
>The bug refers to http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
>L2 guest vnc console hangs at black screen with cursor flashing at the top left corner.
>After several minutes, the Seabios screen shows up, but the screen still flush slowly, the guest could not boot up.

That would then indeed be an indication of excessive flushes. I.e. you may want to
simply track down which one (and why) gets triggered too often.

>For the good point(L0 git:06bbcaf48d09c18a41c482866941ddd5d2846b44), the L2 rhel_x64 could boot up less in than 90s.

Not sure what you're meaning to tell us here.

Jan

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-05-30 11:20         ` Jan Beulich
@ 2014-06-12  1:28           ` Liu, SongtaoX
  2014-06-12  8:43             ` Ian Campbell
  2014-06-16 13:01             ` Jan Beulich
  0 siblings, 2 replies; 16+ messages in thread
From: Liu, SongtaoX @ 2014-06-12  1:28 UTC (permalink / raw)
  To: Jan Beulich, xen-devel
  Cc: Tian, Kevin, keir, tim, Dong, Eddie, Nakajima, Jun, Zhang,
	Yang Z, Hu, Robert, Pang, LongtaoX



> -----Original Message-----
> From: Jan Beulich [mailto:jbeulich@suse.com]
> Sent: Friday, May 30, 2014 7:20 PM
> To: Liu, SongtaoX; xen-devel@lists.xenproject.org
> Cc: Dong, Eddie; Nakajima, Jun; Tian, Kevin; Pang, LongtaoX; Hu, Robert; Zhang,
> Yang Z; keir@xen.org; tim@xen.org
> Subject: Re: RE: [Xen-devel] [PATCH] x86/EPT: flush cache when (potentially)
> limiting cachability
> 
> >>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 9:35 AM >>>
> >Sorry to update.
> >The bug refers to
> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
> >L2 guest vnc console hangs at black screen with cursor flashing at the top left
> corner.
> >After several minutes, the Seabios screen shows up, but the screen still flush
> slowly, the guest could not boot up.
> 
> That would then indeed be an indication of excessive flushes. I.e. you may want
> to simply track down which one (and why) gets triggered too often.
> 
How to get that information? It is hard for me to do it since I am not a Xen expert. But if you can provide a patch help to debug, I would happy to do it.

> >For the good point(L0 git:06bbcaf48d09c18a41c482866941ddd5d2846b44),
> the L2 rhel_x64 could boot up less in than 90s.
> 
> Not sure what you're meaning to tell us here.
> 
I want to say the L2 guest boot up within less than 90s in good case, just for comparison. 

Regards
Songtao

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-12  1:28           ` Liu, SongtaoX
@ 2014-06-12  8:43             ` Ian Campbell
  2014-06-16 13:01             ` Jan Beulich
  1 sibling, 0 replies; 16+ messages in thread
From: Ian Campbell @ 2014-06-12  8:43 UTC (permalink / raw)
  To: Liu, SongtaoX
  Cc: Tian, Kevin, keir, Nakajima, Jun, tim, Dong, Eddie, Jan Beulich,
	Hu, Robert, Zhang, Yang Z, xen-devel, Pang, LongtaoX

On Thu, 2014-06-12 at 01:28 +0000, Liu, SongtaoX wrote:
> 
> > -----Original Message-----
> > From: Jan Beulich [mailto:jbeulich@suse.com]
> > Sent: Friday, May 30, 2014 7:20 PM
> > To: Liu, SongtaoX; xen-devel@lists.xenproject.org
> > Cc: Dong, Eddie; Nakajima, Jun; Tian, Kevin; Pang, LongtaoX; Hu, Robert; Zhang,
> > Yang Z; keir@xen.org; tim@xen.org
> > Subject: Re: RE: [Xen-devel] [PATCH] x86/EPT: flush cache when (potentially)
> > limiting cachability
> > 
> > >>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 9:35 AM >>>
> > >Sorry to update.
> > >The bug refers to
> > http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
> > >L2 guest vnc console hangs at black screen with cursor flashing at the top left
> > corner.
> > >After several minutes, the Seabios screen shows up, but the screen still flush
> > slowly, the guest could not boot up.
> > 
> > That would then indeed be an indication of excessive flushes. I.e. you may want
> > to simply track down which one (and why) gets triggered too often.
> > 
> How to get that information? It is hard for me to do it since I am not
> a Xen expert. But if you can provide a patch help to debug, I would
> happy to do it.

Is this the sort of thing for which xentrace and xenalyze could be
useful?

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-12  1:28           ` Liu, SongtaoX
  2014-06-12  8:43             ` Ian Campbell
@ 2014-06-16 13:01             ` Jan Beulich
  2014-06-17  2:19               ` Liu, SongtaoX
  1 sibling, 1 reply; 16+ messages in thread
From: Jan Beulich @ 2014-06-16 13:01 UTC (permalink / raw)
  To: SongtaoX Liu
  Cc: Kevin Tian, keir, tim, Eddie Dong, Jun Nakajima, xen-devel,
	Yang Z Zhang, Robert Hu, LongtaoX Pang

[-- Attachment #1: Type: text/plain, Size: 1137 bytes --]

>>> On 12.06.14 at 03:28, <songtaox.liu@intel.com> wrote:
>> From: Jan Beulich [mailto:jbeulich@suse.com]
>> >>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 9:35 AM >>>
>> >Sorry to update.
>> >The bug refers to
>> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
>> >L2 guest vnc console hangs at black screen with cursor flashing at the top 
> left
>> corner.
>> >After several minutes, the Seabios screen shows up, but the screen still 
> flush
>> slowly, the guest could not boot up.
>> 
>> That would then indeed be an indication of excessive flushes. I.e. you may 
> want
>> to simply track down which one (and why) gets triggered too often.
>> 
> How to get that information? It is hard for me to do it since I am not a Xen 
> expert. But if you can provide a patch help to debug, I would happy to do it.

The original patch makes quite clear where to put the instrumentation;
I'm attaching a patch anyway for you to try. This (obviously) is against
the current staging tree - while it ought to apply fine on master, it
certainly won't apply on 4.4 or older without adjustments.

Jan


[-- Attachment #2: EPT-track-cache-flushes.patch --]
[-- Type: text/plain, Size: 1484 bytes --]

--- 2014-05-12.orig/xen/arch/x86/hvm/mtrr.c	2014-05-12 14:13:16.000000000 +0200
+++ 2014-05-12/xen/arch/x86/hvm/mtrr.c	2014-06-16 14:55:25.000000000 +0200
@@ -654,7 +654,14 @@ int32_t hvm_set_mem_pinned_cacheattr(
                 call_rcu(&range->rcu, free_pinned_cacheattr_entry);
                 p2m_memory_type_changed(d);
                 if ( type != PAT_TYPE_UNCACHABLE )
+{//temp
+ static unsigned long cnt, thr;
+ if(++cnt > thr) {
+  thr |= cnt;
+  printk("unpin[%06lx] d%d t=%u\n", cnt, d->domain_id, type);
+ }
                     flush_all(FLUSH_CACHE);
+}
                 return 0;
             }
         rcu_read_unlock(&pinned_cacheattr_rcu_lock);
@@ -702,7 +709,14 @@ int32_t hvm_set_mem_pinned_cacheattr(
     list_add_rcu(&range->list, &d->arch.hvm_domain.pinned_cacheattr_ranges);
     p2m_memory_type_changed(d);
     if ( type != PAT_TYPE_WRBACK )
+{//temp
+ static unsigned long cnt, thr;
+ if(++cnt > thr) {
+  thr |= cnt;
+  printk("pin[%06lx] d%d t=%u\n", cnt, d->domain_id, type);
+ }
         flush_all(FLUSH_CACHE);
+}
 
     return 0;
 }
@@ -793,7 +807,12 @@ void memory_type_changed(struct domain *
 {
     if ( iommu_enabled && d->vcpu && d->vcpu[0] )
     {
+static unsigned long cnt, thr;//temp
         p2m_memory_type_changed(d);
+if(++cnt > thr) {//temp
+ thr |= cnt;
+ printk("chg[%06lx] d%d [%pS]\n", cnt, d->domain_id, __builtin_return_address(0));
+}
         flush_all(FLUSH_CACHE);
     }
 }

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-16 13:01             ` Jan Beulich
@ 2014-06-17  2:19               ` Liu, SongtaoX
  2014-06-17  7:11                 ` Jan Beulich
  0 siblings, 1 reply; 16+ messages in thread
From: Liu, SongtaoX @ 2014-06-17  2:19 UTC (permalink / raw)
  To: Jan Beulich
  Cc: Tian, Kevin, keir, tim, Dong, Eddie, Nakajima, Jun, xen-devel,
	Zhang, Yang Z, Hu, Robert, Pang, LongtaoX

> >>> On 12.06.14 at 03:28, <songtaox.liu@intel.com> wrote:
> >> From: Jan Beulich [mailto:jbeulich@suse.com]
> >> >>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 9:35 AM >>>
> >> >Sorry to update.
> >> >The bug refers to
> >> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
> >> >L2 guest vnc console hangs at black screen with cursor flashing at
> >> >the top
> > left
> >> corner.
> >> >After several minutes, the Seabios screen shows up, but the screen
> >> >still
> > flush
> >> slowly, the guest could not boot up.
> >>
> >> That would then indeed be an indication of excessive flushes. I.e.
> >> you may
> > want
> >> to simply track down which one (and why) gets triggered too often.
> >>
> > How to get that information? It is hard for me to do it since I am not
> > a Xen expert. But if you can provide a patch help to debug, I would happy to
> do it.
> 
> The original patch makes quite clear where to put the instrumentation; I'm
> attaching a patch anyway for you to try. This (obviously) is against the current
> staging tree - while it ought to apply fine on master, it certainly won't apply on
> 4.4 or older without adjustments.
> 
Env: Xen.git, master, commit: 7f8d8abcf6dfb85fae591a547b24f9b27d92272c, with your patch,
L2 guest with "hap=1", after creating the L2, "xl dmesg" in L0 shows: 
(XEN) chg[000020] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000040] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000080] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000100] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000200] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000400] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000800] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[001000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[002000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[004000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[008000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[008000] d1 [hvm_set_guest_pat+0xad/0xb9]

Regards
Songtao

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-17  2:19               ` Liu, SongtaoX
@ 2014-06-17  7:11                 ` Jan Beulich
  2014-06-17  8:33                   ` Liu, SongtaoX
  0 siblings, 1 reply; 16+ messages in thread
From: Jan Beulich @ 2014-06-17  7:11 UTC (permalink / raw)
  To: SongtaoX Liu
  Cc: Kevin Tian, keir, tim, Eddie Dong, Jun Nakajima, xen-devel,
	Yang Z Zhang, Robert Hu, LongtaoX Pang

>>> On 17.06.14 at 04:19, <songtaox.liu@intel.com> wrote:
>> >>> On 12.06.14 at 03:28, <songtaox.liu@intel.com> wrote:
>> >> From: Jan Beulich [mailto:jbeulich@suse.com]
>> >> >>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 9:35 AM >>>
>> >> >Sorry to update.
>> >> >The bug refers to
>> >> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
>> >> >L2 guest vnc console hangs at black screen with cursor flashing at
>> >> >the top
>> > left
>> >> corner.
>> >> >After several minutes, the Seabios screen shows up, but the screen
>> >> >still
>> > flush
>> >> slowly, the guest could not boot up.
>> >>
>> >> That would then indeed be an indication of excessive flushes. I.e.
>> >> you may
>> > want
>> >> to simply track down which one (and why) gets triggered too often.
>> >>
>> > How to get that information? It is hard for me to do it since I am not
>> > a Xen expert. But if you can provide a patch help to debug, I would happy 
> to
>> do it.
>> 
>> The original patch makes quite clear where to put the instrumentation; I'm
>> attaching a patch anyway for you to try. This (obviously) is against the 
> current
>> staging tree - while it ought to apply fine on master, it certainly won't 
> apply on
>> 4.4 or older without adjustments.
>> 
> Env: Xen.git, master, commit: 7f8d8abcf6dfb85fae591a547b24f9b27d92272c, with 
> your patch,
> L2 guest with "hap=1", after creating the L2, "xl dmesg" in L0 shows: 
> (XEN) chg[000020] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[000040] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[000080] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[000100] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[000200] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[000400] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[000800] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[001000] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[002000] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[004000] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[008000] d1 [hvm_set_guest_pat+0xad/0xb9]
> (XEN) chg[008000] d1 [hvm_set_guest_pat+0xad/0xb9]

This looks like it's not really a proper part of the log (the last two
lines being duplicated). Which underlines that you should supply
(attach!) full logs rather than decide on your own which part(s)
might be relevant.

_Assuming_ the tail above really is the tail of the log, I can't see
why the guest wouldn't come up: 32k cache flushes aren't the
end of the world. There ought to be something else...

Jan

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-17  7:11                 ` Jan Beulich
@ 2014-06-17  8:33                   ` Liu, SongtaoX
  2014-06-17 15:34                     ` Jan Beulich
  0 siblings, 1 reply; 16+ messages in thread
From: Liu, SongtaoX @ 2014-06-17  8:33 UTC (permalink / raw)
  To: Jan Beulich
  Cc: Tian, Kevin, keir, tim, Dong, Eddie, Nakajima, Jun, xen-devel,
	Zhang, Yang Z, Hu, Robert, Pang, LongtaoX

[-- Attachment #1: Type: text/plain, Size: 2906 bytes --]

> >> >> From: Jan Beulich [mailto:jbeulich@suse.com]
> >> >> >>> "Liu, SongtaoX" <songtaox.liu@intel.com> 05/30/14 9:35 AM >>>
> >> >> >Sorry to update.
> >> >> >The bug refers to
> >> >> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1887.
> >> >> >L2 guest vnc console hangs at black screen with cursor flashing
> >> >> >at the top
> >> > left
> >> >> corner.
> >> >> >After several minutes, the Seabios screen shows up, but the
> >> >> >screen still
> >> > flush
> >> >> slowly, the guest could not boot up.
> >> >>
> >> >> That would then indeed be an indication of excessive flushes. I.e.
> >> >> you may
> >> > want
> >> >> to simply track down which one (and why) gets triggered too often.
> >> >>
> >> > How to get that information? It is hard for me to do it since I am
> >> > not a Xen expert. But if you can provide a patch help to debug, I
> >> > would happy
> > to
> >> do it.
> >>
> >> The original patch makes quite clear where to put the
> >> instrumentation; I'm attaching a patch anyway for you to try. This
> >> (obviously) is against the
> > current
> >> staging tree - while it ought to apply fine on master, it certainly
> >> won't
> > apply on
> >> 4.4 or older without adjustments.
> >>
> > Env: Xen.git, master, commit:
> > 7f8d8abcf6dfb85fae591a547b24f9b27d92272c, with your patch,
> > L2 guest with "hap=1", after creating the L2, "xl dmesg" in L0 shows:
> > (XEN) chg[000020] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[000040] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[000080] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[000100] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[000200] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[000400] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[000800] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[001000] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[002000] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[004000] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[008000] d1 [hvm_set_guest_pat+0xad/0xb9]
> > (XEN) chg[008000] d1 [hvm_set_guest_pat+0xad/0xb9]
> 
> This looks like it's not really a proper part of the log (the last two lines being
> duplicated). Which underlines that you should supply
> (attach!) full logs rather than decide on your own which part(s) might be
> relevant.
> 
> _Assuming_ the tail above really is the tail of the log, I can't see why the guest
> wouldn't come up: 32k cache flushes aren't the end of the world. There ought
> to be something else...
> 
Sorry, it's my mistake, the last line should be " (XEN) chg[010000] d1 [hvm_set_guest_pat+0xad/0xb9]".
Full L0 serial log as attached, it was from L0 boot to L2 guest creation.
After creating L2, it takes nearly 15 minutes to print the last line of " (XEN) chg[040000] d1 [hvm_set_guest_pat+0xad/0xb9]". 
No other logs printed out in 20 minutes.

Regards
Songtao

[-- Attachment #2: xen-nested-serial.log --]
[-- Type: application/octet-stream, Size: 76205 bytes --]

(XEN) Xen version 4.5-unstable (root@tsp.org) (gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4)) debug=y Tue Jun 17 01:50:33 CST 2014
(XEN) Latest ChangeSet: Wed May 28 10:57:18 2014 +0200 git:7f8d8ab-dirty
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: dom0_mem=4096M,max:4096M console=com1 hap_1gb=1  conring_size=128M
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN)  EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009a800 (usable)
(XEN)  000000000009a800 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 0000000074b5b000 (usable)
(XEN)  0000000074b5b000 - 0000000074c08000 (ACPI data)
(XEN)  0000000074c08000 - 0000000077694000 (usable)
(XEN)  0000000077694000 - 0000000077715000 (reserved)
(XEN)  0000000077715000 - 0000000078bdf000 (usable)
(XEN)  0000000078bdf000 - 000000007accf000 (reserved)
(XEN)  000000007accf000 - 000000007b6ff000 (ACPI NVS)
(XEN)  000000007b6ff000 - 000000007b7da000 (ACPI data)
(XEN)  000000007b7da000 - 000000007b800000 (usable)
(XEN)  000000007b800000 - 0000000090000000 (reserved)
(XEN)  00000000fed1c000 - 00000000fed20000 (reserved)
(XEN)  00000000ff800000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000880000000 (usable)
(XEN) ACPI: RSDP 000F0410, 0024 (r2 INTEL )
(XEN) ACPI: XSDT 7B7D80E8, 00B4 (r1 INTEL  INTEL ID        0       1000013)
(XEN) ACPI: FACP 7B7D7000, 00F4 (r4 INTEL  INTEL ID        0 INTL 20091013)
(XEN) ACPI: DSDT 7B79D000, 2FE6A (r2 INTEL  INTEL ID        3 INTL 20091013)
(XEN) ACPI: FACS 7B6FB000, 0040
(XEN) ACPI: UEFI 7B6F3000, 0042 (r1                        0             0)
(XEN) ACPI: HPET 7B7D6000, 0038 (r1 INTEL  INTEL ID        1 INTL 20091013)
(XEN) ACPI: APIC 7B7D5000, 085C (r2 INTEL  INTEL ID        0 INTL 20091013)
(XEN) ACPI: MCFG 7B7D4000, 003C (r1 INTEL  INTEL ID        1 INTL 20091013)
(XEN) ACPI: MIGT 7B7D3000, 0040 (r1 INTEL  INTEL ID        0 INTL 20091013)
(XEN) ACPI: MSCT 7B7D2000, 0090 (r1 INTEL  INTEL ID        1 INTL 20091013)
(XEN) ACPI: PMCT 7B7D1000, 0064 (r1 INTEL  INTEL ID        0 INTL 20091013)
(XEN) ACPI: SLIT 7B7D0000, 006C (r1 INTEL  INTEL ID        1 INTL 20091013)
(XEN) ACPI: SRAT 7B7CF000, 0E30 (r3 INTEL  INTEL ID        1 INTL 20091013)
(XEN) ACPI: SVOS 7B7CE000, 0032 (r1 INTEL  INTEL ID        0 INTL 20091013)
(XEN) ACPI: WDDT 7B7CD000, 0040 (r1 INTEL  INTEL ID        0 INTL 20091013)
(XEN) ACPI: SSDT 74B5B000, ACA42 (r2  INTEL SSDT  PM     4000 INTL 20130328)
(XEN) ACPI: SSDT 7B79A000, 213C (r2  INTEL SpsNm           2 INTL 20130328)
(XEN) ACPI: SSDT 7B799000, 0064 (r2  INTEL SpsNvs          2 INTL 20130328)
(XEN) ACPI: PRAD 7B798000, 0102 (r2  INTEL SpsPrAgg        2 INTL 20130328)
(XEN) ACPI: SPCR 7B797000, 0050 (r1                        0             0)
(XEN) ACPI: DMAR 7B796000, 00A0 (r1 INTEL  INTEL ID        1 INTL 20091013)
(XEN) System RAM: 32650MB (33434052kB)
(XEN) SRAT: PXM 0 -> APIC 0 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 2 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 4 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 6 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 8 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 10 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 12 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 16 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 18 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 20 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 22 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 24 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 26 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 28 -> Node 0
(XEN) SRAT: PXM 1 -> APIC 32 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 34 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 36 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 38 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 40 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 42 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 44 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 48 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 50 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 52 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 54 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 56 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 58 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 60 -> Node 1
(XEN) SRAT: PXM 0 -> APIC 1 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 3 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 5 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 7 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 9 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 11 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 13 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 17 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 19 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 21 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 23 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 25 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 27 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 29 -> Node 0
(XEN) SRAT: PXM 1 -> APIC 33 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 35 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 37 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 39 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 41 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 43 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 45 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 49 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 51 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 53 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 55 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 57 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 59 -> Node 1
(XEN) SRAT: PXM 1 -> APIC 61 -> Node 1
(XEN) SRAT: Node 0 PXM 0 0-480000000
(XEN) SRAT: Node 1 PXM 1 480000000-880000000
(XEN) NUMA: Using 19 for the hash shift.
(XEN) Domain heap initialised DMA width 32 bits
(XEN) DMI 2.7 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x408
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:404,1:0], pm1x_evt[1:400,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - 7b6fb000/0000000000000000, using 32
(XEN) ACPI:             wakeup_vec[7b6fb00c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
(XEN) Processor #4 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
(XEN) Processor #6 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled)
(XEN) Processor #8 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] enabled)
(XEN) Processor #10 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] enabled)
(XEN) Processor #12 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x10] enabled)
(XEN) Processor #16 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x12] enabled)
(XEN) Processor #18 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x14] enabled)
(XEN) Processor #20 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x16] enabled)
(XEN) Processor #22 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x18] enabled)
(XEN) Processor #24 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x1a] enabled)
(XEN) Processor #26 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x1c] enabled)
(XEN) Processor #28 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x20] enabled)
(XEN) Processor #32 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x22] lapic_id[0x22] enabled)
(XEN) Processor #34 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x24] lapic_id[0x24] enabled)
(XEN) Processor #36 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x26] lapic_id[0x26] enabled)
(XEN) Processor #38 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x28] lapic_id[0x28] enabled)
(XEN) Processor #40 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x2a] lapic_id[0x2a] enabled)
(XEN) Processor #42 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x2c] lapic_id[0x2c] enabled)
(XEN) Processor #44 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x30] lapic_id[0x30] enabled)
(XEN) Processor #48 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x32] lapic_id[0x32] enabled)
(XEN) Processor #50 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x34] lapic_id[0x34] enabled)
(XEN) Processor #52 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x36] lapic_id[0x36] enabled)
(XEN) Processor #54 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x38] lapic_id[0x38] enabled)
(XEN) Processor #56 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x3a] enabled)
(XEN) Processor #58 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x3c] enabled)
(XEN) Processor #60 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
(XEN) Processor #1 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
(XEN) Processor #3 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
(XEN) Processor #5 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
(XEN) Processor #7 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled)
(XEN) Processor #9 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] enabled)
(XEN) Processor #11 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] enabled)
(XEN) Processor #13 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x11] enabled)
(XEN) Processor #17 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x13] enabled)
(XEN) Processor #19 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x15] enabled)
(XEN) Processor #21 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x17] enabled)
(XEN) Processor #23 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x19] enabled)
(XEN) Processor #25 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x1b] enabled)
(XEN) Processor #27 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x1d] enabled)
(XEN) Processor #29 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x21] lapic_id[0x21] enabled)
(XEN) Processor #33 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x23] lapic_id[0x23] enabled)
(XEN) Processor #35 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x25] lapic_id[0x25] enabled)
(XEN) Processor #37 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x27] lapic_id[0x27] enabled)
(XEN) Processor #39 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x29] lapic_id[0x29] enabled)
(XEN) Processor #41 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x2b] lapic_id[0x2b] enabled)
(XEN) Processor #43 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x2d] lapic_id[0x2d] enabled)
(XEN) Processor #45 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x31] lapic_id[0x31] enabled)
(XEN) Processor #49 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x33] lapic_id[0x33] enabled)
(XEN) Processor #51 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x35] lapic_id[0x35] enabled)
(XEN) Processor #53 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x37] lapic_id[0x37] enabled)
(XEN) Processor #55 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x39] lapic_id[0x39] enabled)
(XEN) Processor #57 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x3b] enabled)
(XEN) Processor #59 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x3d] enabled)
(XEN) Processor #61 7:15 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC (id[0x09] address[0xfec01000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
(XEN) ACPI: IOAPIC (id[0x0a] address[0xfec40000] gsi_base[48])
(XEN) IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode:  Phys.  Using 3 I/O APICs
(XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 144 CPUs (88 hotplug CPUs)
(XEN) IRQ limits: 72 GSI, 10696 MSI/MSI-X
(XEN) Switched to APIC driver x2apic_cluster.
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2594.054 MHz processor.
(XEN) Initing memory sharing.
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) mce_intel.c:717: MCA Capability: BCAST 1 SER 1 CMCI 1 firstbank 0 extended MCE MSR 0
(XEN) Intel machine check reporting enabled
(XEN) PCI: MCFG configuration 0: base 80000000 segment 0000 buses 00 - ff
(XEN) PCI: MCFG area at 80000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-ff
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d iommu 1 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d Snoop Control enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Shared EPT tables enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Interrupt remapping enabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using old ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) TSC deadline timer enabled
(XEN) Platform timer is 14.318MHz HPET
(XEN) Defaulting to alternative key handling; send 'A' to switch to normal mode.
(XEN) Allocated console ring of 131072 KiB.
(XEN) mwait-idle: MWAIT substates: 0x2120
(XEN) mwait-idle: v0.4 model 0x3f
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN)  - APIC Register Virtualization
(XEN)  - Virtual Interrupt Delivery
(XEN)  - Posted Interrupt Processing
(XEN)  - VMCS shadowing
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) Brought up 56 CPUs
(XEN) ACPI sleep modes: S3
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0x1000000 memsz=0xa27000
(XEN) elf_parse_binary: phdr: paddr=0x1c00000 memsz=0xb00f0
(XEN) elf_parse_binary: phdr: paddr=0x1cb1000 memsz=0x14a80
(XEN) elf_parse_binary: phdr: paddr=0x1cc6000 memsz=0x61a000
(XEN) elf_parse_binary: memory: 0x1000000 -> 0x22e0000
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff81cc61f0
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff81001000
(XEN) elf_xen_parse_note: FEATURES = "!writable_page_tables|pae_pgdir_above_4gb"
(XEN) elf_xen_parse_note: SUPPORTED_FEATURES = 0x801
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_parse_note: unknown xen elf note (0xd)
(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1
(XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0x0
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)     virt_base        = 0xffffffff80000000
(XEN)     elf_paddr_offset = 0x0
(XEN)     virt_offset      = 0xffffffff80000000
(XEN)     virt_kstart      = 0xffffffff81000000
(XEN)     virt_kend        = 0xffffffff822e0000
(XEN)     virt_entry       = 0xffffffff81cc61f0
(XEN)     p2m_base         = 0xffffffffffffffff
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x22e0000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000864000000->0000000868000000 (1024583 pages to be allocated)
(XEN)  Init. ramdisk: 000000087e247000->000000087ffff400
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff822e0000
(XEN)  Init. ramdisk: ffffffff822e0000->ffffffff84098400
(XEN)  Phys-Mach map: ffffffff84099000->ffffffff84899000
(XEN)  Start info:    ffffffff84899000->ffffffff848994b4
(XEN)  Page tables:   ffffffff8489a000->ffffffff848c3000
(XEN)  Boot stack:    ffffffff848c3000->ffffffff848c4000
(XEN)  TOTAL:         ffffffff80000000->ffffffff84c00000
(XEN)  ENTRY ADDRESS: ffffffff81cc61f0
(XEN) Dom0 has maximum 56 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff81a27000
(XEN) elf_load_binary: phdr 1 at 0xffffffff81c00000 -> 0xffffffff81cb00f0
(XEN) elf_load_binary: phdr 2 at 0xffffffff81cb1000 -> 0xffffffff81cc5a80
(XEN) elf_load_binary: phdr 3 at 0xffffffff81cc6000 -> 0xffffffff81dc3000
(XEN) Scrubbing Free RAM: ......................................................................................................................................................................................................................................................................................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 284kB init memory.
mapping kernel into physical memory
about to get started...
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.14.4 (build@xen-build) (gcc version 4.4.6 20110731 (Red Hat 4.4.6-3) (GCC) ) #1 SMP Sun Jun 1 10:44:37 CST 2014
[    0.000000] Command line: ro root=UUID=541a9f8d-47c8-4a60-b1cd-5514a05bb5fd max_loop=64 3 debug console=hvc0
[    0.000000] Freeing 9a-100 pfn range: 102 pages freed
[    0.000000] 1-1 mapping on 9a->100
[    0.000000] Freeing 74b5b-74c08 pfn range: 173 pages freed
[    0.000000] 1-1 mapping on 74b5b->74c08
[    0.000000] Freeing 77694-77715 pfn range: 129 pages freed
[    0.000000] 1-1 mapping on 77694->77715
[    0.000000] Freeing 78bdf-7b7da pfn range: 11259 pages freed
[    0.000000] 1-1 mapping on 78bdf->7b7da
[    0.000000] Freeing 7b800-100000 pfn range: 542720 pages freed
[    0.000000] 1-1 mapping on 7b800->100000
[    0.000000] Released 554383 pages of unused memory
[    0.000000] Set 554383 page(s) to 1-1 mapping
[    0.000000] Populating 100000-18758f pfn range: 554383 pages added
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] Xen: [mem 0x0000000000000000-0x0000000000099fff] usable
[    0.000000] Xen: [mem 0x000000000009a800-0x00000000000fffff] reserved
[    0.000000] Xen: [mem 0x0000000000100000-0x0000000074b5afff] usable
[    0.000000] Xen: [mem 0x0000000074b5b000-0x0000000074c07fff] ACPI data
[    0.000000] Xen: [mem 0x0000000074c08000-0x0000000077693fff] usable
[    0.000000] Xen: [mem 0x0000000077694000-0x0000000077714fff] reserved
[    0.000000] Xen: [mem 0x0000000077715000-0x0000000078bdefff] usable
[    0.000000] Xen: [mem 0x0000000078bdf000-0x000000007accefff] reserved
[    0.000000] Xen: [mem 0x000000007accf000-0x000000007b6fefff] ACPI NVS
[    0.000000] Xen: [mem 0x000000007b6ff000-0x000000007b7d9fff] ACPI data
[    0.000000] Xen: [mem 0x000000007b7da000-0x000000007b7fffff] usable
[    0.000000] Xen: [mem 0x000000007b800000-0x000000008fffffff] reserved
[    0.000000] Xen: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] Xen: [mem 0x00000000fee00000-0x00000000feefffff] reserved
[    0.000000] Xen: [mem 0x00000000ff800000-0x00000000ffffffff] reserved
[    0.000000] Xen: [mem 0x0000000100000000-0x000000018758efff] usable
[    0.000000] Xen: [mem 0x000000018758f000-0x000000087fffffff] unusable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Intel Corporation S2600WTT/S2600WTT, BIOS GRNDSDP1.86B.0030.R03.1405061547 05/06/2014
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x18758f max_arch_pfn = 0x400000000
[    0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [ffff880000093000] 93000 size 28672
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x187200000-0x1873fffff]
[    0.000000]  [mem 0x187200000-0x1873fffff] page 4k
[    0.000000] BRK [0x01ed9000, 0x01ed9fff] PGTABLE
[    0.000000] BRK [0x01eda000, 0x01edafff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x184000000-0x1871fffff]
[    0.000000]  [mem 0x184000000-0x1871fffff] page 4k
[    0.000000] BRK [0x01edb000, 0x01edbfff] PGTABLE
[    0.000000] BRK [0x01edc000, 0x01edcfff] PGTABLE
[    0.000000] BRK [0x01edd000, 0x01eddfff] PGTABLE
[    0.000000] BRK [0x01ede000, 0x01edefff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x180000000-0x183ffffff]
[    0.000000]  [mem 0x180000000-0x183ffffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x00100000-0x74b5afff]
[    0.000000]  [mem 0x00100000-0x74b5afff] page 4k
[    0.000000] init_memory_mapping: [mem 0x74c08000-0x77693fff]
[    0.000000]  [mem 0x74c08000-0x77693fff] page 4k
[    0.000000] init_memory_mapping: [mem 0x77715000-0x78bdefff]
[    0.000000]  [mem 0x77715000-0x78bdefff] page 4k
[    0.000000] init_memory_mapping: [mem 0x7b7da000-0x7b7fffff]
[    0.000000]  [mem 0x7b7da000-0x7b7fffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x100000000-0x17fffffff]
[    0.000000]  [mem 0x100000000-0x17fffffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x187400000-0x18758efff]
[    0.000000]  [mem 0x187400000-0x18758efff] page 4k
[    0.000000] RAMDISK: [mem 0x022e0000-0x04098fff]
[    0.000000] ACPI: RSDP 00000000000f0410 000024 (v02 INTEL )
[    0.000000] ACPI: XSDT 000000007b7d80e8 0000B4 (v01 INTEL  INTEL ID 00000000      01000013)
[    0.000000] ACPI: FACP 000000007b7d7000 0000F4 (v04 INTEL  INTEL ID 00000000 INTL 20091013)
[    0.000000] ACPI: DSDT 000000007b79d000 02FE6A (v02 INTEL  INTEL ID 00000003 INTL 20091013)
[    0.000000] ACPI: FACS 000000007b6fb000 000040
[    0.000000] ACPI: UEFI 000000007b6f3000 000042 (v01                 00000000      00000000)
[    0.000000] ACPI: HPET 000000007b7d6000 000038 (v01 INTEL  INTEL ID 00000001 INTL 20091013)
[    0.000000] ACPI: APIC 000000007b7d5000 00085C (v02 INTEL  INTEL ID 00000000 INTL 20091013)
[    0.000000] ACPI: MCFG 000000007b7d4000 00003C (v01 INTEL  INTEL ID 00000001 INTL 20091013)
[    0.000000] ACPI: MIGT 000000007b7d3000 000040 (v01 INTEL  INTEL ID 00000000 INTL 20091013)
[    0.000000] ACPI: MSCT 000000007b7d2000 000090 (v01 INTEL  INTEL ID 00000001 INTL 20091013)
[    0.000000] ACPI: PMCT 000000007b7d1000 000064 (v01 INTEL  INTEL ID 00000000 INTL 20091013)
[    0.000000] ACPI: SLIT 000000007b7d0000 00006C (v01 INTEL  INTEL ID 00000001 INTL 20091013)
[    0.000000] ACPI: SRAT 000000007b7cf000 000E30 (v03 INTEL  INTEL ID 00000001 INTL 20091013)
[    0.000000] ACPI: SVOS 000000007b7ce000 000032 (v01 INTEL  INTEL ID 00000000 INTL 20091013)
[    0.000000] ACPI: WDDT 000000007b7cd000 000040 (v01 INTEL  INTEL ID 00000000 INTL 20091013)
[    0.000000] ACPI: SSDT 0000000074b5b000 0ACA42 (v02  INTEL SSDT  PM 00004000 INTL 20130328)
[    0.000000] ACPI: SSDT 000000007b79a000 00213C (v02  INTEL SpsNm    00000002 INTL 20130328)
[    0.000000] ACPI: SSDT 000000007b799000 000064 (v02  INTEL SpsNvs   00000002 INTL 20130328)
[    0.000000] ACPI: PRAD 000000007b798000 000102 (v02  INTEL SpsPrAgg 00000002 INTL 20130328)
[    0.000000] ACPI: SPCR 000000007b797000 000050 (v01                 00000000      00000000)
[    0.000000] ACPI: XMAR 000000007b796000 0000A0 (v01 INTEL  INTEL ID 00000001 INTL 20091013)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x18758efff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x00099fff]
[    0.000000]   node   0: [mem 0x00100000-0x74b5afff]
[    0.000000]   node   0: [mem 0x74c08000-0x77693fff]
[    0.000000]   node   0: [mem 0x77715000-0x78bdefff]
[    0.000000]   node   0: [mem 0x7b7da000-0x7b7fffff]
[    0.000000]   node   0: [mem 0x100000000-0x18758efff]
[    0.000000] On node 0 totalpages: 1048575
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 22 pages reserved
[    0.000000]   DMA zone: 3993 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 7660 pages used for memmap
[    0.000000]   DMA32 zone: 490199 pages, LIFO batch:31
[    0.000000]   Normal zone: 8663 pages used for memmap
[    0.000000]   Normal zone: 554383 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x10] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x12] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x14] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x16] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x18] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x1a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x1c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0x30] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0x32] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0x34] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0x36] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0x38] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x3a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x3c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x11] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x13] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x15] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x17] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x19] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x1b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x1d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0x31] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0x33] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0x35] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0x37] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0x39] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x3b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x3d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled)
[    0.000000] [   16.719240] loop: module loaded
[   16.719299] tun: Universal TUN/TAP device driver, 1.6
[   16.719301] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[   16.719469] e100: Intel(R) PRO/100 Network Driver, 3.5.24-k2-NAPI
[   16.719472] e100: Copyright(c) 1999-2006 Intel Corporation
[   16.719553] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI
[   16.719556] e1000: Copyright (c) 1999-2006 Intel Corporation.
[   16.719638] sky2: driver version 1.30
[   16.719791] xen_netfront: Initialising Xen virtual ethernet driver
[   16.720153] usbcore: registered new interface driver usblp
[   16.720383] i8042: PNP: No PS/2 controller found. Probing ports directly.
[   17.769669] i8042: No controller found
[   17.769906] mousedev: PS/2 mouse device common for all mice
[   17.770384] rtc_cmos 00:02: RTC can wake from S4
[   17.770608] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[   17.770683] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram
[   17.770846] xen: registering gsi 18 triggering 0 polarity 1
[   17.770856] Already setup the GSI :18
[   17.770961] i801_smbus 0000:00:1f.3: SMBus using PCI Interrupt
[   17.771126] xen_wdt: Xen WatchDog Timer Driver v0.01
[   17.771428] xen_wdt: initialized (timeout=60s, nowayout=0)
[   17.771795] device-mapper: ioctl: 4.27.0-ioctl (2013-10-30) initialised: dm-devel@redhat.com
[   17.771906] hidraw: raw HID events driver (C) Jiri Kosina
[   17.772982] usbcore: registered new interface driver usbhid
[   17.772985] usbhid: USB HID core driver
[   17.773872] Netfilter messages via NETLINK v0.30.
[   17.773885] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[   17.774082] ctnetlink v0.93: registering with nfnetlink.
[   17.774172] ip_tables: (C) 2000-2006 Netfilter Core Team
[   17.774246] TCP: cubic registered
[   17.774249] Initializing XFRM netlink socket
[   17.774541] NET: Registered protocol family 10
[   17.775283] ip6_tables: (C) 2000-2006 Netfilter Core Team
[   17.775369] sit: IPv6 over IPv4 tunneling driver
[   17.775667] NET: Registered protocol family 17
[   17.775684] Key type dns_resolver registered
[   17.779105] registered taskstats version 1
[   17.780138]   Magic number: 2:942:470
[   17.780153] thermal cooling_device50: hash matches
[   17.780294] xen_cpu xen_cpu37: hash matches
[   17.780308] console [netcon0] enabled
[   17.780310] netconsole: network logging started
[   17.781412] ALSA device list:
[   17.781415]   No soundcards found.
[   17.782178] Freeing unused kernel memory: 1068K (ffffffff81cb1000 - ffffffff81dbc000)
[   17.782183] Write protecting the kernel read-only data: 12288k
[   17.786513] Freeing unused kernel memory: 920K (ffff88000171a000 - ffff880001800000)
[   17.787655] Freeing unused kernel memory: 1892K (ffff880001a27000 - ffff880001c00000)
[   17.809624] dracut: dracut-004-335.el6
[   17.831942] udev: starting version 147
[   17.832007] udevd (2355): /proc/2355/oom_adj is deprecated, please use /proc/2355/oom_score_adj instead.
[   17.891035] dracut: Starting plymouth daemon
[   18.348505] SCSI subsystem initialized
[   18.349858] libata version 3.00 loaded.
[   18.350457] ahci 0000:00:11.4: version 3.0
[   18.350553] xen: registering gsi 16 triggering 0 polarity 1
[   18.350583] xen: --> pirq=16 -> irq=16 (gsi=16)
[   18.350741] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0x1 impl SATA mode
[   18.350746] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst 
[   18.351720] scsi0 : ahci
[   18.351900] scsi1 : ahci
[   18.352082] scsi2 : ahci
[   18.352265] scsi3 : ahci
[   18.352362] ata1: SATA max UDMA/133 abar m2048@0x92104000 port 0x92104100 irq 490
[   18.352365] ata2: DUMMY
[   18.352367] ata3: DUMMY
[   18.352368] ata4: DUMMY
[   18.352459] xen: registering gsi 16 triggering 0 polarity 1
[   18.352468] Already setup the GSI :16
[   18.352597] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x20 impl SATA mode
[   18.352602] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst 
[   18.354013] scsi4 : ahci
[   18.354201] scsi5 : ahci
[   18.354380] scsi6 : ahci
[   18.354561] scsi7 : ahci
[   18.354739] scsi8 : ahci
[   18.354919] scsi9 : ahci
[   18.355060] ata5: DUMMY
[   18.355063] ata6: DUMMY
[   18.355064] ata7: DUMMY
[   18.355066] ata8: DUMMY
[   18.355067] ata9: DUMMY
[   18.355070] ata10: SATA max UDMA/133 abar m2048@0x92100000 port 0x92100380 irq 491
[   18.656972] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[   18.659015] ata1.00: ATA-8: WDC WD1002FAEX-00Z3A0, 05.01D05, max UDMA/133
[   18.659022] ata1.00: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[   18.659966] ata10: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[   18.661629] ata10.00: ATAPI: DV-W28S-A, 9.2A, max UDMA/100
[   18.662051] ata1.00: configured for UDMA/133
[   18.662141] scsi 0:0:0:0: Direct-Access     ATA      WDC WD1002FAEX-0 05.0 PQ: 0 ANSI: 5
[   18.663537] ata10.00: configured for UDMA/100
[   18.664230] scsi 9:0:0:0: CD-ROM            TEAC     DV-W28S-A        9.2A PQ: 0 ANSI: 5
[   18.667886] xen: registering gsi 19 triggering 0 polarity 1
[   18.667897] Already setup the GSI :19
[   18.667966] xhci_hcd 0000:00:14.0: xHCI Host Controller
[   18.668074] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1
[   18.668166] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
[   18.668280] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[   18.668284] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   18.668288] usb usb1: Product: xHCI Host Controller
[   18.668291] usb usb1: Manufacturer: Linux 3.14.4 xhci_hcd
[   18.668294] usb usb1: SerialNumber: 0000:00:14.0
[   18.668488] hub 1-0:1.0: USB hub found
[   18.668508] hub 1-0:1.0: 15 ports detected
[   18.670288] xhci_hcd 0000:00:14.0: xHCI Host Controller
[   18.670381] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2
[   18.670422] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[   18.670426] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   18.670429] usb usb2: Product: xHCI Host Controller
[   18.670432] usb usb2: Manufacturer: Linux 3.14.4 xhci_hcd
[   18.670435] usb usb2: SerialNumber: 0000:00:14.0
[   18.670619] hub 2-0:1.0: USB hub found
[   18.670634] hub 2-0:1.0: 6 ports detected
G[   18.995643] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB)
[   18.995686] sd 0:0:0:0: [sda] Write Protect is off
[   18.995690] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[   18.995704] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   19.023043] usb 1-2: new low-speed USB device number 2 using xhci_hcd
[   19.029141]  sda: sda1 sda2
[   19.029668] sd 0:0:0:0: [sda] Attached SCSI disk
[   19.044538] sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[   19.044557] cdrom: Uniform CD-ROM driver Revision: 3.20
[   19.044891] sr 9:0:0:0: Attached scsi CD-ROM sr0
[   19.277639] usb 1-2: New USB device found, idVendor=0603, idProduct=00f2
[   19.277658] usb 1-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   19.277662] usb 1-2: Product: USB Keyboard
[   19.277665] usb 1-2: Manufacturer: NOVATEK
[   19.277936] usb 1-2: ep 0x81 - rounding interval to 64 microframes, ep desc says 80 microframes
[   19.277943] usb 1-2: ep 0x82 - rounding interval to 64 microframes, ep desc says 80 microframes
[   19.277948] usb 1-2: ep 0x83 - rounding interval to 32 microframes, ep desc says 40 microframes
[   19.303369] input: NOVATEK USB Keyboard as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.0/0003:0603:00F2.0001/input/input1
[   19.303578] hid-generic 0003:0603:00F2.0001: input,hidraw0: USB HID v1.10 Keyboard [NOVATEK USB Keyboard] on usb-0000:00:14.0-2/input0
[   19.358831] input: NOVATEK USB Keyboard as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.1/0003:0603:00F2.0002/input/input2
[   19.359204] hid-generic 0003:0603:00F2.0002: input,hiddev0,hidraw1: USB HID v1.10 Device [NOVATEK USB Keyboard] on usb-0000:00:14.0-2/input1
[   19.378971] input: NOVATEK USB Keyboard as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2:1.2/0003:0603:00F2.0003/input/input3
[   19.379279] hid-generic 0003:0603:00F2.0003: input,hidraw2: USB HID v1.10 Mouse [NOVATEK USB Keyboard] on usb-0000:00:14.0-2/input2
[   19.474133] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[   19.532077] usb 1-9: new full-speed USB device number 3 using xhci_hcd
[   19.591366] dracut: Mounted root filesystem /dev/sda1
[   19.716498] usb 1-9: New USB device found, idVendor=046b, idProduct=ff10
[   19.716518] usb 1-9: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[   19.716522] usb 1-9: Product: Virtual Keyboard and Mouse
[   19.716525] usb 1-9: Manufacturer: American Megatrends Inc.
[   19.716528] usb 1-9: SerialNumber: serial
[   19.716754] usb 1-9: ep 0x81 - rounding interval to 64 microframes, ep desc says 80 microframes
[   19.718325] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-9/1-9:1.0/0003:046B:FF10.0004/input/input4
[   19.718567] hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input0
[   19.719587] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-9/1-9:1.1/0003:046B:FF10.0005/input/input5
[   19.719892] hid-generic 0003:046B:FF10.0005: input,hidraw4: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input1
[   19.992047] SELinux:  Disabled at runtime.
[   19.992114] SELinux:  Unregistering netfilter hooks
[   20.027017] audit: type=1404 audit(1402990181.953:2): selinux=0 auid=4294967295 ses=4294967295
[   20.032393] dracut: 
[   20.140119] dracut: Switching root
		Welcome to Red Hat Enterprise Linux Server
Starting udev: [   21.960103] udev: starting version 147
[   22.762575] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 3.19.1-k
[   22.762597] ixgbe: Copyright (c) 1999-2013 Intel Corporation.
[   22.762733] xen: registering gsi 37 triggering 0 polarity 1
[   22.762770] xen: --> pirq=37 -> irq=37 (gsi=37)
[   22.867157] ixgbe 0000:03:00.0: Enabling SR-IOV VFs using the max_vfs module parameter is deprecated - please use the pci sysfs interface instead.
[   23.236993] pci 0000:03:10.0: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.0
[   23.237336] pci 0000:03:10.2: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.2
[   23.237578] pci 0000:03:10.4: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.4
[   23.237818] pci 0000:03:10.6: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.6
[   23.238057] ixgbe 0000:03:00.0 (unregistered net_device): SR-IOV enabled with 4 VFs
[   23.304410] ixgbe 0000:03:00.0: Multiqueue Disabled: Rx Queue count = 1, Tx Queue count = 1
[   23.364769] ixgbe 0000:03:00.0: PCI Express bandwidth of 32GT/s available
[   23.364788] ixgbe 0000:03:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[   23.405014] ixgbe 0000:03:00.0: MAC: 3, PHY: 3, PBA No: 000000-000
[   23.405035] ixgbe 0000:03:00.0: 00:1e:67:94:ab:e1
[   23.539437] ixgbe 0000:03:00.0 eth0: IOV is enabled with 4 VFs
[   23.561599] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection
[   23.561678] xen: registering gsi 34 triggering 0 polarity 1
[   23.561697] xen: --> pirq=34 -> irq=34 (gsi=34)
[   23.663119] ixgbe 0000:03:00.1: Enabling SR-IOV VFs using the max_vfs module parameter is deprecated - please use the pci sysfs interface instead.
[   24.027977] pci 0000:03:10.1: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.1
[   24.028259] pci 0000:03:10.3: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.3
[   24.028500] pci 0000:03:10.5: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.5
[   24.028736] pci 0000:03:10.7: [8086:1515] type 00 class 0x020000
(XEN) PCI add virtual function 0000:03:10.7
[   24.028961] ixgbe 0000:03:00.1 (unregistered net_device): SR-IOV enabled with 4 VFs
[   24.095283] ixgbe 0000:03:00.1: Multiqueue Disabled: Rx Queue count = 1, Tx Queue count = 1
[   24.155565] ixgbe 0000:03:00.1: PCI Express bandwidth of 32GT/s available
[   24.155583] ixgbe 0000:03:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[   24.195757] ixgbe 0000:03:00.1: MAC: 3, PHY: 3, PBA No: 000000-000
[   24.195774] ixgbe 0000:03:00.1: 00:1e:67:94:ab:e2
[   24.318487] ixgbe 0000:03:00.1 eth1: IOV is enabled with 4 VFs
[   24.340684] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection
[   24.340766] xen: registering gsi 40 triggering 0 polarity 1
[   24.340789] xen: --> pirq=40 -> irq=40 (gsi=40)
[   24.341082] ixgbe 0000:05:00.0: Enabling SR-IOV VFs using the max_vfs module parameter is deprecated - please use the pci sysfs interface instead.
[   24.566983] pci 0000:05:10.0: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.0
[   24.567226] pci 0000:05:10.2: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.2
[   24.567440] pci 0000:05:10.4: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.4
[   24.567638] pci 0000:05:10.6: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.6
[   24.567821] ixgbe 0000:05:00.0 (unregistered net_device): SR-IOV enabled with 4 VFs
[   24.591785] ixgbe 0000:05:00.0: Multiqueue Disabled: Rx Queue count = 1, Tx Queue count = 1
[   24.591918] ixgbe 0000:05:00.0: PCI Express bandwidth of 32GT/s available
[   24.591927] ixgbe 0000:05:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[   24.592011] ixgbe 0000:05:00.0: MAC: 2, PHY: 15, SFP+: 5, PBA No: E70854-007
[   24.592016] ixgbe 0000:05:00.0: 90:e2:ba:1b:dd:40
[   24.593213] ixgbe 0000:05:00.0 eth2: IOV is enabled with 4 VFs
[   24.593250] ixgbe 0000:05:00.0: Intel(R) 10 Gigabit Network Connection
[   24.593349] xen: registering gsi 44 triggering 0 polarity 1
[   24.593369] xen: --> pirq=44 -> irq=44 (gsi=44)
[   24.593598] ixgbe 0000:05:00.1: Enabling SR-IOV VFs using the max_vfs module parameter is deprecated - please use the pci sysfs interface instead.
[   25.769096] pci 0000:05:10.1: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.1
[   25.769549] pci 0000:05:10.3: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.3
[   25.769754] pci 0000:05:10.5: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.5
[   25.769996] pci 0000:05:10.7: [8086:10ed] type 00 class 0x020000
(XEN) PCI add virtual function 0000:05:10.7
[   25.770193] ixgbe 0000:05:00.1 (unregistered net_device): SR-IOV enabled with 4 VFs
[   25.794505] ixgbe 0000:05:00.1: Multiqueue Disabled: Rx Queue count = 1, Tx Queue count = 1
[   25.794641] ixgbe 0000:05:00.1: PCI Express bandwidth of 32GT/s available
[   25.794644] ixgbe 0000:05:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[   25.794730] ixgbe 0000:05:00.1: MAC: 2, PHY: 1, PBA No: E70854-007
[   25.794733] ixgbe 0000:05:00.1: 90:e2:ba:1b:dd:41
[   25.796001] ixgbe 0000:05:00.1 eth3: IOV is enabled with 4 VFs
[   25.796040] ixgbe 0000:05:00.1: Intel(R) 10 Gigabit Network Connection
[   25.952302] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[   25.957477] ehci-pci: EHCI PCI platform driver
[   25.957599] xen: registering gsi 18 triggering 0 polarity 1
[   25.957616] Already setup the GSI :18
[   25.957701] ehci-pci 0000:00:1a.0: EHCI Host Controller
[   25.957832] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3
[   25.957857] ehci-pci 0000:00:1a.0: debug port 2
[   25.961838] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[   25.961848] ehci-pci 0000:00:1a.0: irq 18, io mem 0x92102000
[   25.966969] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[   25.967012] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[   25.967017] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   25.967021] usb usb3: Product: EHCI Host Controller
[   25.967024] usb usb3: Manufacturer: Linux 3.14.4 ehci_hcd
[   25.967027] usb usb3: SerialNumber: 0000:00:1a.0
[   25.967211] hub 3-0:1.0: USB hub found
[   25.967219] hub 3-0:1.0: 2 ports detected
[   25.967410] xen: registering gsi 18 triggering 0 polarity 1
[   25.967420] Already setup the GSI :18
[   25.967482] ehci-pci 0000:00:1d.0: EHCI Host Controller
[   25.967563] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 4
[   25.967583] ehci-pci 0000:00:1d.0: debug port 2
[   25.971542] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[   25.971550] ehci-pci 0000:00:1d.0: irq 18, io mem 0x92101000
[   25.976953] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[   25.976981] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002
[   25.976984] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   25.976988] usb usb4: Product: EHCI Host Controller
[   25.976991] usb usb4: Manufacturer: Linux 3.14.4 ehci_hcd
[   25.976994] usb usb4: SerialNumber: 0000:00:1d.0
[   25.977109] hub 4-0:1.0: USB hub found
[   25.977115] hub 4-0:1.0: 2 ports detected
[   26.222736] i40e: Intel(R) Ethernet Connection XL710 Network Driver - version 0.3.30-k
[   26.222757] i40e: Copyright (c) 2013 - 2014 Intel Corporation.
[   26.222855] xen: registering gsi 56 triggering 0 polarity 1
[   26.222887] xen: --> pirq=56 -> irq=56 (gsi=56)
[   26.234223] i40e 0000:81:00.0: f4.0 a1.0 n40.00 e80001063
[   26.234231] i40e 0000:81:00.0: warning: NVM version not supported, supported version: 02.30
[   26.234433] i40e 0000:81:00.0: Flow Director ATR mode Enabled
[   26.234439] i40e 0000:81:00.0: Flow Director Side Band mode Enabled
[   26.234444] i40e 0000:81:00.0: Number of VFs being requested for PF[0] = 32
[   26.235181] i40e 0000:81:00.0: MAC address: 68:05:ca:26:15:a0
[   26.242884] netif_napi_add() called with weight 256 on device eth4
[   26.258233] i40e 0000:81:00.0: i40e_ptp_init: added PHC on eth4
[   26.269011] usb 3-1: new high-speed USB device number 2 using ehci-pci
[   26.269515] i40e 0000:81:00.0: PCI Express: Speed 8.0GT/s Width x8
[   26.269591] xen: registering gsi 56 triggering 0 polarity 1
[   26.269607] Already setup the GSI :56
[   26.281192] i40e 0000:81:00.1: f4.0 a1.0 n40.00 e80001063
[   26.281198] i40e 0000:81:00.1: warning: NVM version not supported, supported version: 02.30
[   26.281401] i40e 0000:81:00.1: Flow Director ATR mode Enabled
[   26.281405] i40e 0000:81:00.1: Flow Director Side Band mode Enabled
[   26.281408] i40e 0000:81:00.1: Number of VFs being requested for PF[1] = 32
[   26.281575] i40e 0000:81:00.1: MAC address: 68:05:ca:26:15:a2
[   26.293055] i40e 0000:81:00.1: i40e_ptp_init: added PHC on eth5
[   26.293569] i40e 0000:81:00.1: PCI Express: Speed 8.0GT/s Width x8
[   26.293661] xen: registering gsi 56 triggering 0 polarity 1
[   26.293679] Already setup the GSI :56
[   26.307254] i40e 0000:81:00.2: f4.0 a1.0 n40.00 e80001063
[   26.307264] i40e 0000:81:00.2: warning: NVM version not supported, supported version: 02.30
[   26.307462] i40e 0000:81:00.2: Flow Director ATR mode Enabled
[   26.307473] i40e 0000:81:00.2: Flow Director Side Band mode Enabled
[   26.307483] i40e 0000:81:00.2: Number of VFs being requested for PF[2] = 32
[   26.308213] i40e 0000:81:00.2: MAC address: 68:05:ca:26:15:a4
[   26.319198] i40e 0000:81:00.2: i40e_ptp_init: added PHC on eth6
[   26.319684] i40e 0000:81:00.2: PCI Express: Speed 8.0GT/s Width x8
[   26.319764] xen: registering gsi 56 triggering 0 polarity 1
[   26.319783] Already setup the GSI :56
[   26.330511] i40e 0000:81:00.3: f4.0 a1.0 n40.00 e80001063
[   26.330517] i40e 0000:81:00.3: warning: NVM version not supported, supported version: 02.30
[   26.330715] i40e 0000:81:00.3: Flow Director ATR mode Enabled
[   26.330718] i40e 0000:81:00.3: Flow Director Side Band mode Enabled
[   26.330722] i40e 0000:81:00.3: Number of VFs being requested for PF[3] = 32
[   26.330866] i40e 0000:81:00.3: MAC address: 68:05:ca:26:15:a6
[   26.343904] i40e 0000:81:00.3: i40e_ptp_init: added PHC on eth7
[   26.344366] i40e 0000:81:00.3: PCI Express: Speed 8.0GT/s Width x8
[   26.368932] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   26.368995] sr 9:0:0:0: Attached scsi generic sg1 type 5
G[   26.383292] usb 3-1: New USB device found, idVendor=8087, idProduct=800a
[   26.383299] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[   26.383603] hub 3-1:1.0: USB hub found
[   26.383664] hub 3-1:1.0: 6 ports detected
[   26.485998] usb 4-1: new high-speed USB device number 2 using ehci-pci
[   26.600289] usb 4-1: New USB device found, idVendor=8087, idProduct=8002
[   26.600311] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[   26.602231] hub 4-1:1.0: USB hub found
[   26.602292] hub 4-1:1.0: 8 ports detected
[  OK  ]
Setting hostname vt-hsw1:  [  OK  ]
Setting up Logical Volume Management:   No volume groups found
[  OK  ]
Checking filesystems
Checking all file systems.
[/sbin/fsck.ext4 (1) -- /] fsck.ext4 -a /dev/sda1 
/dev/sda1: clean, 668848/60538880 files, 41328484/242142208 blocks
[  OK  ]
Remounting root filesystem in read-write mode:  [   27.816010] EXT4-fs (sda1): re-mounted. Opts: (null)
[  OK  ]
Mounting local filesystems:  [  OK  ]
Enabling local filesystem quotas:  [  OK  ]
Enabling /etc/fstab swaps:  [   28.541333] Adding 8191996k swap on /dev/sda2.  Priority:-1 extents:1 across:8191996k 
[  OK  ]
Entering non-interactive startup
Calling the system activity data collector (sadc)... 
Bringing up loopback interface:  [  OK  ]
Bringing up interface eth0:  
Determining IP information for eth0...[   29.363852] pps pps0: new PPS source ptp4
[   29.363872] ixgbe 0000:03:00.0: registered PHC device on eth0
[   29.774306] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
 failed; no link present.  Check cable?
[FAILED]
Starting auditd: [  OK  ]
Starting portreserve: [  OK  ]
Starting system logger: [  OK  ]
Starting irqbalance: [  OK  ]
Starting rpcbind: [  OK  ]
Kdump is not supported on this kernel[FAILED]
Starting system message bus: [  OK  ]
Starting NFS statd: [  OK  ]
Starting cups: [  OK  ]
Mounting filesystems:  [  OK  ]
Starting HAL daemon: [  OK  ]
Retrigger failed udev events[  OK  ]
Starting automount: [  OK  ]
Starting mcelog daemon
[  OK  ]Starting sshd: [  OK  ]
Starting postfix: [  OK  ]
Starting abrt daemon: [  OK  ]
Starting crond: [  OK  ]
Starting VNC server: 1:root xauth: (stdin):1:  bad display name "vt-hsw1:1" in "add" command

New 'vt-hsw1:1 (root)' desktop is vt-hsw1:1

Starting applications specified in /root/.vnc/xstartup
Log file is /root/.vnc/vt-hsw1:1.log

2:root xauth: (stdin):1:  bad display name "vt-hsw1:2" in "add" command

New 'vt-hsw1:2 (root)' desktop is vt-hsw1:2

Starting applications specified in /root/.vnc/xstartup
Log file is /root/.vnc/vt-hsw1:2.log

[  OK  ]
Starting atd: [  OK  ]
Starting rhsmcertd...[  OK  ]
Starting certmonger: [  OK  ]
+ /etc/init.d/xencommons start
[   50.444947] xen_acpi_processor: Uploading Xen processor PM info
Starting C xenstored...
Setting domain 0 name and domid...
Starting xenconsoled...
Starting QEMU as disk backend for dom0

Red Hat Enterprise Linux Server release 6.5 (Santiago)
Kernel 3.14.4 on an x86_64

vt-hsw1 login: 
(d1) HVM Loader
(d1) Detected Xen v4.5-unstable
(d1) Xenbus rings @0xfeffc000, event channel 1
(d1) System requested SeaBIOS
(d1) CPU speed is 2594 MHz
(d1) Relocating guest memory for lowmem MMIO space disabled
(XEN) irq.c:270: Dom1 PCI link 0 changed 0 -> 5
(d1) PCI-ISA link 0 routed to IRQ5
(XEN) irq.c:270: Dom1 PCI link 1 changed 0 -> 10
(d1) PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:270: Dom1 PCI link 2 changed 0 -> 11
(d1) PCI-ISA link 2 routed to IRQ11
(XEN) irq.c:270: Dom1 PCI link 3 changed 0 -> 5
(d1) PCI-ISA link 3 routed to IRQ5
(d1) pci dev 01:2 INTD->IRQ5
(d1) pci dev 01:3 INTA->IRQ10
(d1) pci dev 02:0 INTA->IRQ11
(d1) pci dev 04:0 INTA->IRQ5
(d1) No RAM in high memory; setting high_mem resource base to 100000000
(d1) pci dev 02:0 bar 14 size 001000000: 0f0000008
(d1) pci dev 03:0 bar 10 size 001000000: 0f1000008
(d1) pci dev 04:0 bar 30 size 000040000: 0f2000000
(d1) pci dev 03:0 bar 30 size 000010000: 0f2040000
(d1) pci dev 03:0 bar 18 size 000001000: 0f2050000
(d1) pci dev 02:0 bar 10 size 000000100: 00000c001
(d1) pci dev 04:0 bar 10 size 000000100: 00000c101
(d1) pci dev 04:0 bar 14 size 000000100: 0f2051000
(d1) pci dev 01:2 bar 20 size 000000020: 00000c201
(d1) pci dev 01:1 bar 20 size 000000010: 00000c221
(d1) Multiprocessor initialisation:
(XEN) chg[000001] d1 [mtrr_fix_range_msr_set+0x51/0x5f]
(XEN) chg[000002] d1 [mtrr_fix_range_msr_set+0x51/0x5f]
(XEN) chg[000004] d1 [mtrr_fix_range_msr_set+0x51/0x5f]
(XEN) chg[000008] d1 [mtrr_fix_range_msr_set+0x51/0x5f]
(d1)  - CPU0 ... 46-bit phys ... fixed MTRRs ... var MTRRs [1/8] ... done.
(d1) Testing HVM environment:
(d1)  - REP INSB across page boundaries ... passed
(d1)  - GS base MSRs and SWAPGS ... passed
(d1) Passed 2 of 2 tests
(d1) Writing SMBIOS tables ...
(d1) Loading SeaBIOS ...
(d1) Creating MP tables ...
(d1) Loading ACPI ...
(d1) vm86 TSS at fc00a180
(d1) BIOS map:
(d1)  10000-100d3: Scratch space
(d1)  e0000-fffff: Main BIOS
(d1) E820 table:
(d1)  [00]: 00000000:00000000 - 00000000:000a0000: RAM
(d1)  HOLE: 00000000:000a0000 - 00000000:000e0000
(d1)  [01]: 00000000:000e0000 - 00000000:00100000: RESERVED
(d1)  [02]: 00000000:00100000 - 00000000:7f000000: RAM
(d1)  HOLE: 00000000:7f000000 - 00000000:fc000000
(d1)  [03]: 00000000:fc000000 - 00000001:00000000: RESERVED
(d1) Invoking SeaBIOS ...
(d1) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20140601_103755-xen-build)
(d1) 
(d1) Found Xen hypervisor signature at 40000000
(d1) xen: copy e820...
(d1) Relocating init from 0x000e2e88 to 0x7efe1d80 (size 57784)
(d1) CPU Mhz=2594
(d1) Found 8 PCI devices (max PCI bus is 00)
(d1) Allocated Xen hypercall page at 7efff000
(d1) Detected Xen v4.5-unstable
(d1) xen: copy BIOS tables...
(d1) Copying SMBIOS entry point from 0x00010010 to 0x000f1020
(d1) Copying MPTABLE from 0xfc001140/fc001150 to 0x000f0f40
(d1) Copying PIR from 0x00010030 to 0x000f0ec0
(d1) Copying ACPI RSDP from 0x000100b0 to 0x000f0e90
(d1) Using pmtimer, ioport 0xb008, freq 3579 kHz
(d1) Scan for VGA option rom
(d1) WARNING! Found unaligned PCI rom (vd=1234:1111)
(d1) Running option rom at c000:0003
(XEN) stdvga.c:147:d1v0 entering stdvga and caching modes
(d1) Turning on vga text mode console
(d1) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20140601_103755-xen-build)
(d1) Machine UUID 705394ed-86c3-466c-a951-c59ec1f50b5d
(d1) UHCI init on dev 00:01.2 (io=c200)
(d1) Found 0 lpt ports
(d1) Found 1 serial ports
(d1) ATA controller 1 at 1f0/3f4/c220 (irq 14 dev 9)
(d1) ATA controller 2 at 170/374/c228 (irq 15 dev 9)
(d1) ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (51200 MiBytes)
(d1) Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0
(d1) PS2 keyboard initialized
(d1) All threads complete.
(d1) Scan for option roms
(d1) Running option rom at ca00:0003
(d1) pmm call arg1=1
(d1) pmm call arg1=0
(d1) pmm call arg1=1
(d1) pmm call arg1=0
(d1) Searching bootorder for: /pci@i0cf8/*@4
(d1) 
(d1) Press F12 for boot menu.
(d1) 
(d1) Searching bootorder for: HALT
(d1) drive 0x000f0e40: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 s=104857600
(d1) 
(d1) Space available for UMB: cb000-ef000, f0000-f0e40
(d1) Returned 61440 bytes of ZoneHigh
(d1) e820 map has 6 items:
(d1)   0: 0000000000000000 - 000000000009fc00 = 1 RAM
(d1)   1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED
(d1)   2: 00000000000f0000 - 0000000000100000 = 2 RESERVED
(d1)   3: 0000000000100000 - 000000007efff000 = 1 RAM
(d1)   4: 000000007efff000 - 000000007f000000 = 2 RESERVED
(d1)   5: 00000000fc000000 - 0000000100000000 = 2 RESERVED
(d1) enter handle_19:
(d1)   NULL
(d1) Booting from Hard Disk...
(d1) Booting from 0000:7c00
(XEN) chg[000010] d1 [mtrr_def_type_msr_set+0xdf/0xed]
[  162.222022] xenbr0: port 3(vif1.0-emu) entered forwarding state
(XEN) irq.c:270: Dom1 PCI link 0 changed 5 -> 0
(XEN) irq.c:270: Dom1 PCI link 1 changed 10 -> 0
(XEN) irq.c:270: Dom1 PCI link 2 changed 11 -> 0
(XEN) irq.c:270: Dom1 PCI link 3 changed 5 -> 0
(XEN) chg[000020] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000040] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000080] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000100] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000200] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000400] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[000800] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[001000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[002000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[004000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[008000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[010000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[020000] d1 [hvm_set_guest_pat+0xad/0xb9]
(XEN) chg[040000] d1 [hvm_set_guest_pat+0xad/0xb9]

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-17  8:33                   ` Liu, SongtaoX
@ 2014-06-17 15:34                     ` Jan Beulich
  2014-06-18  3:09                       ` Liu, SongtaoX
  0 siblings, 1 reply; 16+ messages in thread
From: Jan Beulich @ 2014-06-17 15:34 UTC (permalink / raw)
  To: Kevin Tian, SongtaoX Liu, Tim Deegan
  Cc: keir, Eddie Dong, Jun Nakajima, xen-devel, Yang Z Zhang,
	Robert Hu, LongtaoX Pang

>>> On 17.06.14 at 10:33, <songtaox.liu@intel.com> wrote:
> Full L0 serial log as attached, it was from L0 boot to L2 guest creation.
> After creating L2, it takes nearly 15 minutes to print the last line of " 
> (XEN) chg[040000] d1 [hvm_set_guest_pat+0xad/0xb9]". 
> No other logs printed out in 20 minutes.

So then I suppose the problem are the two hvm_set_guest_pat()
invocations from vvmx.c. Thinking about it, the call from that function
to memory_type_changed() seems unnecessary - PAT_CR contents
don't influence the decision taken by epte_get_entry_emt(). Tim,
Kevin, you had looked at the original patch - would you agree?
Songtao - mind giving removal of that call a try to at least verify the
theory?

Jan

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-17 15:34                     ` Jan Beulich
@ 2014-06-18  3:09                       ` Liu, SongtaoX
  2014-06-18 10:02                         ` Jan Beulich
  0 siblings, 1 reply; 16+ messages in thread
From: Liu, SongtaoX @ 2014-06-18  3:09 UTC (permalink / raw)
  To: Jan Beulich, Tian, Kevin, Tim Deegan
  Cc: keir, Dong, Eddie, Nakajima, Jun, xen-devel, Zhang, Yang Z, Hu,
	Robert, Pang, LongtaoX


> 
> >>> On 17.06.14 at 10:33, <songtaox.liu@intel.com> wrote:
> > Full L0 serial log as attached, it was from L0 boot to L2 guest creation.
> > After creating L2, it takes nearly 15 minutes to print the last line of "
> > (XEN) chg[040000] d1 [hvm_set_guest_pat+0xad/0xb9]".
> > No other logs printed out in 20 minutes.
> 
> So then I suppose the problem are the two hvm_set_guest_pat() invocations
> from vvmx.c. Thinking about it, the call from that function to
> memory_type_changed() seems unnecessary - PAT_CR contents don't
> influence the decision taken by epte_get_entry_emt(). Tim, Kevin, you had
> looked at the original patch - would you agree?
> Songtao - mind giving removal of that call a try to at least verify the theory?
> 
I guess your meaning is to remove flush_all(FLUSH_CACHE) in function memory_type_changed.
After removing it, the L2 guest could boot well, it works.

Regards
Songtao

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: [PATCH] x86/EPT: flush cache when (potentially) limiting cachability
  2014-06-18  3:09                       ` Liu, SongtaoX
@ 2014-06-18 10:02                         ` Jan Beulich
  0 siblings, 0 replies; 16+ messages in thread
From: Jan Beulich @ 2014-06-18 10:02 UTC (permalink / raw)
  To: kevin.tian, songtaox.liu, tim
  Cc: keir, eddie.dong, jun.nakajima, xen-devel, yang.z.zhang,
	robert.hu, longtaox.pang

>>> "Liu, SongtaoX" <songtaox.liu@intel.com> 06/18/14 5:11 AM >>>
>> >>> On 17.06.14 at 10:33, <songtaox.liu@intel.com> wrote:
>> > Full L0 serial log as attached, it was from L0 boot to L2 guest creation.
>> > After creating L2, it takes nearly 15 minutes to print the last line of "
>> > (XEN) chg[040000] d1 [hvm_set_guest_pat+0xad/0xb9]".
>> > No other logs printed out in 20 minutes.
>> 
>> So then I suppose the problem are the two hvm_set_guest_pat() invocations
>> from vvmx.c. Thinking about it, the call from that function to
>> memory_type_changed() seems unnecessary - PAT_CR contents don't
>> influence the decision taken by epte_get_entry_emt(). Tim, Kevin, you had
>> looked at the original patch - would you agree?
>> Songtao - mind giving removal of that call a try to at least verify the theory?
> 
>I guess your meaning is to remove flush_all(FLUSH_CACHE) in function memory_type_changed.

No, I clearly told you to try removing the call of memory_type_changed() from
hvm_set_guest_pat(). What you did is definitely wrong.

Jan

^ permalink raw reply	[flat|nested] 16+ messages in thread

end of thread, other threads:[~2014-06-18 10:02 UTC | newest]

Thread overview: 16+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-04-25 12:13 [PATCH] x86/EPT: flush cache when (potentially) limiting cachability Jan Beulich
2014-05-01 13:39 ` Tim Deegan
2014-05-30  2:07 ` Liu, SongtaoX
2014-05-30  6:26   ` Jan Beulich
2014-05-30  7:02     ` Jan Beulich
2014-05-30  7:34       ` Liu, SongtaoX
2014-05-30 11:20         ` Jan Beulich
2014-06-12  1:28           ` Liu, SongtaoX
2014-06-12  8:43             ` Ian Campbell
2014-06-16 13:01             ` Jan Beulich
2014-06-17  2:19               ` Liu, SongtaoX
2014-06-17  7:11                 ` Jan Beulich
2014-06-17  8:33                   ` Liu, SongtaoX
2014-06-17 15:34                     ` Jan Beulich
2014-06-18  3:09                       ` Liu, SongtaoX
2014-06-18 10:02                         ` Jan Beulich

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.