All of lore.kernel.org
 help / color / mirror / Atom feed
* 答复: about xenalyze
       [not found] ` <5549EE3F.90206@eu.citrix.com>
@ 2015-05-07  3:30   ` 蒋雄伟(蒋冲)
  2015-05-07 17:57     ` George Dunlap
  0 siblings, 1 reply; 11+ messages in thread
From: 蒋雄伟(蒋冲) @ 2015-05-07  3:30 UTC (permalink / raw)
  To: 'George Dunlap'; +Cc: xen-devel, xen-devel

 Hi, George

I deploy a Discuz application in a VM and use jmeter to stress the application.  Meanwhile I use xentrace to trace.
#xentrace -D -e 0x0008f000 -T 30 trace_file_discuz.bin

Then I use xenalyze to analyze
#xenalyze --summary trace_file_discuz.bin It tells me as follows:

 --- Log volume summary ---
  - cpu 0 -
  hvm   :       1784
  +-vmentry:        448
  +-vmexit :        784
  +-handler:        552

[...]
 
 
 It seems different from what you show in your presentation 《Xenalyze Finding meaning in the chaos》。 What's wrong with it ?
 I would like to see the reason, counts and cpu time for handler of each VMEXIT.  I would also like to see the wait time, blocked time , cpu usage of a domain.  What should I do?

I am looking forward to receiving reply from you. 
 
Best Regards


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 答复: about xenalyze
  2015-05-07  3:30   ` 答复: about xenalyze 蒋雄伟(蒋冲)
@ 2015-05-07 17:57     ` George Dunlap
  2015-05-08  2:41       ` 答复: " 蒋雄伟(蒋冲)
  0 siblings, 1 reply; 11+ messages in thread
From: George Dunlap @ 2015-05-07 17:57 UTC (permalink / raw)
  To: "蒋雄伟(蒋冲)"; +Cc: xen-devel, xen-devel

On 05/07/2015 04:30 AM, 蒋雄伟(蒋冲) wrote:
>  Hi, George
> 
> I deploy a Discuz application in a VM and use jmeter to stress the application.  Meanwhile I use xentrace to trace.
> #xentrace -D -e 0x0008f000 -T 30 trace_file_discuz.bin
> 
> Then I use xenalyze to analyze
> #xenalyze --summary trace_file_discuz.bin It tells me as follows:
> 
>  --- Log volume summary ---
>   - cpu 0 -
>   hvm   :       1784
>   +-vmentry:        448
>   +-vmexit :        784
>   +-handler:        552
> 
> [...]
>  
>  
>  It seems different from what you show in your presentation 《Xenalyze Finding meaning in the chaos》。 What's wrong with it ?
>  I would like to see the reason, counts and cpu time for handler of each VMEXIT.  I would also like to see the wait time, blocked time , cpu usage of a domain.  What should I do?

The log volume summary is just the first part of the output; normally
the summary of stuff by domain is below that.

Can you please include the full output?

Thanks,
 -George


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* 答复: 答复: about xenalyze
  2015-05-07 17:57     ` George Dunlap
@ 2015-05-08  2:41       ` 蒋雄伟(蒋冲)
  2015-05-11 10:04         ` George Dunlap
  0 siblings, 1 reply; 11+ messages in thread
From: 蒋雄伟(蒋冲) @ 2015-05-08  2:41 UTC (permalink / raw)
  To: 'George Dunlap'; +Cc: xen-devel, xen-devel

$xenalyze --summary trace_file_discuz.bin 
Using VMX hardware-assisted virtualization.
scan_for_new_pcpu: Activating pcpu 10 at offset 0
Creating vcpu 10 for dom 32768
scan_for_new_pcpu: Activating pcpu 21 at offset 42196
Creating vcpu 21 for dom 32768
scan_for_new_pcpu: Activating pcpu 22 at offset 43516
Creating vcpu 22 for dom 32768
scan_for_new_pcpu: Activating pcpu 24 at offset 44664
Creating vcpu 24 for dom 32768
init_pcpus: through first trace write, done for now.
Detected off-by-one bug; relaxing expectations
hvm_generic_postprocess: Strange, exit 2c(APIC_ACCESS) missing a handler
scan_for_new_pcpu: Activating pcpu 7 at offset 3360952
Creating vcpu 7 for dom 32768
process_cpu_change: Activating pcpu 11 at offset 3396528
Creating vcpu 11 for dom 32768
process_cpu_change: Activating pcpu 16 at offset 4685392
Creating vcpu 16 for dom 32768
process_cpu_change: Activating pcpu 25 at offset 4767196
Creating vcpu 25 for dom 32768
process_cpu_change: Activating pcpu 23 at offset 8820852
Creating vcpu 23 for dom 32768
process_cpu_change: Activating pcpu 26 at offset 10467560
Creating vcpu 26 for dom 32768
process_cpu_change: Activating pcpu 27 at offset 13377152
Creating vcpu 27 for dom 32768
process_cpu_change: Activating pcpu 0 at offset 14202228
Creating vcpu 0 for dom 32768
process_cpu_change: Activating pcpu 12 at offset 14204024
Creating vcpu 12 for dom 32768
process_cpu_change: Activating pcpu 17 at offset 14762404
Creating vcpu 17 for dom 32768
process_cpu_change: Activating pcpu 28 at offset 14771148
Creating vcpu 28 for dom 32768
scan_for_new_pcpu: Activating pcpu 1 at offset 14776680
Creating vcpu 1 for dom 32768
process_cpu_change: Activating pcpu 4 at offset 14779148
Creating vcpu 4 for dom 32768
process_cpu_change: Activating pcpu 13 at offset 14825668
Creating vcpu 13 for dom 32768
process_cpu_change: Activating pcpu 18 at offset 14938016
Creating vcpu 18 for dom 32768
process_cpu_change: Activating pcpu 20 at offset 14941080
Creating vcpu 20 for dom 32768
process_cpu_change: Activating pcpu 29 at offset 14954728
Creating vcpu 29 for dom 32768
read_record: read returned zero, deactivating pcpu 10
deactivate_pcpu: setting d32768v10 to state LOST
hvm_generic_postprocess: Strange, exit 0(EXCEPTION_NMI) missing a handler
hvm_generic_postprocess: HVM evt 0 in 2c and 0!
read_record: read returned zero, deactivating pcpu 7
deactivate_pcpu: setting d32768v7 to state LOST
read_record: read returned zero, deactivating pcpu 11
deactivate_pcpu: setting d32768v11 to state LOST
read_record: read returned zero, deactivating pcpu 16
deactivate_pcpu: setting d32768v16 to state LOST
read_record: read returned zero, deactivating pcpu 21
deactivate_pcpu: setting d32768v21 to state LOST
read_record: read returned zero, deactivating pcpu 22
deactivate_pcpu: setting d32768v22 to state LOST
read_record: read returned zero, deactivating pcpu 26
deactivate_pcpu: setting d32768v26 to state LOST
read_record: read returned zero, deactivating pcpu 27
deactivate_pcpu: setting d32768v27 to state LOST
read_record: read returned zero, deactivating pcpu 0
deactivate_pcpu: setting d32768v0 to state LOST
read_record: read returned zero, deactivating pcpu 12
deactivate_pcpu: setting d32768v12 to state LOST
read_record: read returned zero, deactivating pcpu 17
deactivate_pcpu: setting d32768v17 to state LOST
read_record: read returned zero, deactivating pcpu 28
deactivate_pcpu: setting d32768v28 to state LOST
read_record: read returned zero, deactivating pcpu 1
deactivate_pcpu: setting d32768v1 to state LOST
read_record: read returned zero, deactivating pcpu 4
deactivate_pcpu: setting d32768v4 to state LOST
read_record: read returned zero, deactivating pcpu 13
deactivate_pcpu: setting d32768v13 to state LOST
read_record: read returned zero, deactivating pcpu 18
deactivate_pcpu: setting d32768v18 to state LOST
read_record: read returned zero, deactivating pcpu 20
deactivate_pcpu: setting d32768v20 to state LOST
read_record: read returned zero, deactivating pcpu 25
deactivate_pcpu: setting d32768v25 to state LOST
read_record: read returned zero, deactivating pcpu 23
deactivate_pcpu: setting d32768v23 to state LOST
read_record: read returned zero, deactivating pcpu 24
deactivate_pcpu: setting d32768v24 to state LOST
read_record: read returned zero, deactivating pcpu 29
deactivate_pcpu: setting d32768v29 to state LOST
deactivate_pcpu: Setting max_active_pcpu to -1
Total time: 32.49 seconds (using cpu speed 2.40 GHz)
--- Log volume summary ---
 - cpu 0 -
 hvm   :       1784
 +-vmentry:        448
 +-vmexit :        784
 +-handler:        552
 - cpu 1 -
 hvm   :       2456
 +-vmentry:        688
 +-vmexit :       1204
 +-handler:        564
 - cpu 4 -
 hvm   :      31220
 +-vmentry:       8544
 +-vmexit :      14952
 +-handler:       7724
 - cpu 7 -
 hvm   :      22708
 +-vmentry:       6240
 +-vmexit :      10920
 +-handler:       5548
 - cpu 10 -
 gen   :        336
 hvm   :    2925480
 +-vmentry:     746048
 +-vmexit :    1305612
 +-handler:     873820
 - cpu 11 -
 gen   :        104
 hvm   :    1159676
 +-vmentry:     297584
 +-vmexit :     520772
 +-handler:     341320
 - cpu 12 -
 gen   :         48
 hvm   :     453336
 +-vmentry:     116240
 +-vmexit :     203420
 +-handler:     133676
 - cpu 13 -
 gen   :          4
 hvm   :      99404
 +-vmentry:      24784
 +-vmexit :      43372
 +-handler:      31248
 - cpu 16 -
 hvm   :       7092
 +-vmentry:       1728
 +-vmexit :       3024
 +-handler:       2340
 - cpu 17 -
 hvm   :       1536
 +-vmentry:        432
 +-vmexit :        756
 +-handler:        348
 - cpu 18 -
 hvm   :       3052
 +-vmentry:        752
 +-vmexit :       1316
 +-handler:        984
 - cpu 20 -
 hvm   :       5652
 +-vmentry:       1344
 +-vmexit :       2352
 +-handler:       1956
 - cpu 21 -
 gen   :         44
 hvm   :     439156
 +-vmentry:     122656
 +-vmexit :     214648
 +-handler:     101852
 - cpu 22 -
 gen   :        108
 hvm   :     634364
 +-vmentry:     178096
 +-vmexit :     311668
 +-handler:     144600
 - cpu 23 -
 gen   :         56
 hvm   :     489208
 +-vmentry:     136288
 +-vmexit :     238504
 +-handler:     114416
 - cpu 24 -
 gen   :        396
 hvm   :    3937836
 +-vmentry:    1010016
 +-vmexit :    1767528
 +-handler:    1160292
 - cpu 25 -
 gen   :        148
 hvm   :    1747160
 +-vmentry:     453488
 +-vmexit :     793604
 +-handler:     500068
 - cpu 26 -
 gen   :        220
 hvm   :    2588608
 +-vmentry:     661024
 +-vmexit :    1156792
 +-handler:     770792
 - cpu 27 -
 gen   :        112
 hvm   :     745320
 +-vmentry:     189632
 +-vmexit :     331856
 +-handler:     223832
 - cpu 28 -
 hvm   :      13316
 +-vmentry:       3712
 +-vmexit :       6496
 +-handler:       3108
 - cpu 29 -
 gen   :        348
 hvm   :    3038412
 +-vmentry:     771680
 +-vmexit :    1350412
 +-handler:     916320


This is the full output. 

-----邮件原件-----
发件人: George Dunlap [mailto:george.dunlap@eu.citrix.com] 
发送时间: 2015年5月8日 1:58
收件人: 蒋雄伟(蒋冲)
抄送: xen-devel@lists.xen.org; xen-devel@lists.xensource.com
主题: Re: 答复: about xenalyze

On 05/07/2015 04:30 AM, 蒋雄伟(蒋冲) wrote:
>  Hi, George
> 
> I deploy a Discuz application in a VM and use jmeter to stress the application.  Meanwhile I use xentrace to trace.
> #xentrace -D -e 0x0008f000 -T 30 trace_file_discuz.bin
> 
> Then I use xenalyze to analyze
> #xenalyze --summary trace_file_discuz.bin It tells me as follows:
> 
>  --- Log volume summary ---
>   - cpu 0 -
>   hvm   :       1784
>   +-vmentry:        448
>   +-vmexit :        784
>   +-handler:        552
> 
> [...]
>  
>  
>  It seems different from what you show in your presentation 《Xenalyze Finding meaning in the chaos》。 What's wrong with it ?
>  I would like to see the reason, counts and cpu time for handler of each VMEXIT.  I would also like to see the wait time, blocked time , cpu usage of a domain.  What should I do?

The log volume summary is just the first part of the output; normally the summary of stuff by domain is below that.

Can you please include the full output?

Thanks,
 -George


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 答复: 答复: about xenalyze
  2015-05-08  2:41       ` 答复: " 蒋雄伟(蒋冲)
@ 2015-05-11 10:04         ` George Dunlap
  2015-05-12  2:18           ` 答复: " 蒋雄伟(蒋冲)
  2015-05-12  6:29           ` 蒋雄伟(蒋冲)
  0 siblings, 2 replies; 11+ messages in thread
From: George Dunlap @ 2015-05-11 10:04 UTC (permalink / raw)
  To: 蒋雄伟(蒋冲); +Cc: xen-devel, xen-devel

On Fri, May 8, 2015 at 3:41 AM, 蒋雄伟(蒋冲) <xiongwei.jiang@alibaba-inc.com> wrote:
> $xenalyze --summary trace_file_discuz.bin

[snip]

> This is the full output.

Don't top-post please.

I probably should have said "attach the full output", rather than
including it inline.

So actually -- it looks like you've set the trace to only collect
HVM-related tracing information ("-e 0x8f000" from your command-line
below); but to get the output that you want (with the per-domain and
per-vcpu summaries), it also needs the scheduling traces, so that it
knows which vcpu is running where.

Can you try this again with "-e 0xaf000" and see what you get?

 -George

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* 答复:  答复: 答复: about xenalyze
  2015-05-11 10:04         ` George Dunlap
@ 2015-05-12  2:18           ` 蒋雄伟(蒋冲)
  2015-05-12  9:31             ` George Dunlap
  2015-05-12  6:29           ` 蒋雄伟(蒋冲)
  1 sibling, 1 reply; 11+ messages in thread
From: 蒋雄伟(蒋冲) @ 2015-05-12  2:18 UTC (permalink / raw)
  To: 'George Dunlap'; +Cc: xen-devel, xen-devel

[-- Attachment #1: Type: text/plain, Size: 1063 bytes --]

I try again with "-e 0xaf000", and run xenalyze --summary. The attached is the output.

-----邮件原件-----
发件人: dunlapg@gmail.com [mailto:dunlapg@gmail.com] 代表 George Dunlap
发送时间: 2015年5月11日 18:05
收件人: 蒋雄伟(蒋冲)
抄送: xen-devel@lists.xensource.com; xen-devel@lists.xen.org
主题: Re: [Xen-devel] 答复: 答复: about xenalyze

On Fri, May 8, 2015 at 3:41 AM, 蒋雄伟(蒋冲) <xiongwei.jiang@alibaba-inc.com> wrote:
> $xenalyze --summary trace_file_discuz.bin

[snip]

> This is the full output.

Don't top-post please.

I probably should have said "attach the full output", rather than including it inline.

So actually -- it looks like you've set the trace to only collect HVM-related tracing information ("-e 0x8f000" from your command-line below); but to get the output that you want (with the per-domain and per-vcpu summaries), it also needs the scheduling traces, so that it knows which vcpu is running where.

Can you try this again with "-e 0xaf000" and see what you get?

 -George

[-- Attachment #2: summary_output --]
[-- Type: application/octet-stream, Size: 31678 bytes --]

Total time: 64.99 seconds (using cpu speed 2.40 GHz)
--- Log volume summary ---
 - cpu 0 -
 gen   :       1852
 sched :   16357552
 +-verbose:   11540032
 hvm   :       4392
 +-vmentry:       1232
 +-vmexit :       2156
 +-handler:       1004
 - cpu 1 -
 gen   :        592
 sched :    4911144
 +-verbose:    3464952
 hvm   :       3252
 +-vmentry:        832
 +-vmexit :       1456
 +-handler:        964
 - cpu 2 -
 gen   :        368
 sched :    2852852
 +-verbose:    1991428
 hvm   :       2996
 +-vmentry:        800
 +-vmexit :       1400
 +-handler:        796
 - cpu 3 -
 gen   :       1064
 sched :    8984872
 +-verbose:    6387128
 hvm   :       1360
 +-vmentry:        336
 +-vmexit :        588
 +-handler:        436
 - cpu 4 -
 gen   :         24
 sched :        852
 +-verbose:        404
 hvm   :      19168
 +-vmentry:       4976
 +-vmexit :       8708
 +-handler:       5484
 - cpu 5 -
 sched :       1284
 +-verbose:        644
 hvm   :      21520
 +-vmentry:       5328
 +-vmexit :       9324
 +-handler:       6868
 - cpu 6 -
 gen   :         16
 sched :       4296
 +-verbose:       2536
 hvm   :      63940
 +-vmentry:      16144
 +-vmexit :      28252
 +-handler:      19544
 - cpu 7 -
 gen   :          8
 sched :       6536
 +-verbose:       3880
 hvm   :     122016
 +-vmentry:      31696
 +-vmexit :      55468
 +-handler:      34852
 - cpu 8 -
 gen   :         92
 sched :      44608
 +-verbose:      26096
 hvm   :     961456
 +-vmentry:     246272
 +-vmexit :     431004
 +-handler:     284180
 - cpu 9 -
 gen   :         72
 sched :      24708
 +-verbose:      14388
 hvm   :     525096
 +-vmentry:     133472
 +-vmexit :     233576
 +-handler:     158048
 - cpu 10 -
 gen   :        384
 sched :     146316
 +-verbose:      85276
 hvm   :    3317212
 +-vmentry:     850576
 +-vmexit :    1488508
 +-handler:     978128
 - cpu 11 -
 gen   :         88
 sched :      38672
 +-verbose:      22512
 hvm   :     856744
 +-vmentry:     219296
 +-vmexit :     383768
 +-handler:     253680
 - cpu 12 -
 gen   :         44
 sched :      12196
 +-verbose:       6964
 hvm   :     283276
 +-vmentry:      72688
 +-vmexit :     127204
 +-handler:      83384
 - cpu 13 -
 gen   :        324
 sched :     105748
 +-verbose:      61588
 hvm   :    2383488
 +-vmentry:     611536
 +-vmexit :    1070188
 +-handler:     701764
 - cpu 14 -
 gen   :        304
 sched :     107600
 +-verbose:      62880
 hvm   :    2568276
 +-vmentry:     657392
 +-vmexit :    1150436
 +-handler:     760448
 - cpu 15 -
 gen   :        344
 sched :     167140
 +-verbose:      97444
 hvm   :    3902332
 +-vmentry:     998624
 +-vmexit :    1747564
 +-handler:    1156144
 - cpu 16 -
 gen   :        448
 sched :    4221664
 +-verbose:    2706896
 hvm   :        100
 +-vmentry:         32
 +-vmexit :         56
 +-handler:         12
 - cpu 17 -
 gen   :        264
 sched :    2059496
 +-verbose:    1436408
 hvm   :       2240
 +-vmentry:        592
 +-vmexit :       1036
 +-handler:        612
 - cpu 18 -
 gen   :        476
 sched :    3888136
 +-verbose:    2711480
 hvm   :       1928
 +-vmentry:        544
 +-vmexit :        952
 +-handler:        432
 - cpu 19 -
 gen   :        464
 sched :    3611592
 +-verbose:    2518376
 hvm   :       1620
 +-vmentry:        432
 +-vmexit :        756
 +-handler:        432
 - cpu 20 -
 gen   :        148
 sched :     393820
 +-verbose:     272620
 hvm   :     591756
 +-vmentry:     160064
 +-vmexit :     280112
 +-handler:     151580
 - cpu 21 -
 gen   :        280
 sched :    1332948
 +-verbose:     926676
 hvm   :    1400376
 +-vmentry:     389392
 +-vmexit :     681436
 +-handler:     329548
 - cpu 22 -
 gen   :         40
 sched :     207928
 +-verbose:     144616
 hvm   :     223952
 +-vmentry:      62400
 +-vmexit :     109200
 +-handler:      52352
 - cpu 23 -
 gen   :        132
 sched :     858164
 +-verbose:     596180
 hvm   :     807448
 +-vmentry:     225168
 +-vmexit :     394044
 +-handler:     188236
 - cpu 24 -
 gen   :        652
 sched :     210352
 +-verbose:     123072
 hvm   :    5146040
 +-vmentry:    1317728
 +-vmexit :    2306024
 +-handler:    1522288
 - cpu 25 -
 gen   :        620
 sched :    1413212
 +-verbose:     966652
 hvm   :    5204360
 +-vmentry:    1361904
 +-vmexit :    2383332
 +-handler:    1459124
 - cpu 26 -
 gen   :         68
 sched :     300316
 +-verbose:     201980
 hvm   :     461408
 +-vmentry:     124960
 +-vmexit :     218680
 +-handler:     117768
 - cpu 27 -
 sched :        160
 - cpu 28 -
 sched :        160
 - cpu 29 -
 sched :        160
 - cpu 30 -
 sched :        160
 - cpu 31 -
 gen   :         16
 sched :      22492
 +-verbose:      13084
 hvm   :     535512
 +-vmentry:     136896
 +-vmexit :     239568
 +-handler:     159048
|-- Domain 0 --|
 Runstates:
   blocked:   90820 45.17s 1193653 {813156|12676654|14916632}
  partial run:  264064 19.37s 176086 { 63802|2711480|15725642}
  full run:     283  0.11s 911391 {6521628|186297596|186297596}
  partial contention:   92985  0.19s   4846 {  2588|  7154|  9090}
  concurrency_hazard:   91043  0.18s   4831 {  2616| 10122|  8954}
  full_contention:       1  0.00s   5728 {  5728|  5728|  5728}
      lost:      88  0.05s 1479732 {2717716|15795632|15795632}
 Grant table ops:
  Done by:
  Done for:
 Populate-on-demand:
  Populated:
  Reclaim order:
  Reclaim contexts:
-- v0 --
 Runstates:
   running:   65785  5.84s 212893 { 66084|78005088|78007040}
  runnable:   65622  0.15s   5493 {  2628|  7334|  9648}
        wake:   65540  0.15s   5491 {  2524|  7450|18125402}
     preempt:      82  0.00s   6603 {  5492|  5616|  9252}
   blocked:   65540 58.95s 2158716 {100608|6502080|23915648}
      lost:      61  0.13s 5279808 {4333888|186297596|186297596}
 cpu affinity:       1 155968154252 {155968154252|155968154252|155968154252}
   [0]:       1 155968154252 {155968154252|155968154252|155968154252}
-- v1 --
 Runstates:
   running:   19779  3.23s 391725 { 61816|78004356|78005768}
  runnable:   19724  0.05s   5565 {  3132|  6080|16748364}
        wake:   19710  0.05s   5564 {  2708|  4944|  8064}
     preempt:      14  0.00s   5784 {  4276|  7148|  9624}
   blocked:   19710 61.61s 7501454 {12207058|238945520|152231188}
      lost:      10  0.05s 11678631 {26119260|26119756|26119756}
 cpu affinity:       1 155951770804 {155951770804|155951770804|155951770804}
   [1]:       1 155951770804 {155951770804|155951770804|155951770804}
-- v2 --
 Runstates:
   running:   10942  2.95s 647434 { 96876|78004112|78005844}
  runnable:   10889  0.02s   4673 {  2696|  8348|  8924}
        wake:   10868  0.02s   4670 {  3664|  6080|  9164}
     preempt:      21  0.00s   6512 {  6352|  5760| 10988}
   blocked:   10868 61.88s 13664604 {1672356|116960108|207846716}
      lost:       6  0.13s 52434346 {196077168|196077168|196077168}
 cpu affinity:       1 155927568864 {155927568864|155927568864|155927568864}
   [2]:       1 155927568864 {155927568864|155927568864|155927568864}
-- v3 --
 Runstates:
   running:   37428  2.96s 189757 { 31712|78005268|78006392}
  runnable:   37349  0.08s   4926 {  3112|  5510|  9286}
        wake:   37294  0.08s   4924 {  3004|  5334|  9090}
     preempt:      55  0.00s   6000 {  4928|  6076|  8488}
   blocked:   37294 61.89s 3982925 {11665664|19943110|101332910}
      lost:      34  0.13s 8891985 {10250576|186584814|186584814}
 cpu affinity:       1 155961186674 {155961186674|155961186674|155961186674}
   [3]:       1 155961186674 {155961186674|155961186674|155961186674}
-- v4 --
 Runstates:
   running:    9831  6.34s 1547972 {4433492|78094752|78094752}
  runnable:    9684  0.02s   4109 {  2812|  4140|  7430}
        wake:    9580  0.02s   4110 {  3660|  6736|  9512}
     preempt:     104  0.00s   3987 {  3484|  3540|  6512}
   blocked:    9580 58.54s 14664410 {2573752|185718652|189106560}
      lost:       3  0.14s 114215333 {57622204|230634804|230634804}
 cpu affinity:       1 155957282656 {155957282656|155957282656|155957282656}
   [16]:       1 155957282656 {155957282656|155957282656|155957282656}
-- v5 --
 Runstates:
   running:    7884  3.09s 940310 {1721160|78003968|78134236}
  runnable:    7835  0.02s   4655 {  2728|  3508| 10300}
        wake:    7831  0.02s   4653 {  2652|  4528|  9840}
     preempt:       4  0.00s   7560 {  7880|  8152|  8152}
   blocked:    7831 61.76s 18928635 {2555504|171854252|474410068}
 cpu affinity:       1 155714642248 {155714642248|155714642248|155714642248}
   [17]:       1 155714642248 {155714642248|155714642248|155714642248}
-- v6 --
 Runstates:
   running:   14829  3.27s 529388 {125904|78005724|78058084}
  runnable:   14771  0.02s   3850 {  2688|  3284|  8284}
        wake:   14765  0.02s   3849 {  2564|  4580|  7648}
     preempt:       6  0.00s   6173 {  5776|  6144|  7220}
   blocked:   14765 61.62s 10016113 {1631276|54992936|105690196}
      lost:       8  0.15s 43706178 {27887032|192748472|192748472}
 cpu affinity:       1 155967941512 {155967941512|155967941512|155967941512}
   [18]:       1 155967941512 {155967941512|155967941512|155967941512}
-- v7 --
 Runstates:
   running:   13794  3.95s 687707 {112144|78005032|78006184}
  runnable:   13711  0.02s   4189 {  2640|  5508|  8296}
        wake:   13704  0.02s   4188 {  2712|  6134|  8286}
     preempt:       7  0.00s   6698 {  6276|  6444|  7616}
   blocked:   13704 60.94s 10672548 {3400864|45799774|208927936}
      lost:      11  0.12s 26615672 {15316436|189551786|189551786}
 cpu affinity:       1 155951330258 {155951330258|155951330258|155951330258}
   [19]:       1 155951330258 {155951330258|155951330258|155951330258}
Emulate eip list
|-- Domain 1180 --|
 Runstates:
   blocked:    9017 64.58s 17189246 {58371792|68901156|73987826}
  partial run:    9186  0.33s  87113 { 59988|2910100|2920524}
  full run:     172  0.00s  31538 { 28088|104648|163872}
  partial contention:    9017  0.01s   3752 {  2756|  4812|  6498}
  concurrency_hazard:     171  0.00s   6860 {  7640|  7782|  9816}
  full_contention:       2  0.00s   2245 {  3988|  3988|  3988}
      lost:       2  0.11s 136710282 {242797332|242797332|242797332}
 Grant table ops:
  Done by:
  Done for:
 Populate-on-demand:
  Populated:
  Reclaim order:
  Reclaim contexts:
-- v0 --
 Runstates:
   running:    5372  0.15s  67146 { 83600|158544|2163236}
  runnable:    5370  0.01s   3964 {  2744|  6694|  8640}
        wake:    5370  0.01s   3964 {  2744|  6694|  8640}
   blocked:    3690 64.73s 42101089 {17431348|130111716|130125964}
   offline:    1680  0.02s  35377 { 23410| 66080|207230}
      lost:       1  0.13s 315064294 {315064294|315064294|315064294}
 cpu affinity:       7 22275362682 {255369668|5502011968|98289719790}
   [20]:       2 20738542357 {255369668|41221715046|41221715046}
   [21]:       2 51895865879 {5502011968|98289719790|98289719790}
   [23]:       2 2423342490 {2013410050|2833274930|2833274930}
   [25]:       1 5812037326 {5812037326|5812037326|5812037326}
Exit reasons:
 EXTERNAL_INTERRUPT         63  0.00s  0.00%  3881 cyc { 2296| 3512| 6596}
 PENDING_INTERRUPT         123  0.00s  0.00%   813 cyc {  500|  628| 1560}
 HLT                      3690 64.74s 99.61% 42104523 cyc {2499160|34214824|121164992}
 VMCALL                      2  0.00s  0.00%  8620 cyc { 8260| 8980| 8980}
 CR_ACCESS                 288  0.00s  0.00%  2563 cyc { 1432| 2052| 4912}
 IO_INSTRUCTION           1860  0.03s  0.04% 37544 cyc { 2860|29058|81866}
 APIC_ACCESS             14187  0.04s  0.06%  6331 cyc {  576| 7240|10152}
Guest interrupt counts:
  [233] 107
   * wake to halt alone:     105  0.00s  66455 { 24932| 86684|424460}
   * wake to halt any  :     105  0.00s  66455 { 24932| 86684|424460}
   * intr to halt      :       1  0.00s  67236 { 67236| 67236| 67236}
  [239] 3592
   * wake to halt alone:    3524  0.17s 115885 { 56044|413592|2198152}
   * wake to halt any  :    3525  0.17s 115929 { 40736|173772|2331020}
   * intr to halt      :       2  0.00s 146852 {156008|156008|156008}
  [253] 60
   * wake to halt alone:      60  0.00s  43128 { 36264| 42124| 85000}
   * wake to halt any  :      60  0.00s  43128 { 36264| 42124| 85000}
IO address summary:
    1f48:[r]      180  0.00s  0.00%  4131 cyc { 2564| 2852|10296}
    c106:[r]      240  0.01s  0.01% 87331 cyc {70956|77420|122298}
    c110:[r]      720  0.01s  0.02% 35785 cyc {25028|30962|48358}
    c112:[r]      720  0.01s  0.01% 31061 cyc {24672|28218|44364}
-- v1 --
 Runstates:
   running:    3819  0.19s 118125 { 42476|180452|2910100}
  runnable:    3816  0.01s   3597 {  2932|  3844|  8666}
        wake:    3816  0.01s   3597 {  2932|  3844|  8666}
   blocked:    3816 64.65s 40660914 {38171344|120936016|127315120}
      lost:       2  0.11s 136710282 {242797332|242797332|242797332}
 cpu affinity:       3 51956496564 {21611846842|41156198678|93101444172}
   [25]:       1 21611846842 {21611846842|21611846842|21611846842}
   [26]:       2 67128821425 {41156198678|93101444172|93101444172}
Exit reasons:
 EXTERNAL_INTERRUPT         99  0.00s  0.00%  3526 cyc { 2208| 2980| 5588}
 PENDING_INTERRUPT          24  0.00s  0.00%  1504 cyc { 1236| 1456| 1828}
 HLT                      3816 64.66s 99.48% 40664777 cyc {1191652|26431048|116702552}
 CR_ACCESS                 110  0.00s  0.00%  2498 cyc { 1308| 2720| 3368}
 IO_INSTRUCTION            180  0.00s  0.00%  5387 cyc { 2556| 2888|12264}
 APIC_ACCESS             13761  0.04s  0.05%  6124 cyc {  560| 7272|11096}
Guest interrupt counts:
  [239] 3849
   * wake to halt alone:    3755  0.18s 115330 { 61604|247488|2886612}
   * wake to halt any  :    3755  0.18s 115330 { 61604|247488|2886612}
   * intr to halt      :       3  0.00s  70698 { 76168| 81608| 81608}
  [253] 61
   * wake to halt alone:      61  0.00s  50477 { 41116| 65928|164200}
   * wake to halt any  :      61  0.00s  50477 { 41116| 65928|164200}
IO address summary:
    1f48:[r]      180  0.00s  0.00%  5387 cyc { 2556| 2888|12264}
Emulate eip list
|-- Domain 1181 --|
 Runstates:
   blocked:    1724  0.03s  45266 { 36288| 37336|973810}
  full run:    3630 64.95s 42940800 { 12580|78007380|78010988}
  full_contention:    1725  0.01s   6988 {  6466|  6426|  9034}
 Grant table ops:
  Done by:
  Done for:
 Populate-on-demand:
  Populated:
  Reclaim order:
  Reclaim contexts:
-- v0 --
 Runstates:
   running:    3630 64.95s 42940800 { 12580|78007380|78010988}
  runnable:    1725  0.01s   6988 {  6466|  6426|  9034}
        wake:    1724  0.00s   6877 {  6440|  6426| 11440}
     preempt:       1  0.00s 199004 {199004|199004|199004}
   offline:    1724  0.03s  45266 { 36288| 37336|973810}
 cpu affinity:      42 3710080146 {10008168|676205568|16749014786}
   [0]:       2 14287506081 {4162118484|24412893678|24412893678}
   [1]:       1 472551156 {472551156|472551156|472551156}
   [2]:       1 1171910018 {1171910018|1171910018|1171910018}
   [3]:       1 778083648 {778083648|778083648|778083648}
   [4]:       1 15609467972 {15609467972|15609467972|15609467972}
   [5]:       1 1039789254 {1039789254|1039789254|1039789254}
   [6]:       1 1253481808 {1253481808|1253481808|1253481808}
   [7]:       1 336153960 {336153960|336153960|336153960}
   [8]:       1 17346070 {17346070|17346070|17346070}
   [9]:       2 36335128 {17557622|55112634|55112634}
   [10]:       2 525126434 {5227828|1045025040|1045025040}
   [11]:       2 120008467 {107100820|132916114|132916114}
   [12]:       2 83293609 {64096084|102491134|102491134}
   [13]:       2 418829103 {351635064|486023142|486023142}
   [14]:       2 610802447 {390895920|830708974|830708974}
   [15]:       3 5816096805 {23070062|676205568|16749014786}
   [16]:       1 11445959882 {11445959882|11445959882|11445959882}
   [17]:       1 14465452332 {14465452332|14465452332|14465452332}
   [18]:       1 4298382090 {4298382090|4298382090|4298382090}
   [19]:       1 6987507728 {6987507728|6987507728|6987507728}
   [20]:       4 12090381 {1365262|18491750|18496346}
   [21]:       1 1337185452 {1337185452|1337185452|1337185452}
   [22]:       2 3901238984 {3217689986|4584787982|4584787982}
   [23]:       2 18204021734 {4752727806|31655315662|31655315662}
   [24]:       1 101815728 {101815728|101815728|101815728}
   [25]:       1 368131542 {368131542|368131542|368131542}
   [26]:       1 2249125620 {2249125620|2249125620|2249125620}
   [31]:       1 20045994 {20045994|20045994|20045994}
Exit reasons:
 EXCEPTION_NMI              42  0.00s  0.00%  2600 cyc { 1864| 2568| 3288}
 EXTERNAL_INTERRUPT     116256  0.25s  0.38%  5094 cyc { 2572| 5476| 7196}
 PENDING_INTERRUPT       56060  0.02s  0.03%   781 cyc {  444|  660| 1596}
 VMCALL                  21108  0.08s  0.12%  8875 cyc { 7004| 8988|10224}
 CR_ACCESS               83920  0.06s  0.10%  1816 cyc { 1052| 1796| 2572}
 IO_INSTRUCTION           2040  0.04s  0.06% 45258 cyc { 2828|42710|97458}
 APIC_ACCESS            127478  0.45s  0.69%  8436 cyc {  928| 8560|17208}
Guest interrupt counts:
  [233] 47630
  [239] 63739
IO address summary:
    1f48:[r]      360  0.00s  0.00%  4594 cyc { 2620| 3016| 8940}
    c106:[r]      240  0.01s  0.02% 106780 cyc {85880|95392|150086}
    c110:[r]      720  0.01s  0.02% 44193 cyc {30442|42994|57158}
    c112:[r]      720  0.01s  0.02% 46146 cyc {29686|42686|57578}
Emulate eip list
|-- Domain 1182 --|
 Runstates:
   blocked:    7646 64.64s 20289100 {33029324|110263872|110478156}
  full run:    7653  0.26s  82237 { 87196|259792|2811380}
  full_contention:    7646  0.01s   3825 {  2744|  3960|  8412}
      lost:       6  0.13s 52905084 {18232600|187133016|187133016}
 Grant table ops:
  Done by:
  Done for:
 Populate-on-demand:
  Populated:
  Reclaim order:
  Reclaim contexts:
-- v0 --
 Runstates:
   running:    7653  0.26s  82237 { 87196|259792|2811380}
  runnable:    7646  0.01s   3825 {  2744|  3960|  8412}
        wake:    7646  0.01s   3825 {  2744|  3960|  8412}
   blocked:    5966 64.61s 25990913 {2353388|70137476|110269604}
   offline:    1680  0.03s  40875 { 25678| 76422|1914774}
      lost:       6  0.13s 52905084 {18232600|187133016|187133016}
 cpu affinity:       3 51974850166 {4704305910|43378118012|107842126578}
   [21]:       2 75610122295 {43378118012|107842126578|107842126578}
   [25]:       1 4704305910 {4704305910|4704305910|4704305910}
Exit reasons:
 EXTERNAL_INTERRUPT        133  0.00s  0.00%  3987 cyc { 2380| 3804| 5956}
 PENDING_INTERRUPT         150  0.00s  0.00%   940 cyc {  512|  800| 1788}
 HLT                      5966 64.62s 99.42% 25994373 cyc {1040840|18829412|81025724}
   hlt     5966 64.62s 99.42% 25994373 cyc {1040840|18829412|81025724}
 VMCALL                      9  0.00s  0.00%  7643 cyc { 5772| 7860| 9204}
 CR_ACCESS                 436  0.00s  0.00%  2445 cyc { 1372| 2212| 4292}
 IO_INSTRUCTION           2037  0.03s  0.05% 39632 cyc { 2784|31434|87286}
 APIC_ACCESS             22982  0.06s  0.10%  6561 cyc {  584| 7644|10432}
Guest interrupt counts:
  [233] 121
   * wake to halt alone:     111  0.00s  74691 { 37940|211576|226024}
   * wake to halt any  :     113  0.00s  79587 { 30560|211576|561992}
   * intr to halt      :       6  0.00s  50538 { 59080| 99960| 99960}
  [239] 5983
   * wake to halt alone:    5847  0.28s 116185 { 49888|2643704|2978912}
   * wake to halt any  :    5853  0.28s 116385 { 53200|379504|2801440}
   * intr to halt      :       9  0.00s  88929 { 61744|258392|258392}
IO address summary:
    1f48:[r]      357  0.00s  0.00%  4250 cyc { 2656| 2916| 9784}
    c106:[r]      240  0.01s  0.02% 107632 cyc {71434|81878|136322}
    c110:[r]      720  0.01s  0.02% 39053 cyc {25630|41322|51548}
    c112:[r]      720  0.01s  0.02% 35088 cyc {25294|30066|47466}
Emulate eip list
|-- Domain 32767 --|
 Runstates:
  full run:     757  0.38s 1195903 {1752894|2799426|186297296}
  concurrency_hazard:  396026 64.69s 392017 {614812|3868596|11463644}
  full_contention:       2  0.00s  44100 { 74028| 74028| 74028}
 Grant table ops:
  Done by:
  Done for:
 Populate-on-demand:
  Populated:
  Reclaim order:
  Reclaim contexts:
-- v0 --
 Runstates:
   running:   65679 59.12s 2160190 {2574112|2257908|20786760}
  runnable:   65679  5.87s 214513 { 64620|34954396|277298568}
     preempt:   65679  5.87s 214513 { 64620|34954396|277298568}
 cpu affinity:       1 155968151288 {155968151288|155968151288|155968151288}
   [0]:       1 155968151288 {155968151288|155968151288|155968151288}
-- v1 --
 Runstates:
   running:   19735 61.69s 7502004 {1254548|46767032|241625856}
  runnable:   19734  3.24s 394044 { 86840|117630020|291035648}
     preempt:   19734  3.24s 394044 { 86840|117630020|291035648}
      lost:       1  0.08s 186307112 {186307112|186307112|186307112}
 cpu affinity:       1 155951775076 {155951775076|155951775076|155951775076}
   [1]:       1 155951775076 {155951775076|155951775076|155951775076}
-- v2 --
 Runstates:
   running:   10897 61.97s 13649544 {73442856|99895900|225106452}
  runnable:   10897  2.96s 652296 {103368|184338960|1006558460}
     preempt:   10897  2.96s 652296 {103368|184338960|1006558460}
 cpu affinity:       1 155927573456 {155927573456|155927573456|155927573456}
   [2]:       1 155927573456 {155927573456|155927573456|155927573456}
-- v3 --
 Runstates:
   running:   37384 62.01s 3980746 {4983208|20434728|71889632}
  runnable:   37384  2.97s 190658 { 47472|134258152|493849376}
     preempt:   37384  2.97s 190658 { 47472|134258152|493849376}
 cpu affinity:       1 155961188298 {155961188298|155961188298|155961188298}
   [3]:       1 155961188298 {155961188298|155961188298|155961188298}
-- v4 --
 Runstates:
   running:      10 45.80s 10993114403 {18101448224|66365039876|66365039876}
  runnable:       1  0.06s 132903008 {132903008|132903008|132903008}
     preempt:       1  0.06s 132903008 {132903008|132903008|132903008}
 cpu affinity:       1 116023303530 {116023303530|116023303530|116023303530}
   [4]:       1 116023303530 {116023303530|116023303530|116023303530}
-- v5 --
 Runstates:
   running:      10 45.82s 10996156796 {19274152736|66365041468|66365041468}
  runnable:       1  0.04s 102477492 {102477492|102477492|102477492}
     preempt:       1  0.04s 102477492 {102477492|102477492|102477492}
 cpu affinity:       1 114881023646 {114881023646|114881023646|114881023646}
   [5]:       1 114881023646 {114881023646|114881023646|114881023646}
-- v6 --
 Runstates:
   running:      18 45.71s 6095151897 {5509159496|66365038932|66365038932}
  runnable:       9  0.15s 39034524 {270744484|270744484|270744484}
     preempt:       9  0.15s 39034524 {270744484|270744484|270744484}
 cpu affinity:       1 113573036304 {113573036304|113573036304|113573036304}
   [6]:       1 113573036304 {113573036304|113573036304|113573036304}
-- v7 --
 Runstates:
   running:      24 45.51s 4551418092 {5812037720|66365042284|66365042284}
  runnable:      15  0.35s 55334184 {649579788|649579788|649579788}
     preempt:      15  0.35s 55334184 {649579788|649579788|649579788}
 cpu affinity:       1 112923023580 {112923023580|112923023580|112923023580}
   [7]:       1 112923023580 {112923023580|112923023580|112923023580}
-- v8 --
 Runstates:
   running:      81 45.38s 1344614114 {24724422900|66365041256|66365041256}
  runnable:      70  2.13s 72912679 {649610792|649620788|649621720}
     preempt:      70  2.13s 72912679 {649610792|649620788|649621720}
      lost:       1  0.34s 808652262 {808652262|808652262|808652262}
 cpu affinity:       1 155823443370 {155823443370|155823443370|155823443370}
   [8]:       1 155823443370 {155823443370|155823443370|155823443370}
-- v9 --
 Runstates:
   running:      45 44.60s 2378634897 {5509159372|66365041680|66365041680}
  runnable:      37  1.26s 81769641 {649575192|649599776|649599776}
     preempt:      37  1.26s 81769641 {649575192|649599776|649599776}
 cpu affinity:       1 150623395410 {150623395410|150623395410|150623395410}
   [9]:       1 150623395410 {150623395410|150623395410|150623395410}
-- v10 --
 Runstates:
   running:     228 37.38s 393478894 {2833274920|66365040476|66365040476}
  runnable:     219  8.48s 92926286 {649613840|649642096|649659580}
     preempt:     219  8.48s 92926286 {649613840|649642096|649659580}
 cpu affinity:       1 146073342494 {146073342494|146073342494|146073342494}
   [10]:       1 146073342494 {146073342494|146073342494|146073342494}
-- v11 --
 Runstates:
   running:      66 43.69s 1588876835 {18234360588|66365041344|66365041344}
  runnable:      58  2.17s 89623681 {649588232| 13344|649607624}
     preempt:      58  2.17s 89623681 {649588232| 13344|649607624}
 cpu affinity:       1 141523303848 {141523303848|141523303848|141523303848}
   [11]:       1 141523303848 {141523303848|141523303848|141523303848}
-- v12 --
 Runstates:
   running:      25 45.14s 4333551654 {18874801540|66365039468|66365039468}
  runnable:      16  0.72s 107828393 {595075176|649508752|649508752}
     preempt:      16  0.72s 107828393 {595075176|649508752|649508752}
 cpu affinity:       1 133755811648 {133755811648|133755811648|133755811648}
   [12]:       1 133755811648 {133755811648|133755811648|133755811648}
-- v13 --
 Runstates:
   running:     166 39.70s 573914006 {5812037788|44233152104|44233152104}
  runnable:     157  6.16s 94231338 {649603392|649634060|649634060}
     preempt:     157  6.16s 94231338 {649603392|649634060|649634060}
 cpu affinity:       1 113043790824 {113043790824|113043790824|113043790824}
   [13]:       1 113043790824 {113043790824|113043790824|113043790824}
-- v14 --
 Runstates:
   running:     178 39.30s 529937019 {22148619412|39525375020|39525375020}
  runnable:     170  6.56s 92560325 {649593460|649604768|649610604}
     preempt:     170  6.56s 92560325 {649593460|649604768|649610604}
 cpu affinity:       1 111623010338 {111623010338|111623010338|111623010338}
   [14]:       1 111623010338 {111623010338|111623010338|111623010338}
-- v15 --
 Runstates:
   running:     263 53.12s 484778658 {26415515864|31843172952|31843172952}
  runnable:     253  9.69s 91904971 {649589476|649613236|649625188}
     preempt:     253  9.69s 91904971 {649589476|649613236|649625188}
 cpu affinity:       1 79772692094 {79772692094|79772692094|79772692094}
   [15]:       1 79772692094 {79772692094|79772692094|79772692094}
-- v16 --
 Runstates:
   running:    9689 58.63s 14523726 {2565200|158330356|191257676}
  runnable:    9689  6.34s 1571378 {3384836|8446465304|8446465304}
     preempt:    9689  6.34s 1571378 {3384836|8446465304|8446465304}
 cpu affinity:       1 155961193960 {155961193960|155961193960|155961193960}
   [16]:       1 155961193960 {155961193960|155961193960|155961193960}
-- v17 --
 Runstates:
   running:    7837 61.77s 18915849 {21322828|193512080|381639652}
  runnable:    7837  3.10s 948898 {1947380|185422632|939337064}
     preempt:    7837  3.10s 948898 {1947380|185422632|939337064}
 cpu affinity:       1 155714646324 {155714646324|155714646324|155714646324}
   [17]:       1 155714646324 {155714646324|155714646324|155714646324}
-- v18 --
 Runstates:
   running:   14779 61.70s 10020374 {14480176|28631476|104916648}
  runnable:   14778  3.28s 532972 {100268|270761612|909756916}
     preempt:   14778  3.28s 532972 {100268|270761612|909756916}
 cpu affinity:       1 155967784940 {155967784940|155967784940|155967784940}
   [18]:       1 155967784940 {155967784940|155967784940|155967784940}
-- v19 --
 Runstates:
   running:   13724 61.01s 10668901 {28462324|46342312|191182612}
  runnable:   13724  3.96s 692489 { 93148|996266772|997988728}
     preempt:   13724  3.96s 692489 { 93148|996266772|997988728}
 cpu affinity:       1 155951334090 {155951334090|155951334090|155951334090}
   [19]:       1 155951334090 {155951334090|155951334090|155951334090}
-- v20 --
 Runstates:
   running:    1568 62.28s 95320924 {60824556|26415519484|31731349152}
  runnable:    1560  0.73s 1123558 {524368|561261284|561261284}
     preempt:    1560  0.73s 1123558 {524368|561261284|561261284}
 cpu affinity:       1 100572901642 {100572901642|100572901642|100572901642}
   [20]:       1 100572901642 {100572901642|100572901642|100572901642}
-- v21 --
 Runstates:
   running:    5283 62.41s 28351493 { 73288|130128632|26415520004}
  runnable:    5279  0.60s 271901 { 62788|649603284|649603284}
     preempt:    5279  0.60s 271901 { 62788|649603284|649603284}
 cpu affinity:       1 150425403594 {150425403594|150425403594|150425403594}
   [21]:       1 150425403594 {150425403594|150425403594|150425403594}
-- v22 --
 Runstates:
   running:     802 47.75s 142880468 {70157632|66365039684|66365039684}
  runnable:     794  0.07s 224451 {100020|64082844|64082844}
     preempt:     794  0.07s 224451 {100020|64082844|64082844}
 cpu affinity:       1 155924485000 {155924485000|155924485000|155924485000}
   [22]:       1 155924485000 {155924485000|155924485000|155924485000}
-- v23 --
 Runstates:
   running:    3474 45.57s 31479484 {117764356|130127932|2833279416}
  runnable:    3470  0.29s 202972 { 68468|236927996|236927996}
     preempt:    3470  0.29s 202972 { 68468|236927996|236927996}
 cpu affinity:       1 147592131500 {147592131500|147592131500|147592131500}
   [23]:       1 147592131500 {147592131500|147592131500|147592131500}
-- v24 --
 Runstates:
   running:     347 32.68s 226010268 {26415517212|34633701660|34633701660}
  runnable:     338 13.18s 93604983 {649576932|649612568|649622404}
     preempt:     338 13.18s 93604983 {649576932|649612568|649622404}
 cpu affinity:       1 72622614718 {72622614718|72622614718|72622614718}
   [24]:       1 72622614718 {72622614718|72622614718|72622614718}
-- v25 --
 Runstates:
   running:    5126 47.58s 22278954 {44052332|120711836|121687408}
  runnable:    5122 10.40s 4871833 {649600276|649682060|649682060}
     preempt:    5122 10.40s 4871833 {649600276|649682060|649682060}
 cpu affinity:       1 155927374646 {155927374646|155927374646|155927374646}
   [25]:       1 155927374646 {155927374646|155927374646|155927374646}
-- v26 --
 Runstates:
   running:     958 62.36s 156230322 {63844116|66365041836|66365041836}
  runnable:     950  0.61s 1528808 {170288|649596208|649596208}
     preempt:     950  0.61s 1528808 {170288|649596208|649596208}
 cpu affinity:       1 148673374294 {148673374294|148673374294|148673374294}
   [26]:       1 148673374294 {148673374294|148673374294|148673374294}
-- v27 --
 Runstates:
   running:       9 45.86s 12229338390 {26415514912|66365041488|66365041488}
-- v28 --
 Runstates:
   running:       9 45.86s 12229338378 {26415514272|66365042444|66365042444}
-- v29 --
 Runstates:
   running:       9 45.86s 12229338268 {26415515848|66365042740|66365042740}
-- v30 --
 Runstates:
   running:       9 45.86s 12229338084 {26415517468|66365039588|66365039588}
-- v31 --
 Runstates:
   running:      45 44.52s 2374401925 {26415515012|66365042960|66365042960}
  runnable:      36  1.34s 89332174 {649548756|649599452|649599452}
     preempt:      36  1.34s 89332174 {649548756|649599452|649599452}
 cpu affinity:       1 136973253314 {136973253314|136973253314|136973253314}
   [31]:       1 136973253314 {136973253314|136973253314|136973253314}
Emulate eip list

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* 答复:  答复: 答复: about xenalyze
  2015-05-11 10:04         ` George Dunlap
  2015-05-12  2:18           ` 答复: " 蒋雄伟(蒋冲)
@ 2015-05-12  6:29           ` 蒋雄伟(蒋冲)
  2015-05-12 10:20             ` Dario Faggioli
  1 sibling, 1 reply; 11+ messages in thread
From: 蒋雄伟(蒋冲) @ 2015-05-12  6:29 UTC (permalink / raw)
  To: 'George Dunlap'; +Cc: xen-devel, xen-devel


[-- Attachment #1.1.1: Type: text/plain, Size: 1137 bytes --]



 

Each number means what ?

 



Each number means what ? 

 

-----邮件原件-----
发件人: dunlapg@gmail.com [mailto:dunlapg@gmail.com] 代表 George Dunlap
发送时间: 2015年5月11日 18:05
收件人: 蒋雄伟(蒋冲)
抄送: xen-devel@lists.xensource.com; xen-devel@lists.xen.org
主题: Re: [Xen-devel] 答复: 答复: about xenalyze

 

On Fri, May 8, 2015 at 3:41 AM, 蒋雄伟(蒋冲) < <mailto:xiongwei.jiang@alibaba-inc.com> xiongwei.jiang@alibaba-inc.com> wrote:

> $xenalyze --summary trace_file_discuz.bin

 

[snip]

 

> This is the full output.

 

Don't top-post please.

 

I probably should have said "attach the full output", rather than including it inline.

 

So actually -- it looks like you've set the trace to only collect HVM-related tracing information ("-e 0x8f000" from your command-line below); but to get the output that you want (with the per-domain and per-vcpu summaries), it also needs the scheduling traces, so that it knows which vcpu is running where.

 

Can you try this again with "-e 0xaf000" and see what you get?

 

-George


[-- Attachment #1.1.2: Type: text/html, Size: 6604 bytes --]

[-- Attachment #1.2: image001.png --]
[-- Type: image/png, Size: 9974 bytes --]

[-- Attachment #1.3: image002.png --]
[-- Type: image/png, Size: 10758 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 答复: 答复: 答复: about xenalyze
  2015-05-12  2:18           ` 答复: " 蒋雄伟(蒋冲)
@ 2015-05-12  9:31             ` George Dunlap
  2015-05-12 10:37               ` Lars Kurth
  2015-05-13  4:00               ` 答复: 答复: 答复: 答复: " 蒋雄伟(蒋冲)
  0 siblings, 2 replies; 11+ messages in thread
From: George Dunlap @ 2015-05-12  9:31 UTC (permalink / raw)
  To: 蒋雄伟(蒋冲); +Cc: xen-devel, xen-devel

On Tue, May 12, 2015 at 3:18 AM, 蒋雄伟(蒋冲) <xiongwei.jiang@alibaba-inc.com> wrote:
> I try again with "-e 0xaf000", and run xenalyze --summary. The attached is the output.

Again, please don't top-post: configure your mailer to quote properly,
and reply in-line (as I am doing now).

So it looks like now it works. :-)

You can find a bit about what the output is from the xenalyze.html
wiki inside the repo.  In particular, look for "Quickstart - Generate
a summary".

 -George


>
> -----邮件原件-----
> 发件人: dunlapg@gmail.com [mailto:dunlapg@gmail.com] 代表 George Dunlap
> 发送时间: 2015年5月11日 18:05
> 收件人: 蒋雄伟(蒋冲)
> 抄送: xen-devel@lists.xensource.com; xen-devel@lists.xen.org
> 主题: Re: [Xen-devel] 答复: 答复: about xenalyze
>
> On Fri, May 8, 2015 at 3:41 AM, 蒋雄伟(蒋冲) <xiongwei.jiang@alibaba-inc.com> wrote:
>> $xenalyze --summary trace_file_discuz.bin
>
> [snip]
>
>> This is the full output.
>
> Don't top-post please.
>
> I probably should have said "attach the full output", rather than including it inline.
>
> So actually -- it looks like you've set the trace to only collect HVM-related tracing information ("-e 0x8f000" from your command-line below); but to get the output that you want (with the per-domain and per-vcpu summaries), it also needs the scheduling traces, so that it knows which vcpu is running where.
>
> Can you try this again with "-e 0xaf000" and see what you get?
>
>  -George
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel
>

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: 答复:  答复: 答复:  about xenalyze
  2015-05-12  6:29           ` 蒋雄伟(蒋冲)
@ 2015-05-12 10:20             ` Dario Faggioli
  0 siblings, 0 replies; 11+ messages in thread
From: Dario Faggioli @ 2015-05-12 10:20 UTC (permalink / raw)
  To: 蒋雄伟(蒋冲)
  Cc: 'George Dunlap', xen-devel, xen-devel


[-- Attachment #1.1: Type: text/plain, Size: 434 bytes --]

On Tue, 2015-05-12 at 14:29 +0800, 蒋雄伟(蒋冲) wrote:
> 
>  
Again, don't top-post, reply inline, don't use HTML emails and (and
that's new) avoid posting images on the mailing list, please.

> Each number means what ?
>
Have you looked at the xenalyze.html file, as George said in his last
email (and as I said myself at least 3 times?)

Look for the section "Quickstart - Generate a summary".

Regards,
Dario


[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: about xenalyze
  2015-05-12  9:31             ` George Dunlap
@ 2015-05-12 10:37               ` Lars Kurth
  2015-05-12 11:43                 ` Dario Faggioli
  2015-05-13  4:00               ` 答复: 答复: 答复: 答复: " 蒋雄伟(蒋冲)
  1 sibling, 1 reply; 11+ messages in thread
From: Lars Kurth @ 2015-05-12 10:37 UTC (permalink / raw)
  To: George Dunlap
  Cc: "蒋雄伟(蒋冲)", xen-devel

George,

given that this question is coming up  occasionally, I was going to create a wiki page. I can't find xenalyze.html and xenalyse on xenbuts though

I can find
* https://github.com/nikmis/xentrace-analysis - but that does not contain the html file and is probably a different tool
* https://blog.xenproject.org/2012/09/27/tracing-with-xentrace-and-xenalyze/ - but the link to the repos - aka  http://xenbits.xensource.com/ext/xenalyze.hg - are broken 
* https://github.com/PennPanda/xen-analyze - not sure whether this is the master repo

Could you send me a few pointers?

I you could point me to the right locations, I will  put together a wiki page

Lars

> On 12 May 2015, at 10:31, George Dunlap <george.dunlap@eu.citrix.com> wrote:
> 
> On Tue, May 12, 2015 at 3:18 AM, 蒋雄伟(蒋冲) <xiongwei.jiang@alibaba-inc.com> wrote:
>> I try again with "-e 0xaf000", and run xenalyze --summary. The attached is the output.
> 
> Again, please don't top-post: configure your mailer to quote properly,
> and reply in-line (as I am doing now).
> 
> So it looks like now it works. :-)
> 
> You can find a bit about what the output is from the xenalyze.html
> wiki inside the repo.  In particular, look for "Quickstart - Generate
> a summary".
> 
> -George


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: about xenalyze
  2015-05-12 10:37               ` Lars Kurth
@ 2015-05-12 11:43                 ` Dario Faggioli
  0 siblings, 0 replies; 11+ messages in thread
From: Dario Faggioli @ 2015-05-12 11:43 UTC (permalink / raw)
  To: Lars Kurth
  Cc: George Dunlap,
	"蒋雄伟(蒋冲)",
	xen-devel


[-- Attachment #1.1: Type: text/plain, Size: 900 bytes --]

On Tue, 2015-05-12 at 11:37 +0100, Lars Kurth wrote:
> George,
> 
> given that this question is coming up  occasionally, I was going to create a wiki page. I can't find xenalyze.html and xenalyse on xenbuts though
> 
> I can find
> * https://github.com/nikmis/xentrace-analysis - but that does not contain the html file and is probably a different tool
> * https://blog.xenproject.org/2012/09/27/tracing-with-xentrace-and-xenalyze/ - but the link to the repos - aka  http://xenbits.xensource.com/ext/xenalyze.hg - are broken 
> * https://github.com/PennPanda/xen-analyze - not sure whether this is the master repo
> 
> Could you send me a few pointers?
> 
It's this file:
http://xenbits.xensource.com/ext/xenalyze/file/24308507be1d/xenalyze.html

You have to download the repo and open the said file in a browser. It's
some kind of self-contained javascript wiki.

Regards,
Dario

[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

* 答复:  答复: 答复: 答复: about xenalyze
  2015-05-12  9:31             ` George Dunlap
  2015-05-12 10:37               ` Lars Kurth
@ 2015-05-13  4:00               ` 蒋雄伟(蒋冲)
  1 sibling, 0 replies; 11+ messages in thread
From: 蒋雄伟(蒋冲) @ 2015-05-13  4:00 UTC (permalink / raw)
  To: 'George Dunlap'; +Cc: xen-devel, xen-devel


[-- Attachment #1.1.1: Type: text/plain, Size: 2935 bytes --]

Sorry, it seems that my mailer doesn't have this function. 

 

My question is :

 

1、how is the blocked time of a domain computed? And how is the blocked time of a vcpu computed ?

 

2、In Runstates, there are many terms , such as partial run, full run, partial contention, concurrency_hazard, full contention, wake, preempt,lost。 What do they mean?

 

3、in log volume summary, why are there so many hvms ? in fact there are only three hvm guest and one domain0 in this machine. Also, the terms such as gen, sched, verbose, hvm, handler means what ?



 

-----邮件原件-----
发件人: dunlapg@gmail.com [mailto:dunlapg@gmail.com] 代表 George Dunlap
发送时间: 2015年5月12日 17:31
收件人: 蒋雄伟(蒋冲)
抄送: xen-devel@lists.xensource.com; xen-devel@lists.xen.org
主题: Re: [Xen-devel] 答复: 答复: 答复: about xenalyze

 

On Tue, May 12, 2015 at 3:18 AM, 蒋雄伟(蒋冲) < <mailto:xiongwei.jiang@alibaba-inc.com> xiongwei.jiang@alibaba-inc.com> wrote:

> I try again with "-e 0xaf000", and run xenalyze --summary. The attached is the output.

 

Again, please don't top-post: configure your mailer to quote properly, and reply in-line (as I am doing now).

 

So it looks like now it works. :-)

 

You can find a bit about what the output is from the xenalyze.html wiki inside the repo.  In particular, look for "Quickstart - Generate a summary".

 

-George

 

 

> 

> -----邮件原件-----

> 发件人:  <mailto:dunlapg@gmail.com> dunlapg@gmail.com [ <mailto:dunlapg@gmail.com> mailto:dunlapg@gmail.com] 代表 George Dunlap

> 发送时间: 2015年5月11日 18:05

> 收件人: 蒋雄伟(蒋冲)

> 抄送:  <mailto:xen-devel@lists.xensource.com> xen-devel@lists.xensource.com;  <mailto:xen-devel@lists.xen.org> xen-devel@lists.xen.org

> 主题: Re: [Xen-devel] 答复: 答复: about xenalyze

> 

> On Fri, May 8, 2015 at 3:41 AM, 蒋雄伟(蒋冲) < <mailto:xiongwei.jiang@alibaba-inc.com> xiongwei.jiang@alibaba-inc.com> wrote:

>> $xenalyze --summary trace_file_discuz.bin

> 

> [snip]

> 

>> This is the full output.

> 

> Don't top-post please.

> 

> I probably should have said "attach the full output", rather than including it inline.

> 

> So actually -- it looks like you've set the trace to only collect HVM-related tracing information ("-e 0x8f000" from your command-line below); but to get the output that you want (with the per-domain and per-vcpu summaries), it also needs the scheduling traces, so that it knows which vcpu is running where.

> 

> Can you try this again with "-e 0xaf000" and see what you get?

> 

>  -George

> 

> _______________________________________________

> Xen-devel mailing list

>  <mailto:Xen-devel@lists.xen.org> Xen-devel@lists.xen.org

>  <http://lists.xen.org/xen-devel> http://lists.xen.org/xen-devel

> 


[-- Attachment #1.1.2: Type: text/html, Size: 12144 bytes --]

[-- Attachment #1.2: image001.png --]
[-- Type: image/png, Size: 7236 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 11+ messages in thread

end of thread, other threads:[~2015-05-13  4:00 UTC | newest]

Thread overview: 11+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <014b01d0871d$3ef55050$bcdff0f0$@alibaba-inc.com>
     [not found] ` <5549EE3F.90206@eu.citrix.com>
2015-05-07  3:30   ` 答复: about xenalyze 蒋雄伟(蒋冲)
2015-05-07 17:57     ` George Dunlap
2015-05-08  2:41       ` 答复: " 蒋雄伟(蒋冲)
2015-05-11 10:04         ` George Dunlap
2015-05-12  2:18           ` 答复: " 蒋雄伟(蒋冲)
2015-05-12  9:31             ` George Dunlap
2015-05-12 10:37               ` Lars Kurth
2015-05-12 11:43                 ` Dario Faggioli
2015-05-13  4:00               ` 答复: 答复: 答复: 答复: " 蒋雄伟(蒋冲)
2015-05-12  6:29           ` 蒋雄伟(蒋冲)
2015-05-12 10:20             ` Dario Faggioli

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.