From mboxrd@z Thu Jan 1 00:00:00 1970 From: Valentine Sinitsyn Subject: Re: Nested paging in nested SVM setup Date: Tue, 02 Sep 2014 01:21:36 +0600 Message-ID: <5404C740.4010602@gmail.com> References: <53A179C4.9060203@gmail.com> <53A18A6D.2050407@siemens.com> <53F44440.6070408@gmail.com> <53F44645.2000708@redhat.com> <53F45036.1070309@gmail.com> <53F45832.5080708@redhat.com> <53F59192.3070500@gmail.com> <53F5B250.3000206@gmail.com> <53F5D709.3060207@redhat.com> <53F5E5FF.90604@gmail.com> <5404AFB2.3090000@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=koi8-r; format=flowed Content-Transfer-Encoding: 7bit To: Paolo Bonzini , Jan Kiszka , kvm@vger.kernel.org Return-path: Received: from mail-la0-f44.google.com ([209.85.215.44]:46151 "EHLO mail-la0-f44.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752233AbaIATVl (ORCPT ); Mon, 1 Sep 2014 15:21:41 -0400 Received: by mail-la0-f44.google.com with SMTP id hz20so6702869lab.3 for ; Mon, 01 Sep 2014 12:21:40 -0700 (PDT) In-Reply-To: <5404AFB2.3090000@redhat.com> Sender: kvm-owner@vger.kernel.org List-ID: Hi Paolo, On 01.09.2014 23:41, Paolo Bonzini wrote: > Il 21/08/2014 14:28, Valentine Sinitsyn ha scritto: > BTW npt_rsvd does *not* fail on the machine I've been testing on today. I can confirm l1mmio test doesn't fail in kvm-unit-test's master anymore. npt_rsvd still does. I also needed to disable ioio test, or it was hanging for a long time (this doesn't happen if I use Jan's patched KVM that have IOPM bugs fixed). However, l1mmio test passes regardless I use stock kvm 3.16.1 or a patched version. > Can you retry running the tests with the latest kvm-unit-tests (branch > "master"), gather a trace of kvm and kvmmmu events, and send the > compressed trace.dat my way? You mean the trace when the problem reveal itself (not from running tests), I assume? It's around 2G uncompressed (probably I'm enabling tracing to early or doing anything else wrong). Will look into it tomorrow, hopefully, I can reduce the size (e.g. by switching to uniprocessor mode). Below is a trace snippet similar to the one I've sent earlier. ---------------------------------------------------------------------- qemu-system-x86-2728 [002] 1726.426225: kvm_exit: reason npf rip 0xffffffff8104e876 info 10000000f fee000b0 qemu-system-x86-2728 [002] 1726.426226: kvm_nested_vmexit: rip: 0xffffffff8104e876 reason: npf ext_inf1: 0x000000010000000f ext_inf2: 0x00000000fee000b0 ext_int: 0x00000000 ext_int_err: 0x00000000 qemu-system-x86-2728 [002] 1726.426227: kvm_page_fault: address fee000b0 error_code f qemu-system-x86-2725 [000] 1726.426227: kvm_exit: reason npf rip 0xffffffff8104e876 info 10000000f fee000b0 qemu-system-x86-2725 [000] 1726.426228: kvm_nested_vmexit: rip: 0xffffffff8104e876 reason: npf ext_inf1: 0x000000010000000f ext_inf2: 0x00000000fee000b0 ext_int: 0x00000000 ext_int_err: 0x00000000 qemu-system-x86-2725 [000] 1726.426229: kvm_page_fault: address fee000b0 error_code f qemu-system-x86-2728 [002] 1726.426229: kvm_emulate_insn: 0:ffffffff8104e876:89 b7 00 b0 5f ff (prot64) qemu-system-x86-2725 [000] 1726.426230: kvm_emulate_insn: 0:ffffffff8104e876:89 b7 00 b0 5f ff (prot64) qemu-system-x86-2728 [002] 1726.426231: kvm_mmu_pagetable_walk: addr ffffffffff5fb0b0 pferr 2 W qemu-system-x86-2725 [000] 1726.426231: kvm_mmu_pagetable_walk: addr ffffffffff5fb0b0 pferr 2 W qemu-system-x86-2728 [002] 1726.426231: kvm_mmu_pagetable_walk: addr 1811000 pferr 6 W|U qemu-system-x86-2725 [000] 1726.426232: kvm_mmu_pagetable_walk: addr 36c49000 pferr 6 W|U qemu-system-x86-2728 [002] 1726.426232: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2725 [000] 1726.426232: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2728 [002] 1726.426232: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2725 [000] 1726.426233: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2728 [002] 1726.426233: kvm_mmu_paging_element: pte 18000e7 level 2 qemu-system-x86-2725 [000] 1726.426233: kvm_mmu_paging_element: pte 36c000e7 level 2 qemu-system-x86-2728 [002] 1726.426233: kvm_mmu_paging_element: pte 1814067 level 4 qemu-system-x86-2725 [000] 1726.426233: kvm_mmu_paging_element: pte 1814067 level 4 qemu-system-x86-2728 [002] 1726.426233: kvm_mmu_pagetable_walk: addr 1814000 pferr 6 W|U qemu-system-x86-2725 [000] 1726.426234: kvm_mmu_pagetable_walk: addr 1814000 pferr 6 W|U qemu-system-x86-2728 [002] 1726.426234: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2725 [000] 1726.426234: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2728 [002] 1726.426234: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2725 [000] 1726.426235: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2728 [002] 1726.426235: kvm_mmu_paging_element: pte 18000e7 level 2 qemu-system-x86-2725 [000] 1726.426235: kvm_mmu_paging_element: pte 18000e7 level 2 qemu-system-x86-2728 [002] 1726.426235: kvm_mmu_paging_element: pte 1816067 level 3 qemu-system-x86-2725 [000] 1726.426235: kvm_mmu_paging_element: pte 1816067 level 3 qemu-system-x86-2728 [002] 1726.426235: kvm_mmu_pagetable_walk: addr 1816000 pferr 6 W|U qemu-system-x86-2725 [000] 1726.426236: kvm_mmu_pagetable_walk: addr 1816000 pferr 6 W|U qemu-system-x86-2728 [002] 1726.426236: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2725 [000] 1726.426236: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2728 [002] 1726.426236: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2725 [000] 1726.426236: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2728 [002] 1726.426236: kvm_mmu_paging_element: pte 18000e7 level 2 qemu-system-x86-2725 [000] 1726.426237: kvm_mmu_paging_element: pte 18000e7 level 2 qemu-system-x86-2728 [002] 1726.426237: kvm_mmu_paging_element: pte 1a06067 level 2 qemu-system-x86-2725 [000] 1726.426237: kvm_mmu_paging_element: pte 1a06067 level 2 qemu-system-x86-2725 [000] 1726.426238: kvm_mmu_pagetable_walk: addr 1a06000 pferr 6 W|U qemu-system-x86-2728 [002] 1726.426238: kvm_mmu_pagetable_walk: addr 1a06000 pferr 6 W|U qemu-system-x86-2725 [000] 1726.426238: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2728 [002] 1726.426238: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2725 [000] 1726.426238: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2725 [000] 1726.426239: kvm_mmu_paging_element: pte 1a000e7 level 2 qemu-system-x86-2728 [002] 1726.426239: kvm_mmu_paging_element: pte 3c03d027 level 3 qemu-system-x86-2725 [000] 1726.426239: kvm_mmu_paging_element: pte 80000000fee0017b level 1 qemu-system-x86-2728 [002] 1726.426239: kvm_mmu_paging_element: pte 1a000e7 level 2 qemu-system-x86-2725 [000] 1726.426239: kvm_mmu_pagetable_walk: addr fee00000 pferr 6 W|U qemu-system-x86-2728 [002] 1726.426239: kvm_mmu_paging_element: pte 80000000fee0017b level 1 qemu-system-x86-2725 [000] 1726.426240: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2728 [002] 1726.426240: kvm_mmu_pagetable_walk: addr fee00000 pferr 6 W|U qemu-system-x86-2725 [000] 1726.426240: kvm_mmu_paging_element: pte 3c03b027 level 3 qemu-system-x86-2728 [002] 1726.426240: kvm_mmu_paging_element: pte 3c03a027 level 4 qemu-system-x86-2725 [000] 1726.426240: kvm_mmu_paging_element: pte 3c03c027 level 2 qemu-system-x86-2728 [002] 1726.426241: kvm_mmu_paging_element: pte 3c03b027 level 3 qemu-system-x86-2725 [000] 1726.426241: kvm_mmu_paging_element: pte fee0003d level 1 qemu-system-x86-2728 [002] 1726.426241: kvm_mmu_paging_element: pte 3c03c027 level 2 qemu-system-x86-2725 [000] 1726.426241: kvm_mmu_walker_error: pferr 7 P|W|U qemu-system-x86-2728 [002] 1726.426241: kvm_mmu_paging_element: pte fee0003d level 1 qemu-system-x86-2725 [000] 1726.426241: kvm_mmu_walker_error: pferr 2 W qemu-system-x86-2728 [002] 1726.426242: kvm_mmu_walker_error: pferr 7 P|W|U qemu-system-x86-2728 [002] 1726.426242: kvm_mmu_walker_error: pferr 2 W qemu-system-x86-2725 [000] 1726.426243: kvm_inj_exception: e (0x2) qemu-system-x86-2728 [002] 1726.426243: kvm_inj_exception: e (0x2) qemu-system-x86-2725 [000] 1726.426244: kvm_entry: vcpu 0 Thanks, Valentine