* [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up.
@ 2014-08-12 7:35 bugzilla-daemon
2014-08-12 7:36 ` [Bug 82211] " bugzilla-daemon
` (15 more replies)
0 siblings, 16 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-08-12 7:35 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Bug ID: 82211
Summary: [Nested xen on kvm] L1 guest panic and reboot when L1
guest boot up.
Product: Virtualization
Version: unspecified
Kernel Version: 3.16.0
Hardware: All
OS: Linux
Tree: Mainline
Status: NEW
Severity: normal
Priority: P1
Component: kvm
Assignee: virtualization_kvm@kernel-bugs.osdl.org
Reporter: chao.zhou@intel.com
Regression: No
Environment:
------------
Host OS (ia32/ia32e/IA64):ia32e
Guest OS (ia32/ia32e/IA64):ia32e
Guest OS Type (Linux/Windows):Linux
kvm.git Commit:c77dcacb397519b6ade8f08201a4a90a7f4f751e
qemu.git Commit:2d591ce2aeebf9620ff527c7946844a3122afeec
Host Kernel Version:3.16.0
Hardware:Romley_EP, Haswell_EP, Ivytown_EP
Bug detailed description:
--------------------------
L1(xen on kvm) guest panic then reboot continuously when boot up L1 guest.
note:
this is a kernel bug:
kvm.git + qemu.git = result
c77dcacb + 2d591ce2 = bad
9f6226a7 + 2d591ce2 = good
Reproduce steps:
----------------
1. create guest
qemu-system-x86_64 -enable-kvm -m 4G -smp 2 -net nic,macaddr=00:13:13:51:51:15
-net tap,script=/etc/kvm/qemu-ifup nested-xen.qcow -cpu host
Current result:
----------------
L1 guest panic then reboot continuously
Expected result:
----------------
L1 guest boot up correctly
Basic root-causing log:
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up.
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
@ 2014-08-12 7:36 ` bugzilla-daemon
2014-08-12 7:40 ` bugzilla-daemon
` (14 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-08-12 7:36 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #1 from Zhou, Chao <chao.zhou@intel.com> ---
the first bad commit is:
commit 6addfc42992be4b073c39137ecfdf4b2aa2d487f
Author: Paolo Bonzini <pbonzini@redhat.com>
Date: Thu Mar 27 11:29:28 2014 +0100
KVM: x86: avoid useless set of KVM_REQ_EVENT after emulation
Despite the provisions to emulate up to 130 consecutive instructions, in
practice KVM will emulate just one before exiting
handle_invalid_guest_state
because x86_emulate_instruction always sets KVM_REQ_EVENT.
However, we only need to do this if an interrupt could be injected,
which happens a) if an interrupt shadow bit (STI or MOV SS) has gone
away; b) if the interrupt flag has just been set (other instructions
than STI can set it without enabling an interrupt shadow).
This cuts another 700-900 cycles from the cost of emulating an
instruction (measured on a Sandy Bridge Xeon: 1650-2600 cycles
before the patch on kvm-unit-tests, 925-1700 afterwards).
Signed-off-by: Paolo Bonzini <pbonzini@redhat.com>
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up.
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
2014-08-12 7:36 ` [Bug 82211] " bugzilla-daemon
@ 2014-08-12 7:40 ` bugzilla-daemon
2014-08-21 17:56 ` [Bug 82211] [BISECTED][Nested " bugzilla-daemon
` (13 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-08-12 7:40 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #2 from Zhou, Chao <chao.zhou@intel.com> ---
Created attachment 146291
--> https://bugzilla.kernel.org/attachment.cgi?id=146291&action=edit
L1 serial log
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] [BISECTED][Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up.
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
2014-08-12 7:36 ` [Bug 82211] " bugzilla-daemon
2014-08-12 7:40 ` bugzilla-daemon
@ 2014-08-21 17:56 ` bugzilla-daemon
2014-09-01 12:46 ` bugzilla-daemon
` (12 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-08-21 17:56 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Alan <alan@lxorguk.ukuu.org.uk> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |alan@lxorguk.ukuu.org.uk
Regression|No |Yes
Summary|[Nested xen on kvm] L1 |[BISECTED][Nested xen on
|guest panic and reboot when |kvm] L1 guest panic and
|L1 guest boot up. |reboot when L1 guest boot
| |up.
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] [BISECTED][Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up.
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (2 preceding siblings ...)
2014-08-21 17:56 ` [Bug 82211] [BISECTED][Nested " bugzilla-daemon
@ 2014-09-01 12:46 ` bugzilla-daemon
2014-09-01 13:09 ` [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled bugzilla-daemon
` (11 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-01 12:46 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Paolo Bonzini <bonzini@gnu.org> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |bonzini@gnu.org
--- Comment #3 from Paolo Bonzini <bonzini@gnu.org> ---
Reproduced. This is caused by "-cpu host" and, in particular by x2apic. This
command line fails:
/usr/libexec/qemu-kvm \
-kernel xen-4.4.0 \
-append 'noreboot loglvl=all com1=115200,8n1 console=com1' \
-serial mon:stdio \
-initrd /boot/vmlinuz-2.6.18-348.el5xen -cpu kvm64,+x2apic
It works with "-cpu kvm64".
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (3 preceding siblings ...)
2014-09-01 12:46 ` bugzilla-daemon
@ 2014-09-01 13:09 ` bugzilla-daemon
2014-09-01 13:19 ` bugzilla-daemon
` (10 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-01 13:09 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Paolo Bonzini <bonzini@gnu.org> changed:
What |Removed |Added
----------------------------------------------------------------------------
Summary|[BISECTED][Nested xen on |Cannot boot Xen under KVM
|kvm] L1 guest panic and |with X2APIC enabled
|reboot when L1 guest boot |
|up. |
--- Comment #4 from Paolo Bonzini <bonzini@gnu.org> ---
... but couldn't reproduce the bisection results. It fails for me in all three
of 3.16, 3.17 and RHEL6.
Maybe the bisection result is specific to a particular KVM module parameter,
for example enable_apicv=1?
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (4 preceding siblings ...)
2014-09-01 13:09 ` [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled bugzilla-daemon
@ 2014-09-01 13:19 ` bugzilla-daemon
2014-09-02 4:50 ` bugzilla-daemon
` (9 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-01 13:19 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Paolo Bonzini <bonzini@gnu.org> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |NEEDINFO
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (5 preceding siblings ...)
2014-09-01 13:19 ` bugzilla-daemon
@ 2014-09-02 4:50 ` bugzilla-daemon
2014-09-02 6:31 ` bugzilla-daemon
` (8 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-02 4:50 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #5 from Zhou, Chao <chao.zhou@intel.com> ---
kvm.git+ qemu.git:fd275235_8b303011
kernel version:3.17.0-rc1
test on Ivytown_EP
qemu-system-x86_64 -enable-kvm -m 4G -smp 2 -net nic,macaddr=00:13:13:51:51:15
-net tap,script=/etc/kvm/qemu-ifup nested-xen.qcow -cpu kvm64
the L1 guest panic and reboot, the bug can reproduce.
when I try enable_apicv=1 or enalbe_apicv=0
create guest
qemu-system-x86_64 -enable-kvm -m 4G -smp 2 -net nic,macaddr=00:13:13:51:51:15
-net tap,script=/etc/kvm/qemu-ifup nested-xen.qcow -cpu kvm64
or
qemu-system-x86_64 -enable-kvm -m 4G -smp 2 -net nic,macaddr=00:13:13:51:51:15
-net tap,script=/etc/kvm/qemu-ifup nested-xen.qcow -cpu host
the bug can reproduce.
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (6 preceding siblings ...)
2014-09-02 4:50 ` bugzilla-daemon
@ 2014-09-02 6:31 ` bugzilla-daemon
2014-09-03 1:50 ` bugzilla-daemon
` (7 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-02 6:31 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #6 from Paolo Bonzini <bonzini@gnu.org> ---
What version of Xen? Can you attach the xen.gz file?
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (7 preceding siblings ...)
2014-09-02 6:31 ` bugzilla-daemon
@ 2014-09-03 1:50 ` bugzilla-daemon
2014-09-03 1:58 ` bugzilla-daemon
` (6 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-03 1:50 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #7 from Zhou, Chao <chao.zhou@intel.com> ---
xen verion: 4.4-unstable. xen.gz file is attached
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (8 preceding siblings ...)
2014-09-03 1:50 ` bugzilla-daemon
@ 2014-09-03 1:58 ` bugzilla-daemon
2014-09-03 11:25 ` bugzilla-daemon
` (5 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-03 1:58 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #8 from Zhou, Chao <chao.zhou@intel.com> ---
Created attachment 149111
--> https://bugzilla.kernel.org/attachment.cgi?id=149111&action=edit
xen.gz file
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (9 preceding siblings ...)
2014-09-03 1:58 ` bugzilla-daemon
@ 2014-09-03 11:25 ` bugzilla-daemon
2015-03-17 3:53 ` bugzilla-daemon
` (4 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2014-09-03 11:25 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #9 from Paolo Bonzini <bonzini@gnu.org> ---
Nope, your binary works with kvm/queue for me:
/sys/module/kvm_intel/parameters/emulate_invalid_guest_state:Y
/sys/module/kvm_intel/parameters/enable_apicv:N
/sys/module/kvm_intel/parameters/enable_shadow_vmcs:N
/sys/module/kvm_intel/parameters/ept:Y
/sys/module/kvm_intel/parameters/eptad:N
/sys/module/kvm_intel/parameters/fasteoi:Y
/sys/module/kvm_intel/parameters/flexpriority:Y
/sys/module/kvm_intel/parameters/nested:Y
/sys/module/kvm_intel/parameters/ple_gap:128
/sys/module/kvm_intel/parameters/ple_window:4096
/sys/module/kvm_intel/parameters/ple_window_grow:2
/sys/module/kvm_intel/parameters/ple_window_max:1073741823
/sys/module/kvm_intel/parameters/ple_window_shrink:0
/sys/module/kvm_intel/parameters/unrestricted_guest:Y
/sys/module/kvm_intel/parameters/vmm_exclusive:Y
/sys/module/kvm_intel/parameters/vpid:Y
I unzipped it, and invoked QEMU with
qemu-kvm -kernel ./xen -initrd /boot/vmlinuz-2.6.18-348.el5xen -cpu kvm64
(Any initrd will do).
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (10 preceding siblings ...)
2014-09-03 11:25 ` bugzilla-daemon
@ 2015-03-17 3:53 ` bugzilla-daemon
2015-03-17 17:01 ` bugzilla-daemon
` (3 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2015-03-17 3:53 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Bandan Das <bsd@makefile.in> changed:
What |Removed |Added
----------------------------------------------------------------------------
Blocks| |94971
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (11 preceding siblings ...)
2015-03-17 3:53 ` bugzilla-daemon
@ 2015-03-17 17:01 ` bugzilla-daemon
2015-03-18 18:56 ` bugzilla-daemon
` (2 subsequent siblings)
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2015-03-17 17:01 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Radim Krčmář <rkrcmar@redhat.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |rkrcmar@redhat.com
--- Comment #10 from Radim Krčmář <rkrcmar@redhat.com> ---
I can reproduce with kernel-4.0.0-0.rc3.git2.1.fc23.x86_64 and attached Xen.
qemu-kvm -kernel ./xen -initrd /boot/vmlinuz-[...] -cpu kvm64,+x2apic
Xen doesn't use x2APIC (which is good), but x2APIC enables directed EOI for
xAPIC, which doesn't work. All is good if we manually avoid it
qemu-kvm [...] -append ioapic_ack=new
KVM IOAPIC never gets EOI.
I'll take a look where the problem is.
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (12 preceding siblings ...)
2015-03-17 17:01 ` bugzilla-daemon
@ 2015-03-18 18:56 ` bugzilla-daemon
2015-03-20 5:17 ` bugzilla-daemon
2015-04-08 8:36 ` bugzilla-daemon
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2015-03-18 18:56 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #11 from Radim Krčmář <rkrcmar@redhat.com> ---
Should be fixed with "KVM: x86: call irq notifiers with directed EOI",
(http://www.spinics.net/lists/kernel/msg1949367.html)
can you check if it is?
Thanks.
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (13 preceding siblings ...)
2015-03-18 18:56 ` bugzilla-daemon
@ 2015-03-20 5:17 ` bugzilla-daemon
2015-04-08 8:36 ` bugzilla-daemon
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2015-03-20 5:17 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
--- Comment #12 from Zhou, Chao <chao.zhou@intel.com> ---
(In reply to Radim Krčmář from comment #11)
> Should be fixed with "KVM: x86: call irq notifiers with directed EOI",
> (http://www.spinics.net/lists/kernel/msg1949367.html)
>
> can you check if it is?
>
> Thanks.
test this patch with kvm.git:4ff6f8e61eb7f96d3ca535c6d240f863ccd6fb7d
kernel version: 4.0.0-rc1+
qemu.git:cd232acfa0d70002fed89e9293f04afda577a513
test on Haswell_EP and Ivytown_EP
L1(xen on kvm) guest works fine when boot up L1 guest
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
* [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
` (14 preceding siblings ...)
2015-03-20 5:17 ` bugzilla-daemon
@ 2015-04-08 8:36 ` bugzilla-daemon
15 siblings, 0 replies; 17+ messages in thread
From: bugzilla-daemon @ 2015-04-08 8:36 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=82211
Zhou, Chao <chao.zhou@intel.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEEDINFO |RESOLVED
Resolution|--- |CODE_FIX
--
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 17+ messages in thread
end of thread, other threads:[~2015-04-08 8:36 UTC | newest]
Thread overview: 17+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-08-12 7:35 [Bug 82211] New: [Nested xen on kvm] L1 guest panic and reboot when L1 guest boot up bugzilla-daemon
2014-08-12 7:36 ` [Bug 82211] " bugzilla-daemon
2014-08-12 7:40 ` bugzilla-daemon
2014-08-21 17:56 ` [Bug 82211] [BISECTED][Nested " bugzilla-daemon
2014-09-01 12:46 ` bugzilla-daemon
2014-09-01 13:09 ` [Bug 82211] Cannot boot Xen under KVM with X2APIC enabled bugzilla-daemon
2014-09-01 13:19 ` bugzilla-daemon
2014-09-02 4:50 ` bugzilla-daemon
2014-09-02 6:31 ` bugzilla-daemon
2014-09-03 1:50 ` bugzilla-daemon
2014-09-03 1:58 ` bugzilla-daemon
2014-09-03 11:25 ` bugzilla-daemon
2015-03-17 3:53 ` bugzilla-daemon
2015-03-17 17:01 ` bugzilla-daemon
2015-03-18 18:56 ` bugzilla-daemon
2015-03-20 5:17 ` bugzilla-daemon
2015-04-08 8:36 ` bugzilla-daemon
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.