All of lore.kernel.org
 help / color / mirror / Atom feed
* KVM Test result, kernel 680615e.., userspace 52be1a1..
@ 2008-03-26  6:25 Yunfeng Zhao
  2008-03-26  6:55 ` Chris Wedgwood
  2008-03-26  8:21 ` Yunfeng Zhao
  0 siblings, 2 replies; 5+ messages in thread
From: Yunfeng Zhao @ 2008-03-26  6:25 UTC (permalink / raw)
  To: kvm-devel

Hi All,
 
This is today's KVM test result against kvm.git 
680615e31ee986b6a5d64783c536ed9fae67c010 and kvm-userspace.git 
52be1a18bb7429506acc95c7fdcf4f87ded7a92c.

Issue list
================================================
1.  Booting four guests likely fails
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1919354&group_id=180599 

2.  booting smp windows guests has 30% chance of hang
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1910923&group_id=180599 

 
Test environment
================================================
 
Platform                Woodcrest
CPU                     4
Memory size         8G'
 
Details
================================================
IA32-pae:  
1. boot guest with 256M memory                                  PASS
2. boot two windows xp guest                                       PASS
3. boot 4 same guest in parallel                                    PASS
4. boot linux and windows guest in parallel                     PASS
5. boot guest with 1500M memory                                 PASS
6. boot windows 2003 with ACPI enabled                       PASS
7. boot Windows xp with ACPI enabled                          PASS
8. boot Windows 2000 without ACPI                              PASS
9. kernel build on SMP linux guest                                PASS
10. LTP on SMP linux guest                                         PASS
11. boot base kernel linux                                             PASS
12. save/restore 32-bit HVM guests                               PASS
13. live migration 32-bit HVM guests                              PASS
14. boot SMP Windows xp with ACPI enabled                PASS
15. boot SMP Windows 2003 with ACPI enabled             PASS
16. boot SMP Windows 2000 with ACPI enabled             PASS
 
================================================
IA32e:  
1. boot four 32-bit guest in 
parallel                                      PASS
2. boot four 64-bit guest in 
parallel                                      FAIL
3. boot 4G 64-bit 
guest                                                      PASS
4. boot 4G pae 
guest                                                         PASS
5. boot 32-bit linux and 32 bit windows guest in parallel        PASS
6. boot 32-bit guest with 1500M memory                             PASS
7. boot 64-bit guest with 1500M memory                             PASS
8. boot 32-bit guest with 256M memory                               PASS
9. boot 64-bit guest with 256M memory                               PASS
10. boot two 32-bit windows xp in parallel                            PASS
11. boot four 32-bit different guest in para                            PASS
12. save/restore 64-bit linux guests                                     
PASS
13. save/restore 32-bit linux guests                                     
PASS
14. boot 32-bit SMP windows 2003 with ACPI enabled         PASS
15. boot 32-bit SMP Windows 2000 with ACPI enabled        PASS
16. boot 32-bit SMP Windows xp with ACPI enabled            PASS
17. boot 32-bit Windows 2000 without ACPI                        PASS
18. boot 64-bit Windows xp with ACPI enabled                    PASS
19. boot 32-bit Windows xp without ACPI                            PASS
20. boot 64-bit UP 
vista                                                      PASS
21. boot 64-bit SMP 
vista                                                   PASS
22. kernel build in 32-bit linux guest OS                              PASS
23. kernel build in 64-bit linux guest OS                              PASS
24. LTP on SMP 32-bit linux guest OS                                PASS
25. LTP on SMP 64-bit linux guest OS                                PASS
26. boot 64-bit guests with ACPI enabled                             PASS
27. boot 32-bit 
x-server                                                       PASS   
28. boot 64-bit SMP windows XP with ACPI enabled             FAIL
29. boot 64-bit SMP windows 2003 with ACPI enabled          PASS
30. live migration 64bit linux 
guests                                     PASS
31. live migration 32bit linux 
guests                                     PASS
32. reboot 32bit windows xp guest                CRASH
33. reboot 32bit windows xp guest                                       PASS
 
Report Summary on IA32-pae
 
Summary Test Report of Last Session
=====================================================================
                          Total   Pass    Fail    NoResult   Crash
=====================================================================
control_panel               7       7       0         0        0
Restart                     2       2       0         0        0
gtest                       15      15      0         0        0
=====================================================================
control_panel               7       7       0         0        0
 :KVM_LM_PAE_gPAE           1       1       0         0        0
 :KVM_four_sguest_PAE_gPA   1       1       0         0        0
 :KVM_256M_guest_PAE_gPAE   1       1       0         0        0
 :KVM_linux_win_PAE_gPAE    1       1       0         0        0
 :KVM_1500M_guest_PAE_gPA   1       1       0         0        0
 :KVM_SR_PAE_gPAE           1       1       0         0        0
 :KVM_two_winxp_PAE_gPAE    1       1       0         0        0
Restart                     2       2       0         0        0
 :GuestPAE_PAE_g64          1       1       0         0        0
 :BootTo32pae_PAE_g64       1       1       0         0        0
gtest                       15      15      0         0        0
 :ltp_nightly_PAE_gPAE      1       1       0         0        0
 :boot_up_acpi_PAE_gPAE     1       1       0         0        0
 :reboot_xp_PAE_gPAE        1       1       0         0        0
 :boot_up_vista_PAE_gPAE    1       1       0         0        0
 :boot_up_acpi_xp_PAE_gPA   1       1       0         0        0
 :boot_up_acpi_win2k3_PAE   1       1       0         0        0
 :boot_base_kernel_PAE_gP   1       1       0         0        0
 :boot_smp_acpi_win2k3_PA   1       1       0         0        0
 :boot_smp_acpi_win2k_PAE   1       1       0         0        0
 :boot_up_acpi_win2k_PAE_   1       1       0         0        0
 :boot_smp_acpi_xp_PAE_gP   1       1       0         0        0
 :boot_up_noacpi_win2k_PA   1       1       0         0        0
 :boot_smp_vista_PAE_gPAE   1       1       0         0        0
 :bootx_PAE_gPAE            1       1       0         0        0
 :kb_nightly_PAE_gPAE       1       1       0         0        0
=====================================================================
Total                       24      24      0         0        0
 
Report Summary on IA32e
 
Summary Test Report of Last Session
=====================================================================
                          Total   Pass    Fail    NoResult   Crash
=====================================================================
control_panel               15      13      2         0        0
Restart                     3       3       0         0        0
gtest                       26      24      1         0        1
=====================================================================
control_panel               15      13      2         0        0
 :KVM_LM_64_g64             1       1       0         0        0
 :KVM_four_sguest_64_gPAE   1       1       0         0        0
 :KVM_4G_guest_64_g64       1       1       0         0        0
 :KVM_four_sguest_64_g64    1       0       1         0        0
 :KVM_linux_win_64_gPAE     1       1       0         0        0
 :KVM_1500M_guest_64_gPAE   1       1       0         0        0
 :KVM_SR_64_g64             1       1       0         0        0
 :KVM_LM_64_gPAE            1       1       0         0        0
 :KVM_256M_guest_64_g64     1       1       0         0        0
 :KVM_1500M_guest_64_g64    1       1       0         0        0
 :KVM_4G_guest_64_gPAE      1       1       0         0        0
 :KVM_SR_64_gPAE            1       0       1         0        0
 :KVM_256M_guest_64_gPAE    1       1       0         0        0
 :KVM_two_winxp_64_gPAE     1       1       0         0        0
 :KVM_four_dguest_64_gPAE   1       1       0         0        0
Restart                     3       3       0         0        0
 :GuestPAE_64_gPAE          1       1       0         0        0
 :BootTo64_64_gPAE          1       1       0         0        0
 :Guest64_64_gPAE           1       1       0         0        0
gtest                       26      24      1         0        1
 :boot_up_acpi_64_gPAE      1       1       0         0        0
 :boot_up_noacpi_xp_64_gP   1       1       0         0        0
 :boot_smp_acpi_xp_64_g64   1       0       1         0        0
 :boot_base_kernel_64_gPA   1       1       0         0        0
 :boot_smp_acpi_win2k3_64   1       1       0         0        0
 :boot_smp_acpi_win2k_64_   1       1       0         0        0
 :boot_base_kernel_64_g64   1       1       0         0        0
 :bootx_64_gPAE             1       1       0         0        0
 :kb_nightly_64_gPAE        1       1       0         0        0
 :ltp_nightly_64_g64        1       1       0         0        0
 :boot_up_acpi_64_g64       1       1       0         0        0
 :boot_up_noacpi_win2k_64   1       1       0         0        0
 :boot_smp_acpi_xp_64_gPA   1       1       0         0        0
 :boot_smp_vista_64_gPAE    1       1       0         0        0
 :boot_up_acpi_win2k3_64_   1       1       0         0        0
 :reboot_xp_64_gPAE         1       0       0         0        1
 :bootx_64_g64              1       1       0         0        0
 :reboot_xp_64_g64          1       1       0         0        0
 :boot_up_vista_64_g64      1       1       0         0        0
 :boot_smp_vista_64_g64     1       1       0         0        0
 :boot_up_acpi_xp_64_g64    1       1       0         0        0
 :boot_up_vista_64_gPAE     1       1       0         0        0
 :ltp_nightly_64_gPAE       1       1       0         0        0
 :boot_smp_acpi_win2k3_64   1       1       0         0        0
 :boot_up_noacpi_win2k3_6   1       1       0         0        0
 :kb_nightly_64_g64         1       1       0         0        0
=====================================================================
Total                       44      40      3         0        1


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: KVM Test result, kernel 680615e.., userspace 52be1a1..
  2008-03-26  6:25 KVM Test result, kernel 680615e.., userspace 52be1a1 Yunfeng Zhao
@ 2008-03-26  6:55 ` Chris Wedgwood
  2008-03-26  8:39   ` Avi Kivity
  2008-03-26  8:21 ` Yunfeng Zhao
  1 sibling, 1 reply; 5+ messages in thread
From: Chris Wedgwood @ 2008-03-26  6:55 UTC (permalink / raw)
  To: Yunfeng Zhao; +Cc: kvm-devel

On Wed, Mar 26, 2008 at 02:25:11PM +0800, Yunfeng Zhao wrote:

> 2.  booting smp windows guests has 30% chance of hang
> https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1910923&group_id=180599 

Does it hang or bluescreen?  What if you disable the FlexPriority
optimization?

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: KVM Test result, kernel 680615e.., userspace 52be1a1..
  2008-03-26  6:25 KVM Test result, kernel 680615e.., userspace 52be1a1 Yunfeng Zhao
  2008-03-26  6:55 ` Chris Wedgwood
@ 2008-03-26  8:21 ` Yunfeng Zhao
  2008-03-26  8:37   ` Avi Kivity
  1 sibling, 1 reply; 5+ messages in thread
From: Yunfeng Zhao @ 2008-03-26  8:21 UTC (permalink / raw)
  To: Yunfeng Zhao; +Cc: kvm-devel

Just find one new issue:
*[ kvm-Bugs-1925889 ] slab error in kmem_cache_destroy(): cache `kvm_vcpu':
https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1925889&group_id=180599

This error happened when reinsert kvm-intel.ko after creating and 
destroying several guests. It causes the host to hang.
*
> Hi All,
>
> This is today's KVM test result against kvm.git 
> 680615e31ee986b6a5d64783c536ed9fae67c010 and kvm-userspace.git 
> 52be1a18bb7429506acc95c7fdcf4f87ded7a92c.
>
> Issue list
> ================================================
> 1.  Booting four guests likely fails
> https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1919354&group_id=180599 
>
> 2.  booting smp windows guests has 30% chance of hang
> https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1910923&group_id=180599 
>
>
> Test environment
> ================================================
>
> Platform                Woodcrest
> CPU                     4
> Memory size         8G'
>
> Details
> ================================================
> IA32-pae:  1. boot guest with 256M 
> memory                                  PASS
> 2. boot two windows xp guest                                       PASS
> 3. boot 4 same guest in parallel                                    PASS
> 4. boot linux and windows guest in parallel                     PASS
> 5. boot guest with 1500M memory                                 PASS
> 6. boot windows 2003 with ACPI enabled                       PASS
> 7. boot Windows xp with ACPI enabled                          PASS
> 8. boot Windows 2000 without ACPI                              PASS
> 9. kernel build on SMP linux guest                                PASS
> 10. LTP on SMP linux guest                                         PASS
> 11. boot base kernel linux                                             
> PASS
> 12. save/restore 32-bit HVM guests                               PASS
> 13. live migration 32-bit HVM guests                              PASS
> 14. boot SMP Windows xp with ACPI enabled                PASS
> 15. boot SMP Windows 2003 with ACPI enabled             PASS
> 16. boot SMP Windows 2000 with ACPI enabled             PASS
>
> ================================================
> IA32e:  1. boot four 32-bit guest in 
> parallel                                      PASS
> 2. boot four 64-bit guest in 
> parallel                                      FAIL
> 3. boot 4G 64-bit 
> guest                                                      PASS
> 4. boot 4G pae 
> guest                                                         PASS
> 5. boot 32-bit linux and 32 bit windows guest in parallel        PASS
> 6. boot 32-bit guest with 1500M memory                             PASS
> 7. boot 64-bit guest with 1500M memory                             PASS
> 8. boot 32-bit guest with 256M memory                               PASS
> 9. boot 64-bit guest with 256M memory                               PASS
> 10. boot two 32-bit windows xp in parallel                            
> PASS
> 11. boot four 32-bit different guest in 
> para                            PASS
> 12. save/restore 64-bit linux 
> guests                                     PASS
> 13. save/restore 32-bit linux 
> guests                                     PASS
> 14. boot 32-bit SMP windows 2003 with ACPI enabled         PASS
> 15. boot 32-bit SMP Windows 2000 with ACPI enabled        PASS
> 16. boot 32-bit SMP Windows xp with ACPI enabled            PASS
> 17. boot 32-bit Windows 2000 without ACPI                        PASS
> 18. boot 64-bit Windows xp with ACPI enabled                    PASS
> 19. boot 32-bit Windows xp without ACPI                            PASS
> 20. boot 64-bit UP 
> vista                                                      PASS
> 21. boot 64-bit SMP 
> vista                                                   PASS
> 22. kernel build in 32-bit linux guest OS                              
> PASS
> 23. kernel build in 64-bit linux guest OS                              
> PASS
> 24. LTP on SMP 32-bit linux guest OS                                PASS
> 25. LTP on SMP 64-bit linux guest OS                                PASS
> 26. boot 64-bit guests with ACPI enabled                             PASS
> 27. boot 32-bit 
> x-server                                                       PASS   
> 28. boot 64-bit SMP windows XP with ACPI enabled             FAIL
> 29. boot 64-bit SMP windows 2003 with ACPI enabled          PASS
> 30. live migration 64bit linux 
> guests                                     PASS
> 31. live migration 32bit linux 
> guests                                     PASS
> 32. reboot 32bit windows xp guest                CRASH
> 33. reboot 32bit windows xp 
> guest                                       PASS
>
> Report Summary on IA32-pae
>
> Summary Test Report of Last Session
> =====================================================================
>                          Total   Pass    Fail    NoResult   Crash
> =====================================================================
> control_panel               7       7       0         0        0
> Restart                     2       2       0         0        0
> gtest                       15      15      0         0        0
> =====================================================================
> control_panel               7       7       0         0        0
> :KVM_LM_PAE_gPAE           1       1       0         0        0
> :KVM_four_sguest_PAE_gPA   1       1       0         0        0
> :KVM_256M_guest_PAE_gPAE   1       1       0         0        0
> :KVM_linux_win_PAE_gPAE    1       1       0         0        0
> :KVM_1500M_guest_PAE_gPA   1       1       0         0        0
> :KVM_SR_PAE_gPAE           1       1       0         0        0
> :KVM_two_winxp_PAE_gPAE    1       1       0         0        0
> Restart                     2       2       0         0        0
> :GuestPAE_PAE_g64          1       1       0         0        0
> :BootTo32pae_PAE_g64       1       1       0         0        0
> gtest                       15      15      0         0        0
> :ltp_nightly_PAE_gPAE      1       1       0         0        0
> :boot_up_acpi_PAE_gPAE     1       1       0         0        0
> :reboot_xp_PAE_gPAE        1       1       0         0        0
> :boot_up_vista_PAE_gPAE    1       1       0         0        0
> :boot_up_acpi_xp_PAE_gPA   1       1       0         0        0
> :boot_up_acpi_win2k3_PAE   1       1       0         0        0
> :boot_base_kernel_PAE_gP   1       1       0         0        0
> :boot_smp_acpi_win2k3_PA   1       1       0         0        0
> :boot_smp_acpi_win2k_PAE   1       1       0         0        0
> :boot_up_acpi_win2k_PAE_   1       1       0         0        0
> :boot_smp_acpi_xp_PAE_gP   1       1       0         0        0
> :boot_up_noacpi_win2k_PA   1       1       0         0        0
> :boot_smp_vista_PAE_gPAE   1       1       0         0        0
> :bootx_PAE_gPAE            1       1       0         0        0
> :kb_nightly_PAE_gPAE       1       1       0         0        0
> =====================================================================
> Total                       24      24      0         0        0
>
> Report Summary on IA32e
>
> Summary Test Report of Last Session
> =====================================================================
>                          Total   Pass    Fail    NoResult   Crash
> =====================================================================
> control_panel               15      13      2         0        0
> Restart                     3       3       0         0        0
> gtest                       26      24      1         0        1
> =====================================================================
> control_panel               15      13      2         0        0
> :KVM_LM_64_g64             1       1       0         0        0
> :KVM_four_sguest_64_gPAE   1       1       0         0        0
> :KVM_4G_guest_64_g64       1       1       0         0        0
> :KVM_four_sguest_64_g64    1       0       1         0        0
> :KVM_linux_win_64_gPAE     1       1       0         0        0
> :KVM_1500M_guest_64_gPAE   1       1       0         0        0
> :KVM_SR_64_g64             1       1       0         0        0
> :KVM_LM_64_gPAE            1       1       0         0        0
> :KVM_256M_guest_64_g64     1       1       0         0        0
> :KVM_1500M_guest_64_g64    1       1       0         0        0
> :KVM_4G_guest_64_gPAE      1       1       0         0        0
> :KVM_SR_64_gPAE            1       0       1         0        0
> :KVM_256M_guest_64_gPAE    1       1       0         0        0
> :KVM_two_winxp_64_gPAE     1       1       0         0        0
> :KVM_four_dguest_64_gPAE   1       1       0         0        0
> Restart                     3       3       0         0        0
> :GuestPAE_64_gPAE          1       1       0         0        0
> :BootTo64_64_gPAE          1       1       0         0        0
> :Guest64_64_gPAE           1       1       0         0        0
> gtest                       26      24      1         0        1
> :boot_up_acpi_64_gPAE      1       1       0         0        0
> :boot_up_noacpi_xp_64_gP   1       1       0         0        0
> :boot_smp_acpi_xp_64_g64   1       0       1         0        0
> :boot_base_kernel_64_gPA   1       1       0         0        0
> :boot_smp_acpi_win2k3_64   1       1       0         0        0
> :boot_smp_acpi_win2k_64_   1       1       0         0        0
> :boot_base_kernel_64_g64   1       1       0         0        0
> :bootx_64_gPAE             1       1       0         0        0
> :kb_nightly_64_gPAE        1       1       0         0        0
> :ltp_nightly_64_g64        1       1       0         0        0
> :boot_up_acpi_64_g64       1       1       0         0        0
> :boot_up_noacpi_win2k_64   1       1       0         0        0
> :boot_smp_acpi_xp_64_gPA   1       1       0         0        0
> :boot_smp_vista_64_gPAE    1       1       0         0        0
> :boot_up_acpi_win2k3_64_   1       1       0         0        0
> :reboot_xp_64_gPAE         1       0       0         0        1
> :bootx_64_g64              1       1       0         0        0
> :reboot_xp_64_g64          1       1       0         0        0
> :boot_up_vista_64_g64      1       1       0         0        0
> :boot_smp_vista_64_g64     1       1       0         0        0
> :boot_up_acpi_xp_64_g64    1       1       0         0        0
> :boot_up_vista_64_gPAE     1       1       0         0        0
> :ltp_nightly_64_gPAE       1       1       0         0        0
> :boot_smp_acpi_win2k3_64   1       1       0         0        0
> :boot_up_noacpi_win2k3_6   1       1       0         0        0
> :kb_nightly_64_g64         1       1       0         0        0
> =====================================================================
> Total                       44      40      3         0        1
>
>


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: KVM Test result, kernel 680615e.., userspace 52be1a1..
  2008-03-26  8:21 ` Yunfeng Zhao
@ 2008-03-26  8:37   ` Avi Kivity
  0 siblings, 0 replies; 5+ messages in thread
From: Avi Kivity @ 2008-03-26  8:37 UTC (permalink / raw)
  To: Yunfeng Zhao; +Cc: kvm-devel

Yunfeng Zhao wrote:
> Just find one new issue:
> *[ kvm-Bugs-1925889 ] slab error in kmem_cache_destroy(): cache `kvm_vcpu':
> https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1925889&group_id=180599
>
> This error happened when reinsert kvm-intel.ko after creating and 
> destroying several guests. It causes the host to hang.
>   

I saw this also.  I think it only happens with the external module.  I 
am looking into it.

-- 
Do not meddle in the internals of kernels, for they are subtle and quick to panic.


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: KVM Test result, kernel 680615e.., userspace 52be1a1..
  2008-03-26  6:55 ` Chris Wedgwood
@ 2008-03-26  8:39   ` Avi Kivity
  0 siblings, 0 replies; 5+ messages in thread
From: Avi Kivity @ 2008-03-26  8:39 UTC (permalink / raw)
  To: Chris Wedgwood; +Cc: kvm-devel

Chris Wedgwood wrote:
> On Wed, Mar 26, 2008 at 02:25:11PM +0800, Yunfeng Zhao wrote:
>
>   
>> 2.  booting smp windows guests has 30% chance of hang
>> https://sourceforge.net/tracker/?func=detail&atid=893831&aid=1910923&group_id=180599 
>>     
>
> Does it hang or bluescreen?  What if you disable the FlexPriority
> optimization?
>
>   

There's a new module parameter for that (kvm_intel.ko): 
flexpriority_enabled=[0|1]

-- 
Do not meddle in the internals of kernels, for they are subtle and quick to panic.


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2008-03-26  8:39 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2008-03-26  6:25 KVM Test result, kernel 680615e.., userspace 52be1a1 Yunfeng Zhao
2008-03-26  6:55 ` Chris Wedgwood
2008-03-26  8:39   ` Avi Kivity
2008-03-26  8:21 ` Yunfeng Zhao
2008-03-26  8:37   ` Avi Kivity

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.