Yinghai, There are many kernel paging errors showing up in tree: git://git.kernel.org/pub/scm/linux/kernel/git/yinghai/linux-yinghai.git for-pci-for-each-res-addon-v2 The below summary shows that 1) it's a reliably reproducible bug 2) all paging fault happens at address 0ffff163 and in some e1000 functions I'll try to bisect if the root cause is not obvious to you. (Cannot do so for now because there are 3 bisections on the way and I cannot afford more..) Thanks, Fengguang --- i386-randconfig-m012 _________B__________B__________B_CBC__BC__B__________B__BB__B_____B__________B_BB__________BB___BBB_ -- 8: 7d7903b 9: B 8200bc7 2012-09-05 kvm-ant [ 127.519645] BUG: unable to handle kernel paging request at 0ffff163 [e1000_read_mbx_vf rmt e1000_init_hw_80003es2lan tcam_assoc_write rmt] 10: 2a80eeb -- 19: e5c8ae5 20: B eb0ff56 2012-09-05 kvm-bens [ 14.562316] BUG: unable to handle kernel paging request at 0ffff163 [igbvf_get_msglevel rmt e1000_setup_copper_link_80003es2lan niu_set_nfc rmt] 21: 08bd108 -- 30: 5cdaaf8 31: B 532c5f6 2012-09-05 kvm-fat [ 9.702038] BUG: unable to handle kernel paging request at 0ffff163 [igbvf_get_eeprom rmt e1000_setup_copper_link_80003es2lan niu_set_nfc rmt] 32: 479e0d4 33: 0d7614f 34: B e1c171b 2012-09-05 kvm-waimea [ 10.338600] BUG: unable to handle kernel paging request at 0ffff163 35: 0d7614f -- 37: defb944 38: B a28afda 2012-09-05 kvm-stoakley [ 9.315985] BUG: unable to handle kernel paging request at 0ffff163 [igbvf_set_msglevel rmt e1000_setup_copper_link_80003es2lan niu_set_nfc rmt] 39: 0d7614f -- 41: 34e5484 42: B 0a14057 2012-09-05 kvm-slim [ 15.523994] BUG: unable to handle kernel paging request at 0fffe163 [usc_set_sdlc_mode rmt_init] 43: 657c207 -- 52: f5725f4 53: B 0b79ca2 2012-09-05 kvm-stoakley [ 9.902012] BUG: unable to handle kernel paging request at 0ffff163 [e1000_write_mbx_vf rmt e1000_init_hw_80003es2lan niu_alloc_channels rmt] 54: 0a4af14 55: c29aabe 56: B 7bf79d8 2012-09-05 kvm-waimea [ 9.354137] BUG: unable to handle kernel paging request at 0ffff163 [igbvf_get_coalesce rmt e1000_setup_copper_link_80003es2lan niu_set_nfc rmt] 57: B 588dde7 2012-09-05 kvm-bens [ 10.047686] BUG: unable to handle kernel paging request at 0ffff163 58: 3f7aaec 59: faa5956 60: B 6e67404 2012-09-05 kvm-xgwo [ 10.161540] WARNING: at /c/kernel-tests/src/i386/kernel/lockdep.c:3493 check_flags+0x9e/0x14f() [check_flags lock_is_held __might_sleep rt_mutex_lock rcu_kthread preempt_schedule complete __rcu_process_callbacks kthread insert_kthread_work] 61: 73f02ab -- 65: 5a58343 66: B f773c5c 2012-09-05 kvm-stoakley [ 9.378884] BUG: unable to handle kernel paging request at 0ffff163 [igbvf_get_msglevel rmt e1000_setup_copper_link_80003es2lan niu_set_nfc rmt] 67: 1071aab -- 76: 4f930f1 77: B c7d6768 2012-09-05 kvm-ant [ 114.891808] BUG: unable to handle kernel paging request at 0ffff163 [e1000_init_mbx_params_vf rmt e1000_init_hw_80003es2lan tcam_write rmt] 78: 6102ea8 79: B 242ae74 2012-09-05 kvm-bens [ 10.263933] BUG: unable to handle kernel paging request at 0ffff163 [e1000_read_mbx_vf rmt e1000_init_hw_80003es2lan tcam_write rmt] 80: B 77d56a0 2012-09-05 kvm-ant [ 99.832354] BUG: unable to handle kernel paging request at 0ffff163 [e1000_write_mbx_vf rmt e1000_init_hw_80003es2lan tcam_flush rmt] 81: 3cc1773 -- 90: e5dd9d3 91: B a40758f 2012-09-05 kvm-waimea [ 8.623070] BUG: unable to handle kernel paging request at 0ffff163 [e1000_set_vfta_vf smt_pmf_received_pack e1000_reset_hw_80003es2lan niu_init_tx_mac smt_pmf_received_pack] 92: B eedd911 2012-09-05 kvm-ant [ 95.184152] BUG: unable to handle kernel paging request at 0ffff163 [e1000_get_link_up_info_vf smt_pmf_received_pack e1000_reset_hw_80003es2lan niu_init_tx_mac smt_pmf_received_pack] 93: f7a01f3 -- 95: b58d6f5 96: B c5cce62 2012-09-05 kvm-waimea [ 9.441889] BUG: unable to handle kernel paging request at 0ffff163 97: B 4dc8c06 2012-09-05 kvm-xgwo [ 9.770754] BUG: unable to handle kernel paging request at 0ffff163 [e1000_init_mac_params_vf smt_pmf_received_pack e1000_reset_hw_80003es2lan niu_init_tx_mac smt_pmf_received_pack] 98: B 0852a83 2012-09-05 kvm-xgwo [ 9.715270] BUG: unable to handle kernel paging request at 0ffff163 [igb_ptp_remove smt_pmf_received_pack e1000_cfg_on_link_up_80003es2lan niu_stop_rx_channels smt_pmf_received_pack] 99: a37fbc4 [ 9.350967] cdc_acm 1-1:2.0: This device cannot do calls on its own. It is not a modem. [ 9.353255] cdc_acm 1-1:2.0: ttyACM0: USB ACM device [ 9.354137] BUG: unable to handle kernel paging request at 0ffff163 [ 9.355214] IP: [<0ffff163>] 0xffff162 [ 9.355869] *pde = 00000000 [ 9.356308] Oops: 0000 [#1] PREEMPT [ 9.356308] Pid: 1, comm: swapper Not tainted 3.6.0-rc1-00061-g7bf79d8 #10 Bochs Bochs [ 9.356308] EIP: 0060:[<0ffff163>] EFLAGS: 00010246 CPU: 0 [ 9.356308] EIP is at 0xffff163 [ 9.356308] EAX: 00000000 EBX: 4d812f18 ECX: 4d80d410 EDX: 00000000 [ 9.356308] ESI: 00000000 EDI: 4d813ef8 EBP: 0fffe163 ESP: 4d810008 [ 9.356308] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068 [ 9.356308] CR0: 8005003b CR2: 0ffff163 CR3: 01d03000 CR4: 00000690 [ 9.356308] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [ 9.356308] DR6: ffff0ff0 DR7: 00000400 [ 9.356308] Process swapper (pid: 1, ti=4d80e000 task=4d80d410 task.ti=4d816000) [ 9.356308] Stack: [ 9.356308] 00000000 00000000 fed00173 00000000 07b57163 07b58163 07b59163 07b5a163 [ 9.356308] 07b5b163 07b5c163 07b5d163 07b5e163 07b5f163 07b60163 07b61163 00000000 [ 9.356308] 07b63163 07b66163 07b67163 07b68163 07b69163 07b6a163 07b6b163 07b6c163 [ 9.356308] Call Trace: [ 9.356308] [<414d5043>] ? igbvf_get_coalesce+0x15/0x23 [ 9.356308] [<4154535f>] ? rmt+0x357/0x604 [ 9.356308] [<414b4e4c>] ? e1000_setup_copper_link_80003es2lan+0x111/0x31d [ 9.356308] [<41535244>] ? niu_set_nfc+0xe4/0x6fd [ 9.356308] [<4154535f>] ? rmt+0x357/0x604 [ 9.356308] [<4154535f>] ? rmt+0x357/0x604 [ 9.356308] [<4154535f>] ? rmt+0x357/0x604 [ 9.356308] [<4154535f>] ? rmt+0x357/0x604 [ 9.356308] [<4154535f>] ? rmt+0x357/0x604 [ 9.356308]