From mboxrd@z Thu Jan 1 00:00:00 1970 Content-Type: multipart/mixed; boundary="===============0785970512724440199==" MIME-Version: 1.0 From: Oza Oza Subject: [SPDK] PCI hotplug and SPDK Date: Tue, 29 Aug 2017 13:51:31 +0530 Message-ID: List-ID: To: spdk@lists.01.org --===============0785970512724440199== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi All, PCI hotplug support; requires creation of root bus and probe to go ahead with all PCIe configuration. Which means following APIs ae not called. pci_stop_root_bus(bus); pci_remove_root_bus(bus); And then If I run SPDK, It makes system crash with following info. Note: if the disk is connected then SPDK is fine. Otherwise it stalls the system with following crash. root(a)bcm958742k:~# echo 2048 > /proc/sys/vm/nr_hugepages; /usr/share/spdk/scripts/setup.sh grep: /usr/share/spdk/scripts/../include/spdk/pci_ids.h: No such[ 34.621325] pci 0008:00:00.0: PCI bridge to [bus 01] file or directory [ 34.640586] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring [ 50.267056] pci 0000:00:00.0: PCI bridge to [bus 01] [ 50.272337] pci 0001:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring [ 65.898762] pci 0001:00:00.0: PCI bridge to [bus 01] [ 65.904015] pci 0006:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring [ 81.530437] pci 0006:00:00.0: PCI bridge to [bus 01] [ 81.535680] pci 0007:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring [ 97.162103] pci 0007:00:00.0: PCI bridge to [bus 01] [ 97.167255] Bad mode in Error handler detected on CPU6, code 0xbf000002 -- SError [ 97.174974] Internal error: Oops - bad mode: 0 [#1] SMP [ 97.180364] Modules linked in: [ 97.183515] CPU: 6 PID: 2104 Comm: bash Not tainted 4.12.0-01560-gc83093d-dirty #89 [ 97.191413] Hardware name: Stingray Combo SVK w/PCIe IOMMU (BCM958742K) (DT) [ 97.198683] task: ffff80a163a40000 task.stack: ffff80a1612b4000 [ 97.204790] PC is at 0xffff7cbdfba8 [ 97.208387] LR is at 0xffff7cb8f288 [ 97.211983] pc : [<0000ffff7cbdfba8>] lr : [<0000ffff7cb8f288>] pstate: 20000000 [ 97.219612] sp : 0000fffffe564040 [ 97.223029] x29: 0000fffffe564040 x28: 000000001054ce60 [ 97.228509] x27: 0000000000000000 x26: 00000000004e2000 [ 97.233989] x25: 00000000004e5000 x24: 0000000000000002 [ 97.239468] x23: 0000ffff7cc63638 x22: 0000000000000002 [ 97.244947] x21: 0000ffff7cc67480 x20: 000000001054db10 [ 97.250427] x19: 0000000000000002 x18: 0000000000000000 [ 97.255906] x17: 00000000004daac8 x16: 0000000000000000 [ 97.261386] x15: 0000000000000096 x14: 0000000000000000 [ 97.266865] x13: 0000000000000000 x12: 0000000000000000 [ 97.272344] x11: 0000000000000020 x10: 0101010101010101 [ 97.277824] x9 : ffffff80ffffffc8 x8 : 0000000000000040 [ 97.283303] x7 : 0000000000000001 x6 : 0000ffff7cc669f0 [ 97.288782] x5 : 0000000000015551 x4 : 0000000000000888 [ 97.294261] x3 : 0000000000000000 x2 : 0000000000000002 [ 97.299741] x1 : 000000001054db10 x0 : 0000000000000002 [ 97.305220] Process bash (pid: 2104, stack limit =3D 0xffff80a1612b4000) [ 97.311960] ---[ end trace a1f48abe30820241 ]--- Regards, Oza. --===============0785970512724440199== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGh0bWw+PGhlYWQ+PG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0 L2h0bWw7IGNoYXJzZXQ9dXMtYXNjaWkiPjxtZXRhIG5hbWU9IkdlbmVyYXRvciIgY29udGVudD0i TWljcm9zb2Z0IFdvcmQgMTQgKGZpbHRlcmVkIG1lZGl1bSkiPjxzdHlsZT48IS0tCi8qIEZvbnQg RGVmaW5pdGlvbnMgKi8KQGZvbnQtZmFjZQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7CglwYW5vc2Ut MToyIDE1IDUgMiAyIDIgNCAzIDIgNDt9Ci8qIFN0eWxlIERlZmluaXRpb25zICovCnAuTXNvTm9y bWFsLCBsaS5Nc29Ob3JtYWwsIGRpdi5Nc29Ob3JtYWwKCXttYXJnaW46MGluOwoJbWFyZ2luLWJv dHRvbTouMDAwMXB0OwoJZm9udC1zaXplOjExLjBwdDsKCWZvbnQtZmFtaWx5OiJDYWxpYnJpIiwi c2Fucy1zZXJpZiI7fQphOmxpbmssIHNwYW4uTXNvSHlwZXJsaW5rCgl7bXNvLXN0eWxlLXByaW9y aXR5Ojk5OwoJY29sb3I6Ymx1ZTsKCXRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQphOnZpc2l0 ZWQsIHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93ZWQKCXttc28tc3R5bGUtcHJpb3JpdHk6OTk7Cglj b2xvcjpwdXJwbGU7Cgl0ZXh0LWRlY29yYXRpb246dW5kZXJsaW5lO30Kc3Bhbi5FbWFpbFN0eWxl MTcKCXttc28tc3R5bGUtdHlwZTpwZXJzb25hbC1jb21wb3NlOwoJZm9udC1mYW1pbHk6IkNhbGli cmkiLCJzYW5zLXNlcmlmIjsKCWNvbG9yOndpbmRvd3RleHQ7fQouTXNvQ2hwRGVmYXVsdAoJe21z by1zdHlsZS10eXBlOmV4cG9ydC1vbmx5OwoJZm9udC1mYW1pbHk6IkNhbGlicmkiLCJzYW5zLXNl cmlmIjt9CkBwYWdlIFdvcmRTZWN0aW9uMQoJe3NpemU6OC41aW4gMTEuMGluOwoJbWFyZ2luOjEu MGluIDEuMGluIDEuMGluIDEuMGluO30KZGl2LldvcmRTZWN0aW9uMQoJe3BhZ2U6V29yZFNlY3Rp b24xO30KLS0+PC9zdHlsZT48L2hlYWQ+PGJvZHkgbGFuZz0iRU4tVVMiIGxpbms9ImJsdWUiIHZs aW5rPSJwdXJwbGUiPjxkaXYgY2xhc3M9IldvcmRTZWN0aW9uMSI+PHAgY2xhc3M9Ik1zb05vcm1h bCI+SGkgQWxsLDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9y bWFsIj5QQ0kgaG90cGx1ZyBzdXBwb3J0OyByZXF1aXJlcyBjcmVhdGlvbiBvZiByb290IGJ1cyBh bmQgcHJvYmUgdG8gZ28gYWhlYWQgd2l0aCBhbGwgUENJZSBjb25maWd1cmF0aW9uLjwvcD48cCBj bGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5XaGljaCBtZWFucyBm b2xsb3dpbmcgQVBJcyBhZSBub3QgY2FsbGVkLjwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoMKg IHBjaV9zdG9wX3Jvb3RfYnVzKGJ1cyk7PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPsKgwqAgcGNp X3JlbW92ZV9yb290X2J1cyhidXMpOzwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBj bGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5BbmQgdGhlbiBJZiBJ IHJ1biBTUERLLCBJdCBtYWtlcyBzeXN0ZW0gY3Jhc2ggd2l0aCBmb2xsb3dpbmcgaW5mby48L3A+ PHAgY2xhc3M9Ik1zb05vcm1hbCI+wqA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+Tm90ZTogaWYg dGhlIGRpc2sgaXMgY29ubmVjdGVkIHRoZW4gU1BESyBpcyBmaW5lLjwvcD48cCBjbGFzcz0iTXNv Tm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5PdGhlcndpc2UgaXQgc3RhbGxzIHRo ZSBzeXN0ZW0gd2l0aCBmb2xsb3dpbmcgY3Jhc2guPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPsKg PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPnJvb3RAYmNtOTU4NzQyazp+IyBlY2hvIDIwNDggJmd0 OyAvcHJvYy9zeXMvdm0vbnJfaHVnZXBhZ2VzOyAvdXNyL3NoYXJlL3NwZGsvc2NyaXB0cy9zZXR1 cC5zaDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5ncmVwOiAvdXNyL3NoYXJlL3NwZGsvc2NyaXB0 cy8uLi9pbmNsdWRlL3NwZGsvcGNpX2lkcy5oOiBObyBzdWNoW8KgwqAgMzQuNjIxMzI1XSBwY2kg MDAwODowMDowMC4wOiBQQ0kgYnJpZGdlIHRvIFtidXMgMDFdPC9wPjxwIGNsYXNzPSJNc29Ob3Jt YWwiPiBmaWxlIG9yIGRpcmVjdG9yeTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5bwqDCoCAzNC42 NDA1ODZdIHBjaSAwMDAwOjAwOjAwLjA6IGJyaWRnZSBjb25maWd1cmF0aW9uIGludmFsaWQgKFti dXMgMDAtMDBdKSwgcmVjb25maWd1cmluZzwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5bwqDCoCA1 MC4yNjcwNTZdIHBjaSAwMDAwOjAwOjAwLjA6IFBDSSBicmlkZ2UgdG8gW2J1cyAwMV08L3A+PHAg Y2xhc3M9Ik1zb05vcm1hbCI+W8KgwqAgNTAuMjcyMzM3XSBwY2kgMDAwMTowMDowMC4wOiBicmlk Z2UgY29uZmlndXJhdGlvbiBpbnZhbGlkIChbYnVzIDAwLTAwXSksIHJlY29uZmlndXJpbmc8L3A+ PHAgY2xhc3M9Ik1zb05vcm1hbCI+W8KgwqAgNjUuODk4NzYyXSBwY2kgMDAwMTowMDowMC4wOiBQ Q0kgYnJpZGdlIHRvIFtidXMgMDFdPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPlvCoMKgIDY1Ljkw NDAxNV0gcGNpIDAwMDY6MDA6MDAuMDogYnJpZGdlIGNvbmZpZ3VyYXRpb24gaW52YWxpZCAoW2J1 cyAwMC0wMF0pLCByZWNvbmZpZ3VyaW5nPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPlvCoMKgIDgx LjUzMDQzN10gcGNpIDAwMDY6MDA6MDAuMDogUENJIGJyaWRnZSB0byBbYnVzIDAxXTwvcD48cCBj bGFzcz0iTXNvTm9ybWFsIj5bwqDCoCA4MS41MzU2ODBdIHBjaSAwMDA3OjAwOjAwLjA6IGJyaWRn ZSBjb25maWd1cmF0aW9uIGludmFsaWQgKFtidXMgMDAtMDBdKSwgcmVjb25maWd1cmluZzwvcD48 cCBjbGFzcz0iTXNvTm9ybWFsIj5bwqDCoCA5Ny4xNjIxMDNdIHBjaSAwMDA3OjAwOjAwLjA6IFBD SSBicmlkZ2UgdG8gW2J1cyAwMV08L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+W8KgwqAgOTcuMTY3 MjU1XSBCYWQgbW9kZSBpbiBFcnJvciBoYW5kbGVyIGRldGVjdGVkIG9uIENQVTYsIGNvZGUgMHhi ZjAwMDAwMiAtLSBTRXJyb3I8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+W8KgwqAgOTcuMTc0OTc0 XSBJbnRlcm5hbCBlcnJvcjogT29wcyAtIGJhZCBtb2RlOiAwIFsjMV0gU01QPC9wPjxwIGNsYXNz PSJNc29Ob3JtYWwiPlvCoMKgIDk3LjE4MDM2NF0gTW9kdWxlcyBsaW5rZWQgaW46PC9wPjxwIGNs YXNzPSJNc29Ob3JtYWwiPlvCoMKgIDk3LjE4MzUxNV0gQ1BVOiA2IFBJRDogMjEwNCBDb21tOiBi YXNoIE5vdCB0YWludGVkIDQuMTIuMC0wMTU2MC1nYzgzMDkzZC1kaXJ0eSAjODk8L3A+PHAgY2xh c3M9Ik1zb05vcm1hbCI+W8KgwqAgOTcuMTkxNDEzXSBIYXJkd2FyZSBuYW1lOiBTdGluZ3JheSBD b21ibyBTVksgdy9QQ0llIElPTU1VIChCQ005NTg3NDJLKSAoRFQpPC9wPjxwIGNsYXNzPSJNc29O b3JtYWwiPlvCoMKgIDk3LjE5ODY4M10gdGFzazogZmZmZjgwYTE2M2E0MDAwMCB0YXNrLnN0YWNr OiBmZmZmODBhMTYxMmI0MDAwPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPlvCoMKgIDk3LjIwNDc5 MF0gUEMgaXMgYXQgMHhmZmZmN2NiZGZiYTg8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+W8KgwqAg OTcuMjA4Mzg3XSBMUiBpcyBhdCAweGZmZmY3Y2I4ZjI4ODwvcD48cCBjbGFzcz0iTXNvTm9ybWFs Ij5bwqDCoCA5Ny4yMTE5ODNdIHBjIDogWyZsdDswMDAwZmZmZjdjYmRmYmE4Jmd0O10gbHIgOiBb Jmx0OzAwMDBmZmZmN2NiOGYyODgmZ3Q7XSBwc3RhdGU6IDIwMDAwMDAwPC9wPjxwIGNsYXNzPSJN c29Ob3JtYWwiPlvCoMKgIDk3LjIxOTYxMl0gc3AgOiAwMDAwZmZmZmZlNTY0MDQwPC9wPjxwIGNs YXNzPSJNc29Ob3JtYWwiPlvCoMKgIDk3LjIyMzAyOV0geDI5OiAwMDAwZmZmZmZlNTY0MDQwIHgy ODogMDAwMDAwMDAxMDU0Y2U2MDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5bwqDCoCA5Ny4yMjg1 MDldIHgyNzogMDAwMDAwMDAwMDAwMDAwMCB4MjY6IDAwMDAwMDAwMDA0ZTIwMDA8L3A+PHAgY2xh c3M9Ik1zb05vcm1hbCI+W8KgwqAgOTcuMjMzOTg5XSB4MjU6IDAwMDAwMDAwMDA0ZTUwMDAgeDI0 OiAwMDAwMDAwMDAwMDAwMDAyPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPlvCoMKgIDk3LjIzOTQ2 OF0geDIzOiAwMDAwZmZmZjdjYzYzNjM4IHgyMjogMDAwMDAwMDAwMDAwMDAwMjwvcD48cCBjbGFz cz0iTXNvTm9ybWFsIj5bwqDCoCA5Ny4yNDQ5NDddIHgyMTogMDAwMGZmZmY3Y2M2NzQ4MCB4MjA6 IDAwMDAwMDAwMTA1NGRiMTA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+W8KgwqAgOTcuMjUwNDI3 XSB4MTk6IDAwMDAwMDAwMDAwMDAwMDIgeDE4OiAwMDAwMDAwMDAwMDAwMDAwPC9wPjxwIGNsYXNz PSJNc29Ob3JtYWwiPlvCoMKgIDk3LjI1NTkwNl0geDE3OiAwMDAwMDAwMDAwNGRhYWM4IHgxNjog MDAwMDAwMDAwMDAwMDAwMDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5bwqDCoCA5Ny4yNjEzODZd IHgxNTogMDAwMDAwMDAwMDAwMDA5NiB4MTQ6IDAwMDAwMDAwMDAwMDAwMDA8L3A+PHAgY2xhc3M9 Ik1zb05vcm1hbCI+W8KgwqAgOTcuMjY2ODY1XSB4MTM6IDAwMDAwMDAwMDAwMDAwMDAgeDEyOiAw MDAwMDAwMDAwMDAwMDAwPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPlvCoMKgIDk3LjI3MjM0NF0g eDExOiAwMDAwMDAwMDAwMDAwMDIwIHgxMDogMDEwMTAxMDEwMTAxMDEwMTwvcD48cCBjbGFzcz0i TXNvTm9ybWFsIj5bwqDCoCA5Ny4yNzc4MjRdIHg5IDogZmZmZmZmODBmZmZmZmZjOCB4OCA6IDAw MDAwMDAwMDAwMDAwNDA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+W8KgwqAgOTcuMjgzMzAzXSB4 NyA6IDAwMDAwMDAwMDAwMDAwMDEgeDYgOiAwMDAwZmZmZjdjYzY2OWYwPC9wPjxwIGNsYXNzPSJN c29Ob3JtYWwiPlvCoMKgIDk3LjI4ODc4Ml0geDUgOiAwMDAwMDAwMDAwMDE1NTUxIHg0IDogMDAw MDAwMDAwMDAwMDg4ODwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5bwqDCoCA5Ny4yOTQyNjFdIHgz IDogMDAwMDAwMDAwMDAwMDAwMCB4MiA6IDAwMDAwMDAwMDAwMDAwMDI8L3A+PHAgY2xhc3M9Ik1z b05vcm1hbCI+W8KgwqAgOTcuMjk5NzQxXSB4MSA6IDAwMDAwMDAwMTA1NGRiMTAgeDAgOiAwMDAw MDAwMDAwMDAwMDAyPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPlvCoMKgIDk3LjMwNTIyMF0gUHJv Y2VzcyBiYXNoIChwaWQ6IDIxMDQsIHN0YWNrIGxpbWl0ID0gMHhmZmZmODBhMTYxMmI0MDAwKTwv cD48cCBjbGFzcz0iTXNvTm9ybWFsIj5bwqDCoCA5Ny4zMTE5NjBdIC0tLVsgZW5kIHRyYWNlIGEx ZjQ4YWJlMzA4MjAyNDEgXS0tLTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFz cz0iTXNvTm9ybWFsIj5SZWdhcmRzLDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5PemEuPC9wPjwv ZGl2PjwvYm9keT48L2h0bWw+Cg== --===============0785970512724440199==--