All of lore.kernel.org
 help / color / mirror / Atom feed
* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
       [not found] <BC29A004BA570342A4CC0044A3845572010DCF3E30@H3CMLB12-EX.srv.huawei-3com.com>
@ 2018-01-13  5:28   ` Nicholas A. Bellinger
  0 siblings, 0 replies; 16+ messages in thread
From: Nicholas A. Bellinger @ 2018-01-13  5:28 UTC (permalink / raw)
  To: Changlimin
  Cc: quinn.tran, Jifuliang, Zhangguanghui, Zhangzijian, target-devel,
	linux-scsi, Himanshu Madhani

Hi Chang & Co,

(Adding list + Himanshu CC')

On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
> Hi,
> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git/commit/?idr6b85487067d7f5b23495bc33c484b8517c4074 
> 

Thanks for reporting + including debug log.  :)

> lspci:
> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
> 
> syslog:
> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
> scsi host1: qla2xxx
> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
> scsi host2: qla2xxx
> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
> 
> The attached file is the module log.
> 
> Do you have any advice?

Quinn & Himanshu folks, any comments..?


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
@ 2018-01-13  5:28   ` Nicholas A. Bellinger
  0 siblings, 0 replies; 16+ messages in thread
From: Nicholas A. Bellinger @ 2018-01-13  5:28 UTC (permalink / raw)
  To: Changlimin
  Cc: quinn.tran, Jifuliang, Zhangguanghui, Zhangzijian, target-devel,
	linux-scsi, Himanshu Madhani

Hi Chang & Co,

(Adding list + Himanshu CC')

On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
> Hi,
> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074 
> 

Thanks for reporting + including debug log.  :)

> lspci:
> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
> 
> syslog:
> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
> scsi host1: qla2xxx
> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
> scsi host2: qla2xxx
> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
> 
> The attached file is the module log.
> 
> Do you have any advice?

Quinn & Himanshu folks, any comments..?

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-13  5:28   ` Nicholas A. Bellinger
  (?)
@ 2018-01-15 16:57   ` Madhani, Himanshu
  2018-01-16  0:27     ` Changlimin
  -1 siblings, 1 reply; 16+ messages in thread
From: Madhani, Himanshu @ 2018-01-15 16:57 UTC (permalink / raw)
  To: Nicholas A. Bellinger
  Cc: Changlimin, Tran, Quinn, Jifuliang, Zhangguanghui, Zhangzijian,
	target-devel, linux-scsi

Hi Nic, Chang,

> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
> 
> Hi Chang & Co,
> 
> (Adding list + Himanshu CC')
> 
> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>> Hi,
>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074 
>> 
> 
> Thanks for reporting + including debug log.  :)
> 
>> lspci:
>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
>> 
>> syslog:
>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>> scsi host1: qla2xxx
>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>> scsi host2: qla2xxx
>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>> 
>> The attached file is the module log.
>> 
>> Do you have any advice?
> 
> Quinn & Himanshu folks, any comments..?
> 

What is the issue here? I am not clear form the snippet above.

One thing I noticed that, if you are using 4.15-rc6 driver version should be 10.00.00.02-k but the snippet shows 
8.07.00.38-k which tells me you might 

Thanks,
- Himanshu

^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-15 16:57   ` Madhani, Himanshu
@ 2018-01-16  0:27     ` Changlimin
  2018-01-16  4:58         ` Madhani, Himanshu
  0 siblings, 1 reply; 16+ messages in thread
From: Changlimin @ 2018-01-16  0:27 UTC (permalink / raw)
  To: Madhani, Himanshu, Nicholas A. Bellinger
  Cc: Tran, Quinn, Jifuliang, Zhangguanghui, Zhangzijian, target-devel,
	linux-scsi

[-- Attachment #1: Type: text/plain, Size: 3074 bytes --]

Hi Himanshu,
  The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.
  I have git bisect the commits. 
  The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
  The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .

Regards
Chang Limin

-----Original Message-----
From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
Sent: Tuesday, January 16, 2018 12:58 AM
To: Nicholas A. Bellinger
Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6

Hi Nic, Chang,

> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
> 
> Hi Chang & Co,
> 
> (Adding list + Himanshu CC')
> 
> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>> Hi,
>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.g
>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>> 
> 
> Thanks for reporting + including debug log.  :)
> 
>> lspci:
>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>> to PCI Express HBA (rev 02)
>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>> to PCI Express HBA (rev 02)
>> 
>> syslog:
>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>> scsi host1: qla2xxx
>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>> scsi host2: qla2xxx
>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>> 
>> The attached file is the module log.
>> 
>> Do you have any advice?
> 
> Quinn & Himanshu folks, any comments..?
> 

What is the issue here? I am not clear form the snippet above.

One thing I noticed that, if you are using 4.15-rc6 driver version should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which tells me you might 

Thanks,
- Himanshu

[-- Attachment #2: qla2xxx-full.log.gz --]
[-- Type: application/x-gzip, Size: 62088 bytes --]

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-16  0:27     ` Changlimin
@ 2018-01-16  4:58         ` Madhani, Himanshu
  0 siblings, 0 replies; 16+ messages in thread
From: Madhani, Himanshu @ 2018-01-16  4:58 UTC (permalink / raw)
  To: Changlimin
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Chang, 

> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>  The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.

From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 

[  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.

4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled
in with kernel 4.15.0-rc6.

>  I have git bisect the commits. 
>  The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>  The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
> 
> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
> Sent: Tuesday, January 16, 2018 12:58 AM
> To: Nicholas A. Bellinger
> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
> 
> Hi Nic, Chang,
> 
>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>> 
>> Hi Chang & Co,
>> 
>> (Adding list + Himanshu CC')
>> 
>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>> Hi,
>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.g
>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>> 
>> 
>> Thanks for reporting + including debug log.  :)
>> 
>>> lspci:
>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 
>>> syslog:
>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host1: qla2xxx
>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host2: qla2xxx
>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>> 
>>> The attached file is the module log.
>>> 
>>> Do you have any advice?
>> 
>> Quinn & Himanshu folks, any comments..?
>> 
> 
> What is the issue here? I am not clear form the snippet above.
> 
> One thing I noticed that, if you are using 4.15-rc6 driver version should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which tells me you might 
> 
> Thanks,
> - Himanshu
> <qla2xxx-full.log.gz>

Thanks,
- Himanshu


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
@ 2018-01-16  4:58         ` Madhani, Himanshu
  0 siblings, 0 replies; 16+ messages in thread
From: Madhani, Himanshu @ 2018-01-16  4:58 UTC (permalink / raw)
  To: Changlimin
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Chang, 

> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>  The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.

>From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 

[  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.

4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled
in with kernel 4.15.0-rc6.

>  I have git bisect the commits. 
>  The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>  The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
> 
> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
> Sent: Tuesday, January 16, 2018 12:58 AM
> To: Nicholas A. Bellinger
> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
> 
> Hi Nic, Chang,
> 
>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>> 
>> Hi Chang & Co,
>> 
>> (Adding list + Himanshu CC')
>> 
>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>> Hi,
>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.g
>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>> 
>> 
>> Thanks for reporting + including debug log.  :)
>> 
>>> lspci:
>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 
>>> syslog:
>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host1: qla2xxx
>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host2: qla2xxx
>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>> 
>>> The attached file is the module log.
>>> 
>>> Do you have any advice?
>> 
>> Quinn & Himanshu folks, any comments..?
>> 
> 
> What is the issue here? I am not clear form the snippet above.
> 
> One thing I noticed that, if you are using 4.15-rc6 driver version should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which tells me you might 
> 
> Thanks,
> - Himanshu
> <qla2xxx-full.log.gz>

Thanks,
- Himanshu

^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-16  4:58         ` Madhani, Himanshu
@ 2018-01-16  6:49           ` Changlimin
  -1 siblings, 0 replies; 16+ messages in thread
From: Changlimin @ 2018-01-16  6:49 UTC (permalink / raw)
  To: Madhani, Himanshu
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Himanshu,
   This is my progress.
   First, I compiled 4.15-rc6, I found linux hang when booting, the stack showed something wrong in qla2xxx driver.
   Second, I want to find which commit introduced the issue. So I tried many times via git bisect to linux kernel.
   Finally, I found the commit 726b85487067d7f5b23495bc33c484b8517c4074 introduced the issue. The attached log is related to this commit.
   Also ubuntu kernel has this issue: 
   https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-4.13.0-25-generic_4.13.0-25.29_amd64.deb
   https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-extra-4.13.0-25-generic_4.13.0-25.29_amd64.deb

Regards
Chang Limin

-----Original Message-----
From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
Sent: Tuesday, January 16, 2018 12:59 PM
To: changlimin (Cloud)
Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6

Hi Chang, 

> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>  The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.

From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 

[  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.

4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled in with kernel 4.15.0-rc6.

>  I have git bisect the commits. 
>  The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>  The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
> 
> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
> Sent: Tuesday, January 16, 2018 12:58 AM
> To: Nicholas A. Bellinger
> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui 
> (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
> in lastest version 4.15-rc6
> 
> Hi Nic, Chang,
> 
>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>> 
>> Hi Chang & Co,
>> 
>> (Adding list + Himanshu CC')
>> 
>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>> Hi,
>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.
>>> g
>>> it/commit/?idr6b85487067d7f5b23495bc33c484b8517c4074
>>> 
>> 
>> Thanks for reporting + including debug log.  :)
>> 
>>> lspci:
>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 
>>> syslog:
>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host1: qla2xxx
>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host2: qla2xxx
>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>> 
>>> The attached file is the module log.
>>> 
>>> Do you have any advice?
>> 
>> Quinn & Himanshu folks, any comments..?
>> 
> 
> What is the issue here? I am not clear form the snippet above.
> 
> One thing I noticed that, if you are using 4.15-rc6 driver version 
> should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which tells 
> me you might
> 
> Thanks,
> - Himanshu
> <qla2xxx-full.log.gz>

Thanks,
- Himanshu


^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
@ 2018-01-16  6:49           ` Changlimin
  0 siblings, 0 replies; 16+ messages in thread
From: Changlimin @ 2018-01-16  6:49 UTC (permalink / raw)
  To: Madhani, Himanshu
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Himanshu,
   This is my progress.
   First, I compiled 4.15-rc6, I found linux hang when booting, the stack showed something wrong in qla2xxx driver.
   Second, I want to find which commit introduced the issue. So I tried many times via git bisect to linux kernel.
   Finally, I found the commit 726b85487067d7f5b23495bc33c484b8517c4074 introduced the issue. The attached log is related to this commit.
   Also ubuntu kernel has this issue: 
   https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-4.13.0-25-generic_4.13.0-25.29_amd64.deb
   https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-extra-4.13.0-25-generic_4.13.0-25.29_amd64.deb

Regards
Chang Limin

-----Original Message-----
From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
Sent: Tuesday, January 16, 2018 12:59 PM
To: changlimin (Cloud)
Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6

Hi Chang, 

> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>  The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.

>From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 

[  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.

4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled in with kernel 4.15.0-rc6.

>  I have git bisect the commits. 
>  The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>  The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
> 
> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
> Sent: Tuesday, January 16, 2018 12:58 AM
> To: Nicholas A. Bellinger
> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui 
> (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
> in lastest version 4.15-rc6
> 
> Hi Nic, Chang,
> 
>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>> 
>> Hi Chang & Co,
>> 
>> (Adding list + Himanshu CC')
>> 
>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>> Hi,
>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.
>>> g
>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>> 
>> 
>> Thanks for reporting + including debug log.  :)
>> 
>>> lspci:
>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>> to PCI Express HBA (rev 02)
>>> 
>>> syslog:
>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host1: qla2xxx
>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>> scsi host2: qla2xxx
>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>> 
>>> The attached file is the module log.
>>> 
>>> Do you have any advice?
>> 
>> Quinn & Himanshu folks, any comments..?
>> 
> 
> What is the issue here? I am not clear form the snippet above.
> 
> One thing I noticed that, if you are using 4.15-rc6 driver version 
> should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which tells 
> me you might
> 
> Thanks,
> - Himanshu
> <qla2xxx-full.log.gz>

Thanks,
- Himanshu

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-16  6:49           ` Changlimin
  (?)
@ 2018-01-17 18:26           ` Madhani, Himanshu
  2018-01-18 12:47             ` Changlimin
  2018-01-18 12:51               ` Changlimin
  -1 siblings, 2 replies; 16+ messages in thread
From: Madhani, Himanshu @ 2018-01-17 18:26 UTC (permalink / raw)
  To: Changlimin
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Chang, 

> On Jan 15, 2018, at 10:49 PM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>   This is my progress.
>   First, I compiled 4.15-rc6, I found linux hang when booting, the stack showed something wrong in qla2xxx driver.

Can you provide me detail steps of how you compiled 4.15-rc6. Also provide me details of how you are loading driver and also provide complete 
log file.

I do not see how you will be able to load driver which is from 4.9.x when you compile fresh 4.15.0-rc6. 

Just FYI, I build test system with 8G/16G/32G adapter with 4.15.0-rc6 kernel and I am not able to see hang that you are describing. 

# uname -r
4.15.0-rc6+

# modprobe qla2xxx

# fcc.sh
FC HBAs:
HBA       Port Name                Port ID   State     Device
host3     21:00:00:24:ff:7e:f5:80  01:0d:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
host4     21:00:00:24:ff:7e:f5:81  01:0e:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
host5     21:00:00:0e:1e:12:e9:a0  01:06:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
host6     21:00:00:0e:1e:12:e9:a1  01:14:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
host7     21:00:00:24:ff:46:0a:5c  01:0d:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k
host8     21:00:00:24:ff:46:0a:5d  01:15:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k

# modinfo qla2xxx | more

filename:       /lib/modules/4.15.0-rc6+/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
firmware:       ql2500_fw.bin
firmware:       ql2400_fw.bin
firmware:       ql2322_fw.bin
firmware:       ql2300_fw.bin
firmware:       ql2200_fw.bin
firmware:       ql2100_fw.bin
version:        10.00.00.04-k
license:        GPL
description:    QLogic Fibre Channel HBA Driver
author:         QLogic Corporation
srcversion:     6CBCF1372A7756690E83CC3


>   Second, I want to find which commit introduced the issue. So I tried many times via git bisect to linux kernel.
>   Finally, I found the commit 726b85487067d7f5b23495bc33c484b8517c4074 introduced the issue. The attached log is related to this commit.
>   Also ubuntu kernel has this issue: 
>   https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-4.13.0-25-generic_4.13.0-25.29_amd64.deb
>   https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-extra-4.13.0-25-generic_4.13.0-25.29_amd64.deb
> 
> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
> Sent: Tuesday, January 16, 2018 12:59 PM
> To: changlimin (Cloud)
> Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
> 
> Hi Chang, 
> 
>> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
>> 
>> Hi Himanshu,
>> The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.
> 
> From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 
> 
> [  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.
> 
> 4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled in with kernel 4.15.0-rc6.
> 
>> I have git bisect the commits. 
>> The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>> The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
>> 
>> Regards
>> Chang Limin
>> 
>> -----Original Message-----
>> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
>> Sent: Tuesday, January 16, 2018 12:58 AM
>> To: Nicholas A. Bellinger
>> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui 
>> (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
>> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
>> in lastest version 4.15-rc6
>> 
>> Hi Nic, Chang,
>> 
>>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>>> 
>>> Hi Chang & Co,
>>> 
>>> (Adding list + Himanshu CC')
>>> 
>>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>>> Hi,
>>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.
>>>> g
>>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>>> 
>>> 
>>> Thanks for reporting + including debug log.  :)
>>> 
>>>> lspci:
>>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>> to PCI Express HBA (rev 02)
>>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>> to PCI Express HBA (rev 02)
>>>> 
>>>> syslog:
>>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>> scsi host1: qla2xxx
>>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>> scsi host2: qla2xxx
>>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>>> 
>>>> The attached file is the module log.
>>>> 
>>>> Do you have any advice?
>>> 
>>> Quinn & Himanshu folks, any comments..?
>>> 
>> 
>> What is the issue here? I am not clear form the snippet above.
>> 
>> One thing I noticed that, if you are using 4.15-rc6 driver version 
>> should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which tells 
>> me you might
>> 
>> Thanks,
>> - Himanshu
>> <qla2xxx-full.log.gz>
> 
> Thanks,
> - Himanshu
> 

Thanks,
- Himanshu


^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-17 18:26           ` Madhani, Himanshu
@ 2018-01-18 12:47             ` Changlimin
  2018-01-18 12:51               ` Changlimin
  1 sibling, 0 replies; 16+ messages in thread
From: Changlimin @ 2018-01-18 12:47 UTC (permalink / raw)
  To: Madhani, Himanshu
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

[-- Attachment #1: Type: text/plain, Size: 7553 bytes --]

Hi Himanshu,
  Today I reproduced the issue in my server.
  First, I compiled kernel 4.15-rc6, then start the kernel with parameter modprobe.blacklist=qla2xxx.
  Second, tail -f /var/log/syslog
  Third, modprobe qla2xxx ql2xextended_error_logging=0x1e400000 , the log is syslog-1e400000.txt
  The syslog-7fffffff is got when modprobe qla2xxx ql2xextended_error_logging=0x7fffffff

  BTW, I haven't load driver from 4.9.x to kernel 4.15-rc6. 
  When I checkout kernel commit 726b85487067d7f5b23495bc33c484b8517c4074, all kernel code is 4.9.x.

Regards
Chang Limin

-----Original Message-----
From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
Sent: Thursday, January 18, 2018 2:26 AM
To: changlimin (Cloud)
Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6

Hi Chang, 

> On Jan 15, 2018, at 10:49 PM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>   This is my progress.
>   First, I compiled 4.15-rc6, I found linux hang when booting, the stack showed something wrong in qla2xxx driver.

Can you provide me detail steps of how you compiled 4.15-rc6. Also provide me details of how you are loading driver and also provide complete log file.

I do not see how you will be able to load driver which is from 4.9.x when you compile fresh 4.15.0-rc6. 

Just FYI, I build test system with 8G/16G/32G adapter with 4.15.0-rc6 kernel and I am not able to see hang that you are describing. 

# uname -r
4.15.0-rc6+

# modprobe qla2xxx

# fcc.sh
FC HBAs:
HBA       Port Name                Port ID   State     Device
host3     21:00:00:24:ff:7e:f5:80  01:0d:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
host4     21:00:00:24:ff:7e:f5:81  01:0e:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
host5     21:00:00:0e:1e:12:e9:a0  01:06:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
host6     21:00:00:0e:1e:12:e9:a1  01:14:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
host7     21:00:00:24:ff:46:0a:5c  01:0d:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k
host8     21:00:00:24:ff:46:0a:5d  01:15:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k

# modinfo qla2xxx | more

filename:       /lib/modules/4.15.0-rc6+/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
firmware:       ql2500_fw.bin
firmware:       ql2400_fw.bin
firmware:       ql2322_fw.bin
firmware:       ql2300_fw.bin
firmware:       ql2200_fw.bin
firmware:       ql2100_fw.bin
version:        10.00.00.04-k
license:        GPL
description:    QLogic Fibre Channel HBA Driver
author:         QLogic Corporation
srcversion:     6CBCF1372A7756690E83CC3


>   Second, I want to find which commit introduced the issue. So I tried many times via git bisect to linux kernel.
>   Finally, I found the commit 726b85487067d7f5b23495bc33c484b8517c4074 introduced the issue. The attached log is related to this commit.
>   Also ubuntu kernel has this issue: 
>   https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-4.13.0-25-generic_4.13.0-25.29_amd64.deb
>   
> https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-extra
> -4.13.0-25-generic_4.13.0-25.29_amd64.deb
> 
> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
> Sent: Tuesday, January 16, 2018 12:59 PM
> To: changlimin (Cloud)
> Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); 
> zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
> in lastest version 4.15-rc6
> 
> Hi Chang,
> 
>> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
>> 
>> Hi Himanshu,
>> The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.
> 
> From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 
> 
> [  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.
> 
> 4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled in with kernel 4.15.0-rc6.
> 
>> I have git bisect the commits. 
>> The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>> The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
>> 
>> Regards
>> Chang Limin
>> 
>> -----Original Message-----
>> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
>> Sent: Tuesday, January 16, 2018 12:58 AM
>> To: Nicholas A. Bellinger
>> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui 
>> (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
>> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
>> in lastest version 4.15-rc6
>> 
>> Hi Nic, Chang,
>> 
>>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>>> 
>>> Hi Chang & Co,
>>> 
>>> (Adding list + Himanshu CC')
>>> 
>>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>>> Hi,
>>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.
>>>> g
>>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>>> 
>>> 
>>> Thanks for reporting + including debug log.  :)
>>> 
>>>> lspci:
>>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>> to PCI Express HBA (rev 02)
>>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>> to PCI Express HBA (rev 02)
>>>> 
>>>> syslog:
>>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>> scsi host1: qla2xxx
>>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>> scsi host2: qla2xxx
>>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>>> 
>>>> The attached file is the module log.
>>>> 
>>>> Do you have any advice?
>>> 
>>> Quinn & Himanshu folks, any comments..?
>>> 
>> 
>> What is the issue here? I am not clear form the snippet above.
>> 
>> One thing I noticed that, if you are using 4.15-rc6 driver version 
>> should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which 
>> tells me you might
>> 
>> Thanks,
>> - Himanshu
>> <qla2xxx-full.log.gz>
> 
> Thanks,
> - Himanshu
> 

Thanks,
- Himanshu


[-- Attachment #2: syslog-7fffffff.txt.gz --]
[-- Type: application/x-gzip, Size: 139197 bytes --]

[-- Attachment #3: syslog-1e400000.txt.gz --]
[-- Type: application/x-gzip, Size: 31505 bytes --]

^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-17 18:26           ` Madhani, Himanshu
@ 2018-01-18 12:51               ` Changlimin
  2018-01-18 12:51               ` Changlimin
  1 sibling, 0 replies; 16+ messages in thread
From: Changlimin @ 2018-01-18 12:51 UTC (permalink / raw)
  To: Madhani, Himanshu
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

SGkgSGltYW5zaHWjrA0KICBUb2RheSBJIHJlcHJvZHVjZWQgdGhlIGlzc3VlIGluIG15IHNlcnZl
ci4NCiAgRmlyc3QsIEkgY29tcGlsZWQga2VybmVsIDQuMTUtcmM2IChtYWtlIGxvY2FsbW9kY29u
ZmlnOyBtYWtlOyBtYWtlIG1vZHVsZXNfaW5zdGFsbDsgbWFrZSBpbnN0YWxsKSwgdGhlbiBzdGFy
dCB0aGUga2VybmVsIHdpdGggcGFyYW1ldGVyIG1vZHByb2JlLmJsYWNrbGlzdD1xbGEyeHh4Lg0K
ICBTZWNvbmQsICB0YWlsIC1mIC92YXIvbG9nL3N5c2xvZw0KICBUaGlyZCwgIG1vZHByb2JlIHFs
YTJ4eHggcWwyeGV4dGVuZGVkX2Vycm9yX2xvZ2dpbmc9MHgxZTQwMDAwMCAsIHRoZSBsb2cgaXMg
c3lzbG9nLTFlNDAwMDAwLnR4dA0KICBUaGUgc3lzbG9nLTdmZmZmZmZmIGlzIGdvdCB3aGVuIG1v
ZHByb2JlIHFsYTJ4eHggcWwyeGV4dGVuZGVkX2Vycm9yX2xvZ2dpbmc9MHg3ZmZmZmZmZg0KDQog
IEJUVywgSSBoYXZlbid0IGxvYWQgZHJpdmVyIGZyb20gNC45LnggdG8ga2VybmVsIDQuMTUtcmM2
LiANCiAgV2hlbiBJIGNoZWNrb3V0IGtlcm5lbCBjb21taXQgNzI2Yjg1NDg3MDY3ZDdmNWIyMzQ5
NWJjMzNjNDg0Yjg1MTdjNDA3NCwgYWxsIGtlcm5lbCBjb2RlIGlzIDQuOS54Lg0KDQpSZWdhcmRz
DQpDaGFuZyBMaW1pbg0KDQotLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KRnJvbTogTWFkaGFu
aSwgSGltYW5zaHUgW21haWx0bzpIaW1hbnNodS5NYWRoYW5pQGNhdml1bS5jb21dDQpTZW50OiBU
aHVyc2RheSwgSmFudWFyeSAxOCwgMjAxOCAyOjI2IEFNDQpUbzogY2hhbmdsaW1pbiAoQ2xvdWQp
DQpDYzogTmljaG9sYXMgQS4gQmVsbGluZ2VyOyBUcmFuLCBRdWlubjsgamlmdWxpYW5nIChDbG91
ZCk7IHpoYW5nZ3VhbmdodWkgKENsb3VkKTsgemhhbmd6aWppYW4gKENsb3VkKTsgdGFyZ2V0LWRl
dmVsOyBsaW51eC1zY3NpDQpTdWJqZWN0OiBSZTogQSBxbGEyeHh4IGNvbW1pdCBjYXVzZSBMaW51
eCBubyByZXNwb25zZSwgaGFzIG5vdCBmaXhlZCBpbiBsYXN0ZXN0IHZlcnNpb24gNC4xNS1yYzYN
Cg0KSGkgQ2hhbmcsIA0KDQo+IE9uIEphbiAxNSwgMjAxOCwgYXQgMTA6NDkgUE0sIENoYW5nbGlt
aW4gPGNoYW5nbGltaW5AaDNjLmNvbT4gd3JvdGU6DQo+IA0KPiBIaSBIaW1hbnNodSwNCj4gICBU
aGlzIGlzIG15IHByb2dyZXNzLg0KPiAgIEZpcnN0LCBJIGNvbXBpbGVkIDQuMTUtcmM2LCBJIGZv
dW5kIGxpbnV4IGhhbmcgd2hlbiBib290aW5nLCB0aGUgc3RhY2sgc2hvd2VkIHNvbWV0aGluZyB3
cm9uZyBpbiBxbGEyeHh4IGRyaXZlci4NCg0KQ2FuIHlvdSBwcm92aWRlIG1lIGRldGFpbCBzdGVw
cyBvZiBob3cgeW91IGNvbXBpbGVkIDQuMTUtcmM2LiBBbHNvIHByb3ZpZGUgbWUgZGV0YWlscyBv
ZiBob3cgeW91IGFyZSBsb2FkaW5nIGRyaXZlciBhbmQgYWxzbyBwcm92aWRlIGNvbXBsZXRlIGxv
ZyBmaWxlLg0KDQpJIGRvIG5vdCBzZWUgaG93IHlvdSB3aWxsIGJlIGFibGUgdG8gbG9hZCBkcml2
ZXIgd2hpY2ggaXMgZnJvbSA0LjkueCB3aGVuIHlvdSBjb21waWxlIGZyZXNoIDQuMTUuMC1yYzYu
IA0KDQpKdXN0IEZZSSwgSSBidWlsZCB0ZXN0IHN5c3RlbSB3aXRoIDhHLzE2Ry8zMkcgYWRhcHRl
ciB3aXRoIDQuMTUuMC1yYzYga2VybmVsIGFuZCBJIGFtIG5vdCBhYmxlIHRvIHNlZSBoYW5nIHRo
YXQgeW91IGFyZSBkZXNjcmliaW5nLiANCg0KIyB1bmFtZSAtcg0KNC4xNS4wLXJjNisNCg0KIyBt
b2Rwcm9iZSBxbGEyeHh4DQoNCiMgZmNjLnNoDQpGQyBIQkFzOg0KSEJBICAgICAgIFBvcnQgTmFt
ZSAgICAgICAgICAgICAgICBQb3J0IElEICAgU3RhdGUgICAgIERldmljZQ0KaG9zdDMgICAgIDIx
OjAwOjAwOjI0OmZmOjdlOmY1OjgwICAwMTowZDowMCAgT25saW5lICAgIFFMRTI3NDIgRlc6djgu
MDUuNjMgRFZSOnYxMC4wMC4wMC4wNC1rDQpob3N0NCAgICAgMjE6MDA6MDA6MjQ6ZmY6N2U6ZjU6
ODEgIDAxOjBlOjAwICBPbmxpbmUgICAgUUxFMjc0MiBGVzp2OC4wNS42MyBEVlI6djEwLjAwLjAw
LjA0LWsNCmhvc3Q1ICAgICAyMTowMDowMDowZToxZToxMjplOTphMCAgMDE6MDY6MDAgIE9ubGlu
ZSAgICBRTEU4MzYyIEZXOnY4LjAzLjA2IERWUjp2MTAuMDAuMDAuMDQtaw0KaG9zdDYgICAgIDIx
OjAwOjAwOjBlOjFlOjEyOmU5OmExICAwMToxNDowMCAgT25saW5lICAgIFFMRTgzNjIgRlc6djgu
MDMuMDYgRFZSOnYxMC4wMC4wMC4wNC1rDQpob3N0NyAgICAgMjE6MDA6MDA6MjQ6ZmY6NDY6MGE6
NWMgIDAxOjBkOjAwICBPbmxpbmUgICAgUUxFMjU2MiBGVzp2OC4wMy4wMCBEVlI6djEwLjAwLjAw
LjA0LWsNCmhvc3Q4ICAgICAyMTowMDowMDoyNDpmZjo0NjowYTo1ZCAgMDE6MTU6MDAgIE9ubGlu
ZSAgICBRTEUyNTYyIEZXOnY4LjAzLjAwIERWUjp2MTAuMDAuMDAuMDQtaw0KDQojIG1vZGluZm8g
cWxhMnh4eCB8IG1vcmUNCg0KZmlsZW5hbWU6ICAgICAgIC9saWIvbW9kdWxlcy80LjE1LjAtcmM2
Ky9rZXJuZWwvZHJpdmVycy9zY3NpL3FsYTJ4eHgvcWxhMnh4eC5rbw0KZmlybXdhcmU6ICAgICAg
IHFsMjUwMF9mdy5iaW4NCmZpcm13YXJlOiAgICAgICBxbDI0MDBfZncuYmluDQpmaXJtd2FyZTog
ICAgICAgcWwyMzIyX2Z3LmJpbg0KZmlybXdhcmU6ICAgICAgIHFsMjMwMF9mdy5iaW4NCmZpcm13
YXJlOiAgICAgICBxbDIyMDBfZncuYmluDQpmaXJtd2FyZTogICAgICAgcWwyMTAwX2Z3LmJpbg0K
dmVyc2lvbjogICAgICAgIDEwLjAwLjAwLjA0LWsNCmxpY2Vuc2U6ICAgICAgICBHUEwNCmRlc2Ny
aXB0aW9uOiAgICBRTG9naWMgRmlicmUgQ2hhbm5lbCBIQkEgRHJpdmVyDQphdXRob3I6ICAgICAg
ICAgUUxvZ2ljIENvcnBvcmF0aW9uDQpzcmN2ZXJzaW9uOiAgICAgNkNCQ0YxMzcyQTc3NTY2OTBF
ODNDQzMNCg0KDQo+ICAgU2Vjb25kLCBJIHdhbnQgdG8gZmluZCB3aGljaCBjb21taXQgaW50cm9k
dWNlZCB0aGUgaXNzdWUuIFNvIEkgdHJpZWQgbWFueSB0aW1lcyB2aWEgZ2l0IGJpc2VjdCB0byBs
aW51eCBrZXJuZWwuDQo+ICAgRmluYWxseSwgSSBmb3VuZCB0aGUgY29tbWl0IDcyNmI4NTQ4NzA2
N2Q3ZjViMjM0OTViYzMzYzQ4NGI4NTE3YzQwNzQgaW50cm9kdWNlZCB0aGUgaXNzdWUuIFRoZSBh
dHRhY2hlZCBsb2cgaXMgcmVsYXRlZCB0byB0aGlzIGNvbW1pdC4NCj4gICBBbHNvIHVidW50dSBr
ZXJuZWwgaGFzIHRoaXMgaXNzdWU6IA0KPiAgIA0KPiBodHRwczovL2xhdW5jaHBhZC5uZXQvdWJ1
bnR1LythcmNoaXZlL3ByaW1hcnkvK2ZpbGVzL2xpbnV4LWltYWdlLTQuMTMuDQo+IDAtMjUtZ2Vu
ZXJpY180LjEzLjAtMjUuMjlfYW1kNjQuZGViDQo+ICAgDQo+IGh0dHBzOi8vbGF1bmNocGFkLm5l
dC91YnVudHUvK2FyY2hpdmUvcHJpbWFyeS8rZmlsZXMvbGludXgtaW1hZ2UtZXh0cmENCj4gLTQu
MTMuMC0yNS1nZW5lcmljXzQuMTMuMC0yNS4yOV9hbWQ2NC5kZWINCj4gDQo+IFJlZ2FyZHMNCj4g
Q2hhbmcgTGltaW4NCj4gDQo+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+IEZyb206IE1h
ZGhhbmksIEhpbWFuc2h1IFttYWlsdG86SGltYW5zaHUuTWFkaGFuaUBjYXZpdW0uY29tXQ0KPiBT
ZW50OiBUdWVzZGF5LCBKYW51YXJ5IDE2LCAyMDE4IDEyOjU5IFBNDQo+IFRvOiBjaGFuZ2xpbWlu
IChDbG91ZCkNCj4gQ2M6IE5pY2hvbGFzIEEuIEJlbGxpbmdlcjsgVHJhbiwgUXVpbm47IGppZnVs
aWFuZyAoQ2xvdWQpOyANCj4gemhhbmdndWFuZ2h1aSAoQ2xvdWQpOyB6aGFuZ3ppamlhbiAoQ2xv
dWQpOyB0YXJnZXQtZGV2ZWw7IGxpbnV4LXNjc2kNCj4gU3ViamVjdDogUmU6IEEgcWxhMnh4eCBj
b21taXQgY2F1c2UgTGludXggbm8gcmVzcG9uc2UsIGhhcyBub3QgZml4ZWQgDQo+IGluIGxhc3Rl
c3QgdmVyc2lvbiA0LjE1LXJjNg0KPiANCj4gSGkgQ2hhbmcsDQo+IA0KPj4gT24gSmFuIDE1LCAy
MDE4LCBhdCA0OjI3IFBNLCBDaGFuZ2xpbWluIDxjaGFuZ2xpbWluQGgzYy5jb20+IHdyb3RlOg0K
Pj4gDQo+PiBIaSBIaW1hbnNodSwNCj4+IFRoZSBpc3N1ZSBpczogV2hlbiBpbnNtb2QgdGhlIHFs
YTJ4eHgua28gZnJvbSA0LjE1LXJjNiwgbGludXggaGFuZy4NCj4gDQo+IEZyb20gdGhlIGxvZyBm
aWxlIGF0dGFjaGVkLiBJIHNlZSB0aGF0IHlvdSBhcmUgdHJ5aW5nIHRvIGxvYWQgZHJpdmVyIGZy
b20gNC45LnggaW4gNC4xNS4wLXJjNi4gDQo+IA0KPiBbICAyNzkuODk4NzA0XSBxbGEyeHh4IFsw
MDAwOjAwOjAwLjBdLTAwMDU6IDogUUxvZ2ljIEZpYnJlIENoYW5uZWwgSEJBIERyaXZlcjogOC4w
Ny4wMC4zOC1rLWRlYnVnLg0KPiANCj4gNC4xNS4wLXJjNiBoYWQgZHJpdmVyIHZlcnNpb24gMTAu
MDAuMDAuMDItay4gV291bGQgeW91IGNoZWNrIGlmIHlvdSBoYXZlIGFsbCB0aGUgZHJpdmVyIGNo
YW5nZXMgcHVsbGVkIGluIHdpdGgga2VybmVsIDQuMTUuMC1yYzYuDQo+IA0KPj4gSSBoYXZlIGdp
dCBiaXNlY3QgdGhlIGNvbW1pdHMuIA0KPj4gVGhlIGlzc3VlIHdhcyBpbnRyb2R1Y2VkIGluIGNv
bW1pdDogNzI2Yjg1NDg3MDY3ZDdmNWIyMzQ5NWJjMzNjNDg0Yjg1MTdjNDA3NCBxbGEyeHh4OiBB
ZGQgZnJhbWV3b3JrIGZvciBhc3luYyBmYWJyaWMgZGlzY292ZXJ5Lg0KPj4gVGhlIHByZXZpb3Vz
IGNvbW1pdCBpcyBnb29kOiA1ZDk2NDgzN2M2YTc0MzE5M2M2M2M4OTEyZjk4ODM0Yzc0NTdiYTVj
IHFsYTJ4eHg6IFRyYWNrIEktVCBuZXh1cyBhcyBzaW5nbGUgZmNfcG9ydCBzdHJ1Y3QgLg0KPj4g
DQo+PiBSZWdhcmRzDQo+PiBDaGFuZyBMaW1pbg0KPj4gDQo+PiAtLS0tLU9yaWdpbmFsIE1lc3Nh
Z2UtLS0tLQ0KPj4gRnJvbTogTWFkaGFuaSwgSGltYW5zaHUgW21haWx0bzpIaW1hbnNodS5NYWRo
YW5pQGNhdml1bS5jb21dDQo+PiBTZW50OiBUdWVzZGF5LCBKYW51YXJ5IDE2LCAyMDE4IDEyOjU4
IEFNDQo+PiBUbzogTmljaG9sYXMgQS4gQmVsbGluZ2VyDQo+PiBDYzogY2hhbmdsaW1pbiAoQ2xv
dWQpOyBUcmFuLCBRdWlubjsgamlmdWxpYW5nIChDbG91ZCk7IHpoYW5nZ3VhbmdodWkgDQo+PiAo
Q2xvdWQpOyB6aGFuZ3ppamlhbiAoQ2xvdWQpOyB0YXJnZXQtZGV2ZWw7IGxpbnV4LXNjc2kNCj4+
IFN1YmplY3Q6IFJlOiBBIHFsYTJ4eHggY29tbWl0IGNhdXNlIExpbnV4IG5vIHJlc3BvbnNlLCBo
YXMgbm90IGZpeGVkIA0KPj4gaW4gbGFzdGVzdCB2ZXJzaW9uIDQuMTUtcmM2DQo+PiANCj4+IEhp
IE5pYywgQ2hhbmcsDQo+PiANCj4+PiBPbiBKYW4gMTIsIDIwMTgsIGF0IDk6MjggUE0sIE5pY2hv
bGFzIEEuIEJlbGxpbmdlciA8bmFiQGxpbnV4LWlzY3NpLm9yZz4gd3JvdGU6DQo+Pj4gDQo+Pj4g
SGkgQ2hhbmcgJiBDbywNCj4+PiANCj4+PiAoQWRkaW5nIGxpc3QgKyBIaW1hbnNodSBDQycpDQo+
Pj4gDQo+Pj4gT24gU3VuLCAyMDE4LTAxLTA3IGF0IDEwOjIxICswMDAwLCBDaGFuZ2xpbWluIHdy
b3RlOg0KPj4+PiBIaSwNCj4+Pj4gSXQgc2VlbXMgdGhlIHFsYTJ4eHggY29tbWl0IGNhdXNlIExp
bnV4IG5vIHJlc3BvbnNlLCBoYXMgbm90IGZpeGVkIGluIGxhc3Rlc3QgdmVyc2lvbiA0LjE1LXJj
Ni4NCj4+Pj4gaHR0cHM6Ly9naXQua2VybmVsLm9yZy9wdWIvc2NtL2xpbnV4L2tlcm5lbC9naXQv
c3RhYmxlL2xpbnV4LXN0YWJsZS4NCj4+Pj4gZw0KPj4+PiBpdC9jb21taXQvP2lkPTcyNmI4NTQ4
NzA2N2Q3ZjViMjM0OTViYzMzYzQ4NGI4NTE3YzQwNzQNCj4+Pj4gDQo+Pj4gDQo+Pj4gVGhhbmtz
IGZvciByZXBvcnRpbmcgKyBpbmNsdWRpbmcgZGVidWcgbG9nLiAgOikNCj4+PiANCj4+Pj4gbHNw
Y2k6DQo+Pj4+IDBhOjAwLjAgRmlicmUgQ2hhbm5lbDogUUxvZ2ljIENvcnAuIElTUDI1MzItYmFz
ZWQgOEdiIEZpYnJlIENoYW5uZWwgDQo+Pj4+IHRvIFBDSSBFeHByZXNzIEhCQSAocmV2IDAyKQ0K
Pj4+PiAwYTowMC4xIEZpYnJlIENoYW5uZWw6IFFMb2dpYyBDb3JwLiBJU1AyNTMyLWJhc2VkIDhH
YiBGaWJyZSBDaGFubmVsIA0KPj4+PiB0byBQQ0kgRXhwcmVzcyBIQkEgKHJldiAwMikNCj4+Pj4g
DQo+Pj4+IHN5c2xvZzoNCj4+Pj4gcWxhMnh4eCBbMDAwMDowMDowMC4wXS0wMDA1OiA6IFFMb2dp
YyBGaWJyZSBDaGFubmVsIEhCQSBEcml2ZXI6IDguMDcuMDAuMzgtay4NCj4+Pj4gcWxhMnh4eCBb
MDAwMDowYTowMC4wXS0wMDFhOiA6IE1TSS1YIHZlY3RvciBjb3VudDogMzIuDQo+Pj4+IHFsYTJ4
eHggWzAwMDA6MGE6MDAuMF0tMDAxZDogOiBGb3VuZCBhbiBJU1AyNTMyIGlycSAxNiBpb2Jhc2Ug
MHhmZmZmYjBkNWNjNTAxMDAwLg0KPj4+PiBxbGEyeHh4IFswMDAwOjBhOjAwLjBdLTAwYzY6MTog
TVNJLVg6IEZhaWxlZCB0byBlbmFibGUgc3VwcG9ydCB3aXRoIDMyIHZlY3RvcnMsIHVzaW5nIDI2
IHZlY3RvcnMuDQo+Pj4+IHNjc2kgaG9zdDE6IHFsYTJ4eHgNCj4+Pj4gcWxhMnh4eCBbMDAwMDow
YTowMC4wXS0wMGZiOjE6IFFMb2dpYyBIUEFKNzY0QSAtIEhQIDhHYiBEdWFsIENoYW5uZWwgUENJ
LWUgMi4wIEZDIEhCQS4NCj4+Pj4gcWxhMnh4eCBbMDAwMDowYTowMC4wXS0wMGZjOjE6IElTUDI1
MzI6IFBDSWUgKDUuMEdUL3MgeDgpIEAgMDAwMDowYTowMC4wIGhkbWErIGhvc3QjPTEgZnc9OC4w
My4wMCAoOTBkNSkuDQo+Pj4+IHFsYTJ4eHggWzAwMDA6MGE6MDAuMV0tMDAxYTogOiBNU0ktWCB2
ZWN0b3IgY291bnQ6IDMyLg0KPj4+PiBxbGEyeHh4IFswMDAwOjBhOjAwLjFdLTAwMWQ6IDogRm91
bmQgYW4gSVNQMjUzMiBpcnEgMTcgaW9iYXNlIDB4ZmZmZmIwZDVjYzVkOTAwMC4NCj4+Pj4gcWxh
Mnh4eCBbMDAwMDowYTowMC4xXS0wMGM2OjI6IE1TSS1YOiBGYWlsZWQgdG8gZW5hYmxlIHN1cHBv
cnQgd2l0aCAzMiB2ZWN0b3JzLCB1c2luZyAyNiB2ZWN0b3JzLg0KPj4+PiBzY3NpIGhvc3QyOiBx
bGEyeHh4DQo+Pj4+IHFsYTJ4eHggWzAwMDA6MGE6MDAuMV0tMDBmYjoyOiBRTG9naWMgSFBBSjc2
NEEgLSBIUCA4R2IgRHVhbCBDaGFubmVsIFBDSS1lIDIuMCBGQyBIQkEuDQo+Pj4+IHFsYTJ4eHgg
WzAwMDA6MGE6MDAuMV0tMDBmYzoyOiBJU1AyNTMyOiBQQ0llICg1LjBHVC9zIHg4KSBAIDAwMDA6
MGE6MDAuMSBoZG1hKyBob3N0Iz0yIGZ3PTguMDMuMDAgKDkwZDUpLg0KPj4+PiBxbGEyeHh4IFsw
MDAwOjBhOjAwLjBdLTUwMGE6MTogTE9PUCBVUCBkZXRlY3RlZCAoOCBHYnBzKS4NCj4+Pj4gcWxh
Mnh4eCBbMDAwMDowYTowMC4xXS01MDBhOjI6IExPT1AgVVAgZGV0ZWN0ZWQgKDggR2JwcykuDQo+
Pj4+IA0KPj4+PiBUaGUgYXR0YWNoZWQgZmlsZSBpcyB0aGUgbW9kdWxlIGxvZy4NCj4+Pj4gDQo+
Pj4+IERvIHlvdSBoYXZlIGFueSBhZHZpY2U/DQo+Pj4gDQo+Pj4gUXVpbm4gJiBIaW1hbnNodSBm
b2xrcywgYW55IGNvbW1lbnRzLi4/DQo+Pj4gDQo+PiANCj4+IFdoYXQgaXMgdGhlIGlzc3VlIGhl
cmU/IEkgYW0gbm90IGNsZWFyIGZvcm0gdGhlIHNuaXBwZXQgYWJvdmUuDQo+PiANCj4+IE9uZSB0
aGluZyBJIG5vdGljZWQgdGhhdCwgaWYgeW91IGFyZSB1c2luZyA0LjE1LXJjNiBkcml2ZXIgdmVy
c2lvbiANCj4+IHNob3VsZCBiZSAxMC4wMC4wMC4wMi1rIGJ1dCB0aGUgc25pcHBldCBzaG93cyA4
LjA3LjAwLjM4LWsgd2hpY2ggDQo+PiB0ZWxscyBtZSB5b3UgbWlnaHQNCj4+IA0KPj4gVGhhbmtz
LA0KPj4gLSBIaW1hbnNodQ0KPj4gPHFsYTJ4eHgtZnVsbC5sb2cuZ3o+DQo+IA0KPiBUaGFua3Ms
DQo+IC0gSGltYW5zaHUNCj4gDQoNClRoYW5rcywNCi0gSGltYW5zaHUNCg0K

^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
@ 2018-01-18 12:51               ` Changlimin
  0 siblings, 0 replies; 16+ messages in thread
From: Changlimin @ 2018-01-18 12:51 UTC (permalink / raw)
  To: Madhani, Himanshu
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Himanshu,
  Today I reproduced the issue in my server.
  First, I compiled kernel 4.15-rc6 (make localmodconfig; make; make modules_install; make install), then start the kernel with parameter modprobe.blacklist=qla2xxx.
  Second,  tail -f /var/log/syslog
  Third,  modprobe qla2xxx ql2xextended_error_logging=0x1e400000 , the log is syslog-1e400000.txt
  The syslog-7fffffff is got when modprobe qla2xxx ql2xextended_error_logging=0x7fffffff

  BTW, I haven't load driver from 4.9.x to kernel 4.15-rc6. 
  When I checkout kernel commit 726b85487067d7f5b23495bc33c484b8517c4074, all kernel code is 4.9.x.

Regards
Chang Limin

-----Original Message-----
From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
Sent: Thursday, January 18, 2018 2:26 AM
To: changlimin (Cloud)
Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6

Hi Chang, 

> On Jan 15, 2018, at 10:49 PM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>   This is my progress.
>   First, I compiled 4.15-rc6, I found linux hang when booting, the stack showed something wrong in qla2xxx driver.

Can you provide me detail steps of how you compiled 4.15-rc6. Also provide me details of how you are loading driver and also provide complete log file.

I do not see how you will be able to load driver which is from 4.9.x when you compile fresh 4.15.0-rc6. 

Just FYI, I build test system with 8G/16G/32G adapter with 4.15.0-rc6 kernel and I am not able to see hang that you are describing. 

# uname -r
4.15.0-rc6+

# modprobe qla2xxx

# fcc.sh
FC HBAs:
HBA       Port Name                Port ID   State     Device
host3     21:00:00:24:ff:7e:f5:80  01:0d:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
host4     21:00:00:24:ff:7e:f5:81  01:0e:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
host5     21:00:00:0e:1e:12:e9:a0  01:06:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
host6     21:00:00:0e:1e:12:e9:a1  01:14:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
host7     21:00:00:24:ff:46:0a:5c  01:0d:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k
host8     21:00:00:24:ff:46:0a:5d  01:15:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k

# modinfo qla2xxx | more

filename:       /lib/modules/4.15.0-rc6+/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
firmware:       ql2500_fw.bin
firmware:       ql2400_fw.bin
firmware:       ql2322_fw.bin
firmware:       ql2300_fw.bin
firmware:       ql2200_fw.bin
firmware:       ql2100_fw.bin
version:        10.00.00.04-k
license:        GPL
description:    QLogic Fibre Channel HBA Driver
author:         QLogic Corporation
srcversion:     6CBCF1372A7756690E83CC3


>   Second, I want to find which commit introduced the issue. So I tried many times via git bisect to linux kernel.
>   Finally, I found the commit 726b85487067d7f5b23495bc33c484b8517c4074 introduced the issue. The attached log is related to this commit.
>   Also ubuntu kernel has this issue: 
>   
> https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-4.13.
> 0-25-generic_4.13.0-25.29_amd64.deb
>   
> https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-extra
> -4.13.0-25-generic_4.13.0-25.29_amd64.deb
> 
> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
> Sent: Tuesday, January 16, 2018 12:59 PM
> To: changlimin (Cloud)
> Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); 
> zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
> in lastest version 4.15-rc6
> 
> Hi Chang,
> 
>> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
>> 
>> Hi Himanshu,
>> The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.
> 
> From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 
> 
> [  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.
> 
> 4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled in with kernel 4.15.0-rc6.
> 
>> I have git bisect the commits. 
>> The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>> The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
>> 
>> Regards
>> Chang Limin
>> 
>> -----Original Message-----
>> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
>> Sent: Tuesday, January 16, 2018 12:58 AM
>> To: Nicholas A. Bellinger
>> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui 
>> (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
>> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
>> in lastest version 4.15-rc6
>> 
>> Hi Nic, Chang,
>> 
>>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>>> 
>>> Hi Chang & Co,
>>> 
>>> (Adding list + Himanshu CC')
>>> 
>>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>>> Hi,
>>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.
>>>> g
>>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>>> 
>>> 
>>> Thanks for reporting + including debug log.  :)
>>> 
>>>> lspci:
>>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>> to PCI Express HBA (rev 02)
>>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>> to PCI Express HBA (rev 02)
>>>> 
>>>> syslog:
>>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>> scsi host1: qla2xxx
>>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>> scsi host2: qla2xxx
>>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>>> 
>>>> The attached file is the module log.
>>>> 
>>>> Do you have any advice?
>>> 
>>> Quinn & Himanshu folks, any comments..?
>>> 
>> 
>> What is the issue here? I am not clear form the snippet above.
>> 
>> One thing I noticed that, if you are using 4.15-rc6 driver version 
>> should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which 
>> tells me you might
>> 
>> Thanks,
>> - Himanshu
>> <qla2xxx-full.log.gz>
> 
> Thanks,
> - Himanshu
> 

Thanks,
- Himanshu


^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-18 12:51               ` Changlimin
@ 2018-01-29 23:40                 ` Madhani, Himanshu
  -1 siblings, 0 replies; 16+ messages in thread
From: Madhani, Himanshu @ 2018-01-29 23:40 UTC (permalink / raw)
  To: Changlimin
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

SGkgQ2hhbmcsIA0KDQo+IE9uIEphbiAxOCwgMjAxOCwgYXQgNDo1MSBBTSwgQ2hhbmdsaW1pbiA8
Y2hhbmdsaW1pbkBoM2MuY29tPiB3cm90ZToNCj4gDQo+IEhpIEhpbWFuc2h177yMDQo+ICBUb2Rh
eSBJIHJlcHJvZHVjZWQgdGhlIGlzc3VlIGluIG15IHNlcnZlci4NCj4gIEZpcnN0LCBJIGNvbXBp
bGVkIGtlcm5lbCA0LjE1LXJjNiAobWFrZSBsb2NhbG1vZGNvbmZpZzsgbWFrZTsgbWFrZSBtb2R1
bGVzX2luc3RhbGw7IG1ha2UgaW5zdGFsbCksIHRoZW4gc3RhcnQgdGhlIGtlcm5lbCB3aXRoIHBh
cmFtZXRlciBtb2Rwcm9iZS5ibGFja2xpc3Q9cWxhMnh4eC4NCj4gIFNlY29uZCwgIHRhaWwgLWYg
L3Zhci9sb2cvc3lzbG9nDQo+ICBUaGlyZCwgIG1vZHByb2JlIHFsYTJ4eHggcWwyeGV4dGVuZGVk
X2Vycm9yX2xvZ2dpbmc9MHgxZTQwMDAwMCAsIHRoZSBsb2cgaXMgc3lzbG9nLTFlNDAwMDAwLnR4
dA0KPiAgVGhlIHN5c2xvZy03ZmZmZmZmZiBpcyBnb3Qgd2hlbiBtb2Rwcm9iZSBxbGEyeHh4IHFs
MnhleHRlbmRlZF9lcnJvcl9sb2dnaW5nPTB4N2ZmZmZmZmYNCj4gDQo+ICBCVFcsIEkgaGF2ZW4n
dCBsb2FkIGRyaXZlciBmcm9tIDQuOS54IHRvIGtlcm5lbCA0LjE1LXJjNi4gDQo+ICBXaGVuIEkg
Y2hlY2tvdXQga2VybmVsIGNvbW1pdCA3MjZiODU0ODcwNjdkN2Y1YjIzNDk1YmMzM2M0ODRiODUx
N2M0MDc0LCBhbGwga2VybmVsIGNvZGUgaXMgNC45LnguDQo+IA0KDQpTb3JyeSBmb3IgZXh0ZW5k
ZWQgZGVsYXkgaW4gdGhlIHJlc3BvbnNlLiBGcm9tIHRoZSBzeXNsb2cgdGhhdCB5b3Ugc2VudCBt
ZSwgSSBkbyBzZWUgZHJpdmVyIHZlcnNpb24gMTAuMDAuMDAuMDItayB3aGljaCBpcyBmcm9tIDQu
MTUuMC1yYzYgc28gYXRsZWFzdCB5b3UgYXJlIHVzaW5nIHRoZSBjb3JyZWN0DQpkcml2ZXIuIChp
biB5b3VyIGVtYWlsIGVhcmxpZXIgeW91IG1lbnRpb25lZCA4LjA3Lnh4IHdoaWNoIHdhcyBjb25m
dXNpbmcpIA0KDQpKYW4gMTggMjA6MzA6MjMgY3Zrbm9kZTI1IGtlcm5lbDogWyAgMTAwLjk5MTMw
OV0gcWxhMnh4eCBbMDAwMDowMDowMC4wXS0wMDA1OiA6IFFMb2dpYyBGaWJyZSBDaGFubmVsIEhC
QSBEcml2ZXI6IDEwLjAwLjAwLjAyLWstZGVidWcuDQpKYW4gMTggMjA6MzA6MjMgY3Zrbm9kZTI1
IGtlcm5lbDogWyAgMTAwLjk5MTQ4Nl0gcWxhMnh4eCBbMDAwMDowYTowMC4wXS0wMDFkOiA6IEZv
dW5kIGFuIElTUDI1MzIgaXJxIDE2IGlvYmFzZSAweDAwMDAwMDAwNjdhYWQ5ZmQuDQpKYW4gMTgg
MjA6MzA6MjMgY3Zrbm9kZTI1IGtlcm5lbDogWyAgMTAxLjY1MTY3Nl0gcWxhMnh4eCBbMDAwMDow
YTowMC4wXS00ODAwOjE6IERQQyBoYW5kbGVyIHNsZWVwaW5nLg0KSmFuIDE4IDIwOjMwOjIzIGN2
a25vZGUyNSBrZXJuZWw6IFsgIDEwMS42NTE2NzddIHNjc2kgaG9zdDE6IHFsYTJ4eHgNCg0KQWxz
byBJIGRvIHNlZSAgDQoNCkphbiAxOCAyMDozMDoyNCBjdmtub2RlMjUga2VybmVsOiBbICAxMDIu
NjI0OTg3XSBxbGEyeHh4IFswMDAwOjBhOjAwLjBdLTUwMGE6MTogTE9PUCBVUCBkZXRlY3RlZCAo
OCBHYnBzKS4NCg0KaS5lLiBkcml2ZXIgd2FzIGFibGUgdG8gYnJpbmcgdXAgOEcgbGluayANCg0K
U28gaGF2aW5nIHNhaWQgdGhhdCBpIHN0aWxsIGRvIG5vdCBoYXZlIGNsZWFyIHBpY3R1cmUgZnJv
bSB0aGUgbG9ncyBwcm92aWRlZCwgd2h5IHlvdSBhcmUgZW5jb3VudGVyaW5nIGlzc3VlLiANCg0K
Q2FuIHlvdSBwbGVhc2Ugc2hhcmUgeW91IGNvbmZpZ3VyYXRpb24gZGV0YWlscy4gSSB3b3VsZCBs
aWtlIHRvIHNlZSBob3cgaXMgeW91ciBzeXN0ZW0gc2V0dXAgYW5kIHNlZSBpZiBpIGNhbiByZXBs
aWNhdGUgaW4gb3VyIGxhYiBoZXJlLiANCg0KPiBSZWdhcmRzDQo+IENoYW5nIExpbWluDQo+IA0K
PiAtLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KPiBGcm9tOiBNYWRoYW5pLCBIaW1hbnNodSBb
bWFpbHRvOkhpbWFuc2h1Lk1hZGhhbmlAY2F2aXVtLmNvbV0NCj4gU2VudDogVGh1cnNkYXksIEph
bnVhcnkgMTgsIDIwMTggMjoyNiBBTQ0KPiBUbzogY2hhbmdsaW1pbiAoQ2xvdWQpDQo+IENjOiBO
aWNob2xhcyBBLiBCZWxsaW5nZXI7IFRyYW4sIFF1aW5uOyBqaWZ1bGlhbmcgKENsb3VkKTsgemhh
bmdndWFuZ2h1aSAoQ2xvdWQpOyB6aGFuZ3ppamlhbiAoQ2xvdWQpOyB0YXJnZXQtZGV2ZWw7IGxp
bnV4LXNjc2kNCj4gU3ViamVjdDogUmU6IEEgcWxhMnh4eCBjb21taXQgY2F1c2UgTGludXggbm8g
cmVzcG9uc2UsIGhhcyBub3QgZml4ZWQgaW4gbGFzdGVzdCB2ZXJzaW9uIDQuMTUtcmM2DQo+IA0K
PiBIaSBDaGFuZywgDQo+IA0KPj4gT24gSmFuIDE1LCAyMDE4LCBhdCAxMDo0OSBQTSwgQ2hhbmds
aW1pbiA8Y2hhbmdsaW1pbkBoM2MuY29tPiB3cm90ZToNCj4+IA0KPj4gSGkgSGltYW5zaHUsDQo+
PiAgVGhpcyBpcyBteSBwcm9ncmVzcy4NCj4+ICBGaXJzdCwgSSBjb21waWxlZCA0LjE1LXJjNiwg
SSBmb3VuZCBsaW51eCBoYW5nIHdoZW4gYm9vdGluZywgdGhlIHN0YWNrIHNob3dlZCBzb21ldGhp
bmcgd3JvbmcgaW4gcWxhMnh4eCBkcml2ZXIuDQo+IA0KPiBDYW4geW91IHByb3ZpZGUgbWUgZGV0
YWlsIHN0ZXBzIG9mIGhvdyB5b3UgY29tcGlsZWQgNC4xNS1yYzYuIEFsc28gcHJvdmlkZSBtZSBk
ZXRhaWxzIG9mIGhvdyB5b3UgYXJlIGxvYWRpbmcgZHJpdmVyIGFuZCBhbHNvIHByb3ZpZGUgY29t
cGxldGUgbG9nIGZpbGUuDQo+IA0KPiBJIGRvIG5vdCBzZWUgaG93IHlvdSB3aWxsIGJlIGFibGUg
dG8gbG9hZCBkcml2ZXIgd2hpY2ggaXMgZnJvbSA0LjkueCB3aGVuIHlvdSBjb21waWxlIGZyZXNo
IDQuMTUuMC1yYzYuIA0KPiANCj4gSnVzdCBGWUksIEkgYnVpbGQgdGVzdCBzeXN0ZW0gd2l0aCA4
Ry8xNkcvMzJHIGFkYXB0ZXIgd2l0aCA0LjE1LjAtcmM2IGtlcm5lbCBhbmQgSSBhbSBub3QgYWJs
ZSB0byBzZWUgaGFuZyB0aGF0IHlvdSBhcmUgZGVzY3JpYmluZy4gDQo+IA0KPiAjIHVuYW1lIC1y
DQo+IDQuMTUuMC1yYzYrDQo+IA0KPiAjIG1vZHByb2JlIHFsYTJ4eHgNCj4gDQo+ICMgZmNjLnNo
DQo+IEZDIEhCQXM6DQo+IEhCQSAgICAgICBQb3J0IE5hbWUgICAgICAgICAgICAgICAgUG9ydCBJ
RCAgIFN0YXRlICAgICBEZXZpY2UNCj4gaG9zdDMgICAgIDIxOjAwOjAwOjI0OmZmOjdlOmY1Ojgw
ICAwMTowZDowMCAgT25saW5lICAgIFFMRTI3NDIgRlc6djguMDUuNjMgRFZSOnYxMC4wMC4wMC4w
NC1rDQo+IGhvc3Q0ICAgICAyMTowMDowMDoyNDpmZjo3ZTpmNTo4MSAgMDE6MGU6MDAgIE9ubGlu
ZSAgICBRTEUyNzQyIEZXOnY4LjA1LjYzIERWUjp2MTAuMDAuMDAuMDQtaw0KPiBob3N0NSAgICAg
MjE6MDA6MDA6MGU6MWU6MTI6ZTk6YTAgIDAxOjA2OjAwICBPbmxpbmUgICAgUUxFODM2MiBGVzp2
OC4wMy4wNiBEVlI6djEwLjAwLjAwLjA0LWsNCj4gaG9zdDYgICAgIDIxOjAwOjAwOjBlOjFlOjEy
OmU5OmExICAwMToxNDowMCAgT25saW5lICAgIFFMRTgzNjIgRlc6djguMDMuMDYgRFZSOnYxMC4w
MC4wMC4wNC1rDQo+IGhvc3Q3ICAgICAyMTowMDowMDoyNDpmZjo0NjowYTo1YyAgMDE6MGQ6MDAg
IE9ubGluZSAgICBRTEUyNTYyIEZXOnY4LjAzLjAwIERWUjp2MTAuMDAuMDAuMDQtaw0KPiBob3N0
OCAgICAgMjE6MDA6MDA6MjQ6ZmY6NDY6MGE6NWQgIDAxOjE1OjAwICBPbmxpbmUgICAgUUxFMjU2
MiBGVzp2OC4wMy4wMCBEVlI6djEwLjAwLjAwLjA0LWsNCj4gDQo+ICMgbW9kaW5mbyBxbGEyeHh4
IHwgbW9yZQ0KPiANCj4gZmlsZW5hbWU6ICAgICAgIC9saWIvbW9kdWxlcy80LjE1LjAtcmM2Ky9r
ZXJuZWwvZHJpdmVycy9zY3NpL3FsYTJ4eHgvcWxhMnh4eC5rbw0KPiBmaXJtd2FyZTogICAgICAg
cWwyNTAwX2Z3LmJpbg0KPiBmaXJtd2FyZTogICAgICAgcWwyNDAwX2Z3LmJpbg0KPiBmaXJtd2Fy
ZTogICAgICAgcWwyMzIyX2Z3LmJpbg0KPiBmaXJtd2FyZTogICAgICAgcWwyMzAwX2Z3LmJpbg0K
PiBmaXJtd2FyZTogICAgICAgcWwyMjAwX2Z3LmJpbg0KPiBmaXJtd2FyZTogICAgICAgcWwyMTAw
X2Z3LmJpbg0KPiB2ZXJzaW9uOiAgICAgICAgMTAuMDAuMDAuMDQtaw0KPiBsaWNlbnNlOiAgICAg
ICAgR1BMDQo+IGRlc2NyaXB0aW9uOiAgICBRTG9naWMgRmlicmUgQ2hhbm5lbCBIQkEgRHJpdmVy
DQo+IGF1dGhvcjogICAgICAgICBRTG9naWMgQ29ycG9yYXRpb24NCj4gc3JjdmVyc2lvbjogICAg
IDZDQkNGMTM3MkE3NzU2NjkwRTgzQ0MzDQo+IA0KPiANCj4+ICBTZWNvbmQsIEkgd2FudCB0byBm
aW5kIHdoaWNoIGNvbW1pdCBpbnRyb2R1Y2VkIHRoZSBpc3N1ZS4gU28gSSB0cmllZCBtYW55IHRp
bWVzIHZpYSBnaXQgYmlzZWN0IHRvIGxpbnV4IGtlcm5lbC4NCj4+ICBGaW5hbGx5LCBJIGZvdW5k
IHRoZSBjb21taXQgNzI2Yjg1NDg3MDY3ZDdmNWIyMzQ5NWJjMzNjNDg0Yjg1MTdjNDA3NCBpbnRy
b2R1Y2VkIHRoZSBpc3N1ZS4gVGhlIGF0dGFjaGVkIGxvZyBpcyByZWxhdGVkIHRvIHRoaXMgY29t
bWl0Lg0KPj4gIEFsc28gdWJ1bnR1IGtlcm5lbCBoYXMgdGhpcyBpc3N1ZTogDQo+PiANCj4+IGh0
dHBzOi8vbGF1bmNocGFkLm5ldC91YnVudHUvK2FyY2hpdmUvcHJpbWFyeS8rZmlsZXMvbGludXgt
aW1hZ2UtNC4xMy4NCj4+IDAtMjUtZ2VuZXJpY180LjEzLjAtMjUuMjlfYW1kNjQuZGViDQo+PiAN
Cj4+IGh0dHBzOi8vbGF1bmNocGFkLm5ldC91YnVudHUvK2FyY2hpdmUvcHJpbWFyeS8rZmlsZXMv
bGludXgtaW1hZ2UtZXh0cmENCj4+IC00LjEzLjAtMjUtZ2VuZXJpY180LjEzLjAtMjUuMjlfYW1k
NjQuZGViDQo+PiANCj4+IFJlZ2FyZHMNCj4+IENoYW5nIExpbWluDQo+PiANCj4+IC0tLS0tT3Jp
Z2luYWwgTWVzc2FnZS0tLS0tDQo+PiBGcm9tOiBNYWRoYW5pLCBIaW1hbnNodSBbbWFpbHRvOkhp
bWFuc2h1Lk1hZGhhbmlAY2F2aXVtLmNvbV0NCj4+IFNlbnQ6IFR1ZXNkYXksIEphbnVhcnkgMTYs
IDIwMTggMTI6NTkgUE0NCj4+IFRvOiBjaGFuZ2xpbWluIChDbG91ZCkNCj4+IENjOiBOaWNob2xh
cyBBLiBCZWxsaW5nZXI7IFRyYW4sIFF1aW5uOyBqaWZ1bGlhbmcgKENsb3VkKTsgDQo+PiB6aGFu
Z2d1YW5naHVpIChDbG91ZCk7IHpoYW5nemlqaWFuIChDbG91ZCk7IHRhcmdldC1kZXZlbDsgbGlu
dXgtc2NzaQ0KPj4gU3ViamVjdDogUmU6IEEgcWxhMnh4eCBjb21taXQgY2F1c2UgTGludXggbm8g
cmVzcG9uc2UsIGhhcyBub3QgZml4ZWQgDQo+PiBpbiBsYXN0ZXN0IHZlcnNpb24gNC4xNS1yYzYN
Cj4+IA0KPj4gSGkgQ2hhbmcsDQo+PiANCj4+PiBPbiBKYW4gMTUsIDIwMTgsIGF0IDQ6MjcgUE0s
IENoYW5nbGltaW4gPGNoYW5nbGltaW5AaDNjLmNvbT4gd3JvdGU6DQo+Pj4gDQo+Pj4gSGkgSGlt
YW5zaHUsDQo+Pj4gVGhlIGlzc3VlIGlzOiBXaGVuIGluc21vZCB0aGUgcWxhMnh4eC5rbyBmcm9t
IDQuMTUtcmM2LCBsaW51eCBoYW5nLg0KPj4gDQo+PiBGcm9tIHRoZSBsb2cgZmlsZSBhdHRhY2hl
ZC4gSSBzZWUgdGhhdCB5b3UgYXJlIHRyeWluZyB0byBsb2FkIGRyaXZlciBmcm9tIDQuOS54IGlu
IDQuMTUuMC1yYzYuIA0KPj4gDQo+PiBbICAyNzkuODk4NzA0XSBxbGEyeHh4IFswMDAwOjAwOjAw
LjBdLTAwMDU6IDogUUxvZ2ljIEZpYnJlIENoYW5uZWwgSEJBIERyaXZlcjogOC4wNy4wMC4zOC1r
LWRlYnVnLg0KPj4gDQo+PiA0LjE1LjAtcmM2IGhhZCBkcml2ZXIgdmVyc2lvbiAxMC4wMC4wMC4w
Mi1rLiBXb3VsZCB5b3UgY2hlY2sgaWYgeW91IGhhdmUgYWxsIHRoZSBkcml2ZXIgY2hhbmdlcyBw
dWxsZWQgaW4gd2l0aCBrZXJuZWwgNC4xNS4wLXJjNi4NCj4+IA0KPj4+IEkgaGF2ZSBnaXQgYmlz
ZWN0IHRoZSBjb21taXRzLiANCj4+PiBUaGUgaXNzdWUgd2FzIGludHJvZHVjZWQgaW4gY29tbWl0
OiA3MjZiODU0ODcwNjdkN2Y1YjIzNDk1YmMzM2M0ODRiODUxN2M0MDc0IHFsYTJ4eHg6IEFkZCBm
cmFtZXdvcmsgZm9yIGFzeW5jIGZhYnJpYyBkaXNjb3ZlcnkuDQo+Pj4gVGhlIHByZXZpb3VzIGNv
bW1pdCBpcyBnb29kOiA1ZDk2NDgzN2M2YTc0MzE5M2M2M2M4OTEyZjk4ODM0Yzc0NTdiYTVjIHFs
YTJ4eHg6IFRyYWNrIEktVCBuZXh1cyBhcyBzaW5nbGUgZmNfcG9ydCBzdHJ1Y3QgLg0KPj4+IA0K
Pj4+IFJlZ2FyZHMNCj4+PiBDaGFuZyBMaW1pbg0KPj4+IA0KPj4+IC0tLS0tT3JpZ2luYWwgTWVz
c2FnZS0tLS0tDQo+Pj4gRnJvbTogTWFkaGFuaSwgSGltYW5zaHUgW21haWx0bzpIaW1hbnNodS5N
YWRoYW5pQGNhdml1bS5jb21dDQo+Pj4gU2VudDogVHVlc2RheSwgSmFudWFyeSAxNiwgMjAxOCAx
Mjo1OCBBTQ0KPj4+IFRvOiBOaWNob2xhcyBBLiBCZWxsaW5nZXINCj4+PiBDYzogY2hhbmdsaW1p
biAoQ2xvdWQpOyBUcmFuLCBRdWlubjsgamlmdWxpYW5nIChDbG91ZCk7IHpoYW5nZ3VhbmdodWkg
DQo+Pj4gKENsb3VkKTsgemhhbmd6aWppYW4gKENsb3VkKTsgdGFyZ2V0LWRldmVsOyBsaW51eC1z
Y3NpDQo+Pj4gU3ViamVjdDogUmU6IEEgcWxhMnh4eCBjb21taXQgY2F1c2UgTGludXggbm8gcmVz
cG9uc2UsIGhhcyBub3QgZml4ZWQgDQo+Pj4gaW4gbGFzdGVzdCB2ZXJzaW9uIDQuMTUtcmM2DQo+
Pj4gDQo+Pj4gSGkgTmljLCBDaGFuZywNCj4+PiANCj4+Pj4gT24gSmFuIDEyLCAyMDE4LCBhdCA5
OjI4IFBNLCBOaWNob2xhcyBBLiBCZWxsaW5nZXIgPG5hYkBsaW51eC1pc2NzaS5vcmc+IHdyb3Rl
Og0KPj4+PiANCj4+Pj4gSGkgQ2hhbmcgJiBDbywNCj4+Pj4gDQo+Pj4+IChBZGRpbmcgbGlzdCAr
IEhpbWFuc2h1IENDJykNCj4+Pj4gDQo+Pj4+IE9uIFN1biwgMjAxOC0wMS0wNyBhdCAxMDoyMSAr
MDAwMCwgQ2hhbmdsaW1pbiB3cm90ZToNCj4+Pj4+IEhpLA0KPj4+Pj4gSXQgc2VlbXMgdGhlIHFs
YTJ4eHggY29tbWl0IGNhdXNlIExpbnV4IG5vIHJlc3BvbnNlLCBoYXMgbm90IGZpeGVkIGluIGxh
c3Rlc3QgdmVyc2lvbiA0LjE1LXJjNi4NCj4+Pj4+IGh0dHBzOi8vZ2l0Lmtlcm5lbC5vcmcvcHVi
L3NjbS9saW51eC9rZXJuZWwvZ2l0L3N0YWJsZS9saW51eC1zdGFibGUuDQo+Pj4+PiBnDQo+Pj4+
PiBpdC9jb21taXQvP2lkPTcyNmI4NTQ4NzA2N2Q3ZjViMjM0OTViYzMzYzQ4NGI4NTE3YzQwNzQN
Cj4+Pj4+IA0KPj4+PiANCj4+Pj4gVGhhbmtzIGZvciByZXBvcnRpbmcgKyBpbmNsdWRpbmcgZGVi
dWcgbG9nLiAgOikNCj4+Pj4gDQo+Pj4+PiBsc3BjaToNCj4+Pj4+IDBhOjAwLjAgRmlicmUgQ2hh
bm5lbDogUUxvZ2ljIENvcnAuIElTUDI1MzItYmFzZWQgOEdiIEZpYnJlIENoYW5uZWwgDQo+Pj4+
PiB0byBQQ0kgRXhwcmVzcyBIQkEgKHJldiAwMikNCj4+Pj4+IDBhOjAwLjEgRmlicmUgQ2hhbm5l
bDogUUxvZ2ljIENvcnAuIElTUDI1MzItYmFzZWQgOEdiIEZpYnJlIENoYW5uZWwgDQo+Pj4+PiB0
byBQQ0kgRXhwcmVzcyBIQkEgKHJldiAwMikNCj4+Pj4+IA0KPj4+Pj4gc3lzbG9nOg0KPj4+Pj4g
cWxhMnh4eCBbMDAwMDowMDowMC4wXS0wMDA1OiA6IFFMb2dpYyBGaWJyZSBDaGFubmVsIEhCQSBE
cml2ZXI6IDguMDcuMDAuMzgtay4NCj4+Pj4+IHFsYTJ4eHggWzAwMDA6MGE6MDAuMF0tMDAxYTog
OiBNU0ktWCB2ZWN0b3IgY291bnQ6IDMyLg0KPj4+Pj4gcWxhMnh4eCBbMDAwMDowYTowMC4wXS0w
MDFkOiA6IEZvdW5kIGFuIElTUDI1MzIgaXJxIDE2IGlvYmFzZSAweGZmZmZiMGQ1Y2M1MDEwMDAu
DQo+Pj4+PiBxbGEyeHh4IFswMDAwOjBhOjAwLjBdLTAwYzY6MTogTVNJLVg6IEZhaWxlZCB0byBl
bmFibGUgc3VwcG9ydCB3aXRoIDMyIHZlY3RvcnMsIHVzaW5nIDI2IHZlY3RvcnMuDQo+Pj4+PiBz
Y3NpIGhvc3QxOiBxbGEyeHh4DQo+Pj4+PiBxbGEyeHh4IFswMDAwOjBhOjAwLjBdLTAwZmI6MTog
UUxvZ2ljIEhQQUo3NjRBIC0gSFAgOEdiIER1YWwgQ2hhbm5lbCBQQ0ktZSAyLjAgRkMgSEJBLg0K
Pj4+Pj4gcWxhMnh4eCBbMDAwMDowYTowMC4wXS0wMGZjOjE6IElTUDI1MzI6IFBDSWUgKDUuMEdU
L3MgeDgpIEAgMDAwMDowYTowMC4wIGhkbWErIGhvc3QjPTEgZnc9OC4wMy4wMCAoOTBkNSkuDQo+
Pj4+PiBxbGEyeHh4IFswMDAwOjBhOjAwLjFdLTAwMWE6IDogTVNJLVggdmVjdG9yIGNvdW50OiAz
Mi4NCj4+Pj4+IHFsYTJ4eHggWzAwMDA6MGE6MDAuMV0tMDAxZDogOiBGb3VuZCBhbiBJU1AyNTMy
IGlycSAxNyBpb2Jhc2UgMHhmZmZmYjBkNWNjNWQ5MDAwLg0KPj4+Pj4gcWxhMnh4eCBbMDAwMDow
YTowMC4xXS0wMGM2OjI6IE1TSS1YOiBGYWlsZWQgdG8gZW5hYmxlIHN1cHBvcnQgd2l0aCAzMiB2
ZWN0b3JzLCB1c2luZyAyNiB2ZWN0b3JzLg0KPj4+Pj4gc2NzaSBob3N0MjogcWxhMnh4eA0KPj4+
Pj4gcWxhMnh4eCBbMDAwMDowYTowMC4xXS0wMGZiOjI6IFFMb2dpYyBIUEFKNzY0QSAtIEhQIDhH
YiBEdWFsIENoYW5uZWwgUENJLWUgMi4wIEZDIEhCQS4NCj4+Pj4+IHFsYTJ4eHggWzAwMDA6MGE6
MDAuMV0tMDBmYzoyOiBJU1AyNTMyOiBQQ0llICg1LjBHVC9zIHg4KSBAIDAwMDA6MGE6MDAuMSBo
ZG1hKyBob3N0Iz0yIGZ3PTguMDMuMDAgKDkwZDUpLg0KPj4+Pj4gcWxhMnh4eCBbMDAwMDowYTow
MC4wXS01MDBhOjE6IExPT1AgVVAgZGV0ZWN0ZWQgKDggR2JwcykuDQo+Pj4+PiBxbGEyeHh4IFsw
MDAwOjBhOjAwLjFdLTUwMGE6MjogTE9PUCBVUCBkZXRlY3RlZCAoOCBHYnBzKS4NCj4+Pj4+IA0K
Pj4+Pj4gVGhlIGF0dGFjaGVkIGZpbGUgaXMgdGhlIG1vZHVsZSBsb2cuDQo+Pj4+PiANCj4+Pj4+
IERvIHlvdSBoYXZlIGFueSBhZHZpY2U/DQo+Pj4+IA0KPj4+PiBRdWlubiAmIEhpbWFuc2h1IGZv
bGtzLCBhbnkgY29tbWVudHMuLj8NCj4+Pj4gDQo+Pj4gDQo+Pj4gV2hhdCBpcyB0aGUgaXNzdWUg
aGVyZT8gSSBhbSBub3QgY2xlYXIgZm9ybSB0aGUgc25pcHBldCBhYm92ZS4NCj4+PiANCj4+PiBP
bmUgdGhpbmcgSSBub3RpY2VkIHRoYXQsIGlmIHlvdSBhcmUgdXNpbmcgNC4xNS1yYzYgZHJpdmVy
IHZlcnNpb24gDQo+Pj4gc2hvdWxkIGJlIDEwLjAwLjAwLjAyLWsgYnV0IHRoZSBzbmlwcGV0IHNo
b3dzIDguMDcuMDAuMzgtayB3aGljaCANCj4+PiB0ZWxscyBtZSB5b3UgbWlnaHQNCj4+PiANCj4+
PiBUaGFua3MsDQo+Pj4gLSBIaW1hbnNodQ0KPj4+IDxxbGEyeHh4LWZ1bGwubG9nLmd6Pg0KPj4g
DQo+PiBUaGFua3MsDQo+PiAtIEhpbWFuc2h1DQo+PiANCj4gDQo+IFRoYW5rcywNCj4gLSBIaW1h
bnNodQ0KPiANCg0KVGhhbmtzLA0KLSBIaW1hbnNodQ0KDQo

^ permalink raw reply	[flat|nested] 16+ messages in thread

* Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
@ 2018-01-29 23:40                 ` Madhani, Himanshu
  0 siblings, 0 replies; 16+ messages in thread
From: Madhani, Himanshu @ 2018-01-29 23:40 UTC (permalink / raw)
  To: Changlimin
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Chang, 

> On Jan 18, 2018, at 4:51 AM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>  Today I reproduced the issue in my server.
>  First, I compiled kernel 4.15-rc6 (make localmodconfig; make; make modules_install; make install), then start the kernel with parameter modprobe.blacklist=qla2xxx.
>  Second,  tail -f /var/log/syslog
>  Third,  modprobe qla2xxx ql2xextended_error_logging=0x1e400000 , the log is syslog-1e400000.txt
>  The syslog-7fffffff is got when modprobe qla2xxx ql2xextended_error_logging=0x7fffffff
> 
>  BTW, I haven't load driver from 4.9.x to kernel 4.15-rc6. 
>  When I checkout kernel commit 726b85487067d7f5b23495bc33c484b8517c4074, all kernel code is 4.9.x.
> 

Sorry for extended delay in the response. From the syslog that you sent me, I do see driver version 10.00.00.02-k which is from 4.15.0-rc6 so atleast you are using the correct
driver. (in your email earlier you mentioned 8.07.xx which was confusing) 

Jan 18 20:30:23 cvknode25 kernel: [  100.991309] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.00.00.02-k-debug.
Jan 18 20:30:23 cvknode25 kernel: [  100.991486] qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0x0000000067aad9fd.
Jan 18 20:30:23 cvknode25 kernel: [  101.651676] qla2xxx [0000:0a:00.0]-4800:1: DPC handler sleeping.
Jan 18 20:30:23 cvknode25 kernel: [  101.651677] scsi host1: qla2xxx

Also I do see  

Jan 18 20:30:24 cvknode25 kernel: [  102.624987] qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).

i.e. driver was able to bring up 8G link 

So having said that i still do not have clear picture from the logs provided, why you are encountering issue. 

Can you please share you configuration details. I would like to see how is your system setup and see if i can replicate in our lab here. 

> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
> Sent: Thursday, January 18, 2018 2:26 AM
> To: changlimin (Cloud)
> Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
> 
> Hi Chang, 
> 
>> On Jan 15, 2018, at 10:49 PM, Changlimin <changlimin@h3c.com> wrote:
>> 
>> Hi Himanshu,
>>  This is my progress.
>>  First, I compiled 4.15-rc6, I found linux hang when booting, the stack showed something wrong in qla2xxx driver.
> 
> Can you provide me detail steps of how you compiled 4.15-rc6. Also provide me details of how you are loading driver and also provide complete log file.
> 
> I do not see how you will be able to load driver which is from 4.9.x when you compile fresh 4.15.0-rc6. 
> 
> Just FYI, I build test system with 8G/16G/32G adapter with 4.15.0-rc6 kernel and I am not able to see hang that you are describing. 
> 
> # uname -r
> 4.15.0-rc6+
> 
> # modprobe qla2xxx
> 
> # fcc.sh
> FC HBAs:
> HBA       Port Name                Port ID   State     Device
> host3     21:00:00:24:ff:7e:f5:80  01:0d:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
> host4     21:00:00:24:ff:7e:f5:81  01:0e:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
> host5     21:00:00:0e:1e:12:e9:a0  01:06:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
> host6     21:00:00:0e:1e:12:e9:a1  01:14:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
> host7     21:00:00:24:ff:46:0a:5c  01:0d:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k
> host8     21:00:00:24:ff:46:0a:5d  01:15:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k
> 
> # modinfo qla2xxx | more
> 
> filename:       /lib/modules/4.15.0-rc6+/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
> firmware:       ql2500_fw.bin
> firmware:       ql2400_fw.bin
> firmware:       ql2322_fw.bin
> firmware:       ql2300_fw.bin
> firmware:       ql2200_fw.bin
> firmware:       ql2100_fw.bin
> version:        10.00.00.04-k
> license:        GPL
> description:    QLogic Fibre Channel HBA Driver
> author:         QLogic Corporation
> srcversion:     6CBCF1372A7756690E83CC3
> 
> 
>>  Second, I want to find which commit introduced the issue. So I tried many times via git bisect to linux kernel.
>>  Finally, I found the commit 726b85487067d7f5b23495bc33c484b8517c4074 introduced the issue. The attached log is related to this commit.
>>  Also ubuntu kernel has this issue: 
>> 
>> https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-4.13.
>> 0-25-generic_4.13.0-25.29_amd64.deb
>> 
>> https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-extra
>> -4.13.0-25-generic_4.13.0-25.29_amd64.deb
>> 
>> Regards
>> Chang Limin
>> 
>> -----Original Message-----
>> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
>> Sent: Tuesday, January 16, 2018 12:59 PM
>> To: changlimin (Cloud)
>> Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); 
>> zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
>> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
>> in lastest version 4.15-rc6
>> 
>> Hi Chang,
>> 
>>> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
>>> 
>>> Hi Himanshu,
>>> The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.
>> 
>> From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 
>> 
>> [  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.
>> 
>> 4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled in with kernel 4.15.0-rc6.
>> 
>>> I have git bisect the commits. 
>>> The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>>> The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
>>> 
>>> Regards
>>> Chang Limin
>>> 
>>> -----Original Message-----
>>> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
>>> Sent: Tuesday, January 16, 2018 12:58 AM
>>> To: Nicholas A. Bellinger
>>> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui 
>>> (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
>>> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
>>> in lastest version 4.15-rc6
>>> 
>>> Hi Nic, Chang,
>>> 
>>>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>>>> 
>>>> Hi Chang & Co,
>>>> 
>>>> (Adding list + Himanshu CC')
>>>> 
>>>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>>>> Hi,
>>>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.
>>>>> g
>>>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>>>> 
>>>> 
>>>> Thanks for reporting + including debug log.  :)
>>>> 
>>>>> lspci:
>>>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>>> to PCI Express HBA (rev 02)
>>>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>>> to PCI Express HBA (rev 02)
>>>>> 
>>>>> syslog:
>>>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>>> scsi host1: qla2xxx
>>>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>>> scsi host2: qla2xxx
>>>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>>>> 
>>>>> The attached file is the module log.
>>>>> 
>>>>> Do you have any advice?
>>>> 
>>>> Quinn & Himanshu folks, any comments..?
>>>> 
>>> 
>>> What is the issue here? I am not clear form the snippet above.
>>> 
>>> One thing I noticed that, if you are using 4.15-rc6 driver version 
>>> should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which 
>>> tells me you might
>>> 
>>> Thanks,
>>> - Himanshu
>>> <qla2xxx-full.log.gz>
>> 
>> Thanks,
>> - Himanshu
>> 
> 
> Thanks,
> - Himanshu
> 

Thanks,
- Himanshu


^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
  2018-01-29 23:40                 ` Madhani, Himanshu
@ 2018-01-30 10:37                   ` Changlimin
  -1 siblings, 0 replies; 16+ messages in thread
From: Changlimin @ 2018-01-30 10:37 UTC (permalink / raw)
  To: Madhani, Himanshu
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

SGkgSGltYW5zaHUsDQogIFRvZGF5IEkgdHJpZWQgc2V2ZXJhbCB0aW1lcyBhbmQgaGF2ZSBzb21l
IG5ld3MuDQogIEJlZm9yZSBJIGluc21vZCB0aGUgcWxhMnh4eC5rbyAsIGlmIEkgc2h1dGRvd24g
dGhlbiBzdGFydCB0aGUgRkMgc3dpdGNoIHBvcnQgY29ubmVjdGVkIHRvIHRoZSBIQkEgY2FyZCwg
dGhlIHFsYTJ4eHgua28gd29ya3Mgd2VsbC4NCiAgSXQgc2VlbXMgdGhhdCB0aGUgaXNzdWUgaGFz
IHJlbGF0aW9uIHRvIHRoZSBGQyBzd2l0Y2ggcG9ydC4gTWF5YmUgc29tZSBvbGQgc3RhdHVzIGNh
dXNlcyB0aGUgaXNzdWUuDQogIFRoZSBGQyBzd2l0Y2ggbW9kZWwgaXMgSDNDIFM1ODIwVjIuDQoN
ClJlZ2FyZHMNCkNoYW5nIExpbWluDQoNCg0KLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCkZy
b206IE1hZGhhbmksIEhpbWFuc2h1IFttYWlsdG86SGltYW5zaHUuTWFkaGFuaUBjYXZpdW0uY29t
XSANClNlbnQ6IFR1ZXNkYXksIEphbnVhcnkgMzAsIDIwMTggNzo0MCBBTQ0KVG86IGNoYW5nbGlt
aW4gKENsb3VkKQ0KQ2M6IE5pY2hvbGFzIEEuIEJlbGxpbmdlcjsgVHJhbiwgUXVpbm47IGppZnVs
aWFuZyAoQ2xvdWQpOyB6aGFuZ2d1YW5naHVpIChDbG91ZCk7IHpoYW5nemlqaWFuIChDbG91ZCk7
IHRhcmdldC1kZXZlbDsgbGludXgtc2NzaQ0KU3ViamVjdDogUmU6IEEgcWxhMnh4eCBjb21taXQg
Y2F1c2UgTGludXggbm8gcmVzcG9uc2UsIGhhcyBub3QgZml4ZWQgaW4gbGFzdGVzdCB2ZXJzaW9u
IDQuMTUtcmM2DQoNCkhpIENoYW5nLCANCg0KPiBPbiBKYW4gMTgsIDIwMTgsIGF0IDQ6NTEgQU0s
IENoYW5nbGltaW4gPGNoYW5nbGltaW5AaDNjLmNvbT4gd3JvdGU6DQo+IA0KPiBIaSBIaW1hbnNo
de+8jA0KPiAgVG9kYXkgSSByZXByb2R1Y2VkIHRoZSBpc3N1ZSBpbiBteSBzZXJ2ZXIuDQo+ICBG
aXJzdCwgSSBjb21waWxlZCBrZXJuZWwgNC4xNS1yYzYgKG1ha2UgbG9jYWxtb2Rjb25maWc7IG1h
a2U7IG1ha2UgbW9kdWxlc19pbnN0YWxsOyBtYWtlIGluc3RhbGwpLCB0aGVuIHN0YXJ0IHRoZSBr
ZXJuZWwgd2l0aCBwYXJhbWV0ZXIgbW9kcHJvYmUuYmxhY2tsaXN0PXFsYTJ4eHguDQo+ICBTZWNv
bmQsICB0YWlsIC1mIC92YXIvbG9nL3N5c2xvZw0KPiAgVGhpcmQsICBtb2Rwcm9iZSBxbGEyeHh4
IHFsMnhleHRlbmRlZF9lcnJvcl9sb2dnaW5nPTB4MWU0MDAwMDAgLCB0aGUgbG9nIGlzIHN5c2xv
Zy0xZTQwMDAwMC50eHQNCj4gIFRoZSBzeXNsb2ctN2ZmZmZmZmYgaXMgZ290IHdoZW4gbW9kcHJv
YmUgcWxhMnh4eCBxbDJ4ZXh0ZW5kZWRfZXJyb3JfbG9nZ2luZz0weDdmZmZmZmZmDQo+IA0KPiAg
QlRXLCBJIGhhdmVuJ3QgbG9hZCBkcml2ZXIgZnJvbSA0LjkueCB0byBrZXJuZWwgNC4xNS1yYzYu
IA0KPiAgV2hlbiBJIGNoZWNrb3V0IGtlcm5lbCBjb21taXQgNzI2Yjg1NDg3MDY3ZDdmNWIyMzQ5
NWJjMzNjNDg0Yjg1MTdjNDA3NCwgYWxsIGtlcm5lbCBjb2RlIGlzIDQuOS54Lg0KPiANCg0KU29y
cnkgZm9yIGV4dGVuZGVkIGRlbGF5IGluIHRoZSByZXNwb25zZS4gRnJvbSB0aGUgc3lzbG9nIHRo
YXQgeW91IHNlbnQgbWUsIEkgZG8gc2VlIGRyaXZlciB2ZXJzaW9uIDEwLjAwLjAwLjAyLWsgd2hp
Y2ggaXMgZnJvbSA0LjE1LjAtcmM2IHNvIGF0bGVhc3QgeW91IGFyZSB1c2luZyB0aGUgY29ycmVj
dA0KZHJpdmVyLiAoaW4geW91ciBlbWFpbCBlYXJsaWVyIHlvdSBtZW50aW9uZWQgOC4wNy54eCB3
aGljaCB3YXMgY29uZnVzaW5nKSANCg0KSmFuIDE4IDIwOjMwOjIzIGN2a25vZGUyNSBrZXJuZWw6
IFsgIDEwMC45OTEzMDldIHFsYTJ4eHggWzAwMDA6MDA6MDAuMF0tMDAwNTogOiBRTG9naWMgRmli
cmUgQ2hhbm5lbCBIQkEgRHJpdmVyOiAxMC4wMC4wMC4wMi1rLWRlYnVnLg0KSmFuIDE4IDIwOjMw
OjIzIGN2a25vZGUyNSBrZXJuZWw6IFsgIDEwMC45OTE0ODZdIHFsYTJ4eHggWzAwMDA6MGE6MDAu
MF0tMDAxZDogOiBGb3VuZCBhbiBJU1AyNTMyIGlycSAxNiBpb2Jhc2UgMHgwMDAwMDAwMDY3YWFk
OWZkLg0KSmFuIDE4IDIwOjMwOjIzIGN2a25vZGUyNSBrZXJuZWw6IFsgIDEwMS42NTE2NzZdIHFs
YTJ4eHggWzAwMDA6MGE6MDAuMF0tNDgwMDoxOiBEUEMgaGFuZGxlciBzbGVlcGluZy4NCkphbiAx
OCAyMDozMDoyMyBjdmtub2RlMjUga2VybmVsOiBbICAxMDEuNjUxNjc3XSBzY3NpIGhvc3QxOiBx
bGEyeHh4DQoNCkFsc28gSSBkbyBzZWUgIA0KDQpKYW4gMTggMjA6MzA6MjQgY3Zrbm9kZTI1IGtl
cm5lbDogWyAgMTAyLjYyNDk4N10gcWxhMnh4eCBbMDAwMDowYTowMC4wXS01MDBhOjE6IExPT1Ag
VVAgZGV0ZWN0ZWQgKDggR2JwcykuDQoNCmkuZS4gZHJpdmVyIHdhcyBhYmxlIHRvIGJyaW5nIHVw
IDhHIGxpbmsgDQoNClNvIGhhdmluZyBzYWlkIHRoYXQgaSBzdGlsbCBkbyBub3QgaGF2ZSBjbGVh
ciBwaWN0dXJlIGZyb20gdGhlIGxvZ3MgcHJvdmlkZWQsIHdoeSB5b3UgYXJlIGVuY291bnRlcmlu
ZyBpc3N1ZS4gDQoNCkNhbiB5b3UgcGxlYXNlIHNoYXJlIHlvdSBjb25maWd1cmF0aW9uIGRldGFp
bHMuIEkgd291bGQgbGlrZSB0byBzZWUgaG93IGlzIHlvdXIgc3lzdGVtIHNldHVwIGFuZCBzZWUg
aWYgaSBjYW4gcmVwbGljYXRlIGluIG91ciBsYWIgaGVyZS4gDQoNCj4gUmVnYXJkcw0KPiBDaGFu
ZyBMaW1pbg0KPiANCj4gLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCj4gRnJvbTogTWFkaGFu
aSwgSGltYW5zaHUgW21haWx0bzpIaW1hbnNodS5NYWRoYW5pQGNhdml1bS5jb21dDQo+IFNlbnQ6
IFRodXJzZGF5LCBKYW51YXJ5IDE4LCAyMDE4IDI6MjYgQU0NCj4gVG86IGNoYW5nbGltaW4gKENs
b3VkKQ0KPiBDYzogTmljaG9sYXMgQS4gQmVsbGluZ2VyOyBUcmFuLCBRdWlubjsgamlmdWxpYW5n
IChDbG91ZCk7IHpoYW5nZ3VhbmdodWkgKENsb3VkKTsgemhhbmd6aWppYW4gKENsb3VkKTsgdGFy
Z2V0LWRldmVsOyBsaW51eC1zY3NpDQo+IFN1YmplY3Q6IFJlOiBBIHFsYTJ4eHggY29tbWl0IGNh
dXNlIExpbnV4IG5vIHJlc3BvbnNlLCBoYXMgbm90IGZpeGVkIGluIGxhc3Rlc3QgdmVyc2lvbiA0
LjE1LXJjNg0KPiANCj4gSGkgQ2hhbmcsIA0KPiANCj4+IE9uIEphbiAxNSwgMjAxOCwgYXQgMTA6
NDkgUE0sIENoYW5nbGltaW4gPGNoYW5nbGltaW5AaDNjLmNvbT4gd3JvdGU6DQo+PiANCj4+IEhp
IEhpbWFuc2h1LA0KPj4gIFRoaXMgaXMgbXkgcHJvZ3Jlc3MuDQo+PiAgRmlyc3QsIEkgY29tcGls
ZWQgNC4xNS1yYzYsIEkgZm91bmQgbGludXggaGFuZyB3aGVuIGJvb3RpbmcsIHRoZSBzdGFjayBz
aG93ZWQgc29tZXRoaW5nIHdyb25nIGluIHFsYTJ4eHggZHJpdmVyLg0KPiANCj4gQ2FuIHlvdSBw
cm92aWRlIG1lIGRldGFpbCBzdGVwcyBvZiBob3cgeW91IGNvbXBpbGVkIDQuMTUtcmM2LiBBbHNv
IHByb3ZpZGUgbWUgZGV0YWlscyBvZiBob3cgeW91IGFyZSBsb2FkaW5nIGRyaXZlciBhbmQgYWxz
byBwcm92aWRlIGNvbXBsZXRlIGxvZyBmaWxlLg0KPiANCj4gSSBkbyBub3Qgc2VlIGhvdyB5b3Ug
d2lsbCBiZSBhYmxlIHRvIGxvYWQgZHJpdmVyIHdoaWNoIGlzIGZyb20gNC45Lnggd2hlbiB5b3Ug
Y29tcGlsZSBmcmVzaCA0LjE1LjAtcmM2LiANCj4gDQo+IEp1c3QgRllJLCBJIGJ1aWxkIHRlc3Qg
c3lzdGVtIHdpdGggOEcvMTZHLzMyRyBhZGFwdGVyIHdpdGggNC4xNS4wLXJjNiBrZXJuZWwgYW5k
IEkgYW0gbm90IGFibGUgdG8gc2VlIGhhbmcgdGhhdCB5b3UgYXJlIGRlc2NyaWJpbmcuIA0KPiAN
Cj4gIyB1bmFtZSAtcg0KPiA0LjE1LjAtcmM2Kw0KPiANCj4gIyBtb2Rwcm9iZSBxbGEyeHh4DQo+
IA0KPiAjIGZjYy5zaA0KPiBGQyBIQkFzOg0KPiBIQkEgICAgICAgUG9ydCBOYW1lICAgICAgICAg
ICAgICAgIFBvcnQgSUQgICBTdGF0ZSAgICAgRGV2aWNlDQo+IGhvc3QzICAgICAyMTowMDowMDoy
NDpmZjo3ZTpmNTo4MCAgMDE6MGQ6MDAgIE9ubGluZSAgICBRTEUyNzQyIEZXOnY4LjA1LjYzIERW
Ujp2MTAuMDAuMDAuMDQtaw0KPiBob3N0NCAgICAgMjE6MDA6MDA6MjQ6ZmY6N2U6ZjU6ODEgIDAx
OjBlOjAwICBPbmxpbmUgICAgUUxFMjc0MiBGVzp2OC4wNS42MyBEVlI6djEwLjAwLjAwLjA0LWsN
Cj4gaG9zdDUgICAgIDIxOjAwOjAwOjBlOjFlOjEyOmU5OmEwICAwMTowNjowMCAgT25saW5lICAg
IFFMRTgzNjIgRlc6djguMDMuMDYgRFZSOnYxMC4wMC4wMC4wNC1rDQo+IGhvc3Q2ICAgICAyMTow
MDowMDowZToxZToxMjplOTphMSAgMDE6MTQ6MDAgIE9ubGluZSAgICBRTEU4MzYyIEZXOnY4LjAz
LjA2IERWUjp2MTAuMDAuMDAuMDQtaw0KPiBob3N0NyAgICAgMjE6MDA6MDA6MjQ6ZmY6NDY6MGE6
NWMgIDAxOjBkOjAwICBPbmxpbmUgICAgUUxFMjU2MiBGVzp2OC4wMy4wMCBEVlI6djEwLjAwLjAw
LjA0LWsNCj4gaG9zdDggICAgIDIxOjAwOjAwOjI0OmZmOjQ2OjBhOjVkICAwMToxNTowMCAgT25s
aW5lICAgIFFMRTI1NjIgRlc6djguMDMuMDAgRFZSOnYxMC4wMC4wMC4wNC1rDQo+IA0KPiAjIG1v
ZGluZm8gcWxhMnh4eCB8IG1vcmUNCj4gDQo+IGZpbGVuYW1lOiAgICAgICAvbGliL21vZHVsZXMv
NC4xNS4wLXJjNisva2VybmVsL2RyaXZlcnMvc2NzaS9xbGEyeHh4L3FsYTJ4eHgua28NCj4gZmly
bXdhcmU6ICAgICAgIHFsMjUwMF9mdy5iaW4NCj4gZmlybXdhcmU6ICAgICAgIHFsMjQwMF9mdy5i
aW4NCj4gZmlybXdhcmU6ICAgICAgIHFsMjMyMl9mdy5iaW4NCj4gZmlybXdhcmU6ICAgICAgIHFs
MjMwMF9mdy5iaW4NCj4gZmlybXdhcmU6ICAgICAgIHFsMjIwMF9mdy5iaW4NCj4gZmlybXdhcmU6
ICAgICAgIHFsMjEwMF9mdy5iaW4NCj4gdmVyc2lvbjogICAgICAgIDEwLjAwLjAwLjA0LWsNCj4g
bGljZW5zZTogICAgICAgIEdQTA0KPiBkZXNjcmlwdGlvbjogICAgUUxvZ2ljIEZpYnJlIENoYW5u
ZWwgSEJBIERyaXZlcg0KPiBhdXRob3I6ICAgICAgICAgUUxvZ2ljIENvcnBvcmF0aW9uDQo+IHNy
Y3ZlcnNpb246ICAgICA2Q0JDRjEzNzJBNzc1NjY5MEU4M0NDMw0KPiANCj4gDQo+PiAgU2Vjb25k
LCBJIHdhbnQgdG8gZmluZCB3aGljaCBjb21taXQgaW50cm9kdWNlZCB0aGUgaXNzdWUuIFNvIEkg
dHJpZWQgbWFueSB0aW1lcyB2aWEgZ2l0IGJpc2VjdCB0byBsaW51eCBrZXJuZWwuDQo+PiAgRmlu
YWxseSwgSSBmb3VuZCB0aGUgY29tbWl0IDcyNmI4NTQ4NzA2N2Q3ZjViMjM0OTViYzMzYzQ4NGI4
NTE3YzQwNzQgaW50cm9kdWNlZCB0aGUgaXNzdWUuIFRoZSBhdHRhY2hlZCBsb2cgaXMgcmVsYXRl
ZCB0byB0aGlzIGNvbW1pdC4NCj4+ICBBbHNvIHVidW50dSBrZXJuZWwgaGFzIHRoaXMgaXNzdWU6
IA0KPj4gDQo+PiBodHRwczovL2xhdW5jaHBhZC5uZXQvdWJ1bnR1LythcmNoaXZlL3ByaW1hcnkv
K2ZpbGVzL2xpbnV4LWltYWdlLTQuMTMuDQo+PiAwLTI1LWdlbmVyaWNfNC4xMy4wLTI1LjI5X2Ft
ZDY0LmRlYg0KPj4gDQo+PiBodHRwczovL2xhdW5jaHBhZC5uZXQvdWJ1bnR1LythcmNoaXZlL3By
aW1hcnkvK2ZpbGVzL2xpbnV4LWltYWdlLWV4dHJhDQo+PiAtNC4xMy4wLTI1LWdlbmVyaWNfNC4x
My4wLTI1LjI5X2FtZDY0LmRlYg0KPj4gDQo+PiBSZWdhcmRzDQo+PiBDaGFuZyBMaW1pbg0KPj4g
DQo+PiAtLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KPj4gRnJvbTogTWFkaGFuaSwgSGltYW5z
aHUgW21haWx0bzpIaW1hbnNodS5NYWRoYW5pQGNhdml1bS5jb21dDQo+PiBTZW50OiBUdWVzZGF5
LCBKYW51YXJ5IDE2LCAyMDE4IDEyOjU5IFBNDQo+PiBUbzogY2hhbmdsaW1pbiAoQ2xvdWQpDQo+
PiBDYzogTmljaG9sYXMgQS4gQmVsbGluZ2VyOyBUcmFuLCBRdWlubjsgamlmdWxpYW5nIChDbG91
ZCk7IA0KPj4gemhhbmdndWFuZ2h1aSAoQ2xvdWQpOyB6aGFuZ3ppamlhbiAoQ2xvdWQpOyB0YXJn
ZXQtZGV2ZWw7IGxpbnV4LXNjc2kNCj4+IFN1YmplY3Q6IFJlOiBBIHFsYTJ4eHggY29tbWl0IGNh
dXNlIExpbnV4IG5vIHJlc3BvbnNlLCBoYXMgbm90IGZpeGVkIA0KPj4gaW4gbGFzdGVzdCB2ZXJz
aW9uIDQuMTUtcmM2DQo+PiANCj4+IEhpIENoYW5nLA0KPj4gDQo+Pj4gT24gSmFuIDE1LCAyMDE4
LCBhdCA0OjI3IFBNLCBDaGFuZ2xpbWluIDxjaGFuZ2xpbWluQGgzYy5jb20+IHdyb3RlOg0KPj4+
IA0KPj4+IEhpIEhpbWFuc2h1LA0KPj4+IFRoZSBpc3N1ZSBpczogV2hlbiBpbnNtb2QgdGhlIHFs
YTJ4eHgua28gZnJvbSA0LjE1LXJjNiwgbGludXggaGFuZy4NCj4+IA0KPj4gRnJvbSB0aGUgbG9n
IGZpbGUgYXR0YWNoZWQuIEkgc2VlIHRoYXQgeW91IGFyZSB0cnlpbmcgdG8gbG9hZCBkcml2ZXIg
ZnJvbSA0LjkueCBpbiA0LjE1LjAtcmM2LiANCj4+IA0KPj4gWyAgMjc5Ljg5ODcwNF0gcWxhMnh4
eCBbMDAwMDowMDowMC4wXS0wMDA1OiA6IFFMb2dpYyBGaWJyZSBDaGFubmVsIEhCQSBEcml2ZXI6
IDguMDcuMDAuMzgtay1kZWJ1Zy4NCj4+IA0KPj4gNC4xNS4wLXJjNiBoYWQgZHJpdmVyIHZlcnNp
b24gMTAuMDAuMDAuMDItay4gV291bGQgeW91IGNoZWNrIGlmIHlvdSBoYXZlIGFsbCB0aGUgZHJp
dmVyIGNoYW5nZXMgcHVsbGVkIGluIHdpdGgga2VybmVsIDQuMTUuMC1yYzYuDQo+PiANCj4+PiBJ
IGhhdmUgZ2l0IGJpc2VjdCB0aGUgY29tbWl0cy4gDQo+Pj4gVGhlIGlzc3VlIHdhcyBpbnRyb2R1
Y2VkIGluIGNvbW1pdDogNzI2Yjg1NDg3MDY3ZDdmNWIyMzQ5NWJjMzNjNDg0Yjg1MTdjNDA3NCBx
bGEyeHh4OiBBZGQgZnJhbWV3b3JrIGZvciBhc3luYyBmYWJyaWMgZGlzY292ZXJ5Lg0KPj4+IFRo
ZSBwcmV2aW91cyBjb21taXQgaXMgZ29vZDogNWQ5NjQ4MzdjNmE3NDMxOTNjNjNjODkxMmY5ODgz
NGM3NDU3YmE1YyBxbGEyeHh4OiBUcmFjayBJLVQgbmV4dXMgYXMgc2luZ2xlIGZjX3BvcnQgc3Ry
dWN0IC4NCj4+PiANCj4+PiBSZWdhcmRzDQo+Pj4gQ2hhbmcgTGltaW4NCj4+PiANCj4+PiAtLS0t
LU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KPj4+IEZyb206IE1hZGhhbmksIEhpbWFuc2h1IFttYWls
dG86SGltYW5zaHUuTWFkaGFuaUBjYXZpdW0uY29tXQ0KPj4+IFNlbnQ6IFR1ZXNkYXksIEphbnVh
cnkgMTYsIDIwMTggMTI6NTggQU0NCj4+PiBUbzogTmljaG9sYXMgQS4gQmVsbGluZ2VyDQo+Pj4g
Q2M6IGNoYW5nbGltaW4gKENsb3VkKTsgVHJhbiwgUXVpbm47IGppZnVsaWFuZyAoQ2xvdWQpOyB6
aGFuZ2d1YW5naHVpIA0KPj4+IChDbG91ZCk7IHpoYW5nemlqaWFuIChDbG91ZCk7IHRhcmdldC1k
ZXZlbDsgbGludXgtc2NzaQ0KPj4+IFN1YmplY3Q6IFJlOiBBIHFsYTJ4eHggY29tbWl0IGNhdXNl
IExpbnV4IG5vIHJlc3BvbnNlLCBoYXMgbm90IGZpeGVkIA0KPj4+IGluIGxhc3Rlc3QgdmVyc2lv
biA0LjE1LXJjNg0KPj4+IA0KPj4+IEhpIE5pYywgQ2hhbmcsDQo+Pj4gDQo+Pj4+IE9uIEphbiAx
MiwgMjAxOCwgYXQgOToyOCBQTSwgTmljaG9sYXMgQS4gQmVsbGluZ2VyIDxuYWJAbGludXgtaXNj
c2kub3JnPiB3cm90ZToNCj4+Pj4gDQo+Pj4+IEhpIENoYW5nICYgQ28sDQo+Pj4+IA0KPj4+PiAo
QWRkaW5nIGxpc3QgKyBIaW1hbnNodSBDQycpDQo+Pj4+IA0KPj4+PiBPbiBTdW4sIDIwMTgtMDEt
MDcgYXQgMTA6MjEgKzAwMDAsIENoYW5nbGltaW4gd3JvdGU6DQo+Pj4+PiBIaSwNCj4+Pj4+IEl0
IHNlZW1zIHRoZSBxbGEyeHh4IGNvbW1pdCBjYXVzZSBMaW51eCBubyByZXNwb25zZSwgaGFzIG5v
dCBmaXhlZCBpbiBsYXN0ZXN0IHZlcnNpb24gNC4xNS1yYzYuDQo+Pj4+PiBodHRwczovL2dpdC5r
ZXJuZWwub3JnL3B1Yi9zY20vbGludXgva2VybmVsL2dpdC9zdGFibGUvbGludXgtc3RhYmxlLg0K
Pj4+Pj4gZw0KPj4+Pj4gaXQvY29tbWl0Lz9pZD03MjZiODU0ODcwNjdkN2Y1YjIzNDk1YmMzM2M0
ODRiODUxN2M0MDc0DQo+Pj4+PiANCj4+Pj4gDQo+Pj4+IFRoYW5rcyBmb3IgcmVwb3J0aW5nICsg
aW5jbHVkaW5nIGRlYnVnIGxvZy4gIDopDQo+Pj4+IA0KPj4+Pj4gbHNwY2k6DQo+Pj4+PiAwYTow
MC4wIEZpYnJlIENoYW5uZWw6IFFMb2dpYyBDb3JwLiBJU1AyNTMyLWJhc2VkIDhHYiBGaWJyZSBD
aGFubmVsIA0KPj4+Pj4gdG8gUENJIEV4cHJlc3MgSEJBIChyZXYgMDIpDQo+Pj4+PiAwYTowMC4x
IEZpYnJlIENoYW5uZWw6IFFMb2dpYyBDb3JwLiBJU1AyNTMyLWJhc2VkIDhHYiBGaWJyZSBDaGFu
bmVsIA0KPj4+Pj4gdG8gUENJIEV4cHJlc3MgSEJBIChyZXYgMDIpDQo+Pj4+PiANCj4+Pj4+IHN5
c2xvZzoNCj4+Pj4+IHFsYTJ4eHggWzAwMDA6MDA6MDAuMF0tMDAwNTogOiBRTG9naWMgRmlicmUg
Q2hhbm5lbCBIQkEgRHJpdmVyOiA4LjA3LjAwLjM4LWsuDQo+Pj4+PiBxbGEyeHh4IFswMDAwOjBh
OjAwLjBdLTAwMWE6IDogTVNJLVggdmVjdG9yIGNvdW50OiAzMi4NCj4+Pj4+IHFsYTJ4eHggWzAw
MDA6MGE6MDAuMF0tMDAxZDogOiBGb3VuZCBhbiBJU1AyNTMyIGlycSAxNiBpb2Jhc2UgMHhmZmZm
YjBkNWNjNTAxMDAwLg0KPj4+Pj4gcWxhMnh4eCBbMDAwMDowYTowMC4wXS0wMGM2OjE6IE1TSS1Y
OiBGYWlsZWQgdG8gZW5hYmxlIHN1cHBvcnQgd2l0aCAzMiB2ZWN0b3JzLCB1c2luZyAyNiB2ZWN0
b3JzLg0KPj4+Pj4gc2NzaSBob3N0MTogcWxhMnh4eA0KPj4+Pj4gcWxhMnh4eCBbMDAwMDowYTow
MC4wXS0wMGZiOjE6IFFMb2dpYyBIUEFKNzY0QSAtIEhQIDhHYiBEdWFsIENoYW5uZWwgUENJLWUg
Mi4wIEZDIEhCQS4NCj4+Pj4+IHFsYTJ4eHggWzAwMDA6MGE6MDAuMF0tMDBmYzoxOiBJU1AyNTMy
OiBQQ0llICg1LjBHVC9zIHg4KSBAIDAwMDA6MGE6MDAuMCBoZG1hKyBob3N0Iz0xIGZ3PTguMDMu
MDAgKDkwZDUpLg0KPj4+Pj4gcWxhMnh4eCBbMDAwMDowYTowMC4xXS0wMDFhOiA6IE1TSS1YIHZl
Y3RvciBjb3VudDogMzIuDQo+Pj4+PiBxbGEyeHh4IFswMDAwOjBhOjAwLjFdLTAwMWQ6IDogRm91
bmQgYW4gSVNQMjUzMiBpcnEgMTcgaW9iYXNlIDB4ZmZmZmIwZDVjYzVkOTAwMC4NCj4+Pj4+IHFs
YTJ4eHggWzAwMDA6MGE6MDAuMV0tMDBjNjoyOiBNU0ktWDogRmFpbGVkIHRvIGVuYWJsZSBzdXBw
b3J0IHdpdGggMzIgdmVjdG9ycywgdXNpbmcgMjYgdmVjdG9ycy4NCj4+Pj4+IHNjc2kgaG9zdDI6
IHFsYTJ4eHgNCj4+Pj4+IHFsYTJ4eHggWzAwMDA6MGE6MDAuMV0tMDBmYjoyOiBRTG9naWMgSFBB
Sjc2NEEgLSBIUCA4R2IgRHVhbCBDaGFubmVsIFBDSS1lIDIuMCBGQyBIQkEuDQo+Pj4+PiBxbGEy
eHh4IFswMDAwOjBhOjAwLjFdLTAwZmM6MjogSVNQMjUzMjogUENJZSAoNS4wR1QvcyB4OCkgQCAw
MDAwOjBhOjAwLjEgaGRtYSsgaG9zdCM9MiBmdz04LjAzLjAwICg5MGQ1KS4NCj4+Pj4+IHFsYTJ4
eHggWzAwMDA6MGE6MDAuMF0tNTAwYToxOiBMT09QIFVQIGRldGVjdGVkICg4IEdicHMpLg0KPj4+
Pj4gcWxhMnh4eCBbMDAwMDowYTowMC4xXS01MDBhOjI6IExPT1AgVVAgZGV0ZWN0ZWQgKDggR2Jw
cykuDQo+Pj4+PiANCj4+Pj4+IFRoZSBhdHRhY2hlZCBmaWxlIGlzIHRoZSBtb2R1bGUgbG9nLg0K
Pj4+Pj4gDQo+Pj4+PiBEbyB5b3UgaGF2ZSBhbnkgYWR2aWNlPw0KPj4+PiANCj4+Pj4gUXVpbm4g
JiBIaW1hbnNodSBmb2xrcywgYW55IGNvbW1lbnRzLi4/DQo+Pj4+IA0KPj4+IA0KPj4+IFdoYXQg
aXMgdGhlIGlzc3VlIGhlcmU/IEkgYW0gbm90IGNsZWFyIGZvcm0gdGhlIHNuaXBwZXQgYWJvdmUu
DQo+Pj4gDQo+Pj4gT25lIHRoaW5nIEkgbm90aWNlZCB0aGF0LCBpZiB5b3UgYXJlIHVzaW5nIDQu
MTUtcmM2IGRyaXZlciB2ZXJzaW9uIA0KPj4+IHNob3VsZCBiZSAxMC4wMC4wMC4wMi1rIGJ1dCB0
aGUgc25pcHBldCBzaG93cyA4LjA3LjAwLjM4LWsgd2hpY2ggDQo+Pj4gdGVsbHMgbWUgeW91IG1p
Z2h0DQo+Pj4gDQo+Pj4gVGhhbmtzLA0KPj4+IC0gSGltYW5zaHUNCj4+PiA8cWxhMnh4eC1mdWxs
LmxvZy5nej4NCj4+IA0KPj4gVGhhbmtzLA0KPj4gLSBIaW1hbnNodQ0KPj4gDQo+IA0KPiBUaGFu
a3MsDQo+IC0gSGltYW5zaHUNCj4gDQoNClRoYW5rcywNCi0gSGltYW5zaHUNCg0K

^ permalink raw reply	[flat|nested] 16+ messages in thread

* RE: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
@ 2018-01-30 10:37                   ` Changlimin
  0 siblings, 0 replies; 16+ messages in thread
From: Changlimin @ 2018-01-30 10:37 UTC (permalink / raw)
  To: Madhani, Himanshu
  Cc: Nicholas A. Bellinger, Tran, Quinn, Jifuliang, Zhangguanghui,
	Zhangzijian, target-devel, linux-scsi

Hi Himanshu,
  Today I tried several times and have some news.
  Before I insmod the qla2xxx.ko , if I shutdown then start the FC switch port connected to the HBA card, the qla2xxx.ko works well.
  It seems that the issue has relation to the FC switch port. Maybe some old status causes the issue.
  The FC switch model is H3C S5820V2.

Regards
Chang Limin


-----Original Message-----
From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com] 
Sent: Tuesday, January 30, 2018 7:40 AM
To: changlimin (Cloud)
Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6

Hi Chang, 

> On Jan 18, 2018, at 4:51 AM, Changlimin <changlimin@h3c.com> wrote:
> 
> Hi Himanshu,
>  Today I reproduced the issue in my server.
>  First, I compiled kernel 4.15-rc6 (make localmodconfig; make; make modules_install; make install), then start the kernel with parameter modprobe.blacklist=qla2xxx.
>  Second,  tail -f /var/log/syslog
>  Third,  modprobe qla2xxx ql2xextended_error_logging=0x1e400000 , the log is syslog-1e400000.txt
>  The syslog-7fffffff is got when modprobe qla2xxx ql2xextended_error_logging=0x7fffffff
> 
>  BTW, I haven't load driver from 4.9.x to kernel 4.15-rc6. 
>  When I checkout kernel commit 726b85487067d7f5b23495bc33c484b8517c4074, all kernel code is 4.9.x.
> 

Sorry for extended delay in the response. From the syslog that you sent me, I do see driver version 10.00.00.02-k which is from 4.15.0-rc6 so atleast you are using the correct
driver. (in your email earlier you mentioned 8.07.xx which was confusing) 

Jan 18 20:30:23 cvknode25 kernel: [  100.991309] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 10.00.00.02-k-debug.
Jan 18 20:30:23 cvknode25 kernel: [  100.991486] qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0x0000000067aad9fd.
Jan 18 20:30:23 cvknode25 kernel: [  101.651676] qla2xxx [0000:0a:00.0]-4800:1: DPC handler sleeping.
Jan 18 20:30:23 cvknode25 kernel: [  101.651677] scsi host1: qla2xxx

Also I do see  

Jan 18 20:30:24 cvknode25 kernel: [  102.624987] qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).

i.e. driver was able to bring up 8G link 

So having said that i still do not have clear picture from the logs provided, why you are encountering issue. 

Can you please share you configuration details. I would like to see how is your system setup and see if i can replicate in our lab here. 

> Regards
> Chang Limin
> 
> -----Original Message-----
> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
> Sent: Thursday, January 18, 2018 2:26 AM
> To: changlimin (Cloud)
> Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6
> 
> Hi Chang, 
> 
>> On Jan 15, 2018, at 10:49 PM, Changlimin <changlimin@h3c.com> wrote:
>> 
>> Hi Himanshu,
>>  This is my progress.
>>  First, I compiled 4.15-rc6, I found linux hang when booting, the stack showed something wrong in qla2xxx driver.
> 
> Can you provide me detail steps of how you compiled 4.15-rc6. Also provide me details of how you are loading driver and also provide complete log file.
> 
> I do not see how you will be able to load driver which is from 4.9.x when you compile fresh 4.15.0-rc6. 
> 
> Just FYI, I build test system with 8G/16G/32G adapter with 4.15.0-rc6 kernel and I am not able to see hang that you are describing. 
> 
> # uname -r
> 4.15.0-rc6+
> 
> # modprobe qla2xxx
> 
> # fcc.sh
> FC HBAs:
> HBA       Port Name                Port ID   State     Device
> host3     21:00:00:24:ff:7e:f5:80  01:0d:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
> host4     21:00:00:24:ff:7e:f5:81  01:0e:00  Online    QLE2742 FW:v8.05.63 DVR:v10.00.00.04-k
> host5     21:00:00:0e:1e:12:e9:a0  01:06:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
> host6     21:00:00:0e:1e:12:e9:a1  01:14:00  Online    QLE8362 FW:v8.03.06 DVR:v10.00.00.04-k
> host7     21:00:00:24:ff:46:0a:5c  01:0d:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k
> host8     21:00:00:24:ff:46:0a:5d  01:15:00  Online    QLE2562 FW:v8.03.00 DVR:v10.00.00.04-k
> 
> # modinfo qla2xxx | more
> 
> filename:       /lib/modules/4.15.0-rc6+/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
> firmware:       ql2500_fw.bin
> firmware:       ql2400_fw.bin
> firmware:       ql2322_fw.bin
> firmware:       ql2300_fw.bin
> firmware:       ql2200_fw.bin
> firmware:       ql2100_fw.bin
> version:        10.00.00.04-k
> license:        GPL
> description:    QLogic Fibre Channel HBA Driver
> author:         QLogic Corporation
> srcversion:     6CBCF1372A7756690E83CC3
> 
> 
>>  Second, I want to find which commit introduced the issue. So I tried many times via git bisect to linux kernel.
>>  Finally, I found the commit 726b85487067d7f5b23495bc33c484b8517c4074 introduced the issue. The attached log is related to this commit.
>>  Also ubuntu kernel has this issue: 
>> 
>> https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-4.13.
>> 0-25-generic_4.13.0-25.29_amd64.deb
>> 
>> https://launchpad.net/ubuntu/+archive/primary/+files/linux-image-extra
>> -4.13.0-25-generic_4.13.0-25.29_amd64.deb
>> 
>> Regards
>> Chang Limin
>> 
>> -----Original Message-----
>> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
>> Sent: Tuesday, January 16, 2018 12:59 PM
>> To: changlimin (Cloud)
>> Cc: Nicholas A. Bellinger; Tran, Quinn; jifuliang (Cloud); 
>> zhangguanghui (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
>> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
>> in lastest version 4.15-rc6
>> 
>> Hi Chang,
>> 
>>> On Jan 15, 2018, at 4:27 PM, Changlimin <changlimin@h3c.com> wrote:
>>> 
>>> Hi Himanshu,
>>> The issue is: When insmod the qla2xxx.ko from 4.15-rc6, linux hang.
>> 
>> From the log file attached. I see that you are trying to load driver from 4.9.x in 4.15.0-rc6. 
>> 
>> [  279.898704] qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k-debug.
>> 
>> 4.15.0-rc6 had driver version 10.00.00.02-k. Would you check if you have all the driver changes pulled in with kernel 4.15.0-rc6.
>> 
>>> I have git bisect the commits. 
>>> The issue was introduced in commit: 726b85487067d7f5b23495bc33c484b8517c4074 qla2xxx: Add framework for async fabric discovery.
>>> The previous commit is good: 5d964837c6a743193c63c8912f98834c7457ba5c qla2xxx: Track I-T nexus as single fc_port struct .
>>> 
>>> Regards
>>> Chang Limin
>>> 
>>> -----Original Message-----
>>> From: Madhani, Himanshu [mailto:Himanshu.Madhani@cavium.com]
>>> Sent: Tuesday, January 16, 2018 12:58 AM
>>> To: Nicholas A. Bellinger
>>> Cc: changlimin (Cloud); Tran, Quinn; jifuliang (Cloud); zhangguanghui 
>>> (Cloud); zhangzijian (Cloud); target-devel; linux-scsi
>>> Subject: Re: A qla2xxx commit cause Linux no response, has not fixed 
>>> in lastest version 4.15-rc6
>>> 
>>> Hi Nic, Chang,
>>> 
>>>> On Jan 12, 2018, at 9:28 PM, Nicholas A. Bellinger <nab@linux-iscsi.org> wrote:
>>>> 
>>>> Hi Chang & Co,
>>>> 
>>>> (Adding list + Himanshu CC')
>>>> 
>>>> On Sun, 2018-01-07 at 10:21 +0000, Changlimin wrote:
>>>>> Hi,
>>>>> It seems the qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6.
>>>>> https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.
>>>>> g
>>>>> it/commit/?id=726b85487067d7f5b23495bc33c484b8517c4074
>>>>> 
>>>> 
>>>> Thanks for reporting + including debug log.  :)
>>>> 
>>>>> lspci:
>>>>> 0a:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>>> to PCI Express HBA (rev 02)
>>>>> 0a:00.1 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel 
>>>>> to PCI Express HBA (rev 02)
>>>>> 
>>>>> syslog:
>>>>> qla2xxx [0000:00:00.0]-0005: : QLogic Fibre Channel HBA Driver: 8.07.00.38-k.
>>>>> qla2xxx [0000:0a:00.0]-001a: : MSI-X vector count: 32.
>>>>> qla2xxx [0000:0a:00.0]-001d: : Found an ISP2532 irq 16 iobase 0xffffb0d5cc501000.
>>>>> qla2xxx [0000:0a:00.0]-00c6:1: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>>> scsi host1: qla2xxx
>>>>> qla2xxx [0000:0a:00.0]-00fb:1: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>>> qla2xxx [0000:0a:00.0]-00fc:1: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.0 hdma+ host#=1 fw=8.03.00 (90d5).
>>>>> qla2xxx [0000:0a:00.1]-001a: : MSI-X vector count: 32.
>>>>> qla2xxx [0000:0a:00.1]-001d: : Found an ISP2532 irq 17 iobase 0xffffb0d5cc5d9000.
>>>>> qla2xxx [0000:0a:00.1]-00c6:2: MSI-X: Failed to enable support with 32 vectors, using 26 vectors.
>>>>> scsi host2: qla2xxx
>>>>> qla2xxx [0000:0a:00.1]-00fb:2: QLogic HPAJ764A - HP 8Gb Dual Channel PCI-e 2.0 FC HBA.
>>>>> qla2xxx [0000:0a:00.1]-00fc:2: ISP2532: PCIe (5.0GT/s x8) @ 0000:0a:00.1 hdma+ host#=2 fw=8.03.00 (90d5).
>>>>> qla2xxx [0000:0a:00.0]-500a:1: LOOP UP detected (8 Gbps).
>>>>> qla2xxx [0000:0a:00.1]-500a:2: LOOP UP detected (8 Gbps).
>>>>> 
>>>>> The attached file is the module log.
>>>>> 
>>>>> Do you have any advice?
>>>> 
>>>> Quinn & Himanshu folks, any comments..?
>>>> 
>>> 
>>> What is the issue here? I am not clear form the snippet above.
>>> 
>>> One thing I noticed that, if you are using 4.15-rc6 driver version 
>>> should be 10.00.00.02-k but the snippet shows 8.07.00.38-k which 
>>> tells me you might
>>> 
>>> Thanks,
>>> - Himanshu
>>> <qla2xxx-full.log.gz>
>> 
>> Thanks,
>> - Himanshu
>> 
> 
> Thanks,
> - Himanshu
> 

Thanks,
- Himanshu


^ permalink raw reply	[flat|nested] 16+ messages in thread

end of thread, other threads:[~2018-01-30 10:45 UTC | newest]

Thread overview: 16+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <BC29A004BA570342A4CC0044A3845572010DCF3E30@H3CMLB12-EX.srv.huawei-3com.com>
2018-01-13  5:28 ` A qla2xxx commit cause Linux no response, has not fixed in lastest version 4.15-rc6 Nicholas A. Bellinger
2018-01-13  5:28   ` Nicholas A. Bellinger
2018-01-15 16:57   ` Madhani, Himanshu
2018-01-16  0:27     ` Changlimin
2018-01-16  4:58       ` Madhani, Himanshu
2018-01-16  4:58         ` Madhani, Himanshu
2018-01-16  6:49         ` Changlimin
2018-01-16  6:49           ` Changlimin
2018-01-17 18:26           ` Madhani, Himanshu
2018-01-18 12:47             ` Changlimin
2018-01-18 12:51             ` Changlimin
2018-01-18 12:51               ` Changlimin
2018-01-29 23:40               ` Madhani, Himanshu
2018-01-29 23:40                 ` Madhani, Himanshu
2018-01-30 10:37                 ` Changlimin
2018-01-30 10:37                   ` Changlimin

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.