* Re: How to reset HBA when using libsas/mvsas
2020-01-12 2:21 How to reset HBA when using libsas/mvsas Dāvis Mosāns
@ 2020-01-13 9:51 ` John Garry
2020-01-13 23:57 ` Dāvis Mosāns
0 siblings, 1 reply; 4+ messages in thread
From: John Garry @ 2020-01-13 9:51 UTC (permalink / raw)
To: Dāvis Mosāns, linux-scsi
On 12/01/2020 02:21, Dāvis Mosāns wrote:
> Hello,
>
> I've HighPoint RocketRAID 2760A which uses mvsas driver.
> When some error happens then disk becomes inaccessible and
> to get it usable again currently I know only 2 ways,
> either physically pull it out and put back in or reboot whole system.
> This is pretty annoying so I want to just reset HBA to simulate that,
> but I don't know how to do that.
If you just want to rest the disk, you can reset the PHY to which the
disk is attached through sysfs, which is essentially is same as ejecting
and reinserting the disk:
1. Get the PHY index
john@ubuntu:/dev/disk/by-path$ ls -l
total 0
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy10-lun-0 -> ../../sdg
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy11-lun-0 -> ../../sdh
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy1-lun-0 -> ../../sda
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy1-lun-0-part1 ->
../../sda1
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy1-lun-0-part2 ->
../../sda2
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0 -> ../../sdb
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0-part1 ->
../../sdb1
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0-part2 ->
../../sdb2
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0-part3 ->
../../sdb3
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0 -> ../../sdc
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0-part1 ->
../../sdc1
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0-part2 ->
../../sdc2
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0-part3 ->
../../sdc3
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy5-lun-0 -> ../../sdd
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0 -> ../../sde
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0-part1 ->
../../sde1
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0-part2 ->
../../sde2
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0-part3 ->
../../sde3
lrwxrwxrwx 1 root root 9 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0 -> ../../sdf
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0-part1 ->
../../sdf1
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0-part2 ->
../../sdf2
lrwxrwxrwx 1 root root 10 Jan 10 16:36
platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0-part3 ->
../../sdf3
2. Go to PHY sysfs folder and disable+enable the PHY:
john@ubuntu:/dev/disk/by-path$ cd /sys/class/sas_phy/phy-0:0:10
0:10/sas_phy/phy-0:0:10# echo 0 > enable
[234475.077365] sas: smp_execute_task_sg: task to dev 500e004aaaaaaa1f
response: 0x0 status 0x2
[234475.085930] sas: broadcast received: 0
[234475.089771] sas: REVALIDATING DOMAIN on port 0, pid:570
root@ubuntu:/sys/devices/platform[234475.096393] sas: ex
500e004aaaaaaa1f phy10 change count has changed
/HISI0162:01/host0/port-0:0/expander-0:0/phy-0:0[234475.106724] sas: ex
500e004aaaaaaa1f phy10 originated BROADCAST(CHANGE)
0:10/sas_phy/phy-0:0:10# [234475.115134] sas: ex 500e004aaaaaaa1f
unregistering phy10
[234475.123015] sas: ex 500e004aaaaaaa1f phy10:U:1 attached:
0000000000000000 (no device)
[234475.130931] sas: ex 500e004aaaaaaa1f phy10 discover returned 0x0
[234475.137023] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.190814] hisi_sas_v2_hw HISI0162:01: dev[7:1] is gone
[234475.196667] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.204562] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.209963] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.215715] sas: broadcast received: 0
[234475.219550] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.227407] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.232798] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.238545] sas: broadcast received: 0
[234475.242382] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.250233] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.255630] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.261376] sas: broadcast received: 0
[234475.265204] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.273062] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.278460] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.284211] sas: broadcast received: 0
[234475.288044] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.295901] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.301298] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.307047] sas: broadcast received: 0
[234475.310879] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.318735] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.324125] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.329869] sas: broadcast received: 0
[234475.333703] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.341575] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.346964] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234475.352710] sas: broadcast received: 0
[234475.356543] sas: REVALIDATING DOMAIN on port 0, pid:570
[234475.364403] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234475.369796] sas: done REVALIDATING DOMAIN on port 0, pid:570
0:10/sas_phy/phy-0:0:10# echo 1 > enable
0:10/sas_phy/phy-0:0:10# [234479.348543] sas: broadcast received:
0er-0:0/phy-0:0
[234479.352378] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.359008] sas: ex 500e004aaaaaaa1f phy10 change count has changed
[234479.367808] sas: ex 500e004aaaaaaa1f phy10 originated BROADCAST(CHANGE)
[234479.374505] sas: ex 500e004aaaaaaa1f phy10 new device attached
[234479.380558] sas: ex 500e004aaaaaaa1f phy10:U:B attached:
5001e82002862816 (ssp)
[234479.388018] hisi_sas_v2_hw HISI0162:01: dev[7:1] found
[234479.399828] sas: ex 500e004aaaaaaa1f phy10 register returned 0x0
[234479.405912] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.466775] scsi 0:0:10:0: Direct-Access SanDisk LT0200MO
P404 PQ: 0 ANSI: 6
[234479.763239] sas: broadcast received: 0
[234479.767072] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.774965] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234479.780356] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.786100] sas: broadcast received: 0
[234479.789932] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.797791] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234479.803180] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.808927] sas: broadcast received: 0
[234479.812760] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.820640] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234479.826034] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.831781] sas: broadcast received: 0
[234479.835613] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.843471] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234479.848861] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.854606] sas: broadcast received: 0
[234479.858445] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.866302] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234479.871691] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.877437] sas: broadcast received: 0
[234479.881269] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.889125] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234479.894520] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.900266] sas: broadcast received: 0
[234479.904099] sas: REVALIDATING DOMAIN on port 0, pid:570
[234479.911961] sas: ex 500e004aaaaaaa1f phys DID NOT change
[234479.917359] sas: done REVALIDATING DOMAIN on port 0, pid:570
[234479.978557] sd 0:0:10:0: [sdg] 390721968 512-byte logical blocks:
(200 GB/186 GiB)
[234480.020582] sd 0:0:10:0: [sdg] Write Protect is off
[234480.025541] sd 0:0:10:0: [sdg] Mode Sense: cf 00 10 08
[234480.102589] sd 0:0:10:0: [sdg] Write cache: disabled, read cache:
disabled, supports DPO and FUA
[234480.225257] sd 0:0:10:0: [sdg] Optimal transfer size 131072 bytes
0:10/sas_phy/phy-0:0:10# [234481.445588] sd 0:0:10:0: [sdg] Attached
SCSI disk0:0
The standard method to reset the host controller is to call the SCSI
host sysfs reset method, but this does not seem to be supported for
mv_sas - this is no scsi_host_template.host_reset method in the driver.
>
> I have tried:
> $ echo 1 > /sys/block/sdf/device/delete
> $ echo '- - -' > /sys/class/scsi_host/host0/scan
>
> but it doesn't work as it doesn't detect any new drives.
I'm not sure if this is the correct method.
Thanks,
John
>
>
> Some more info see below
>
> $ lspci -vv
>
> 44:00.0 RAID bus controller: HighPoint Technologies, Inc. Device 2760 (rev c2)
> Subsystem: HighPoint Technologies, Inc. Device 0000
> Physical Slot: 117
> Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
> ParErr- Stepping- SERR- FastB2B- DisINTx-
> Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> Latency: 0, Cache Line Size: 64 bytes
> Interrupt: pin A routed to IRQ 50
> Region 0: Memory at 82240000 (64-bit, non-prefetchable) [size=128K]
> Region 2: Memory at 82200000 (64-bit, non-prefetchable) [size=256K]
> Expansion ROM at 82260000 [disabled] [size=64K]
> Capabilities: [40] Power Management version 3
> Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA
> PME(D0+,D1+,D2-,D3hot+,D3cold-)
> Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
> Address: 0000000000000000 Data: 0000
> Capabilities: [70] Express (v2) Endpoint, MSI 00
> DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency
> L0s <1us, L1 <8us
> ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+
> FLReset- SlotPowerLimit 25.000W
> DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
> RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop-
> MaxPayload 512 bytes, MaxReadReq 512 bytes
> DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq-
> AuxPwr- TransPend-
> LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM not supported
> ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
> LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
> ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> LnkSta: Speed 5GT/s (ok), Width x8 (ok)
> TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
> DevCap2: Completion Timeout: Not Supported,
> TimeoutDis+, LTR-, OBFF Not Supported
> AtomicOpsCap: 32bit- 64bit- 128bitCAS-
> DevCtl2: Completion Timeout: 50us to 50ms,
> TimeoutDis-, LTR-, OBFF Disabled
> AtomicOpsCtl: ReqEn-
> LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
> Transmit Margin: Normal Operating Range,
> EnterModifiedCompliance- ComplianceSOS-
> Compliance De-emphasis: -6dB
> LnkSta2: Current De-emphasis Level: -6dB,
> EqualizationComplete-, EqualizationPhase1-
> EqualizationPhase2-, EqualizationPhase3-,
> LinkEqualizationRequest-
> Capabilities: [100 v1] Advanced Error Reporting
> UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
> CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout-
> AdvNonFatalErr-
> CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout-
> AdvNonFatalErr+
> AERCap: First Error Pointer: 00, ECRCGenCap+
> ECRCGenEn- ECRCChkCap+ ECRCChkEn-
> MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
> HeaderLog: 00000000 00000000 00000000 00000000
> Capabilities: [140 v1] Virtual Channel
> Caps: LPEVC=0 RefClk=100ns PATEntryBits=1
> Arb: Fixed- WRR32- WRR64- WRR128-
> Ctrl: ArbSelect=Fixed
> Status: InProgress-
> VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=01
> Status: NegoPending- InProgress-
> Kernel driver in use: mvsas
> Kernel modules: mvsas
>
> 45:00.0 RAID bus controller: HighPoint Technologies, Inc. Device 2760 (rev c2)
> Subsystem: HighPoint Technologies, Inc. Device 0000
> Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
> ParErr- Stepping- SERR- FastB2B- DisINTx-
> Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> Latency: 0, Cache Line Size: 64 bytes
> Interrupt: pin A routed to IRQ 47
> Region 0: Memory at 82140000 (64-bit, non-prefetchable) [size=128K]
> Region 2: Memory at 82100000 (64-bit, non-prefetchable) [size=256K]
> Expansion ROM at 82160000 [disabled] [size=64K]
> Capabilities: [40] Power Management version 3
> Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA
> PME(D0+,D1+,D2-,D3hot+,D3cold-)
> Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
> Address: 0000000000000000 Data: 0000
> Capabilities: [70] Express (v2) Endpoint, MSI 00
> DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency
> L0s <1us, L1 <8us
> ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+
> FLReset- SlotPowerLimit 25.000W
> DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
> RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop-
> MaxPayload 512 bytes, MaxReadReq 512 bytes
> DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq-
> AuxPwr- TransPend-
> LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM not supported
> ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
> LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
> ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> LnkSta: Speed 5GT/s (ok), Width x8 (ok)
> TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
> DevCap2: Completion Timeout: Not Supported,
> TimeoutDis+, LTR-, OBFF Not Supported
> AtomicOpsCap: 32bit- 64bit- 128bitCAS-
> DevCtl2: Completion Timeout: 50us to 50ms,
> TimeoutDis-, LTR-, OBFF Disabled
> AtomicOpsCtl: ReqEn-
> LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
> Transmit Margin: Normal Operating Range,
> EnterModifiedCompliance- ComplianceSOS-
> Compliance De-emphasis: -6dB
> LnkSta2: Current De-emphasis Level: -6dB,
> EqualizationComplete-, EqualizationPhase1-
> EqualizationPhase2-, EqualizationPhase3-,
> LinkEqualizationRequest-
> Capabilities: [100 v1] Advanced Error Reporting
> UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
> CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout-
> AdvNonFatalErr-
> CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout-
> AdvNonFatalErr+
> AERCap: First Error Pointer: 00, ECRCGenCap+
> ECRCGenEn- ECRCChkCap+ ECRCChkEn-
> MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
> HeaderLog: 00000000 00000000 00000000 00000000
> Capabilities: [140 v1] Virtual Channel
> Caps: LPEVC=0 RefClk=100ns PATEntryBits=1
> Arb: Fixed- WRR32- WRR64- WRR128-
> Ctrl: ArbSelect=Fixed
> Status: InProgress-
> VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=01
> Status: NegoPending- InProgress-
> Kernel driver in use: mvsas
> Kernel modules: mvsas
>
> 46:00.0 RAID bus controller: HighPoint Technologies, Inc. Device 2760 (rev c2)
> Subsystem: HighPoint Technologies, Inc. Device 0000
> Physical Slot: 121
> Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
> ParErr- Stepping- SERR- FastB2B- DisINTx-
> Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
> <TAbort- <MAbort- >SERR- <PERR- INTx-
> Latency: 0, Cache Line Size: 64 bytes
> Interrupt: pin A routed to IRQ 50
> Region 0: Memory at 82040000 (64-bit, non-prefetchable) [size=128K]
> Region 2: Memory at 82000000 (64-bit, non-prefetchable) [size=256K]
> Expansion ROM at 82060000 [disabled] [size=64K]
> Capabilities: [40] Power Management version 3
> Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA
> PME(D0+,D1+,D2-,D3hot+,D3cold-)
> Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
> Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
> Address: 0000000000000000 Data: 0000
> Capabilities: [70] Express (v2) Endpoint, MSI 00
> DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency
> L0s <1us, L1 <8us
> ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+
> FLReset- SlotPowerLimit 25.000W
> DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
> RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop-
> MaxPayload 512 bytes, MaxReadReq 512 bytes
> DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq-
> AuxPwr- TransPend-
> LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM not supported
> ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
> LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
> ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> LnkSta: Speed 5GT/s (ok), Width x8 (ok)
> TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
> DevCap2: Completion Timeout: Not Supported,
> TimeoutDis+, LTR-, OBFF Not Supported
> AtomicOpsCap: 32bit- 64bit- 128bitCAS-
> DevCtl2: Completion Timeout: 50us to 50ms,
> TimeoutDis-, LTR-, OBFF Disabled
> AtomicOpsCtl: ReqEn-
> LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
> Transmit Margin: Normal Operating Range,
> EnterModifiedCompliance- ComplianceSOS-
> Compliance De-emphasis: -6dB
> LnkSta2: Current De-emphasis Level: -6dB,
> EqualizationComplete-, EqualizationPhase1-
> EqualizationPhase2-, EqualizationPhase3-,
> LinkEqualizationRequest-
> Capabilities: [100 v1] Advanced Error Reporting
> UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
> UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt-
> UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
> CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout-
> AdvNonFatalErr-
> CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout-
> AdvNonFatalErr+
> AERCap: First Error Pointer: 00, ECRCGenCap+
> ECRCGenEn- ECRCChkCap+ ECRCChkEn-
> MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
> HeaderLog: 00000000 00000000 00000000 00000000
> Capabilities: [140 v1] Virtual Channel
> Caps: LPEVC=0 RefClk=100ns PATEntryBits=1
> Arb: Fixed- WRR32- WRR64- WRR128-
> Ctrl: ArbSelect=Fixed
> Status: InProgress-
> VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=01
> Status: NegoPending- InProgress-
> Kernel driver in use: mvsas
> Kernel modules: mvsas
>
>
> $ dmesg
>
> [ 4609.661372] sas: Enter sas_scsi_recover_host busy: 1 failed: 1
> [ 4609.661375] sas: trying to find task 0x00000000fba080c0
> [ 4609.661375] sas: sas_scsi_find_task: aborting task 0x00000000fba080c0
> [ 4609.661377] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task()
> mvi=00000000f55c98e2 task=00000000fba080c0 slot=00000000928be8ed
> slot_idx=x0
> [ 4609.661378] sas: sas_scsi_find_task: task 0x00000000fba080c0 is aborted
> [ 4609.661378] sas: sas_eh_handle_sas_errors: task 0x00000000fba080c0 is aborted
> [ 4609.661380] sas: ata15: end_device-0:4: cmd error handler
> [ 4609.661390] sas: ata11: end_device-0:0: dev error handler
> [ 4609.661398] sas: ata12: end_device-0:1: dev error handler
> [ 4609.661401] sas: ata13: end_device-0:2: dev error handler
> [ 4609.661404] sas: ata14: end_device-0:3: dev error handler
> [ 4609.661406] sas: ata15: end_device-0:4: dev error handler
> [ 4609.661409] ata15.00: exception Emask 0x0 SAct 0x200000 SErr 0x0
> action 0x6 frozen
> [ 4609.661411] ata15.00: failed command: READ FPDMA QUEUED
> [ 4609.661414] ata15.00: cmd 60/08:00:00:a3:50/00:00:5d:01:00/40 tag
> 21 ncq dma 4096 in
> res 40/00:00:00:00:00/00:00:00:00:00/00 Emask
> 0x4 (timeout)
> [ 4609.661416] sas: ata16: end_device-0:5: dev error handler
> [ 4609.661418] ata15.00: status: { DRDY }
> [ 4609.661419] sas: ata17: end_device-0:6: dev error handler
> [ 4609.661422] sas: ata18: end_device-0:7: dev error handler
> [ 4609.661423] ata15: hard resetting link
> [ 4609.671596] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4609.671602] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081
> [ 4609.707530] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4609.707535] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000
> [ 4609.707538] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0]
> [ 4609.727552] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate
> is 0x122000
> [ 4609.727555] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10
> [ 4609.847627] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001
> [ 4609.847631] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4
> [ 4609.847634] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded.
> [ 4609.847788] sas: sas_form_port: phy0 belongs to port4 already(1)!
> [ 4611.954597] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset
> for device[0]:rc= 0
> [ 4612.111285] drivers/scsi/mvsas/mv_sas.c 1757:port 4 slot 0 rx_desc
> 30000 has error info8000000080000000.
> [ 4617.287750] ata15.00: qc timeout (cmd 0x27)
> [ 4617.287754] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task()
> mvi=00000000f55c98e2 task=000000005325a7e3 slot=00000000928be8ed
> slot_idx=x0
> [ 4617.287757] ata15.00: failed to read native max address (err_mask=0x4)
> [ 4617.287759] ata15.00: HPA support seems broken, skipping HPA handling
> [ 4617.287760] ata15.00: revalidation failed (errno=-5)
> [ 4617.287763] ata15: hard resetting link
> [ 4617.297791] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00000000.
> [ 4617.297792] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000001
> [ 4617.297829] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4617.297830] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081
> [ 4617.318544] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4617.318547] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000
> [ 4617.318549] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0]
> [ 4617.338563] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate
> is 0x122000
> [ 4617.338565] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10
> [ 4617.458637] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001
> [ 4617.458639] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4
> [ 4617.458642] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded.
> [ 4617.458665] sas: sas_form_port: phy0 belongs to port4 already(1)!
> [ 4619.634341] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset
> for device[0]:rc= 0
> [ 4619.790900] drivers/scsi/mvsas/mv_sas.c 1757:port 4 slot 0 rx_desc
> 30000 has error info8000000080000000.
> [ 4636.487111] ata15.00: qc timeout (cmd 0xef)
> [ 4636.487114] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task()
> mvi=00000000f55c98e2 task=0000000060facb2f slot=00000000928be8ed
> slot_idx=x0
> [ 4636.487116] ata15.00: failed to set xfermode (err_mask=0x4)
> [ 4636.487118] ata15.00: limiting speed to UDMA/133:PIO3
> [ 4636.487120] ata15: hard resetting link
> [ 4636.497144] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00000000.
> [ 4636.497144] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000001
> [ 4636.497185] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4636.497185] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081
> [ 4636.514969] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4636.514972] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000
> [ 4636.514974] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0]
> [ 4636.534988] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate
> is 0x122000
> [ 4636.534990] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10
> [ 4636.655062] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001
> [ 4636.655065] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4
> [ 4636.655069] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded.
> [ 4636.655092] sas: sas_form_port: phy0 belongs to port4 already(1)!
> [ 4638.833687] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset
> for device[0]:rc= 0
> [ 4638.990261] drivers/scsi/mvsas/mv_sas.c 1757:port 4 slot 0 rx_desc
> 30000 has error info8000000080000000.
> [ 4655.259921] ata15.00: qc timeout (cmd 0xef)
> [ 4655.259924] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task()
> mvi=00000000f55c98e2 task=00000000cb52cd96 slot=00000000928be8ed
> slot_idx=x0
> [ 4655.259926] ata15.00: failed to set xfermode (err_mask=0x4)
> [ 4655.259928] ata15.00: disabled
> [ 4655.269958] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00000000.
> [ 4655.269961] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000001
> [ 4655.269998] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4655.270000] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081
> [ 4655.287760] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000.
> [ 4655.287762] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000
> [ 4655.287764] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0]
> [ 4655.307778] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate
> is 0x122000
> [ 4655.307780] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10
> [ 4655.427849] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001
> [ 4655.427850] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4
> [ 4655.427854] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded.
> [ 4655.427874] sas: sas_form_port: phy0 belongs to port4 already(1)!
> [ 4657.606419] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset
> for device[0]:rc= 0
> [ 4657.762940] sd 0:0:4:0: [sdf] tag#45 FAILED Result: hostbyte=DID_OK
> driverbyte=DRIVER_SENSE
> [ 4657.762942] sd 0:0:4:0: [sdf] tag#45 Sense Key : Not Ready [current]
> [ 4657.762944] sd 0:0:4:0: [sdf] tag#45 Add. Sense: Logical unit not
> ready, hard reset required
> [ 4657.762945] sd 0:0:4:0: [sdf] tag#45 CDB: Read(16) 88 00 00 00 00
> 01 5d 50 a3 00 00 00 00 08 00 00
> [ 4657.762947] blk_update_request: I/O error, dev sdf, sector
> 5860532992 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
> [ 4657.762965] ata15: EH complete
> [ 4657.763115] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 1 tries: 1
> [ 4657.763154] sd 0:0:4:0: [sdf] tag#54 FAILED Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4657.763158] sd 0:0:4:0: [sdf] tag#54 CDB: Read(16) 88 00 00 00 00
> 01 5d 50 a3 00 00 00 00 08 00 00
> [ 4657.763160] blk_update_request: I/O error, dev sdf, sector
> 5860532992 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0
> [ 4657.763162] Buffer I/O error on dev sdf, logical block 732566624,
> async page read
> [ 4657.763178] drivers/scsi/mvsas/mv_sas.c 1757:port 5 slot 0 rx_desc
> 30000 has error info8000000080000000.
> [ 4657.763216] sd 0:0:4:0: [sdf] tag#52 FAILED Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4657.763218] sd 0:0:4:0: [sdf] tag#52 CDB: Write(16) 8a 00 00 00 00
> 00 35 46 a0 00 00 00 02 00 00 00
> [ 4657.763220] blk_update_request: I/O error, dev sdf, sector
> 893820928 op 0x1:(WRITE) flags 0x8800 phys_seg 64 prio class 0
> [ 4657.763266] sd 0:0:4:0: [sdf] Read Capacity(16) failed: Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4657.763268] sd 0:0:4:0: [sdf] Sense not available.
> [ 4657.763280] sd 0:0:4:0: [sdf] Read Capacity(10) failed: Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4657.763281] sd 0:0:4:0: [sdf] Sense not available.
> [ 4657.763290] sd 0:0:4:0: [sdf] tag#9 FAILED Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4657.763291] sd 0:0:4:0: [sdf] tag#9 CDB: Write(16) 8a 00 00 00 00
> 00 35 46 a0 00 00 00 00 08 00 00
> [ 4657.763293] blk_update_request: I/O error, dev sdf, sector
> 893820928 op 0x1:(WRITE) flags 0x8800 phys_seg 1 prio class 0
> [ 4657.763307] sd 0:0:4:0: [sdf] 0 512-byte logical blocks: (0 B/0 B)
> [ 4657.763308] sd 0:0:4:0: [sdf] 4096-byte physical blocks
> [ 4657.763338] sd 0:0:4:0: [sdf] tag#13 FAILED Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4657.763339] sd 0:0:4:0: [sdf] tag#13 CDB: Write(16) 8a 00 00 00 00
> 00 35 46 a0 08 00 00 00 08 00 00
> [ 4657.763341] blk_update_request: I/O error, dev sdf, sector
> 893820936 op 0x1:(WRITE) flags 0x8800 phys_seg 1 prio class 0
> [ 4657.763363] sd 0:0:4:0: [sdf] tag#15 FAILED Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4657.763366] sd 0:0:4:0: [sdf] tag#15 CDB: Write(16) 8a 00 00 00 00
> 00 35 46 a0 10 00 00 00 08 00 00
> [ 4657.763368] blk_update_request: I/O error, dev sdf, sector
> 893820944 op 0x1:(WRITE) flags 0x8800 phys_seg 1 prio class 0
> [ 4657.763372] sdf: detected capacity change from 3000592982016 to 0
> [ 4663.172629] sd 0:0:4:0: [sdf] Read Capacity(16) failed: Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4663.172631] sd 0:0:4:0: [sdf] Sense not available.
> [ 4663.172657] sd 0:0:4:0: [sdf] Read Capacity(10) failed: Result:
> hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
> [ 4663.172659] sd 0:0:4:0: [sdf] Sense not available.
> [ 4837.222770] sas: Enter sas_scsi_recover_host busy: 0 failed: 0
> [ 4837.222793] sas: ata11: end_device-0:0: dev error handler
> [ 4837.222803] sas: ata12: end_device-0:1: dev error handler
> [ 4837.222806] sas: ata13: end_device-0:2: dev error handler
> [ 4837.222811] sas: ata14: end_device-0:3: dev error handler
> [ 4837.222812] sas: ata15: end_device-0:4: dev error handler
> [ 4837.222822] sas: ata16: end_device-0:5: dev error handler
> [ 4837.222826] sas: ata17: end_device-0:6: dev error handler
> [ 4837.222830] sas: ata18: end_device-0:7: dev error handler
> [ 4837.377344] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1
>
^ permalink raw reply [flat|nested] 4+ messages in thread