From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 84D42C33CA8 for ; Mon, 13 Jan 2020 09:51:12 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 447612072B for ; Mon, 13 Jan 2020 09:51:12 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726133AbgAMJvM (ORCPT ); Mon, 13 Jan 2020 04:51:12 -0500 Received: from lhrrgout.huawei.com ([185.176.76.210]:2258 "EHLO huawei.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1725992AbgAMJvL (ORCPT ); Mon, 13 Jan 2020 04:51:11 -0500 Received: from lhreml707-cah.china.huawei.com (unknown [172.18.7.106]) by Forcepoint Email with ESMTP id E79DAD68002622C6FAF8; Mon, 13 Jan 2020 09:51:09 +0000 (GMT) Received: from lhreml724-chm.china.huawei.com (10.201.108.75) by lhreml707-cah.china.huawei.com (10.201.108.48) with Microsoft SMTP Server (TLS) id 14.3.408.0; Mon, 13 Jan 2020 09:51:09 +0000 Received: from [127.0.0.1] (10.202.226.43) by lhreml724-chm.china.huawei.com (10.201.108.75) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Mon, 13 Jan 2020 09:51:09 +0000 Subject: Re: How to reset HBA when using libsas/mvsas To: =?UTF-8?B?RMSBdmlzIE1vc8SBbnM=?= , "linux-scsi@vger.kernel.org" References: From: John Garry Message-ID: <60f0fed7-43c7-c979-c375-d2ab4c21e141@huawei.com> Date: Mon, 13 Jan 2020 09:51:08 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.1.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Originating-IP: [10.202.226.43] X-ClientProxiedBy: lhreml729-chm.china.huawei.com (10.201.108.80) To lhreml724-chm.china.huawei.com (10.201.108.75) X-CFilter-Loop: Reflected Sender: linux-scsi-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-scsi@vger.kernel.org On 12/01/2020 02:21, Dāvis Mosāns wrote: > Hello, > > I've HighPoint RocketRAID 2760A which uses mvsas driver. > When some error happens then disk becomes inaccessible and > to get it usable again currently I know only 2 ways, > either physically pull it out and put back in or reboot whole system. > This is pretty annoying so I want to just reset HBA to simulate that, > but I don't know how to do that. If you just want to rest the disk, you can reset the PHY to which the disk is attached through sysfs, which is essentially is same as ejecting and reinserting the disk: 1. Get the PHY index john@ubuntu:/dev/disk/by-path$ ls -l total 0 lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy10-lun-0 -> ../../sdg lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy11-lun-0 -> ../../sdh lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy1-lun-0 -> ../../sda lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy1-lun-0-part1 -> ../../sda1 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy1-lun-0-part2 -> ../../sda2 lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0 -> ../../sdb lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0-part1 -> ../../sdb1 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0-part2 -> ../../sdb2 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy2-lun-0-part3 -> ../../sdb3 lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0 -> ../../sdc lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0-part1 -> ../../sdc1 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0-part2 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy4-lun-0-part3 -> ../../sdc3 lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy5-lun-0 -> ../../sdd lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0 -> ../../sde lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0-part1 -> ../../sde1 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0-part2 -> ../../sde2 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy7-lun-0-part3 -> ../../sde3 lrwxrwxrwx 1 root root 9 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0 -> ../../sdf lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0-part1 -> ../../sdf1 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0-part2 -> ../../sdf2 lrwxrwxrwx 1 root root 10 Jan 10 16:36 platform-HISI0162:01-sas-exp0x500e004aaaaaaa1f-phy8-lun-0-part3 -> ../../sdf3 2. Go to PHY sysfs folder and disable+enable the PHY: john@ubuntu:/dev/disk/by-path$ cd /sys/class/sas_phy/phy-0:0:10 0:10/sas_phy/phy-0:0:10# echo 0 > enable [234475.077365] sas: smp_execute_task_sg: task to dev 500e004aaaaaaa1f response: 0x0 status 0x2 [234475.085930] sas: broadcast received: 0 [234475.089771] sas: REVALIDATING DOMAIN on port 0, pid:570 root@ubuntu:/sys/devices/platform[234475.096393] sas: ex 500e004aaaaaaa1f phy10 change count has changed /HISI0162:01/host0/port-0:0/expander-0:0/phy-0:0[234475.106724] sas: ex 500e004aaaaaaa1f phy10 originated BROADCAST(CHANGE) 0:10/sas_phy/phy-0:0:10# [234475.115134] sas: ex 500e004aaaaaaa1f unregistering phy10 [234475.123015] sas: ex 500e004aaaaaaa1f phy10:U:1 attached: 0000000000000000 (no device) [234475.130931] sas: ex 500e004aaaaaaa1f phy10 discover returned 0x0 [234475.137023] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.190814] hisi_sas_v2_hw HISI0162:01: dev[7:1] is gone [234475.196667] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.204562] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.209963] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.215715] sas: broadcast received: 0 [234475.219550] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.227407] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.232798] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.238545] sas: broadcast received: 0 [234475.242382] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.250233] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.255630] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.261376] sas: broadcast received: 0 [234475.265204] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.273062] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.278460] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.284211] sas: broadcast received: 0 [234475.288044] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.295901] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.301298] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.307047] sas: broadcast received: 0 [234475.310879] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.318735] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.324125] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.329869] sas: broadcast received: 0 [234475.333703] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.341575] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.346964] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234475.352710] sas: broadcast received: 0 [234475.356543] sas: REVALIDATING DOMAIN on port 0, pid:570 [234475.364403] sas: ex 500e004aaaaaaa1f phys DID NOT change [234475.369796] sas: done REVALIDATING DOMAIN on port 0, pid:570 0:10/sas_phy/phy-0:0:10# echo 1 > enable 0:10/sas_phy/phy-0:0:10# [234479.348543] sas: broadcast received: 0er-0:0/phy-0:0 [234479.352378] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.359008] sas: ex 500e004aaaaaaa1f phy10 change count has changed [234479.367808] sas: ex 500e004aaaaaaa1f phy10 originated BROADCAST(CHANGE) [234479.374505] sas: ex 500e004aaaaaaa1f phy10 new device attached [234479.380558] sas: ex 500e004aaaaaaa1f phy10:U:B attached: 5001e82002862816 (ssp) [234479.388018] hisi_sas_v2_hw HISI0162:01: dev[7:1] found [234479.399828] sas: ex 500e004aaaaaaa1f phy10 register returned 0x0 [234479.405912] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.466775] scsi 0:0:10:0: Direct-Access SanDisk LT0200MO P404 PQ: 0 ANSI: 6 [234479.763239] sas: broadcast received: 0 [234479.767072] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.774965] sas: ex 500e004aaaaaaa1f phys DID NOT change [234479.780356] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.786100] sas: broadcast received: 0 [234479.789932] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.797791] sas: ex 500e004aaaaaaa1f phys DID NOT change [234479.803180] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.808927] sas: broadcast received: 0 [234479.812760] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.820640] sas: ex 500e004aaaaaaa1f phys DID NOT change [234479.826034] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.831781] sas: broadcast received: 0 [234479.835613] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.843471] sas: ex 500e004aaaaaaa1f phys DID NOT change [234479.848861] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.854606] sas: broadcast received: 0 [234479.858445] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.866302] sas: ex 500e004aaaaaaa1f phys DID NOT change [234479.871691] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.877437] sas: broadcast received: 0 [234479.881269] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.889125] sas: ex 500e004aaaaaaa1f phys DID NOT change [234479.894520] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.900266] sas: broadcast received: 0 [234479.904099] sas: REVALIDATING DOMAIN on port 0, pid:570 [234479.911961] sas: ex 500e004aaaaaaa1f phys DID NOT change [234479.917359] sas: done REVALIDATING DOMAIN on port 0, pid:570 [234479.978557] sd 0:0:10:0: [sdg] 390721968 512-byte logical blocks: (200 GB/186 GiB) [234480.020582] sd 0:0:10:0: [sdg] Write Protect is off [234480.025541] sd 0:0:10:0: [sdg] Mode Sense: cf 00 10 08 [234480.102589] sd 0:0:10:0: [sdg] Write cache: disabled, read cache: disabled, supports DPO and FUA [234480.225257] sd 0:0:10:0: [sdg] Optimal transfer size 131072 bytes 0:10/sas_phy/phy-0:0:10# [234481.445588] sd 0:0:10:0: [sdg] Attached SCSI disk0:0 The standard method to reset the host controller is to call the SCSI host sysfs reset method, but this does not seem to be supported for mv_sas - this is no scsi_host_template.host_reset method in the driver. > > I have tried: > $ echo 1 > /sys/block/sdf/device/delete > $ echo '- - -' > /sys/class/scsi_host/host0/scan > > but it doesn't work as it doesn't detect any new drives. I'm not sure if this is the correct method. Thanks, John > > > Some more info see below > > $ lspci -vv > > 44:00.0 RAID bus controller: HighPoint Technologies, Inc. Device 2760 (rev c2) > Subsystem: HighPoint Technologies, Inc. Device 0000 > Physical Slot: 117 > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- > ParErr- Stepping- SERR- FastB2B- DisINTx- > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- > SERR- Latency: 0, Cache Line Size: 64 bytes > Interrupt: pin A routed to IRQ 50 > Region 0: Memory at 82240000 (64-bit, non-prefetchable) [size=128K] > Region 2: Memory at 82200000 (64-bit, non-prefetchable) [size=256K] > Expansion ROM at 82260000 [disabled] [size=64K] > Capabilities: [40] Power Management version 3 > Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA > PME(D0+,D1+,D2-,D3hot+,D3cold-) > Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- > Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+ > Address: 0000000000000000 Data: 0000 > Capabilities: [70] Express (v2) Endpoint, MSI 00 > DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency > L0s <1us, L1 <8us > ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ > FLReset- SlotPowerLimit 25.000W > DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq- > RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- > MaxPayload 512 bytes, MaxReadReq 512 bytes > DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- > AuxPwr- TransPend- > LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM not supported > ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp- > LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk- > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > LnkSta: Speed 5GT/s (ok), Width x8 (ok) > TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- > DevCap2: Completion Timeout: Not Supported, > TimeoutDis+, LTR-, OBFF Not Supported > AtomicOpsCap: 32bit- 64bit- 128bitCAS- > DevCtl2: Completion Timeout: 50us to 50ms, > TimeoutDis-, LTR-, OBFF Disabled > AtomicOpsCtl: ReqEn- > LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis- > Transmit Margin: Normal Operating Range, > EnterModifiedCompliance- ComplianceSOS- > Compliance De-emphasis: -6dB > LnkSta2: Current De-emphasis Level: -6dB, > EqualizationComplete-, EqualizationPhase1- > EqualizationPhase2-, EqualizationPhase3-, > LinkEqualizationRequest- > Capabilities: [100 v1] Advanced Error Reporting > UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- > UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- > UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- > UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- > CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- > AdvNonFatalErr- > CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- > AdvNonFatalErr+ > AERCap: First Error Pointer: 00, ECRCGenCap+ > ECRCGenEn- ECRCChkCap+ ECRCChkEn- > MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- > HeaderLog: 00000000 00000000 00000000 00000000 > Capabilities: [140 v1] Virtual Channel > Caps: LPEVC=0 RefClk=100ns PATEntryBits=1 > Arb: Fixed- WRR32- WRR64- WRR128- > Ctrl: ArbSelect=Fixed > Status: InProgress- > VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans- > Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256- > Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=01 > Status: NegoPending- InProgress- > Kernel driver in use: mvsas > Kernel modules: mvsas > > 45:00.0 RAID bus controller: HighPoint Technologies, Inc. Device 2760 (rev c2) > Subsystem: HighPoint Technologies, Inc. Device 0000 > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- > ParErr- Stepping- SERR- FastB2B- DisINTx- > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- > SERR- Latency: 0, Cache Line Size: 64 bytes > Interrupt: pin A routed to IRQ 47 > Region 0: Memory at 82140000 (64-bit, non-prefetchable) [size=128K] > Region 2: Memory at 82100000 (64-bit, non-prefetchable) [size=256K] > Expansion ROM at 82160000 [disabled] [size=64K] > Capabilities: [40] Power Management version 3 > Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA > PME(D0+,D1+,D2-,D3hot+,D3cold-) > Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- > Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+ > Address: 0000000000000000 Data: 0000 > Capabilities: [70] Express (v2) Endpoint, MSI 00 > DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency > L0s <1us, L1 <8us > ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ > FLReset- SlotPowerLimit 25.000W > DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq- > RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- > MaxPayload 512 bytes, MaxReadReq 512 bytes > DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- > AuxPwr- TransPend- > LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM not supported > ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp- > LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk- > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > LnkSta: Speed 5GT/s (ok), Width x8 (ok) > TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- > DevCap2: Completion Timeout: Not Supported, > TimeoutDis+, LTR-, OBFF Not Supported > AtomicOpsCap: 32bit- 64bit- 128bitCAS- > DevCtl2: Completion Timeout: 50us to 50ms, > TimeoutDis-, LTR-, OBFF Disabled > AtomicOpsCtl: ReqEn- > LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis- > Transmit Margin: Normal Operating Range, > EnterModifiedCompliance- ComplianceSOS- > Compliance De-emphasis: -6dB > LnkSta2: Current De-emphasis Level: -6dB, > EqualizationComplete-, EqualizationPhase1- > EqualizationPhase2-, EqualizationPhase3-, > LinkEqualizationRequest- > Capabilities: [100 v1] Advanced Error Reporting > UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- > UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- > UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- > UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- > CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- > AdvNonFatalErr- > CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- > AdvNonFatalErr+ > AERCap: First Error Pointer: 00, ECRCGenCap+ > ECRCGenEn- ECRCChkCap+ ECRCChkEn- > MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- > HeaderLog: 00000000 00000000 00000000 00000000 > Capabilities: [140 v1] Virtual Channel > Caps: LPEVC=0 RefClk=100ns PATEntryBits=1 > Arb: Fixed- WRR32- WRR64- WRR128- > Ctrl: ArbSelect=Fixed > Status: InProgress- > VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans- > Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256- > Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=01 > Status: NegoPending- InProgress- > Kernel driver in use: mvsas > Kernel modules: mvsas > > 46:00.0 RAID bus controller: HighPoint Technologies, Inc. Device 2760 (rev c2) > Subsystem: HighPoint Technologies, Inc. Device 0000 > Physical Slot: 121 > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- > ParErr- Stepping- SERR- FastB2B- DisINTx- > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- > SERR- Latency: 0, Cache Line Size: 64 bytes > Interrupt: pin A routed to IRQ 50 > Region 0: Memory at 82040000 (64-bit, non-prefetchable) [size=128K] > Region 2: Memory at 82000000 (64-bit, non-prefetchable) [size=256K] > Expansion ROM at 82060000 [disabled] [size=64K] > Capabilities: [40] Power Management version 3 > Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA > PME(D0+,D1+,D2-,D3hot+,D3cold-) > Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- > Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+ > Address: 0000000000000000 Data: 0000 > Capabilities: [70] Express (v2) Endpoint, MSI 00 > DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency > L0s <1us, L1 <8us > ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ > FLReset- SlotPowerLimit 25.000W > DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq- > RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- > MaxPayload 512 bytes, MaxReadReq 512 bytes > DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- > AuxPwr- TransPend- > LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM not supported > ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp- > LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk- > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > LnkSta: Speed 5GT/s (ok), Width x8 (ok) > TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- > DevCap2: Completion Timeout: Not Supported, > TimeoutDis+, LTR-, OBFF Not Supported > AtomicOpsCap: 32bit- 64bit- 128bitCAS- > DevCtl2: Completion Timeout: 50us to 50ms, > TimeoutDis-, LTR-, OBFF Disabled > AtomicOpsCtl: ReqEn- > LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis- > Transmit Margin: Normal Operating Range, > EnterModifiedCompliance- ComplianceSOS- > Compliance De-emphasis: -6dB > LnkSta2: Current De-emphasis Level: -6dB, > EqualizationComplete-, EqualizationPhase1- > EqualizationPhase2-, EqualizationPhase3-, > LinkEqualizationRequest- > Capabilities: [100 v1] Advanced Error Reporting > UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- > UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- > UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- > UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- > CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- > AdvNonFatalErr- > CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- > AdvNonFatalErr+ > AERCap: First Error Pointer: 00, ECRCGenCap+ > ECRCGenEn- ECRCChkCap+ ECRCChkEn- > MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- > HeaderLog: 00000000 00000000 00000000 00000000 > Capabilities: [140 v1] Virtual Channel > Caps: LPEVC=0 RefClk=100ns PATEntryBits=1 > Arb: Fixed- WRR32- WRR64- WRR128- > Ctrl: ArbSelect=Fixed > Status: InProgress- > VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans- > Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256- > Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=01 > Status: NegoPending- InProgress- > Kernel driver in use: mvsas > Kernel modules: mvsas > > > $ dmesg > > [ 4609.661372] sas: Enter sas_scsi_recover_host busy: 1 failed: 1 > [ 4609.661375] sas: trying to find task 0x00000000fba080c0 > [ 4609.661375] sas: sas_scsi_find_task: aborting task 0x00000000fba080c0 > [ 4609.661377] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task() > mvi=00000000f55c98e2 task=00000000fba080c0 slot=00000000928be8ed > slot_idx=x0 > [ 4609.661378] sas: sas_scsi_find_task: task 0x00000000fba080c0 is aborted > [ 4609.661378] sas: sas_eh_handle_sas_errors: task 0x00000000fba080c0 is aborted > [ 4609.661380] sas: ata15: end_device-0:4: cmd error handler > [ 4609.661390] sas: ata11: end_device-0:0: dev error handler > [ 4609.661398] sas: ata12: end_device-0:1: dev error handler > [ 4609.661401] sas: ata13: end_device-0:2: dev error handler > [ 4609.661404] sas: ata14: end_device-0:3: dev error handler > [ 4609.661406] sas: ata15: end_device-0:4: dev error handler > [ 4609.661409] ata15.00: exception Emask 0x0 SAct 0x200000 SErr 0x0 > action 0x6 frozen > [ 4609.661411] ata15.00: failed command: READ FPDMA QUEUED > [ 4609.661414] ata15.00: cmd 60/08:00:00:a3:50/00:00:5d:01:00/40 tag > 21 ncq dma 4096 in > res 40/00:00:00:00:00/00:00:00:00:00/00 Emask > 0x4 (timeout) > [ 4609.661416] sas: ata16: end_device-0:5: dev error handler > [ 4609.661418] ata15.00: status: { DRDY } > [ 4609.661419] sas: ata17: end_device-0:6: dev error handler > [ 4609.661422] sas: ata18: end_device-0:7: dev error handler > [ 4609.661423] ata15: hard resetting link > [ 4609.671596] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4609.671602] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081 > [ 4609.707530] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4609.707535] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000 > [ 4609.707538] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0] > [ 4609.727552] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate > is 0x122000 > [ 4609.727555] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10 > [ 4609.847627] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001 > [ 4609.847631] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4 > [ 4609.847634] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded. > [ 4609.847788] sas: sas_form_port: phy0 belongs to port4 already(1)! > [ 4611.954597] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset > for device[0]:rc= 0 > [ 4612.111285] drivers/scsi/mvsas/mv_sas.c 1757:port 4 slot 0 rx_desc > 30000 has error info8000000080000000. > [ 4617.287750] ata15.00: qc timeout (cmd 0x27) > [ 4617.287754] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task() > mvi=00000000f55c98e2 task=000000005325a7e3 slot=00000000928be8ed > slot_idx=x0 > [ 4617.287757] ata15.00: failed to read native max address (err_mask=0x4) > [ 4617.287759] ata15.00: HPA support seems broken, skipping HPA handling > [ 4617.287760] ata15.00: revalidation failed (errno=-5) > [ 4617.287763] ata15: hard resetting link > [ 4617.297791] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00000000. > [ 4617.297792] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000001 > [ 4617.297829] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4617.297830] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081 > [ 4617.318544] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4617.318547] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000 > [ 4617.318549] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0] > [ 4617.338563] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate > is 0x122000 > [ 4617.338565] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10 > [ 4617.458637] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001 > [ 4617.458639] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4 > [ 4617.458642] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded. > [ 4617.458665] sas: sas_form_port: phy0 belongs to port4 already(1)! > [ 4619.634341] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset > for device[0]:rc= 0 > [ 4619.790900] drivers/scsi/mvsas/mv_sas.c 1757:port 4 slot 0 rx_desc > 30000 has error info8000000080000000. > [ 4636.487111] ata15.00: qc timeout (cmd 0xef) > [ 4636.487114] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task() > mvi=00000000f55c98e2 task=0000000060facb2f slot=00000000928be8ed > slot_idx=x0 > [ 4636.487116] ata15.00: failed to set xfermode (err_mask=0x4) > [ 4636.487118] ata15.00: limiting speed to UDMA/133:PIO3 > [ 4636.487120] ata15: hard resetting link > [ 4636.497144] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00000000. > [ 4636.497144] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000001 > [ 4636.497185] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4636.497185] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081 > [ 4636.514969] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4636.514972] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000 > [ 4636.514974] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0] > [ 4636.534988] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate > is 0x122000 > [ 4636.534990] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10 > [ 4636.655062] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001 > [ 4636.655065] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4 > [ 4636.655069] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded. > [ 4636.655092] sas: sas_form_port: phy0 belongs to port4 already(1)! > [ 4638.833687] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset > for device[0]:rc= 0 > [ 4638.990261] drivers/scsi/mvsas/mv_sas.c 1757:port 4 slot 0 rx_desc > 30000 has error info8000000080000000. > [ 4655.259921] ata15.00: qc timeout (cmd 0xef) > [ 4655.259924] drivers/scsi/mvsas/mv_sas.c 1526:mvs_abort_task() > mvi=00000000f55c98e2 task=00000000cb52cd96 slot=00000000928be8ed > slot_idx=x0 > [ 4655.259926] ata15.00: failed to set xfermode (err_mask=0x4) > [ 4655.259928] ata15.00: disabled > [ 4655.269958] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00000000. > [ 4655.269961] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000001 > [ 4655.269998] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4655.270000] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00000081 > [ 4655.287760] drivers/scsi/mvsas/mv_sas.c 1961:phy 4 ctrl sts=0x00122000. > [ 4655.287762] drivers/scsi/mvsas/mv_sas.c 1963:phy 4 irq sts = 0x00010000 > [ 4655.287764] drivers/scsi/mvsas/mv_sas.c 2012:notify plug in on phy[0] > [ 4655.307778] drivers/scsi/mvsas/mv_94xx.c 869:get all reg link rate > is 0x122000 > [ 4655.307780] drivers/scsi/mvsas/mv_94xx.c 874:get link rate is 10 > [ 4655.427849] drivers/scsi/mvsas/mv_sas.c 1066:phy 4 attach dev info is 20001 > [ 4655.427850] drivers/scsi/mvsas/mv_sas.c 1068:phy 4 attach sas addr is 4 > [ 4655.427854] drivers/scsi/mvsas/mv_sas.c 261:phy 4 byte dmaded. > [ 4655.427874] sas: sas_form_port: phy0 belongs to port4 already(1)! > [ 4657.606419] drivers/scsi/mvsas/mv_sas.c 1417:mvs_I_T_nexus_reset > for device[0]:rc= 0 > [ 4657.762940] sd 0:0:4:0: [sdf] tag#45 FAILED Result: hostbyte=DID_OK > driverbyte=DRIVER_SENSE > [ 4657.762942] sd 0:0:4:0: [sdf] tag#45 Sense Key : Not Ready [current] > [ 4657.762944] sd 0:0:4:0: [sdf] tag#45 Add. Sense: Logical unit not > ready, hard reset required > [ 4657.762945] sd 0:0:4:0: [sdf] tag#45 CDB: Read(16) 88 00 00 00 00 > 01 5d 50 a3 00 00 00 00 08 00 00 > [ 4657.762947] blk_update_request: I/O error, dev sdf, sector > 5860532992 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0 > [ 4657.762965] ata15: EH complete > [ 4657.763115] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 1 tries: 1 > [ 4657.763154] sd 0:0:4:0: [sdf] tag#54 FAILED Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4657.763158] sd 0:0:4:0: [sdf] tag#54 CDB: Read(16) 88 00 00 00 00 > 01 5d 50 a3 00 00 00 00 08 00 00 > [ 4657.763160] blk_update_request: I/O error, dev sdf, sector > 5860532992 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 > [ 4657.763162] Buffer I/O error on dev sdf, logical block 732566624, > async page read > [ 4657.763178] drivers/scsi/mvsas/mv_sas.c 1757:port 5 slot 0 rx_desc > 30000 has error info8000000080000000. > [ 4657.763216] sd 0:0:4:0: [sdf] tag#52 FAILED Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4657.763218] sd 0:0:4:0: [sdf] tag#52 CDB: Write(16) 8a 00 00 00 00 > 00 35 46 a0 00 00 00 02 00 00 00 > [ 4657.763220] blk_update_request: I/O error, dev sdf, sector > 893820928 op 0x1:(WRITE) flags 0x8800 phys_seg 64 prio class 0 > [ 4657.763266] sd 0:0:4:0: [sdf] Read Capacity(16) failed: Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4657.763268] sd 0:0:4:0: [sdf] Sense not available. > [ 4657.763280] sd 0:0:4:0: [sdf] Read Capacity(10) failed: Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4657.763281] sd 0:0:4:0: [sdf] Sense not available. > [ 4657.763290] sd 0:0:4:0: [sdf] tag#9 FAILED Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4657.763291] sd 0:0:4:0: [sdf] tag#9 CDB: Write(16) 8a 00 00 00 00 > 00 35 46 a0 00 00 00 00 08 00 00 > [ 4657.763293] blk_update_request: I/O error, dev sdf, sector > 893820928 op 0x1:(WRITE) flags 0x8800 phys_seg 1 prio class 0 > [ 4657.763307] sd 0:0:4:0: [sdf] 0 512-byte logical blocks: (0 B/0 B) > [ 4657.763308] sd 0:0:4:0: [sdf] 4096-byte physical blocks > [ 4657.763338] sd 0:0:4:0: [sdf] tag#13 FAILED Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4657.763339] sd 0:0:4:0: [sdf] tag#13 CDB: Write(16) 8a 00 00 00 00 > 00 35 46 a0 08 00 00 00 08 00 00 > [ 4657.763341] blk_update_request: I/O error, dev sdf, sector > 893820936 op 0x1:(WRITE) flags 0x8800 phys_seg 1 prio class 0 > [ 4657.763363] sd 0:0:4:0: [sdf] tag#15 FAILED Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4657.763366] sd 0:0:4:0: [sdf] tag#15 CDB: Write(16) 8a 00 00 00 00 > 00 35 46 a0 10 00 00 00 08 00 00 > [ 4657.763368] blk_update_request: I/O error, dev sdf, sector > 893820944 op 0x1:(WRITE) flags 0x8800 phys_seg 1 prio class 0 > [ 4657.763372] sdf: detected capacity change from 3000592982016 to 0 > [ 4663.172629] sd 0:0:4:0: [sdf] Read Capacity(16) failed: Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4663.172631] sd 0:0:4:0: [sdf] Sense not available. > [ 4663.172657] sd 0:0:4:0: [sdf] Read Capacity(10) failed: Result: > hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 4663.172659] sd 0:0:4:0: [sdf] Sense not available. > [ 4837.222770] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 > [ 4837.222793] sas: ata11: end_device-0:0: dev error handler > [ 4837.222803] sas: ata12: end_device-0:1: dev error handler > [ 4837.222806] sas: ata13: end_device-0:2: dev error handler > [ 4837.222811] sas: ata14: end_device-0:3: dev error handler > [ 4837.222812] sas: ata15: end_device-0:4: dev error handler > [ 4837.222822] sas: ata16: end_device-0:5: dev error handler > [ 4837.222826] sas: ata17: end_device-0:6: dev error handler > [ 4837.222830] sas: ata18: end_device-0:7: dev error handler > [ 4837.377344] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 >