All of lore.kernel.org
 help / color / mirror / Atom feed
* ICH6-M libata disk timeouts 2.6.18 -> 2.6.19
@ 2007-01-09 23:16 Mike Accetta
  2007-01-10  4:56 ` Mike Accetta
  0 siblings, 1 reply; 10+ messages in thread
From: Mike Accetta @ 2007-01-09 23:16 UTC (permalink / raw)
  To: linux-ide

We have a system with an ICH6-M controller and two SATA drives configured
for software RAID1. Under 2.6.18, adding the second drive to the array and
starting a re-sync would go to completion without incident. Under 2.6.19,
adding the second drive will always eventually generate what appear
to be timeout errors, before completion of the re-sync operation. One
trial completed. A second trial devolved into a reset/retry loop which
eventually hard fails the operation.

Transcript of the kernel boot disk section, console logs and lspci
output are included below. Note that the errors are apparently being
logged from the source drive that is already part of the array, not
the drive which is the re-sync target.  I haven't dug into any of this
yet but since it worked on 2.6.18 and consistently fails under 2.6.19,
I thought others might be interested in the interim (and will hopefully
know more than me right away about what might be going wrong).

*** Boot info for SATA disks<

Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ICH6: IDE controller at PCI slot 0000:00:1f.1
PCI: Found IRQ 5 for device 0000:00:1f.1
PCI: Sharing IRQ 5 with 0000:00:1d.2
ICH6: chipset revision 4
ICH6: not 100% native mode: will probe irqs later
ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:pio, hdb:pio
ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:pio, hdd:pio
ide-floppy driver 0.99.newide
PCI: Found IRQ 11 for device 0000:00:1f.2
PCI: Sharing IRQ 11 with 0000:00:1d.1
IRQ routing conflict for 0000:00:1f.3, have irq 5, want irq 11
ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 4 ports 1.5 Gbps 0x5 impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq pm led slum part
ata1: SATA max UDMA/133 cmd 0xF8800D00 ctl 0x0 bmdma 0x0 irq 11
ata2: SATA max UDMA/133 cmd 0xF8800D80 ctl 0x0 bmdma 0x0 irq 11
ata3: SATA max UDMA/133 cmd 0xF8800E00 ctl 0x0 bmdma 0x0 irq 11
ata4: SATA max UDMA/133 cmd 0xF8800E80 ctl 0x0 bmdma 0x0 irq 11
scsi0 : ahci
ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
ata1.00: ATA-7, max UDMA/100, 117210240 sectors: LBA48 NCQ (depth 31/32)
ata1.00: ata1: dev 0 multi count 16
ata1.00: configured for UDMA/100
scsi1 : ahci
ata2: SATA link down (SStatus 0 SControl 0)
scsi2 : ahci
ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
ata3.00: ATA-7, max UDMA/100, 117210240 sectors: LBA48 NCQ (depth 31/32)
ata3.00: ata3: dev 0 multi count 16
ata3.00: configured for UDMA/100
scsi3 : ahci
ata4: SATA link down (SStatus 0 SControl 0)
scsi 0:0:0:0: Direct-Access ATA FUJITSU MHV2060B 0000 PQ: 0 ANSI: 5
SCSI device sda: 117210240 512-byte hdwr sectors (60012 MB)
sda: Write Protect is off
SCSI device sda: drive cache: write back
SCSI device sda: 117210240 512-byte hdwr sectors (60012 MB)
sda: Write Protect is off
SCSI device sda: drive cache: write back
sda: sda1 sda4 &lt; sda5 sda6 sda7 sda8 sda9 &gt;
sd 0:0:0:0: Attached scsi disk sda
scsi 2:0:0:0: Direct-Access ATA FUJITSU MHT2060B 0000 PQ: 0 ANSI: 5
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
sdb: sdb1 sdb4 &lt; sdb5 sdb6 sdb7 sdb8 sdb9 &gt;
sd 2:0:0:0: Attached scsi disk sdb

*** First re-sync trial starts here

# mdadm -a /dev/md_d0 /dev/sda
RAID1 conf printout:
--- wd:1 rd:2
disk 0, wo:0, o:1, dev:sdb
disk 1, wo:1, o:1, dev:sda
mdadm: re-added /dev/sda
# ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: exception Emask 0x0 SAct 0x1fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: limiting speed to UDMA/66
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: limiting speed to UDMA/44
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: limiting speed to UDMA/33
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back

# ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr
0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back

# ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr
0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
RAID1 conf printout:
--- wd:2 rd:2
disk 0, wo:0, o:1, dev:sdb
disk 1, wo:0, o:1, dev:sda

*** First re-sync trial completed here

# mdadm -f /dev/md_d0 /dev/sda
raid1: Disk failure on sda, disabling device.
Operation continuing on 1 devices
mdadm: set /dev/sda faulty in /dev/md_d0
# RAID1 conf printout:
--- wd:1 rd:2
disk 0, wo:0, o:1, dev:sdb
disk 1, wo:1, o:0, dev:sda
RAID1 conf printout:
--- wd:1 rd:2
disk 0, wo:0, o:1, dev:sdb

# mdadm -r /dev/md_d0 /dev/sda
mdadm: hot removed /dev/sda

*** Second re-sync trial starts here

# mdadm -a /dev/md_d0 /dev/sda
RAID1 conf printout:
--- wd:1 rd:2
disk 0, wo:0, o:1, dev:sdb
disk 1, wo:1, o:1, dev:sda
mdadm: re-added /dev/sda
# cat /proc/mdstat
Personalities : [raid1]
md_d0 : active raid1 sda[1] sdb[0]
58593750 blocks super 1.0 [2/1] [U_]
[>....................] recovery = 0.2% (120320/58593750)
finish=40.4min speed=24064K/sec

unused devices: <none>
# ata3.00: exception Emask 0x0 SAct 0x3ffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back

# ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: limiting speed to UDMA/25
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: limiting speed to UDMA/16
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
SCSI device sdb: 117210240 512-byte hdwr sectors (60012 MB)
sdb: Write Protect is off
SCSI device sdb: drive cache: write back
ata3.00: limiting speed to PIO4
ata3.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 1 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 2 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 3 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 4 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 5 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 6 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 7 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 8 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 9 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 10 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 11 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 12 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 13 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 14 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 15 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 16 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 17 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 18 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 19 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 20 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 21 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 22 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 23 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 24 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 25 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 26 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 27 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 28 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 29 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: tag 30 cmd 0x60 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3.00: limiting speed to PIO3
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: limiting speed to PIO2
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: limiting speed to PIO1
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: limiting speed to PIO0
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
end_request: I/O error, dev sdb, sector 26751104
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
end_request: I/O error, dev sdb, sector 26750976
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
<span style="white-space: pre;">ata3: port failed to respond (30 secs,
Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
ata3.00: speed down requested but no transfer mode left
ata3.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x2 frozen
ata3.00: tag 0 cmd 0xc4 Emask 0x4 stat 0x40 err 0x0 (timeout)
ata3: softreset failed (port busy but CLO unavailable)
ata3: softreset failed, retrying in 5 secs
ata3: port is slow to respond, please be patient (Status 0x80)
ata3: port failed to respond (30 secs, Status 0x80)
ata3: COMRESET failed (device not ready)
ata3: hardreset failed, retrying in 5 secs
end_request: I/O error, dev sdb, sector 26750848

*** lspci -vvvn

00:00.0 Class 0600: 8086:2590 (rev 03)
        Subsystem: 8086:1999
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort+ >SERR- <PERR-
        Latency: 0
        Capabilities: [e0] #09 [2109]

00:02.0 Class 0300: 8086:2592 (rev 03)
        Subsystem: 8086:1999
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin A routed to IRQ 10
        Region 0: Memory at ffa80000 (32-bit, non-prefetchable) [size=512K]
        Region 1: I/O ports at ec00 [size=8]
        Region 2: Memory at d0000000 (32-bit, prefetchable) [size=256M]
        Region 3: Memory at ffa40000 (32-bit, non-prefetchable) [size=256K]
        Expansion ROM at <unassigned> [disabled]
        Capabilities: [d0] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-

00:02.1 Class 0380: 8086:2792 (rev 03)
        Subsystem: 8086:1999
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
        Latency: 0
        Region 0: Memory at ff980000 (32-bit, non-prefetchable) [size=512K]
        Capabilities: [d0] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-

00:1d.0 Class 0c03: 8086:2658 (rev 04)
        Subsystem: 8086:2658
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin A routed to IRQ 5
        Region 4: I/O ports at e000 [size=32]

00:1d.1 Class 0c03: 8086:2659 (rev 04)
        Subsystem: 8086:2659
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin B routed to IRQ 11
        Region 4: I/O ports at dc00 [size=32]

00:1d.2 Class 0c03: 8086:265a (rev 04)
        Subsystem: 8086:265a
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin C routed to IRQ 5
        Region 4: I/O ports at d880 [size=32]

00:1d.3 Class 0c03: 8086:265b (rev 04)
        Subsystem: 8086:265b
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin D routed to IRQ 10
        Region 4: I/O ports at d800 [size=32]

00:1d.7 Class 0c03: 8086:265c (rev 04) (prog-if 20)
        Subsystem: 8086:265c
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin A routed to IRQ 5
        Region 0: Memory at ffa3b800 (32-bit, non-prefetchable) [size=1K]
        Capabilities: [50] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [58] #0a [20a0]

00:1e.0 Class 0604: 8086:2448 (rev d4) (prog-if 01)
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR-
        Latency: 0
        Bus: primary=00, secondary=01, subordinate=01, sec-latency=32
        I/O behind bridge: 0000c000-0000cfff
        Memory behind bridge: ff700000-ff7fffff
        Prefetchable memory behind bridge: 00000000fff00000-0000000000000000
        BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [50] #0d [0000]

00:1e.2 Class 0401: 8086:266e (rev 04)
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin A routed to IRQ 5
        Region 0: I/O ports at d400 [size=256]
        Region 1: I/O ports at d080 [size=64]
        Region 2: Memory at ffa3b400 (32-bit, non-prefetchable) [size=512]
        Region 3: Memory at ffa3b000 (32-bit, non-prefetchable) [size=256]
        Capabilities: [50] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-

00:1f.0 Class 0601: 8086:2641 (rev 04)
        Subsystem: 8086:2641
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap- 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0

00:1f.1 Class 0101: 8086:266f (rev 04) (prog-if 8a [Master SecP PriP])
        Subsystem: 8086:266f
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin A routed to IRQ 5
        Region 0: I/O ports at <unassigned>
        Region 1: I/O ports at <unassigned>
        Region 2: I/O ports at <unassigned>
        Region 3: I/O ports at <unassigned>
        Region 4: I/O ports at ffa0 [size=16]

00:1f.2 Class 0106: 8086:2653 (rev 04) (prog-if 01)
        Subsystem: 8086:2653
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap+ 66Mhz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 0
        Interrupt: pin B routed to IRQ 11
        Region 0: I/O ports at e880 [size=8]
        Region 1: I/O ports at e800 [size=4]
        Region 2: I/O ports at e480 [size=8]
        Region 3: I/O ports at e400 [size=4]
        Region 4: I/O ports at e080 [size=16]
        Region 5: Memory at ffa3bc00 (32-bit, non-prefetchable) [size=1K]
        Capabilities: [70] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot+,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-

00:1f.3 Class 0c05: 8086:266a (rev 04)
        Subsystem: 8086:266a
        Control: I/O+ Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Interrupt: pin B routed to IRQ 5
        Region 4: I/O ports at 0400 [size=32]

01:08.0 Class 0200: 8086:1068 (rev 04)
        Subsystem: 8086:1094
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
        Latency: 64 (2000ns min, 14000ns max), cache line size 10
        Interrupt: pin A routed to IRQ 5
        Region 0: Memory at ff7ff000 (32-bit, non-prefetchable) [size=4K]
        Region 1: I/O ports at cc00 [size=64]
        Capabilities: [dc] Power Management version 2
                Flags: PMEClk- DSI+ D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 PME-Enable- DSel=0 DScale=2 PME-

--
Mike Accetta

ECI Telecom Ltd.
Data Networking Division (previously Laurel Networks)

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts 2.6.18 -> 2.6.19
  2007-01-09 23:16 ICH6-M libata disk timeouts 2.6.18 -> 2.6.19 Mike Accetta
@ 2007-01-10  4:56 ` Mike Accetta
  2007-01-13  2:23   ` Tejun Heo
  0 siblings, 1 reply; 10+ messages in thread
From: Mike Accetta @ 2007-01-10  4:56 UTC (permalink / raw)
  To: linux-ide


Here's a bit more information on these timeouts.  I noticed a mention
of changing the command queue depth in a recent lkml post and decided
to give that a whirl.

This problem seems to be related to the depth of the queue.  When I
set the value for /sys/block/sdb/device/queue_depth to 4 the raid1
re-sync completes without incident.  When set to 5 it eventually gives
the timeout error message (although at well past 50% of the re-sync).
The problem was originally observed with the default setting (31).
-- 
Mike Accetta

ECI Telecom Ltd.
Data Networking Division (previously Laurel Networks)


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts 2.6.18 -> 2.6.19
  2007-01-10  4:56 ` Mike Accetta
@ 2007-01-13  2:23   ` Tejun Heo
  2007-01-13  3:09     ` Mike Accetta
  0 siblings, 1 reply; 10+ messages in thread
From: Tejun Heo @ 2007-01-13  2:23 UTC (permalink / raw)
  To: Mike Accetta; +Cc: linux-ide

Mike Accetta wrote:
> Here's a bit more information on these timeouts.  I noticed a mention
> of changing the command queue depth in a recent lkml post and decided
> to give that a whirl.
> 
> This problem seems to be related to the depth of the queue.  When I
> set the value for /sys/block/sdb/device/queue_depth to 4 the raid1
> re-sync completes without incident.  When set to 5 it eventually gives
> the timeout error message (although at well past 50% of the re-sync).
> The problem was originally observed with the default setting (31).

Please post the result of 'hdparm -I /dev/sdb'.  Thanks.

-- 
tejun

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts 2.6.18 -> 2.6.19
  2007-01-13  2:23   ` Tejun Heo
@ 2007-01-13  3:09     ` Mike Accetta
  2007-01-19  2:49       ` ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth) Mike Accetta
  2007-02-27 14:54       ` ICH6-M libata disk timeouts 2.6.18 -> 2.6.19 Tejun Heo
  0 siblings, 2 replies; 10+ messages in thread
From: Mike Accetta @ 2007-01-13  3:09 UTC (permalink / raw)
  To: linux-ide

Tejun Heo wrote:
> Mike Accetta wrote:
> > Here's a bit more information on these timeouts.  I noticed a mention
> > of changing the command queue depth in a recent lkml post and decided
> > to give that a whirl.
> > 
> > This problem seems to be related to the depth of the queue.  When I
> > set the value for /sys/block/sdb/device/queue_depth to 4 the raid1
> > re-sync completes without incident.  When set to 5 it eventually gives
> > the timeout error message (although at well past 50% of the re-sync).
> > The problem was originally observed with the default setting (31).
> 
> Please post the result of 'hdparm -I /dev/sdb'.  Thanks.

The version of hdparm on this box gives
    dev/sdb:
     operation not supported on SCSI disks
against the SCSI disk name.  With the controller in compatible mode,
here is the 'hdparm -I /dev/hdb' output on the same disk:

ATA device, with non-removable media
        Model Number:       FUJITSU MHT2060BH
        Serial Number:      NR0YT53258G8
        Firmware Revision:  0000104A
Standards:
        Supported: 7 6 5 4
        Likely used: 7
Configuration:
        Logical         max     current
        cylinders       16383   65535
        heads           16      1
        sectors/track   63      63
        --
        CHS current addressable sectors:    4128705
        LBA    user addressable sectors:  117210240
        LBA48  user addressable sectors:  117210240
        device size with M = 1024*1024:       57231 MBytes
        device size with M = 1000*1000:       60011 MBytes (60 GB)
Capabilities:
        LBA, IORDY(can be disabled)
        Queue depth: 32
        Standby timer values: spec'd by Standard, no device specific minimum
        R/W multiple sector transfer: Max = 16  Current = 16
        Advanced power management level: 128 (0x80)
        Recommended acoustic management value: 254, current value: 254
        DMA: mdma0 mdma1 *mdma2 udma0 udma1 udma2 udma3 udma4 udma5
             Cycle time: min=120ns recommended=120ns
        PIO: pio0 pio1 pio2 pio3 pio4
             Cycle time: no flow control=240ns  IORDY flow control=120ns
Commands/features:
        Enabled Supported:
           *    READ BUFFER cmd
           *    WRITE BUFFER cmd
           *    Host Protected Area feature set
           *    Look-ahead
           *    Write cache
           *    Power Management feature set
                Security Mode feature set
           *    SMART feature set
           *    FLUSH CACHE EXT command
           *    Mandatory FLUSH CACHE command
           *    Device Configuration Overlay feature set
           *    48-bit Address feature set
           *    Automatic Acoustic Management feature set
                SET MAX security extension
           *    Advanced Power Management feature set
           *    DOWNLOAD MICROCODE cmd
           *    General Purpose Logging feature set
           *    SMART self-test
           *    SMART error logging
Security:
        Master password revision code = 65534
                supported
        not     enabled
        not     locked
        not     frozen
        not     expired: security count
        not     supported: enhanced erase
        60min for SECURITY ERASE UNIT.
Checksum: correct
--
Mike Accetta

ECI Telecom Ltd.
Data Networking Division (previously Laurel Networks)

^ permalink raw reply	[flat|nested] 10+ messages in thread

* ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth)
  2007-01-13  3:09     ` Mike Accetta
@ 2007-01-19  2:49       ` Mike Accetta
  2007-01-20 18:21         ` Tejun Heo
  2007-02-27 14:54       ` ICH6-M libata disk timeouts 2.6.18 -> 2.6.19 Tejun Heo
  1 sibling, 1 reply; 10+ messages in thread
From: Mike Accetta @ 2007-01-19  2:49 UTC (permalink / raw)
  To: linux-ide


The subject of this thread has been adjusted to reflect my revised
understanding of the problem.  I had previously thought the problem
with a RAID1 re-sync generating timeout errors on the active (reading)
disk appeared with 2.6.19 but it turns out the problem was also present
in 2.6.18.  I was running the 2.6.18 tests with a modular kernel and
hadn't loaded the ahci module in that scenario (so there was no queueing)
but was using a kernel with SATA built in for the 2.6.19 test (which
enabled queueing).  When ahci is loaded with 2.6.18, the same timeout
problem appears.

The distinguishing factor appears to be the queue depth (4 works, 5
and various values up to and including 31 fail) not the kernel version.
I am going to try running with the queue depth clamped at 4 to see if
this consistently masks the problem.  I may also try some more experiments
if I have the time, like instrumenting what command was issued right
before the group that all time out or increasing the SCSI timeout,
in order to get some more insight into what is going on at the time of
the failure.

I'd be happy to run any tests people with expertise in this area can
suggest to help better understand what is going on.  I guess this problem
looks like the disk becomes wedged somehow at this point.  For what its
worth, it is usually possible to regain control of the system if I stop
the RAID re-sync after the first timeout is reported but when I let it
try to run to completion, the SATA sub-system system usually eventually
gets stuck issuing reset after reset with no success and a power-cycle
is the only recourse.
--
Mike Accetta

ECI Telecom Ltd.
Data Networking Division (previously Laurel Networks)

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth)
  2007-01-19  2:49       ` ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth) Mike Accetta
@ 2007-01-20 18:21         ` Tejun Heo
  2007-01-22 16:04           ` Mike Accetta
  0 siblings, 1 reply; 10+ messages in thread
From: Tejun Heo @ 2007-01-20 18:21 UTC (permalink / raw)
  To: Mike Accetta; +Cc: linux-ide

Mike Accetta wrote:
> The distinguishing factor appears to be the queue depth (4 works, 5
> and various values up to and including 31 fail) not the kernel version.
> I am going to try running with the queue depth clamped at 4 to see if
> this consistently masks the problem.  I may also try some more experiments
> if I have the time, like instrumenting what command was issued right
> before the group that all time out or increasing the SCSI timeout,
> in order to get some more insight into what is going on at the time of
> the failure.

Please report the result of 'hdparm -I /dev/sdX' where sdX is the
problematic disk.  Quite a few drives have problem with NCQ and we have
to blacklist them.

Thanks.

-- 
tejun

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth)
  2007-01-20 18:21         ` Tejun Heo
@ 2007-01-22 16:04           ` Mike Accetta
  2007-01-23  3:11             ` Mark Lord
  0 siblings, 1 reply; 10+ messages in thread
From: Mike Accetta @ 2007-01-22 16:04 UTC (permalink / raw)
  To: linux-ide

Tejun Heo writes:
> Mike Accetta wrote:
> > The distinguishing factor appears to be the queue depth (4 works, 5
> > and various values up to and including 31 fail) not the kernel version.
> > I am going to try running with the queue depth clamped at 4 to see if
> > this consistently masks the problem.  I may also try some more experiments
> > if I have the time, like instrumenting what command was issued right
> > before the group that all time out or increasing the SCSI timeout,
> > in order to get some more insight into what is going on at the time of
> > the failure.
> 
> Please report the result of 'hdparm -I /dev/sdX' where sdX is the
> problematic disk.  Quite a few drives have problem with NCQ and we have
> to blacklist them.

This was reported last week in a earlier post to this thread.  Here it
is again:

The version of hdparm on this box gives
    dev/sdb:
     operation not supported on SCSI disks
against the SCSI disk name.  With the controller in compatible mode,
here is the 'hdparm -I /dev/hdb' output on the same disk:

ATA device, with non-removable media
        Model Number:       FUJITSU MHT2060BH
        Serial Number:      NR0YT53258G8
        Firmware Revision:  0000104A
Standards:
        Supported: 7 6 5 4
        Likely used: 7
Configuration:
        Logical         max     current
        cylinders       16383   65535
        heads           16      1
        sectors/track   63      63
        --
        CHS current addressable sectors:    4128705
        LBA    user addressable sectors:  117210240
        LBA48  user addressable sectors:  117210240
        device size with M = 1024*1024:       57231 MBytes
        device size with M = 1000*1000:       60011 MBytes (60 GB)
Capabilities:
        LBA, IORDY(can be disabled)
        Queue depth: 32
        Standby timer values: spec'd by Standard, no device specific minimum
        R/W multiple sector transfer: Max = 16  Current = 16
        Advanced power management level: 128 (0x80)
        Recommended acoustic management value: 254, current value: 254
        DMA: mdma0 mdma1 *mdma2 udma0 udma1 udma2 udma3 udma4 udma5
             Cycle time: min=120ns recommended=120ns
        PIO: pio0 pio1 pio2 pio3 pio4
             Cycle time: no flow control=240ns  IORDY flow control=120ns
Commands/features:
        Enabled Supported:
           *    READ BUFFER cmd
           *    WRITE BUFFER cmd
           *    Host Protected Area feature set
           *    Look-ahead
           *    Write cache
           *    Power Management feature set
                Security Mode feature set
           *    SMART feature set
           *    FLUSH CACHE EXT command
           *    Mandatory FLUSH CACHE command
           *    Device Configuration Overlay feature set
           *    48-bit Address feature set
           *    Automatic Acoustic Management feature set
                SET MAX security extension
           *    Advanced Power Management feature set
           *    DOWNLOAD MICROCODE cmd
           *    General Purpose Logging feature set
           *    SMART self-test
           *    SMART error logging
Security:
        Master password revision code = 65534
                supported
        not     enabled
        not     locked
        not     frozen
        not     expired: security count
        not     supported: enhanced erase
        60min for SECURITY ERASE UNIT.
Checksum: correct
--
Mike Accetta

ECI Telecom Ltd.
Data Networking Division (previously Laurel Networks)

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth)
  2007-01-22 16:04           ` Mike Accetta
@ 2007-01-23  3:11             ` Mark Lord
  0 siblings, 0 replies; 10+ messages in thread
From: Mark Lord @ 2007-01-23  3:11 UTC (permalink / raw)
  To: Mike Accetta; +Cc: linux-ide

Mike Accetta wrote:
> ..
> The version of hdparm on this box gives
>     dev/sdb:
>      operation not supported on SCSI disks
> against the SCSI disk name.

Upgrade your copy of hdparm.
That got fixed a very long time ago!

Cheers

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts 2.6.18 -> 2.6.19
  2007-01-13  3:09     ` Mike Accetta
  2007-01-19  2:49       ` ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth) Mike Accetta
@ 2007-02-27 14:54       ` Tejun Heo
  2007-02-27 19:37         ` Mike Accetta
  1 sibling, 1 reply; 10+ messages in thread
From: Tejun Heo @ 2007-02-27 14:54 UTC (permalink / raw)
  To: Mike Accetta; +Cc: linux-ide

Mike Accetta wrote:
> The version of hdparm on this box gives
>     dev/sdb:
>      operation not supported on SCSI disks
> against the SCSI disk name.  With the controller in compatible mode,
> here is the 'hdparm -I /dev/hdb' output on the same disk:
> 
> ATA device, with non-removable media
>         Model Number:       FUJITSU MHT2060BH
>         Serial Number:      NR0YT53258G8
>         Firmware Revision:  0000104A

Sorry about late late late response.  :-)

2.6.21 will behave better and turn off NCQ automatically in such cases.
 It also reports proper model and firmware revision, so we'll be able to
blacklist it from info contained in the dmesg.

Does your drive always work reliably if queue depth is set to one?  And
often fails when queue depth is 31?

Thanks.

-- 
tejun

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: ICH6-M libata disk timeouts 2.6.18 -> 2.6.19
  2007-02-27 14:54       ` ICH6-M libata disk timeouts 2.6.18 -> 2.6.19 Tejun Heo
@ 2007-02-27 19:37         ` Mike Accetta
  0 siblings, 0 replies; 10+ messages in thread
From: Mike Accetta @ 2007-02-27 19:37 UTC (permalink / raw)
  To: Tejun Heo; +Cc: linux-ide

Tejun Heo writes:
> Mike Accetta wrote:
> > The version of hdparm on this box gives
> >     dev/sdb:
> >      operation not supported on SCSI disks
> > against the SCSI disk name.  With the controller in compatible mode,
> > here is the 'hdparm -I /dev/hdb' output on the same disk:
> > 
> > ATA device, with non-removable media
> >         Model Number:       FUJITSU MHT2060BH
> >         Serial Number:      NR0YT53258G8
> >         Firmware Revision:  0000104A
> 
> Sorry about late late late response.  :-)
> 
> 2.6.21 will behave better and turn off NCQ automatically in such cases.
>  It also reports proper model and firmware revision, so we'll be able to
> blacklist it from info contained in the dmesg.
> 
> Does your drive always work reliably if queue depth is set to one?  And
> often fails when queue depth is 31?

Hey, better late than never :-)

The drive actually seems to work fine at queue depth 4 and that is
what we are currently running it at.  I stopped at 4 when that worked and
never went any lower.  It always fails above 4 eventually.  The larger
the number, the quicker it seems to fail.  A raid re-resync operation
was the trigger.  On a 60Gb disk, I don't think I ever saw it complete
without error at NCQ > 4.  Sometimes the re-sync would logically succeed,
but with timeout errors, retries and downshifts logged to the console.
Other times, it would get the timeouts and do the retry/downshift until
it ran out of modes and then seem to get stuck in a retry loop.
--
Mike Accetta

ECI Telecom Ltd.
Data Networking Division (previously Laurel Networks)

^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2007-02-27 19:46 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2007-01-09 23:16 ICH6-M libata disk timeouts 2.6.18 -> 2.6.19 Mike Accetta
2007-01-10  4:56 ` Mike Accetta
2007-01-13  2:23   ` Tejun Heo
2007-01-13  3:09     ` Mike Accetta
2007-01-19  2:49       ` ICH6-M libata disk timeouts in 2.6.19 (except with small queue depth) Mike Accetta
2007-01-20 18:21         ` Tejun Heo
2007-01-22 16:04           ` Mike Accetta
2007-01-23  3:11             ` Mark Lord
2007-02-27 14:54       ` ICH6-M libata disk timeouts 2.6.18 -> 2.6.19 Tejun Heo
2007-02-27 19:37         ` Mike Accetta

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.