All of lore.kernel.org
 help / color / mirror / Atom feed
* arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller
@ 2022-04-24  3:14 Turritopsis Dohrnii Teo En Ming
  2022-04-24 22:25 ` John Stoffel
  0 siblings, 1 reply; 6+ messages in thread
From: Turritopsis Dohrnii Teo En Ming @ 2022-04-24  3:14 UTC (permalink / raw)
  To: linux-raid; +Cc: ceo

Subject: arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller

Good day from Singapore,

Our client has IBM System x3650 server (machine type: 7979). Operating system is CentOS Linux 6.10 (32-bit).

Recently we keep getting the following error messages (output generated by dmesg).

<CODE>

sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d1 50 00 02 00 00
end_request: critical target error, dev sda, sector 153801040
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a cf 50 00 02 00 00
end_request: critical target error, dev sda, sector 153800528
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d3 50 00 02 00 00
end_request: critical target error, dev sda, sector 153801552
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
JBD2: Detected IO errors while flushing file data on dm-0-8
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a cf 38 00 01 00 00
end_request: critical target error, dev sda, sector 153800504
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 38 00 01 00 00
end_request: critical target error, dev sda, sector 153800760
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
end_request: critical target error, dev sda, sector 153800704

</CODE>

/dev/sda is a RAID 5 array with 3 harddisks of 136.6 GB capacity each.

<CODE>

[root@teo-en-ming-server ~]# fdisk /dev/sda

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
         switch off the mode (command 'c') and change display units to
         sectors (command 'u').

Command (m for help): p

Disk /dev/sda: 293.4 GB, 293378981888 bytes
255 heads, 63 sectors/track, 35667 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x8b047782

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          64      512000   83  Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2              64       35668   285989888   8e  Linux LVM

Command (m for help):

</CODE>

We rebooted the server several times. The next morning we still get the same error messages.

<CODE>

sd 0:0:0:0: [sda] 573005824 512-byte logical blocks: (293 GB/273 GiB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 06 00 10 00
sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
 sda: sda1 sda2
sd 0:0:0:0: [sda] Attached SCSI removable disk
dracut: Scanning devices sda2  for LVM logical volumes vg_teo-en-ming-server/lv_swap vg_teo-en-ming-server/lv_root
EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts:
SELinux: initialized (dev sda1, type ext4), uses xattr
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 80 00
end_request: critical target error, dev sda, sector 153800704
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
end_request: critical target error, dev sda, sector 153800704
Buffer I/O error on device sda, logical block 19225088
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
end_request: critical target error, dev sda, sector 153800704
Buffer I/O error on device sda, logical block 19225088
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
end_request: critical target error, dev sda, sector 153800704
Buffer I/O error on device sda, logical block 19225088
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
end_request: critical target error, dev sda, sector 153800704
Buffer I/O error on device sda, logical block 19225088
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
end_request: critical target error, dev sda, sector 153800712
Buffer I/O error on device sda, logical block 19225089
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
end_request: critical target error, dev sda, sector 153800712
Buffer I/O error on device sda, logical block 19225089
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
end_request: critical target error, dev sda, sector 153800712
Buffer I/O error on device sda, logical block 19225089
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
end_request: critical target error, dev sda, sector 153800712
Buffer I/O error on device sda, logical block 19225089
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 10 00 00 08 00
end_request: critical target error, dev sda, sector 153800720
Buffer I/O error on device sda, logical block 19225090
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
end_request: critical target error, dev sda, sector 153800976
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
end_request: critical target error, dev sda, sector 153800976
Buffer I/O error on device sda, logical block 19225122
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
end_request: critical target error, dev sda, sector 153800976
Buffer I/O error on device sda, logical block 19225122
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
end_request: critical target error, dev sda, sector 153800984
Buffer I/O error on device sda, logical block 19225123
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
end_request: critical target error, dev sda, sector 153800984
Buffer I/O error on device sda, logical block 19225123
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
end_request: critical target error, dev sda, sector 153800984
Buffer I/O error on device sda, logical block 19225123
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
end_request: critical target error, dev sda, sector 153800984
Buffer I/O error on device sda, logical block 19225123
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
end_request: critical target error, dev sda, sector 153800992
Buffer I/O error on device sda, logical block 19225124
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
end_request: critical target error, dev sda, sector 153800992
Buffer I/O error on device sda, logical block 19225124
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
end_request: critical target error, dev sda, sector 153800992
Buffer I/O error on device sda, logical block 19225124
Buffer I/O error on device sda, logical block 19225124
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
end_request: critical target error, dev sda, sector 153801256
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
end_request: critical target error, dev sda, sector 153801256
Buffer I/O error on device sda, logical block 19225157
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
end_request: critical target error, dev sda, sector 153801256
Buffer I/O error on device sda, logical block 19225157
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
end_request: critical target error, dev sda, sector 153801256
Buffer I/O error on device sda, logical block 19225157
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
end_request: critical target error, dev sda, sector 153801264
Buffer I/O error on device sda, logical block 19225158
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
end_request: critical target error, dev sda, sector 153801264
Buffer I/O error on device sda, logical block 19225158
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
end_request: critical target error, dev sda, sector 153801264
Buffer I/O error on device sda, logical block 19225158
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
end_request: critical target error, dev sda, sector 153801264
Buffer I/O error on device sda, logical block 19225158
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
end_request: critical target error, dev sda, sector 153801272
Buffer I/O error on device sda, logical block 19225159
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
end_request: critical target error, dev sda, sector 153801272
Buffer I/O error on device sda, logical block 19225159
Buffer I/O error on device sda, logical block 19225159
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 30 00 00 08 00
end_request: critical target error, dev sda, sector 153801520
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
end_request: critical target error, dev sda, sector 153801528
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
end_request: critical target error, dev sda, sector 153801528
Buffer I/O error on device sda, logical block 19225191
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
end_request: critical target error, dev sda, sector 153801528
Buffer I/O error on device sda, logical block 19225191
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
end_request: critical target error, dev sda, sector 153801528
Buffer I/O error on device sda, logical block 19225191
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
end_request: critical target error, dev sda, sector 153801536
Buffer I/O error on device sda, logical block 19225192
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
end_request: critical target error, dev sda, sector 153801536
Buffer I/O error on device sda, logical block 19225192
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
end_request: critical target error, dev sda, sector 153801536
Buffer I/O error on device sda, logical block 19225192
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
end_request: critical target error, dev sda, sector 153801536
Buffer I/O error on device sda, logical block 19225192
sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 48 00 00 08 00
end_request: critical target error, dev sda, sector 153801544
Buffer I/O error on device sda, logical block 19225193
Buffer I/O error on device sda, logical block 19225193
Buffer I/O error on device sda, logical block 19225193

</CODE>

Based on the following discussion thread, we think that the RAID controller may be failing.

Discussion thread: Which disk is bad in raid6 array
Link: https://serverfault.com/questions/384935/which-disk-is-bad-in-raid6-array

I had downloaded 32-bit arcconf Linux utility from the following link.

Link: https://hwraid.le-vert.net/wiki/Adaptec

<CODE>

[root@teo-en-ming-server log]# lspci -vvv | grep RAID
04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
        Subsystem: IBM ServeRAID 8k/8k-l8

</CODE>

However, we keep getting segmentation fault running arcconf utility.

<CODE>

[root@teo-en-ming-server log]# /usr/local/sbin/arcconf getconfig 1
Segmentation fault (core dumped)

</CODE>

These are the Linux Kernel messages.

<CODE>

Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
Apr 22 11:11:33 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
Apr 22 11:11:33 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
Apr 22 11:12:23 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
Apr 22 11:14:37 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
Apr 22 11:14:37 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
Apr 22 11:15:28 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
Apr 22 11:16:34 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
Apr 22 11:16:34 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.

</CODE>

It seems that I could not query the RAID controller. It keeps saying that the RAID controller adapter has kernel panics.

arcconf is a Linux utility to query the RAID controller.

<CODE>

[root@teo-en-ming-server cmdline]# lspci -nn | grep RAID
04:00.0 RAID bus controller [0104]: Adaptec AAC-RAID (Rocket) [9005:0286] (rev 02)

</CODE>

Do you know why I keep getting segmentation fault running arcconf Linux utility?

Regards,

Mr. Turritopsis Dohrnii Teo En Ming
Targeted Individual in Singapore
24 April 2022 Sunday






^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller
  2022-04-24  3:14 arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller Turritopsis Dohrnii Teo En Ming
@ 2022-04-24 22:25 ` John Stoffel
  2022-04-25 14:47   ` Turritopsis Dohrnii Teo En Ming
  0 siblings, 1 reply; 6+ messages in thread
From: John Stoffel @ 2022-04-24 22:25 UTC (permalink / raw)
  To: Turritopsis Dohrnii Teo En Ming; +Cc: linux-raid, ceo

>>>>> "Turritopsis" == Turritopsis Dohrnii Teo En Ming <teo.en.ming@protonmail.com> writes:

Turritopsis> Subject: arcconf Linux utility for Adaptec AAC-RAID
Turritopsis> (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to
Turritopsis> query RAID controller Good day from Singapore,

Turritopsis> Our client has IBM System x3650 server (machine type:
Turritopsis> 7979). Operating system is CentOS Linux 6.10 (32-bit).

Ancient... you're running old mdadm code and kernel... and if it's
critical enough, you could/might be able to get support from Redhat if
you pay them enough... and since it's a hardware RAID controller card,
mdadm and Linux Raid isn't doing anything here, so we're really the
wrong group to ask for help.   But see below...

Turritopsis> Recently we keep getting the following error messages
Turritopsis> (output generated by dmesg).

These errors look to be a bad sector on one of the disks.  But since
you're also using a hardware RAID controller... I would copy your data
off ASAP onto some new media before you lose any thing more.

Just ask them how much it will cost to keep the business running if
they complain about the cost of three replacement disks on the
system.

But basically, I would:

0. copy the data somewhere else, especially if it's critical
1. copy the data somewhere else, especially if it's critical.
2. Try running 'badblocks' on /dev/sda to see if you can force it to
   re-write bad sectors.  See man page for flags to use.
3. You can also try to boot the system to the BIOS and see if there's
   a BIOS screen for the AAC-RAID controller which lets you scrub the
   array or look for bad blocks.

Good luck,
John

Turritopsis> <CODE>

Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d1 50 00 02 00 00
Turritopsis> end_request: critical target error, dev sda, sector 153801040
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a cf 50 00 02 00 00
Turritopsis> end_request: critical target error, dev sda, sector 153800528
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d3 50 00 02 00 00
Turritopsis> end_request: critical target error, dev sda, sector 153801552
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a cf 38 00 01 00 00
Turritopsis> end_request: critical target error, dev sda, sector 153800504
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 38 00 01 00 00
Turritopsis> end_request: critical target error, dev sda, sector 153800760
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800704

Turritopsis> </CODE>

Turritopsis> /dev/sda is a RAID 5 array with 3 harddisks of 136.6 GB capacity each.

Turritopsis> <CODE>

Turritopsis> [root@teo-en-ming-server ~]# fdisk /dev/sda

Turritopsis> WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
Turritopsis>          switch off the mode (command 'c') and change display units to
Turritopsis>          sectors (command 'u').

Turritopsis> Command (m for help): p

Turritopsis> Disk /dev/sda: 293.4 GB, 293378981888 bytes
Turritopsis> 255 heads, 63 sectors/track, 35667 cylinders
Turritopsis> Units = cylinders of 16065 * 512 = 8225280 bytes
Turritopsis> Sector size (logical/physical): 512 bytes / 512 bytes
Turritopsis> I/O size (minimum/optimal): 512 bytes / 512 bytes
Turritopsis> Disk identifier: 0x8b047782

Turritopsis>    Device Boot      Start         End      Blocks   Id  System
Turritopsis> /dev/sda1   *           1          64      512000   83  Linux
Turritopsis> Partition 1 does not end on cylinder boundary.
Turritopsis> /dev/sda2              64       35668   285989888   8e  Linux LVM

Turritopsis> Command (m for help):

Turritopsis> </CODE>

Turritopsis> We rebooted the server several times. The next morning we still get the same error messages.

Turritopsis> <CODE>

Turritopsis> sd 0:0:0:0: [sda] 573005824 512-byte logical blocks: (293 GB/273 GiB)
Turritopsis> sd 0:0:0:0: [sda] Write Protect is off
Turritopsis> sd 0:0:0:0: [sda] Mode Sense: 06 00 10 00
Turritopsis> sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
Turritopsis>  sda: sda1 sda2
Turritopsis> sd 0:0:0:0: [sda] Attached SCSI removable disk
Turritopsis> dracut: Scanning devices sda2  for LVM logical volumes vg_teo-en-ming-server/lv_swap vg_teo-en-ming-server/lv_root
Turritopsis> EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts:
Turritopsis> SELinux: initialized (dev sda1, type ext4), uses xattr
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 80 00
Turritopsis> end_request: critical target error, dev sda, sector 153800704
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800704
Turritopsis> Buffer I/O error on device sda, logical block 19225088
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800704
Turritopsis> Buffer I/O error on device sda, logical block 19225088
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800704
Turritopsis> Buffer I/O error on device sda, logical block 19225088
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800704
Turritopsis> Buffer I/O error on device sda, logical block 19225088
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800712
Turritopsis> Buffer I/O error on device sda, logical block 19225089
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800712
Turritopsis> Buffer I/O error on device sda, logical block 19225089
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800712
Turritopsis> Buffer I/O error on device sda, logical block 19225089
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800712
Turritopsis> Buffer I/O error on device sda, logical block 19225089
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 10 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800720
Turritopsis> Buffer I/O error on device sda, logical block 19225090
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800976
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800976
Turritopsis> Buffer I/O error on device sda, logical block 19225122
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800976
Turritopsis> Buffer I/O error on device sda, logical block 19225122
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800984
Turritopsis> Buffer I/O error on device sda, logical block 19225123
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800984
Turritopsis> Buffer I/O error on device sda, logical block 19225123
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800984
Turritopsis> Buffer I/O error on device sda, logical block 19225123
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800984
Turritopsis> Buffer I/O error on device sda, logical block 19225123
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800992
Turritopsis> Buffer I/O error on device sda, logical block 19225124
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800992
Turritopsis> Buffer I/O error on device sda, logical block 19225124
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153800992
Turritopsis> Buffer I/O error on device sda, logical block 19225124
Turritopsis> Buffer I/O error on device sda, logical block 19225124
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801256
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801256
Turritopsis> Buffer I/O error on device sda, logical block 19225157
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801256
Turritopsis> Buffer I/O error on device sda, logical block 19225157
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801256
Turritopsis> Buffer I/O error on device sda, logical block 19225157
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801264
Turritopsis> Buffer I/O error on device sda, logical block 19225158
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801264
Turritopsis> Buffer I/O error on device sda, logical block 19225158
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801264
Turritopsis> Buffer I/O error on device sda, logical block 19225158
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801264
Turritopsis> Buffer I/O error on device sda, logical block 19225158
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801272
Turritopsis> Buffer I/O error on device sda, logical block 19225159
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801272
Turritopsis> Buffer I/O error on device sda, logical block 19225159
Turritopsis> Buffer I/O error on device sda, logical block 19225159
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 30 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801520
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801528
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801528
Turritopsis> Buffer I/O error on device sda, logical block 19225191
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801528
Turritopsis> Buffer I/O error on device sda, logical block 19225191
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801528
Turritopsis> Buffer I/O error on device sda, logical block 19225191
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801536
Turritopsis> Buffer I/O error on device sda, logical block 19225192
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801536
Turritopsis> Buffer I/O error on device sda, logical block 19225192
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801536
Turritopsis> Buffer I/O error on device sda, logical block 19225192
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801536
Turritopsis> Buffer I/O error on device sda, logical block 19225192
Turritopsis> sd 0:0:0:0: [sda]  Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Turritopsis> sd 0:0:0:0: [sda]  Sense Key : Hardware Error [current]
Turritopsis> sd 0:0:0:0: [sda]  Add. Sense: Internal target failure
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 48 00 00 08 00
Turritopsis> end_request: critical target error, dev sda, sector 153801544
Turritopsis> Buffer I/O error on device sda, logical block 19225193
Turritopsis> Buffer I/O error on device sda, logical block 19225193
Turritopsis> Buffer I/O error on device sda, logical block 19225193

Turritopsis> </CODE>

Turritopsis> Based on the following discussion thread, we think that the RAID controller may be failing.

Turritopsis> Discussion thread: Which disk is bad in raid6 array
Turritopsis> Link: https://serverfault.com/questions/384935/which-disk-is-bad-in-raid6-array

Turritopsis> I had downloaded 32-bit arcconf Linux utility from the following link.

Turritopsis> Link: https://hwraid.le-vert.net/wiki/Adaptec

Turritopsis> <CODE>

Turritopsis> [root@teo-en-ming-server log]# lspci -vvv | grep RAID
Turritopsis> 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
Turritopsis>         Subsystem: IBM ServeRAID 8k/8k-l8

Turritopsis> </CODE>

Turritopsis> However, we keep getting segmentation fault running arcconf utility.

Turritopsis> <CODE>

Turritopsis> [root@teo-en-ming-server log]# /usr/local/sbin/arcconf getconfig 1
Turritopsis> Segmentation fault (core dumped)

Turritopsis> </CODE>

Turritopsis> These are the Linux Kernel messages.

Turritopsis> <CODE>

Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
Turritopsis> Apr 22 11:12:23 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
Turritopsis> Apr 22 11:15:28 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.

Turritopsis> </CODE>

Turritopsis> It seems that I could not query the RAID controller. It keeps saying that the RAID controller adapter has kernel panics.

Turritopsis> arcconf is a Linux utility to query the RAID controller.

Turritopsis> <CODE>

Turritopsis> [root@teo-en-ming-server cmdline]# lspci -nn | grep RAID
Turritopsis> 04:00.0 RAID bus controller [0104]: Adaptec AAC-RAID (Rocket) [9005:0286] (rev 02)

Turritopsis> </CODE>

Turritopsis> Do you know why I keep getting segmentation fault running arcconf Linux utility?

Turritopsis> Regards,

Turritopsis> Mr. Turritopsis Dohrnii Teo En Ming
Turritopsis> Targeted Individual in Singapore
Turritopsis> 24 April 2022 Sunday






^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller
  2022-04-24 22:25 ` John Stoffel
@ 2022-04-25 14:47   ` Turritopsis Dohrnii Teo En Ming
  2022-04-25 14:57     ` John Stoffel
       [not found]     ` <CAAMCDec-nEU10L6qrnmjX6kaMfG2ORobOb6fkmKKNba2D9aGUw@mail.gmail.com>
  0 siblings, 2 replies; 6+ messages in thread
From: Turritopsis Dohrnii Teo En Ming @ 2022-04-25 14:47 UTC (permalink / raw)
  To: John Stoffel; +Cc: linux-raid, ceo

Dear John Stoffel,

I have executed the following command on my client's CentOS 6.10 32-bit Linux server.

# badblocks -sv /dev/sda

And found 512 bad blocks.

Regards,

Mr. Turritopsis Dohrnii Teo En Ming
Targeted Individual in Singapore
25 Apr 2022 Monday


Sent with ProtonMail secure email.


------- Original Message -------
On Monday, April 25th, 2022 at 6:25 AM, John Stoffel <john@stoffel.org> wrote:


> > > > > > "Turritopsis" == Turritopsis Dohrnii Teo En Ming teo.en.ming@protonmail.com writes:
>
>
> Turritopsis> Subject: arcconf Linux utility for Adaptec AAC-RAID
>
> Turritopsis> (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to
>
> Turritopsis> query RAID controller Good day from Singapore,
>
>
> Turritopsis> Our client has IBM System x3650 server (machine type:
>
> Turritopsis> 7979). Operating system is CentOS Linux 6.10 (32-bit).
>
>
> Ancient... you're running old mdadm code and kernel... and if it's
> critical enough, you could/might be able to get support from Redhat if
> you pay them enough... and since it's a hardware RAID controller card,
> mdadm and Linux Raid isn't doing anything here, so we're really the
> wrong group to ask for help. But see below...
>
> Turritopsis> Recently we keep getting the following error messages
>
> Turritopsis> (output generated by dmesg).
>
>
> These errors look to be a bad sector on one of the disks. But since
> you're also using a hardware RAID controller... I would copy your data
> off ASAP onto some new media before you lose any thing more.
>
> Just ask them how much it will cost to keep the business running if
> they complain about the cost of three replacement disks on the
> system.
>
> But basically, I would:
>
> 0. copy the data somewhere else, especially if it's critical
> 1. copy the data somewhere else, especially if it's critical.
> 2. Try running 'badblocks' on /dev/sda to see if you can force it to
> re-write bad sectors. See man page for flags to use.
> 3. You can also try to boot the system to the BIOS and see if there's
> a BIOS screen for the AAC-RAID controller which lets you scrub the
> array or look for bad blocks.
>
> Good luck,
> John
>
> Turritopsis> <CODE>
>
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d1 50 00 02 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801040
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a cf 50 00 02 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800528
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d3 50 00 02 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801552
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a cf 38 00 01 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800504
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 38 00 01 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800760
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
>
> Turritopsis> </CODE>
>
>
> Turritopsis> /dev/sda is a RAID 5 array with 3 harddisks of 136.6 GB capacity each.
>
>
> Turritopsis> <CODE>
>
>
> Turritopsis> [root@teo-en-ming-server ~]# fdisk /dev/sda
>
>
> Turritopsis> WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
>
> Turritopsis> switch off the mode (command 'c') and change display units to
>
> Turritopsis> sectors (command 'u').
>
>
> Turritopsis> Command (m for help): p
>
>
> Turritopsis> Disk /dev/sda: 293.4 GB, 293378981888 bytes
>
> Turritopsis> 255 heads, 63 sectors/track, 35667 cylinders
>
> Turritopsis> Units = cylinders of 16065 * 512 = 8225280 bytes
>
> Turritopsis> Sector size (logical/physical): 512 bytes / 512 bytes
>
> Turritopsis> I/O size (minimum/optimal): 512 bytes / 512 bytes
>
> Turritopsis> Disk identifier: 0x8b047782
>
>
> Turritopsis> Device Boot Start End Blocks Id System
>
> Turritopsis> /dev/sda1 * 1 64 512000 83 Linux
>
> Turritopsis> Partition 1 does not end on cylinder boundary.
>
> Turritopsis> /dev/sda2 64 35668 285989888 8e Linux LVM
>
>
> Turritopsis> Command (m for help):
>
>
> Turritopsis> </CODE>
>
>
> Turritopsis> We rebooted the server several times. The next morning we still get the same error messages.
>
>
> Turritopsis> <CODE>
>
>
> Turritopsis> sd 0:0:0:0: [sda] 573005824 512-byte logical blocks: (293 GB/273 GiB)
>
> Turritopsis> sd 0:0:0:0: [sda] Write Protect is off
>
> Turritopsis> sd 0:0:0:0: [sda] Mode Sense: 06 00 10 00
>
> Turritopsis> sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
>
> Turritopsis> sda: sda1 sda2
>
> Turritopsis> sd 0:0:0:0: [sda] Attached SCSI removable disk
>
> Turritopsis> dracut: Scanning devices sda2 for LVM logical volumes vg_teo-en-ming-server/lv_swap vg_teo-en-ming-server/lv_root
>
> Turritopsis> EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts:
>
> Turritopsis> SELinux: initialized (dev sda1, type ext4), uses xattr
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 80 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800720
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225090
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800976
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800976
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225122
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800976
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225122
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800992
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800992
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800992
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225157
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225157
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225157
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801272
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225159
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801272
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225159
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225159
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801520
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225191
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225191
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225191
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 48 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801544
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225193
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225193
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225193
>
>
> Turritopsis> </CODE>
>
>
> Turritopsis> Based on the following discussion thread, we think that the RAID controller may be failing.
>
>
> Turritopsis> Discussion thread: Which disk is bad in raid6 array
>
> Turritopsis> Link: https://serverfault.com/questions/384935/which-disk-is-bad-in-raid6-array
>
>
> Turritopsis> I had downloaded 32-bit arcconf Linux utility from the following link.
>
>
> Turritopsis> Link: https://hwraid.le-vert.net/wiki/Adaptec
>
>
> Turritopsis> <CODE>
>
>
> Turritopsis> [root@teo-en-ming-server log]# lspci -vvv | grep RAID
>
> Turritopsis> 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
>
> Turritopsis> Subsystem: IBM ServeRAID 8k/8k-l8
>
>
> Turritopsis> </CODE>
>
>
> Turritopsis> However, we keep getting segmentation fault running arcconf utility.
>
>
> Turritopsis> <CODE>
>
>
> Turritopsis> [root@teo-en-ming-server log]# /usr/local/sbin/arcconf getconfig 1
>
> Turritopsis> Segmentation fault (core dumped)
>
>
> Turritopsis> </CODE>
>
>
> Turritopsis> These are the Linux Kernel messages.
>
>
> Turritopsis> <CODE>
>
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>
> Turritopsis> Apr 22 11:12:23 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>
> Turritopsis> Apr 22 11:15:28 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>
>
> Turritopsis> </CODE>
>
>
> Turritopsis> It seems that I could not query the RAID controller. It keeps saying that the RAID controller adapter has kernel panics.
>
>
> Turritopsis> arcconf is a Linux utility to query the RAID controller.
>
>
> Turritopsis> <CODE>
>
>
> Turritopsis> [root@teo-en-ming-server cmdline]# lspci -nn | grep RAID
>
> Turritopsis> 04:00.0 RAID bus controller [0104]: Adaptec AAC-RAID (Rocket) [9005:0286] (rev 02)
>
>
> Turritopsis> </CODE>
>
>
> Turritopsis> Do you know why I keep getting segmentation fault running arcconf Linux utility?
>
>
> Turritopsis> Regards,
>
>
> Turritopsis> Mr. Turritopsis Dohrnii Teo En Ming
>
> Turritopsis> Targeted Individual in Singapore
>
> Turritopsis> 24 April 2022 Sunday
>
>
>
>
>

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller
  2022-04-25 14:47   ` Turritopsis Dohrnii Teo En Ming
@ 2022-04-25 14:57     ` John Stoffel
  2022-04-27 12:52       ` Turritopsis Dohrnii Teo En Ming
       [not found]     ` <CAAMCDec-nEU10L6qrnmjX6kaMfG2ORobOb6fkmKKNba2D9aGUw@mail.gmail.com>
  1 sibling, 1 reply; 6+ messages in thread
From: John Stoffel @ 2022-04-25 14:57 UTC (permalink / raw)
  To: Turritopsis Dohrnii Teo En Ming; +Cc: John Stoffel, linux-raid, ceo


Turritopsis> I have executed the following command on my client's
Turritopsis> CentOS 6.10 32-bit Linux server.

Turritopsis> # badblocks -sv /dev/sda

Turritopsis> And found 512 bad blocks.

Yup, you've got a bad array, either one or more disks is going bad.
You need to backup this data ASAP to another disk somewhere else, so
you can then work on repairing or replacing the bad disk in the RAID
array.

Since you say it's RAID5, and only three disks, you don't have much
redundancy, and because you're seeing bad blocks at the level of the
array (not the inidividual disks) then I think it's only a matter of
time before you lose data.

I also strongly encourage you to change the setup of the system to not
use a hardware based RAID controller.  As you can see now, when you
start having problems, unless you have the right vendor tools, then
you might not have any support to make figuring out what has gone
wrong.

Go look at this web page, it might be helpful for you.

https://www.cyberciti.biz/faq/linux-checking-sas-sata-disks-behind-adaptec-raid-controllers/

Or this might help:

https://storage.microsemi.com/en-us/downloads/storage_manager/sm/productid=aar-2820sa&dn=adaptec+serial+ata+ii+raid+2820sa.html

Good luck!
John


Turritopsis> ------- Original Message -------
Turritopsis> On Monday, April 25th, 2022 at 6:25 AM, John Stoffel <john@stoffel.org> wrote:


>> > > > > > "Turritopsis" == Turritopsis Dohrnii Teo En Ming teo.en.ming@protonmail.com writes:
>> 
>> 
Turritopsis> Subject: arcconf Linux utility for Adaptec AAC-RAID
>> 
Turritopsis> (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to
>> 
Turritopsis> query RAID controller Good day from Singapore,
>> 
>> 
Turritopsis> Our client has IBM System x3650 server (machine type:
>> 
Turritopsis> 7979). Operating system is CentOS Linux 6.10 (32-bit).
>> 
>> 
>> Ancient... you're running old mdadm code and kernel... and if it's
>> critical enough, you could/might be able to get support from Redhat if
>> you pay them enough... and since it's a hardware RAID controller card,
>> mdadm and Linux Raid isn't doing anything here, so we're really the
>> wrong group to ask for help. But see below...
>> 
Turritopsis> Recently we keep getting the following error messages
>> 
Turritopsis> (output generated by dmesg).
>> 
>> 
>> These errors look to be a bad sector on one of the disks. But since
>> you're also using a hardware RAID controller... I would copy your data
>> off ASAP onto some new media before you lose any thing more.
>> 
>> Just ask them how much it will cost to keep the business running if
>> they complain about the cost of three replacement disks on the
>> system.
>> 
>> But basically, I would:
>> 
>> 0. copy the data somewhere else, especially if it's critical
>> 1. copy the data somewhere else, especially if it's critical.
>> 2. Try running 'badblocks' on /dev/sda to see if you can force it to
>> re-write bad sectors. See man page for flags to use.
>> 3. You can also try to boot the system to the BIOS and see if there's
>> a BIOS screen for the AAC-RAID controller which lets you scrub the
>> array or look for bad blocks.
>> 
>> Good luck,
>> John
>> 
Turritopsis> <CODE>
>> 
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d1 50 00 02 00 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801040
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a cf 50 00 02 00 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800528
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d3 50 00 02 00 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801552
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a cf 38 00 01 00 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800504
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 38 00 01 00 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800760
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800704
>> 
>> 
Turritopsis> </CODE>
>> 
>> 
Turritopsis> /dev/sda is a RAID 5 array with 3 harddisks of 136.6 GB capacity each.
>> 
>> 
Turritopsis> <CODE>
>> 
>> 
Turritopsis> [root@teo-en-ming-server ~]# fdisk /dev/sda
>> 
>> 
Turritopsis> WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
>> 
Turritopsis> switch off the mode (command 'c') and change display units to
>> 
Turritopsis> sectors (command 'u').
>> 
>> 
Turritopsis> Command (m for help): p
>> 
>> 
Turritopsis> Disk /dev/sda: 293.4 GB, 293378981888 bytes
>> 
Turritopsis> 255 heads, 63 sectors/track, 35667 cylinders
>> 
Turritopsis> Units = cylinders of 16065 * 512 = 8225280 bytes
>> 
Turritopsis> Sector size (logical/physical): 512 bytes / 512 bytes
>> 
Turritopsis> I/O size (minimum/optimal): 512 bytes / 512 bytes
>> 
Turritopsis> Disk identifier: 0x8b047782
>> 
>> 
Turritopsis> Device Boot Start End Blocks Id System
>> 
Turritopsis> /dev/sda1 * 1 64 512000 83 Linux
>> 
Turritopsis> Partition 1 does not end on cylinder boundary.
>> 
Turritopsis> /dev/sda2 64 35668 285989888 8e Linux LVM
>> 
>> 
Turritopsis> Command (m for help):
>> 
>> 
Turritopsis> </CODE>
>> 
>> 
Turritopsis> We rebooted the server several times. The next morning we still get the same error messages.
>> 
>> 
Turritopsis> <CODE>
>> 
>> 
Turritopsis> sd 0:0:0:0: [sda] 573005824 512-byte logical blocks: (293 GB/273 GiB)
>> 
Turritopsis> sd 0:0:0:0: [sda] Write Protect is off
>> 
Turritopsis> sd 0:0:0:0: [sda] Mode Sense: 06 00 10 00
>> 
Turritopsis> sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
>> 
Turritopsis> sda: sda1 sda2
>> 
Turritopsis> sd 0:0:0:0: [sda] Attached SCSI removable disk
>> 
Turritopsis> dracut: Scanning devices sda2 for LVM logical volumes vg_teo-en-ming-server/lv_swap vg_teo-en-ming-server/lv_root
>> 
Turritopsis> EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts:
>> 
Turritopsis> SELinux: initialized (dev sda1, type ext4), uses xattr
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 80 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800704
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800704
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225088
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800704
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225088
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800704
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225088
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800704
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225088
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800712
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225089
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800712
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225089
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800712
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225089
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800712
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225089
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 10 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800720
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225090
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800976
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800976
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225122
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800976
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225122
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800984
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225123
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800984
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225123
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800984
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225123
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800984
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225123
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800992
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225124
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800992
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225124
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153800992
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225124
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225124
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801256
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801256
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225157
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801256
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225157
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801256
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225157
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801264
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225158
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801264
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225158
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801264
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225158
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801264
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225158
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801272
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225159
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801272
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225159
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225159
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 30 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801520
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801528
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801528
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225191
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801528
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225191
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801528
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225191
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801536
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225192
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801536
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225192
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801536
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225192
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801536
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225192
>> 
Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>> 
Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>> 
Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>> 
Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 48 00 00 08 00
>> 
Turritopsis> end_request: critical target error, dev sda, sector 153801544
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225193
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225193
>> 
Turritopsis> Buffer I/O error on device sda, logical block 19225193
>> 
>> 
Turritopsis> </CODE>
>> 
>> 
Turritopsis> Based on the following discussion thread, we think that the RAID controller may be failing.
>> 
>> 
Turritopsis> Discussion thread: Which disk is bad in raid6 array
>> 
Turritopsis> Link: https://serverfault.com/questions/384935/which-disk-is-bad-in-raid6-array
>> 
>> 
Turritopsis> I had downloaded 32-bit arcconf Linux utility from the following link.
>> 
>> 
Turritopsis> Link: https://hwraid.le-vert.net/wiki/Adaptec
>> 
>> 
Turritopsis> <CODE>
>> 
>> 
Turritopsis> [root@teo-en-ming-server log]# lspci -vvv | grep RAID
>> 
Turritopsis> 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
>> 
Turritopsis> Subsystem: IBM ServeRAID 8k/8k-l8
>> 
>> 
Turritopsis> </CODE>
>> 
>> 
Turritopsis> However, we keep getting segmentation fault running arcconf utility.
>> 
>> 
Turritopsis> <CODE>
>> 
>> 
Turritopsis> [root@teo-en-ming-server log]# /usr/local/sbin/arcconf getconfig 1
>> 
Turritopsis> Segmentation fault (core dumped)
>> 
>> 
Turritopsis> </CODE>
>> 
>> 
Turritopsis> These are the Linux Kernel messages.
>> 
>> 
Turritopsis> <CODE>
>> 
>> 
Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>> 
Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>> 
Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>> 
Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>> 
Turritopsis> Apr 22 11:12:23 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
>> 
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>> 
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>> 
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>> 
Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>> 
Turritopsis> Apr 22 11:15:28 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
>> 
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>> 
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>> 
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>> 
Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>> 
>> 
Turritopsis> </CODE>
>> 
>> 
Turritopsis> It seems that I could not query the RAID controller. It keeps saying that the RAID controller adapter has kernel panics.
>> 
>> 
Turritopsis> arcconf is a Linux utility to query the RAID controller.
>> 
>> 
Turritopsis> <CODE>
>> 
>> 
Turritopsis> [root@teo-en-ming-server cmdline]# lspci -nn | grep RAID
>> 
Turritopsis> 04:00.0 RAID bus controller [0104]: Adaptec AAC-RAID (Rocket) [9005:0286] (rev 02)
>> 
>> 
Turritopsis> </CODE>
>> 
>> 
Turritopsis> Do you know why I keep getting segmentation fault running arcconf Linux utility?
>> 
>> 
Turritopsis> Regards,
>> 
>> 
Turritopsis> Mr. Turritopsis Dohrnii Teo En Ming
>> 
Turritopsis> Targeted Individual in Singapore
>> 
Turritopsis> 24 April 2022 Sunday
>> 
>> 
>> 
>> 
>> 

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller
  2022-04-25 14:57     ` John Stoffel
@ 2022-04-27 12:52       ` Turritopsis Dohrnii Teo En Ming
  0 siblings, 0 replies; 6+ messages in thread
From: Turritopsis Dohrnii Teo En Ming @ 2022-04-27 12:52 UTC (permalink / raw)
  To: John Stoffel; +Cc: linux-raid, ceo

Dear John Stoffel,

Our client has informed us that they are migrating their application to the cloud and this server will be decommissioned in the near future.

As such, we will not continue with troubleshooting this issue.

Thank you for your replies.

Regards,

Mr. Turritopsis Dohrnii Teo En Ming
Targeted Individual in Singapore
27 April 2022 Wednesday










Sent with ProtonMail secure email.
------- Original Message -------
On Monday, April 25th, 2022 at 10:57 PM, John Stoffel <john@stoffel.org> wrote:


> Turritopsis> I have executed the following command on my client's
>
> Turritopsis> CentOS 6.10 32-bit Linux server.
>
>
> Turritopsis> # badblocks -sv /dev/sda
>
>
> Turritopsis> And found 512 bad blocks.
>
>
> Yup, you've got a bad array, either one or more disks is going bad.
> You need to backup this data ASAP to another disk somewhere else, so
> you can then work on repairing or replacing the bad disk in the RAID
> array.
>
> Since you say it's RAID5, and only three disks, you don't have much
> redundancy, and because you're seeing bad blocks at the level of the
> array (not the inidividual disks) then I think it's only a matter of
> time before you lose data.
>
> I also strongly encourage you to change the setup of the system to not
> use a hardware based RAID controller. As you can see now, when you
> start having problems, unless you have the right vendor tools, then
> you might not have any support to make figuring out what has gone
> wrong.
>
> Go look at this web page, it might be helpful for you.
>
> https://www.cyberciti.biz/faq/linux-checking-sas-sata-disks-behind-adaptec-raid-controllers/
>
> Or this might help:
>
> https://storage.microsemi.com/en-us/downloads/storage_manager/sm/productid=aar-2820sa&dn=adaptec+serial+ata+ii+raid+2820sa.html
>
> Good luck!
> John
>
>
> Turritopsis> ------- Original Message -------
>
> Turritopsis> On Monday, April 25th, 2022 at 6:25 AM, John Stoffel john@stoffel.org wrote:
>
>
>
> > > > > > > > "Turritopsis" == Turritopsis Dohrnii Teo En Ming teo.en.ming@protonmail.com writes:
>
> Turritopsis> Subject: arcconf Linux utility for Adaptec AAC-RAID
>
> Turritopsis> (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to
>
> Turritopsis> query RAID controller Good day from Singapore,
>
> Turritopsis> Our client has IBM System x3650 server (machine type:
>
> Turritopsis> 7979). Operating system is CentOS Linux 6.10 (32-bit).
>
> > > Ancient... you're running old mdadm code and kernel... and if it's
> > > critical enough, you could/might be able to get support from Redhat if
> > > you pay them enough... and since it's a hardware RAID controller card,
> > > mdadm and Linux Raid isn't doing anything here, so we're really the
> > > wrong group to ask for help. But see below...
>
> Turritopsis> Recently we keep getting the following error messages
>
> Turritopsis> (output generated by dmesg).
>
> > > These errors look to be a bad sector on one of the disks. But since
> > > you're also using a hardware RAID controller... I would copy your data
> > > off ASAP onto some new media before you lose any thing more.
> > >
> > > Just ask them how much it will cost to keep the business running if
> > > they complain about the cost of three replacement disks on the
> > > system.
> > >
> > > But basically, I would:
> > >
> > > 0. copy the data somewhere else, especially if it's critical
> > > 1. copy the data somewhere else, especially if it's critical.
> > > 2. Try running 'badblocks' on /dev/sda to see if you can force it to
> > > re-write bad sectors. See man page for flags to use.
> > > 3. You can also try to boot the system to the BIOS and see if there's
> > > a BIOS screen for the AAC-RAID controller which lets you scrub the
> > > array or look for bad blocks.
> > >
> > > Good luck,
> > > John
>
> Turritopsis> <CODE>
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d1 50 00 02 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801040
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a cf 50 00 02 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800528
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d3 50 00 02 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801552
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a cf 38 00 01 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800504
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 38 00 01 00 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800760
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> </CODE>
>
> Turritopsis> /dev/sda is a RAID 5 array with 3 harddisks of 136.6 GB capacity each.
>
> Turritopsis> <CODE>
>
> Turritopsis> [root@teo-en-ming-server ~]# fdisk /dev/sda
>
> Turritopsis> WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
>
> Turritopsis> switch off the mode (command 'c') and change display units to
>
> Turritopsis> sectors (command 'u').
>
> Turritopsis> Command (m for help): p
>
> Turritopsis> Disk /dev/sda: 293.4 GB, 293378981888 bytes
>
> Turritopsis> 255 heads, 63 sectors/track, 35667 cylinders
>
> Turritopsis> Units = cylinders of 16065 * 512 = 8225280 bytes
>
> Turritopsis> Sector size (logical/physical): 512 bytes / 512 bytes
>
> Turritopsis> I/O size (minimum/optimal): 512 bytes / 512 bytes
>
> Turritopsis> Disk identifier: 0x8b047782
>
> Turritopsis> Device Boot Start End Blocks Id System
>
> Turritopsis> /dev/sda1 * 1 64 512000 83 Linux
>
> Turritopsis> Partition 1 does not end on cylinder boundary.
>
> Turritopsis> /dev/sda2 64 35668 285989888 8e Linux LVM
>
> Turritopsis> Command (m for help):
>
> Turritopsis> </CODE>
>
> Turritopsis> We rebooted the server several times. The next morning we still get the same error messages.
>
> Turritopsis> <CODE>
>
> Turritopsis> sd 0:0:0:0: [sda] 573005824 512-byte logical blocks: (293 GB/273 GiB)
>
> Turritopsis> sd 0:0:0:0: [sda] Write Protect is off
>
> Turritopsis> sd 0:0:0:0: [sda] Mode Sense: 06 00 10 00
>
> Turritopsis> sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
>
> Turritopsis> sda: sda1 sda2
>
> Turritopsis> sd 0:0:0:0: [sda] Attached SCSI removable disk
>
> Turritopsis> dracut: Scanning devices sda2 for LVM logical volumes vg_teo-en-ming-server/lv_swap vg_teo-en-ming-server/lv_root
>
> Turritopsis> EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts:
>
> Turritopsis> SELinux: initialized (dev sda1, type ext4), uses xattr
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 80 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800704
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225088
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800712
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225089
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800720
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225090
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800976
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800976
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225122
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800976
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225122
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800984
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225123
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800992
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800992
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153800992
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225124
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225157
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225157
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801256
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225157
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801264
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225158
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801272
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225159
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801272
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225159
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225159
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 30 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801520
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225191
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225191
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801528
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225191
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801536
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225192
>
> Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
>
> Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
>
> Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
>
> Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 48 00 00 08 00
>
> Turritopsis> end_request: critical target error, dev sda, sector 153801544
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225193
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225193
>
> Turritopsis> Buffer I/O error on device sda, logical block 19225193
>
> Turritopsis> </CODE>
>
> Turritopsis> Based on the following discussion thread, we think that the RAID controller may be failing.
>
> Turritopsis> Discussion thread: Which disk is bad in raid6 array
>
> Turritopsis> Link: https://serverfault.com/questions/384935/which-disk-is-bad-in-raid6-array
>
> Turritopsis> I had downloaded 32-bit arcconf Linux utility from the following link.
>
> Turritopsis> Link: https://hwraid.le-vert.net/wiki/Adaptec
>
> Turritopsis> <CODE>
>
> Turritopsis> [root@teo-en-ming-server log]# lspci -vvv | grep RAID
>
> Turritopsis> 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
>
> Turritopsis> Subsystem: IBM ServeRAID 8k/8k-l8
>
> Turritopsis> </CODE>
>
> Turritopsis> However, we keep getting segmentation fault running arcconf utility.
>
> Turritopsis> <CODE>
>
> Turritopsis> [root@teo-en-ming-server log]# /usr/local/sbin/arcconf getconfig 1
>
> Turritopsis> Segmentation fault (core dumped)
>
> Turritopsis> </CODE>
>
> Turritopsis> These are the Linux Kernel messages.
>
> Turritopsis> <CODE>
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>
> Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>
> Turritopsis> Apr 22 11:12:23 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>
> Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>
> Turritopsis> Apr 22 11:15:28 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
>
> Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
>
> Turritopsis> </CODE>
>
> Turritopsis> It seems that I could not query the RAID controller. It keeps saying that the RAID controller adapter has kernel panics.
>
> Turritopsis> arcconf is a Linux utility to query the RAID controller.
>
> Turritopsis> <CODE>
>
> Turritopsis> [root@teo-en-ming-server cmdline]# lspci -nn | grep RAID
>
> Turritopsis> 04:00.0 RAID bus controller [0104]: Adaptec AAC-RAID (Rocket) [9005:0286] (rev 02)
>
> Turritopsis> </CODE>
>
> Turritopsis> Do you know why I keep getting segmentation fault running arcconf Linux utility?
>
> Turritopsis> Regards,
>
> Turritopsis> Mr. Turritopsis Dohrnii Teo En Ming
>
> Turritopsis> Targeted Individual in Singapore
>
> Turritopsis> 24 April 2022 Sunday

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller
       [not found]     ` <CAAMCDec-nEU10L6qrnmjX6kaMfG2ORobOb6fkmKKNba2D9aGUw@mail.gmail.com>
@ 2022-04-27 13:14       ` Turritopsis Dohrnii Teo En Ming
  0 siblings, 0 replies; 6+ messages in thread
From: Turritopsis Dohrnii Teo En Ming @ 2022-04-27 13:14 UTC (permalink / raw)
  To: Roger Heflin; +Cc: John Stoffel, linux-raid, ceo

> Given that, odds are very high the disks are dying and/or one of the disks failed a while ago and you are now running a no-redundancy stripe and not a raid5, and odds are you need to figure out how to run and debug your array with the vendor's tool you mentioned. Any status of the underlying raid will need to be done with that vendors tools and any recoveries you need to do will need to be done with that tool, and the support, usage, and knowledge of that tool/hw raid card is not part of the linux raid list as you don't have linux raid.

Noted with thanks. I had asked the linux-raid mailing list because our client is using the hardware RAID controller in a Linux operating system.

Regards,

Mr. Turritopsis Dohrnii Teo En Ming
Targeted Individual in Singapore
27 April 2022 Wednesday






Sent with ProtonMail secure email.
------- Original Message -------
On Tuesday, April 26th, 2022 at 7:21 AM, Roger Heflin <rogerheflin@gmail.com> wrote:


>
>
> On Mon, Apr 25, 2022 at 5:29 AM Turritopsis Dohrnii Teo En Ming <
> #1 as John stated this is not linux raid, this is hardware raid, you need to ask the vendor whose controller that is what is going on. Given the controllers age and the hardware age you probably are going to need to google usage of that controller and figure out exactly what is going on yourself.
>
> #2: You are using 146G disks (probably 2.5") and based on the age of the machine several of those disks are original, and really really old as 146GB disks went EOL a few years ago. Those disks are old enough that they are getting into the old age mechanical failures of pretty much everything that makes them work as disks.
>
> Given that, odds are very high the disks are dying and/or one of the disks failed a while ago and you are now running a no-redundancy stripe and not a raid5, and odds are you need to figure out how to run and debug your array with the vendor's tool you mentioned. Any status of the underlying raid will need to be done with that vendors tools and any recoveries you need to do will need to be done with that tool, and the support, usage, and knowledge of that tool/hw raid card is not part of the linux raid list as you don't have linux raid.
> And given you are already getting bad blocks then your only option is likely to copy the data that you can still read off and rework with new disks, possibly with a new machine as the hardware is quite old also. The 146GB disks are the most concerning though as motherboards and such will last 10+ years but disks get very much at risk at that age.
>
> On Mon, Apr 25, 2022 at 5:36 PM Turritopsis Dohrnii Teo En Ming <teo.en.ming@protonmail.com> wrote:
>
> > Dear John Stoffel,
> >
> > I have executed the following command on my client's CentOS 6.10 32-bit Linux server.
> >
> > # badblocks -sv /dev/sda
> >
> > And found 512 bad blocks.
> >
> > Regards,
> >
> > Mr. Turritopsis Dohrnii Teo En Ming
> > Targeted Individual in Singapore
> > 25 Apr 2022 Monday
> >
> >
> > Sent with ProtonMail secure email.
> >
> >
> > ------- Original Message -------
> > On Monday, April 25th, 2022 at 6:25 AM, John Stoffel <john@stoffel.org> wrote:
> >
> >
> > > > > > > > "Turritopsis" == Turritopsis Dohrnii Teo En Ming teo.en.ming@protonmail.com writes:
> > >
> > >
> > > Turritopsis> Subject: arcconf Linux utility for Adaptec AAC-RAID
> > >
> > > Turritopsis> (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to
> > >
> > > Turritopsis> query RAID controller Good day from Singapore,
> > >
> > >
> > > Turritopsis> Our client has IBM System x3650 server (machine type:
> > >
> > > Turritopsis> 7979). Operating system is CentOS Linux 6.10 (32-bit).
> > >
> > >
> > > Ancient... you're running old mdadm code and kernel... and if it's
> > > critical enough, you could/might be able to get support from Redhat if
> > > you pay them enough... and since it's a hardware RAID controller card,
> > > mdadm and Linux Raid isn't doing anything here, so we're really the
> > > wrong group to ask for help. But see below...
> > >
> > > Turritopsis> Recently we keep getting the following error messages
> > >
> > > Turritopsis> (output generated by dmesg).
> > >
> > >
> > > These errors look to be a bad sector on one of the disks. But since
> > > you're also using a hardware RAID controller... I would copy your data
> > > off ASAP onto some new media before you lose any thing more.
> > >
> > > Just ask them how much it will cost to keep the business running if
> > > they complain about the cost of three replacement disks on the
> > > system.
> > >
> > > But basically, I would:
> > >
> > > 0. copy the data somewhere else, especially if it's critical
> > > 1. copy the data somewhere else, especially if it's critical.
> > > 2. Try running 'badblocks' on /dev/sda to see if you can force it to
> > > re-write bad sectors. See man page for flags to use.
> > > 3. You can also try to boot the system to the BIOS and see if there's
> > > a BIOS screen for the AAC-RAID controller which lets you scrub the
> > > array or look for bad blocks.
> > >
> > > Good luck,
> > > John
> > >
> > > Turritopsis> <CODE>
> > >
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d1 50 00 02 00 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801040
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a cf 50 00 02 00 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800528
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Write(10): 2a 00 09 2a d3 50 00 02 00 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801552
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> JBD2: Detected IO errors while flushing file data on dm-0-8
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a cf 38 00 01 00 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800504
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 38 00 01 00 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800760
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800704
> > >
> > >
> > > Turritopsis> </CODE>
> > >
> > >
> > > Turritopsis> /dev/sda is a RAID 5 array with 3 harddisks of 136.6 GB capacity each.
> > >
> > >
> > > Turritopsis> <CODE>
> > >
> > >
> > > Turritopsis> [root@teo-en-ming-server ~]# fdisk /dev/sda
> > >
> > >
> > > Turritopsis> WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
> > >
> > > Turritopsis> switch off the mode (command 'c') and change display units to
> > >
> > > Turritopsis> sectors (command 'u').
> > >
> > >
> > > Turritopsis> Command (m for help): p
> > >
> > >
> > > Turritopsis> Disk /dev/sda: 293.4 GB, 293378981888 bytes
> > >
> > > Turritopsis> 255 heads, 63 sectors/track, 35667 cylinders
> > >
> > > Turritopsis> Units = cylinders of 16065 * 512 = 8225280 bytes
> > >
> > > Turritopsis> Sector size (logical/physical): 512 bytes / 512 bytes
> > >
> > > Turritopsis> I/O size (minimum/optimal): 512 bytes / 512 bytes
> > >
> > > Turritopsis> Disk identifier: 0x8b047782
> > >
> > >
> > > Turritopsis> Device Boot Start End Blocks Id System
> > >
> > > Turritopsis> /dev/sda1 * 1 64 512000 83 Linux
> > >
> > > Turritopsis> Partition 1 does not end on cylinder boundary.
> > >
> > > Turritopsis> /dev/sda2 64 35668 285989888 8e Linux LVM
> > >
> > >
> > > Turritopsis> Command (m for help):
> > >
> > >
> > > Turritopsis> </CODE>
> > >
> > >
> > > Turritopsis> We rebooted the server several times. The next morning we still get the same error messages.
> > >
> > >
> > > Turritopsis> <CODE>
> > >
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] 573005824 512-byte logical blocks: (293 GB/273 GiB)
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Write Protect is off
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Mode Sense: 06 00 10 00
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
> > >
> > > Turritopsis> sda: sda1 sda2
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Attached SCSI removable disk
> > >
> > > Turritopsis> dracut: Scanning devices sda2 for LVM logical volumes vg_teo-en-ming-server/lv_swap vg_teo-en-ming-server/lv_root
> > >
> > > Turritopsis> EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts:
> > >
> > > Turritopsis> SELinux: initialized (dev sda1, type ext4), uses xattr
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 80 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800704
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800704
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225088
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800704
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225088
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800704
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225088
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 00 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800704
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225088
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800712
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225089
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800712
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225089
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800712
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225089
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 08 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800712
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225089
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d0 10 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800720
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225090
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800976
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800976
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225122
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 10 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800976
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225122
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800984
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225123
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800984
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225123
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800984
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225123
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 18 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800984
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225123
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800992
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225124
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800992
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225124
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d1 20 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153800992
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225124
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225124
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801256
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801256
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225157
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801256
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225157
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 28 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801256
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225157
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801264
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225158
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801264
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225158
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801264
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225158
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 30 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801264
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225158
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801272
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225159
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d2 38 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801272
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225159
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225159
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 30 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801520
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801528
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801528
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225191
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801528
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225191
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 38 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801528
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225191
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801536
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225192
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801536
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225192
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801536
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225192
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 40 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801536
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225192
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Sense Key : Hardware Error [current]
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] Add. Sense: Internal target failure
> > >
> > > Turritopsis> sd 0:0:0:0: [sda] CDB: Read(10): 28 00 09 2a d3 48 00 00 08 00
> > >
> > > Turritopsis> end_request: critical target error, dev sda, sector 153801544
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225193
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225193
> > >
> > > Turritopsis> Buffer I/O error on device sda, logical block 19225193
> > >
> > >
> > > Turritopsis> </CODE>
> > >
> > >
> > > Turritopsis> Based on the following discussion thread, we think that the RAID controller may be failing.
> > >
> > >
> > > Turritopsis> Discussion thread: Which disk is bad in raid6 array
> > >
> > > Turritopsis> Link: https://serverfault.com/questions/384935/which-disk-is-bad-in-raid6-array
> > >
> > >
> > > Turritopsis> I had downloaded 32-bit arcconf Linux utility from the following link.
> > >
> > >
> > > Turritopsis> Link: https://hwraid.le-vert.net/wiki/Adaptec
> > >
> > >
> > > Turritopsis> <CODE>
> > >
> > >
> > > Turritopsis> [root@teo-en-ming-server log]# lspci -vvv | grep RAID
> > >
> > > Turritopsis> 04:00.0 RAID bus controller: Adaptec AAC-RAID (Rocket) (rev 02)
> > >
> > > Turritopsis> Subsystem: IBM ServeRAID 8k/8k-l8
> > >
> > >
> > > Turritopsis> </CODE>
> > >
> > >
> > > Turritopsis> However, we keep getting segmentation fault running arcconf utility.
> > >
> > >
> > > Turritopsis> <CODE>
> > >
> > >
> > > Turritopsis> [root@teo-en-ming-server log]# /usr/local/sbin/arcconf getconfig 1
> > >
> > > Turritopsis> Segmentation fault (core dumped)
> > >
> > >
> > > Turritopsis> </CODE>
> > >
> > >
> > > Turritopsis> These are the Linux Kernel messages.
> > >
> > >
> > > Turritopsis> <CODE>
> > >
> > >
> > > Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
> > >
> > > Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
> > >
> > > Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
> > >
> > > Turritopsis> Apr 22 11:11:33 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
> > >
> > > Turritopsis> Apr 22 11:12:23 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
> > >
> > > Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
> > >
> > > Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
> > >
> > > Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
> > >
> > > Turritopsis> Apr 22 11:14:37 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
> > >
> > > Turritopsis> Apr 22 11:15:28 teo-en-ming-server kernel: IRQ 17/aacraid: IRQF_DISABLED is not guaranteed on shared IRQs
> > >
> > > Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter abort request (0,0,0,0)
> > >
> > > Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: aacraid: Host adapter reset request. SCSI hang ?
> > >
> > > Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC: Host adapter BLINK LED 0x4
> > >
> > > Turritopsis> Apr 22 11:16:34 teo-en-ming-server kernel: AAC0: adapter kernel panic'd 4.
> > >
> > >
> > > Turritopsis> </CODE>
> > >
> > >
> > > Turritopsis> It seems that I could not query the RAID controller. It keeps saying that the RAID controller adapter has kernel panics.
> > >
> > >
> > > Turritopsis> arcconf is a Linux utility to query the RAID controller.
> > >
> > >
> > > Turritopsis> <CODE>
> > >
> > >
> > > Turritopsis> [root@teo-en-ming-server cmdline]# lspci -nn | grep RAID
> > >
> > > Turritopsis> 04:00.0 RAID bus controller [0104]: Adaptec AAC-RAID (Rocket) [9005:0286] (rev 02)
> > >
> > >
> > > Turritopsis> </CODE>
> > >
> > >
> > > Turritopsis> Do you know why I keep getting segmentation fault running arcconf Linux utility?
> > >
> > >
> > > Turritopsis> Regards,
> > >
> > >
> > > Turritopsis> Mr. Turritopsis Dohrnii Teo En Ming
> > >
> > > Turritopsis> Targeted Individual in Singapore
> > >
> > > Turritopsis> 24 April 2022 Sunday
> > >
> > >
> > >
> > >
> > >

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2022-04-27 13:21 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-04-24  3:14 arcconf Linux utility for Adaptec AAC-RAID (Rocket) (rev 02) (IBM ServeRAID 8k/8k-l8) unable to query RAID controller Turritopsis Dohrnii Teo En Ming
2022-04-24 22:25 ` John Stoffel
2022-04-25 14:47   ` Turritopsis Dohrnii Teo En Ming
2022-04-25 14:57     ` John Stoffel
2022-04-27 12:52       ` Turritopsis Dohrnii Teo En Ming
     [not found]     ` <CAAMCDec-nEU10L6qrnmjX6kaMfG2ORobOb6fkmKKNba2D9aGUw@mail.gmail.com>
2022-04-27 13:14       ` Turritopsis Dohrnii Teo En Ming

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.