All of lore.kernel.org
 help / color / mirror / Atom feed
* rbd rm <image> results in osd marked down wrongly with 0.61.3
@ 2013-06-11 14:19 Smart Weblications GmbH - Florian Wiessner
  2013-06-13 12:25 ` [ceph-users] " Smart Weblications GmbH - Florian Wiessner
  0 siblings, 1 reply; 5+ messages in thread
From: Smart Weblications GmbH - Florian Wiessner @ 2013-06-11 14:19 UTC (permalink / raw)
  To: ceph-devel-u79uwXL29TY76Z2rM5mHXA, ceph-users-idqoXFIVOFJgJs9I8MT0rw

[-- Attachment #1: Type: text/plain, Size: 2097 bytes --]

Hi List,

i observed that an rbd rm <image> results in some osds mark one osd as down
wrongly in cuttlefish.

The situation gets even worse if there are more than one rbd rm <image> running
in parallel.

Please see attached logfiles. The rbd rm command was issued on 20:24:00 via
cronjob, 40 seconds later the osd 6 got marked down...


ceph osd tree

# id    weight  type name       up/down reweight
-1      7       pool default
-3      7               rack unknownrack
-2      1                       host node01
0       1                               osd.0   up      1
-4      1                       host node02
1       1                               osd.1   up      1
-5      1                       host node03
2       1                               osd.2   up      1
-6      1                       host node04
3       1                               osd.3   up      1
-7      1                       host node06
5       1                               osd.5   up      1
-8      1                       host node05
4       1                               osd.4   up      1
-9      1                       host node07
6       1                               osd.6   up      1


I have seen some patches to parallelize rbd rm, but i think there must be some
other issue, as my clients seem to not be able to do IO when ceph is
recovering... I think this has worked better in 0.56.x - there was IO while
recovering.

I also observed in the log of osd.6 that after heartbeat_map reset_timeout, the
osd tries to connect to the other osds, but it retries so fast that you could
think this is a DoS attack...


Please advise..

-- 

Mit freundlichen Grüßen,

Florian Wiessner

Smart Weblications GmbH
Martinsberger Str. 1
D-95119 Naila

fon.: +49 9282 9638 200
fax.: +49 9282 9638 205
24/7: +49 900 144 000 00 - 0,99 EUR/Min*
http://www.smart-weblications.de

--
Sitz der Gesellschaft: Naila
Geschäftsführer: Florian Wiessner
HRB-Nr.: HRB 3840 Amtsgericht Hof
*aus dem dt. Festnetz, ggf. abweichende Preise aus dem Mobilfunknetz

[-- Attachment #2: osd0.log --]
[-- Type: text/plain, Size: 4747 bytes --]

2013-06-08 20:24:37.452694 7f5802089700  0 log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.980349 secs
2013-06-08 20:24:37.452703 7f5802089700  0 log [WRN] : slow request 30.980349 seconds old, received at 2013-06-08 20:24:06.472325: osd_op(client.98906.0:295493 rb.0.2c10.1b8d3ce6.000000000380 [write 4149248~4096] 2.7ffe3daf e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:38.452827 7f5802089700  0 log [WRN] : 3 slow requests, 2 included below; oldest blocked for > 31.980471 secs
2013-06-08 20:24:38.452833 7f5802089700  0 log [WRN] : slow request 30.277008 seconds old, received at 2013-06-08 20:24:08.175788: osd_op(client.98909.0:8473983 rb.0.5298.2ae8944a.000000000459 [write 146944~4096] 2.4c106ed1 e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:38.452836 7f5802089700  0 log [WRN] : slow request 30.272214 seconds old, received at 2013-06-08 20:24:08.180582: osd_op(client.98909.0:8474077 rb.0.5298.2ae8944a.00000000041c [write 2489856~4096] 2.7c48e843 e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:39.452955 7f5802089700  0 log [WRN] : 4 slow requests, 1 included below; oldest blocked for > 32.980606 secs
2013-06-08 20:24:39.452975 7f5802089700  0 log [WRN] : slow request 30.907555 seconds old, received at 2013-06-08 20:24:08.545376: osd_op(client.106364.0:485497 rb.0.598c.2ae8944a.000000029430 [write 3599872~4096] 2.e665ea43 e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:41.453219 7f5802089700  0 log [WRN] : 7 slow requests, 3 included below; oldest blocked for > 34.980868 secs
2013-06-08 20:24:41.453224 7f5802089700  0 log [WRN] : slow request 30.828077 seconds old, received at 2013-06-08 20:24:10.625116: osd_op(client.106364.0:485499 rb.0.598c.2ae8944a.000000028cef [write 540160~4096] 2.977d4e1c e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:41.453232 7f5802089700  0 log [WRN] : slow request 30.828007 seconds old, received at 2013-06-08 20:24:10.625186: osd_op(client.106364.0:485501 rb.0.598c.2ae8944a.0000000017e8 [write 540160~4096] 2.bf149f1c e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:41.453242 7f5802089700  0 log [WRN] : slow request 30.269502 seconds old, received at 2013-06-08 20:24:11.183691: osd_op(client.98909.0:8474116 rb.0.5298.2ae8944a.00000000041c [write 40448~4096] 2.7c48e843 e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:42.453387 7f5802089700  0 log [WRN] : 8 slow requests, 1 included below; oldest blocked for > 35.981023 secs
2013-06-08 20:24:42.453392 7f5802089700  0 log [WRN] : slow request 30.153411 seconds old, received at 2013-06-08 20:24:12.299937: osd_op(client.106359.0:382696 rb.0.c46a.2ae8944a.000000002871 [write 1585152~4096] 2.d586d0d1 e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:43.453480 7f5802089700 -1 osd.0 4628 heartbeat_check: no reply from osd.6 since 2013-06-08 20:24:23.034653 (cutoff 2013-06-08 20:24:23.453478)
2013-06-08 20:24:43.453512 7f5802089700  0 log [WRN] : 10 slow requests, 2 included below; oldest blocked for > 36.981165 secs
2013-06-08 20:24:43.453515 7f5802089700  0 log [WRN] : slow request 30.159595 seconds old, received at 2013-06-08 20:24:13.293895: osd_op(client.91121.1:1825706 rb.0.1.000000007544 [write 2101248~4096] 2.8c8e0219 e4628) currently waiting for subops from [6]
2013-06-08 20:24:43.453519 7f5802089700  0 log [WRN] : slow request 30.159534 seconds old, received at 2013-06-08 20:24:13.293956: osd_op(client.91121.1:1825707 rb.0.1.000000007544 [write 2113536~8192] 2.8c8e0219 e4628) currently waiting for subops from [6]
2013-06-08 20:24:44.453669 7f5802089700 -1 osd.0 4628 heartbeat_check: no reply from osd.6 since 2013-06-08 20:24:23.034653 (cutoff 2013-06-08 20:24:24.453668)
2013-06-08 20:24:44.453707 7f5802089700  0 log [WRN] : 11 slow requests, 1 included below; oldest blocked for > 37.981358 secs
2013-06-08 20:24:44.453712 7f5802089700  0 log [WRN] : slow request 30.028243 seconds old, received at 2013-06-08 20:24:14.425440: osd_op(client.106018.0:54448 rb.0.4c40.2ae8944a.0000000004b4 [write 1196032~12288] 2.536e5253 e4628) v4 currently waiting for subops from [6]
2013-06-08 20:24:45.453914 7f5802089700  0 log [WRN] : 12 slow requests, 1 included below; oldest blocked for > 38.981565 secs
2013-06-08 20:24:45.453920 7f5802089700  0 log [WRN] : slow request 30.264245 seconds old, received at 2013-06-08 20:24:15.189645: osd_op(client.98909.0:8474209 rb.0.5298.2ae8944a.00000000041c [write 2493952~8192] 2.7c48e843 e4628) v4 currently reached pg
2013-06-08 20:25:43.538040 7f57e5af4700  0 -- 10.10.10.4:6803/2578 >> 10.10.10.10:6800/17115 pipe(0xa1a2780 sd=39 :6803 s=2 pgs=113756 cs=8585 l=0).fault with nothing to send, going to standby

[-- Attachment #3: osd6.log --]
[-- Type: text/plain, Size: 1542549 bytes --]

2013-06-08 20:21:01.423980 7fddc9601700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.5:0/1050176078 pipe(0xa238c80 sd=75 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.5:0/1050176078 (socket is 10.10.10.5:34164/0)
2013-06-08 20:22:02.730859 7fddc5793700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.6:0/3035720492 pipe(0x11ecaa00 sd=76 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.6:0/3035720492 (socket is 10.10.10.6:56995/0)
2013-06-08 20:24:24.219797 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:24.219802 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:24.747846 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:24.747867 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:25.096156 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:25.096159 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:25.676059 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:25.676064 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:25.935435 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:25.935448 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:26.520235 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:26.520244 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:26.740470 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:26.740476 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:27.301538 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:27.301551 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:27.976424 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:27.976436 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:28.220558 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:28.220572 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:29.747941 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:29.747962 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:29.796379 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:29.796383 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:30.035585 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:30.035589 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:30.840674 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:30.840680 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:31.340895 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:31.340899 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:32.441152 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:32.441156 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:32.920882 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:32.920885 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:32.941386 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:32.941392 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:33.201781 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:33.201784 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:33.441662 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:33.441669 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:33.876843 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:33.876848 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:34.496638 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:34.496642 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:34.541843 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:34.541846 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:34.735760 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:34.735764 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:34.748042 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:34.748062 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:35.221633 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:35.221638 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:35.577301 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:35.577305 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:35.596941 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:35.596944 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:36.523482 7fdde6fb6700  0 log [WRN] : 4 slow requests, 4 included below; oldest blocked for > 30.764585 secs
2013-06-08 20:24:36.523488 7fdde6fb6700  0 log [WRN] : slow request 30.764585 seconds old, received at 2013-06-08 20:24:05.758843: osd_op(client.108261.0:57 rb.0.a06a.238e1f29.000000000033 [delete] 2.cbc5115c e4628) v4 currently waiting for subops from [0]
2013-06-08 20:24:36.523493 7fdde6fb6700  0 log [WRN] : slow request 30.289111 seconds old, received at 2013-06-08 20:24:06.234317: osd_op(client.106250.0:445909 rb.0.6d52.238e1f29.00000003c6a2 [write 2354688~4096] 2.fd22f37b e4628) v4 currently waiting for subops from [5]
2013-06-08 20:24:36.523501 7fdde6fb6700  0 log [WRN] : slow request 30.050447 seconds old, received at 2013-06-08 20:24:06.472981: osd_sub_op(client.98906.0:295493 2.af 7ffe3daf/rb.0.2c10.1b8d3ce6.000000000380/head//2 [] v 4628'1987697 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:24:36.523505 7fdde6fb6700  0 log [WRN] : slow request 30.050360 seconds old, received at 2013-06-08 20:24:06.473068: osd_sub_op(client.98906.0:295492 2.6a 7d9bd26a/rb.0.2c10.1b8d3ce6.00000000039d/head//2 [] v 4628'3774779 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:24:36.701962 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:36.701965 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:36.842064 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:36.842070 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:37.202228 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:37.202232 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:37.523644 7fdde6fb6700  0 log [WRN] : 6 slow requests, 2 included below; oldest blocked for > 31.764768 secs
2013-06-08 20:24:37.523652 7fdde6fb6700  0 log [WRN] : slow request 30.386097 seconds old, received at 2013-06-08 20:24:07.137514: osd_sub_op(client.106248.0:110523 2.90 59ec7090/rb.0.14aef.238e1f29.0000000002bc/head//2 [] v 4628'2636937 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:24:37.523657 7fdde6fb6700  0 log [WRN] : slow request 30.386341 seconds old, received at 2013-06-08 20:24:07.137270: osd_op(client.106248.0:110526 rb.0.14aef.238e1f29.00000000126d [write 3039232~49152] 2.29b5f635 e4628) v4 currently waiting for subops from [2]
2013-06-08 20:24:37.897144 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:37.897148 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:37.942311 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:37.942323 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:38.523834 7fdde6fb6700  0 log [WRN] : 12 slow requests, 6 included below; oldest blocked for > 32.764953 secs
2013-06-08 20:24:38.523841 7fdde6fb6700  0 log [WRN] : slow request 30.353270 seconds old, received at 2013-06-08 20:24:08.170526: osd_op(client.98909.0:8473931 rb.0.5298.2ae8944a.000000000457 [write 1572352~20480] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:38.523853 7fdde6fb6700  0 log [WRN] : slow request 30.352824 seconds old, received at 2013-06-08 20:24:08.170972: osd_op(client.98909.0:8473937 rb.0.5298.2ae8944a.00000000066d [write 1957376~4096] 2.916b9c18 e4628) v4 currently waiting for subops from [1]
2013-06-08 20:24:38.523856 7fdde6fb6700  0 log [WRN] : slow request 30.352549 seconds old, received at 2013-06-08 20:24:08.171247: osd_op(client.98909.0:8473942 rb.0.5298.2ae8944a.000000000457 [write 2665984~40960] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:38.523859 7fdde6fb6700  0 log [WRN] : slow request 30.351978 seconds old, received at 2013-06-08 20:24:08.171818: osd_op(client.98909.0:8473943 rb.0.5298.2ae8944a.000000000457 [write 2739712~45056] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:38.523862 7fdde6fb6700  0 log [WRN] : slow request 30.351542 seconds old, received at 2013-06-08 20:24:08.172254: osd_op(client.98909.0:8473944 rb.0.5298.2ae8944a.000000000457 [write 2788864~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:38.836033 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:38.836039 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:39.077407 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:39.077410 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:39.321859 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:39.321862 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:39.524008 7fdde6fb6700  0 log [WRN] : 17 slow requests, 6 included below; oldest blocked for > 33.765123 secs
2013-06-08 20:24:39.524016 7fdde6fb6700  0 log [WRN] : slow request 31.351388 seconds old, received at 2013-06-08 20:24:08.172578: osd_op(client.98909.0:8473945 rb.0.5298.2ae8944a.000000000457 [write 4156928~37376] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:39.524020 7fdde6fb6700  0 log [WRN] : slow request 31.350844 seconds old, received at 2013-06-08 20:24:08.173122: osd_op(client.98909.0:8473949 rb.0.5298.2ae8944a.000000000457 [write 2514432~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:39.524023 7fdde6fb6700  0 log [WRN] : slow request 31.350787 seconds old, received at 2013-06-08 20:24:08.173179: osd_op(client.98909.0:8473950 rb.0.5298.2ae8944a.000000000457 [write 2649600~12288] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:39.524027 7fdde6fb6700  0 log [WRN] : slow request 31.350741 seconds old, received at 2013-06-08 20:24:08.173225: osd_op(client.98909.0:8473951 rb.0.5298.2ae8944a.000000000457 [write 2104832~94208] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:39.524030 7fdde6fb6700  0 log [WRN] : slow request 31.349488 seconds old, received at 2013-06-08 20:24:08.174478: osd_op(client.98909.0:8473952 rb.0.5298.2ae8944a.000000000457 [write 2203136~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:39.597492 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:39.597496 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:39.748129 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:39.748150 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:40.524163 7fdde6fb6700  0 log [WRN] : 22 slow requests, 6 included below; oldest blocked for > 34.765279 secs
2013-06-08 20:24:40.524170 7fdde6fb6700  0 log [WRN] : slow request 32.349594 seconds old, received at 2013-06-08 20:24:08.174528: osd_op(client.98909.0:8473953 rb.0.5298.2ae8944a.000000000457 [write 2268672~36864] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:40.524179 7fdde6fb6700  0 log [WRN] : slow request 32.349185 seconds old, received at 2013-06-08 20:24:08.174937: osd_op(client.98909.0:8473954 rb.0.5298.2ae8944a.000000000457 [write 1797632~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:40.524183 7fdde6fb6700  0 log [WRN] : slow request 32.349139 seconds old, received at 2013-06-08 20:24:08.174983: osd_op(client.98909.0:8473955 rb.0.5298.2ae8944a.000000000457 [write 1920512~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:40.524186 7fdde6fb6700  0 log [WRN] : slow request 32.348875 seconds old, received at 2013-06-08 20:24:08.175247: osd_op(client.98909.0:8473956 rb.0.5298.2ae8944a.000000000457 [write 1949184~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:40.524189 7fdde6fb6700  0 log [WRN] : slow request 32.348418 seconds old, received at 2013-06-08 20:24:08.175704: osd_op(client.98909.0:8473957 rb.0.5298.2ae8944a.000000000457 [write 1781248~12288] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:41.302413 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:41.302426 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:41.442573 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:41.442587 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:41.524315 7fdde6fb6700  0 log [WRN] : 27 slow requests, 6 included below; oldest blocked for > 35.765421 secs
2013-06-08 20:24:41.524323 7fdde6fb6700  0 log [WRN] : slow request 33.348518 seconds old, received at 2013-06-08 20:24:08.175746: osd_op(client.98909.0:8473958 rb.0.5298.2ae8944a.000000000457 [write 1711616~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:41.524327 7fdde6fb6700  0 log [WRN] : slow request 33.348303 seconds old, received at 2013-06-08 20:24:08.175961: osd_op(client.98909.0:8473959 rb.0.5298.2ae8944a.000000000457 [write 1732096~40960] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:41.524332 7fdde6fb6700  0 log [WRN] : slow request 33.347843 seconds old, received at 2013-06-08 20:24:08.176421: osd_sub_op(client.98909.0:8473983 2.d1 4c106ed1/rb.0.5298.2ae8944a.000000000459/head//2 [] v 4628'3872772 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:24:41.524336 7fdde6fb6700  0 log [WRN] : slow request 33.347825 seconds old, received at 2013-06-08 20:24:08.176439: osd_op(client.98909.0:8473960 rb.0.5298.2ae8944a.000000000457 [write 1482240~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:41.524340 7fdde6fb6700  0 log [WRN] : slow request 33.347558 seconds old, received at 2013-06-08 20:24:08.176706: osd_op(client.98909.0:8473961 rb.0.5298.2ae8944a.000000000457 [write 1510912~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:41.736233 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:41.736236 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:42.497746 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:42.497755 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:42.524482 7fdde6fb6700  0 log [WRN] : 32 slow requests, 6 included below; oldest blocked for > 36.765597 secs
2013-06-08 20:24:42.524488 7fdde6fb6700  0 log [WRN] : slow request 34.347468 seconds old, received at 2013-06-08 20:24:08.176972: osd_op(client.98909.0:8473962 rb.0.5298.2ae8944a.000000000457 [write 1551872~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:42.524490 7fdde6fb6700  0 log [WRN] : slow request 34.347254 seconds old, received at 2013-06-08 20:24:08.177186: osd_op(client.98909.0:8473963 rb.0.5298.2ae8944a.000000000457 [write 1633792~73728] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:42.524497 7fdde6fb6700  0 log [WRN] : slow request 34.346207 seconds old, received at 2013-06-08 20:24:08.178233: osd_op(client.98909.0:8473964 rb.0.5298.2ae8944a.000000000457 [write 1330688~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:42.524500 7fdde6fb6700  0 log [WRN] : slow request 34.345976 seconds old, received at 2013-06-08 20:24:08.178464: osd_op(client.98909.0:8473965 rb.0.5298.2ae8944a.000000000457 [write 1351168~20480] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:42.524501 7fdde6fb6700  0 log [WRN] : slow request 34.345735 seconds old, received at 2013-06-08 20:24:08.178705: osd_op(client.98909.0:8473966 rb.0.5298.2ae8944a.000000000457 [write 1400320~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:43.422831 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:43.422834 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:43.524693 7fdde6fb6700  0 log [WRN] : 37 slow requests, 6 included below; oldest blocked for > 37.765805 secs
2013-06-08 20:24:43.524699 7fdde6fb6700  0 log [WRN] : slow request 35.345908 seconds old, received at 2013-06-08 20:24:08.178740: osd_op(client.98909.0:8473967 rb.0.5298.2ae8944a.000000000457 [write 1424896~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:43.524702 7fdde6fb6700  0 log [WRN] : slow request 35.345640 seconds old, received at 2013-06-08 20:24:08.179008: osd_op(client.98909.0:8473968 rb.0.5298.2ae8944a.000000000457 [write 1502720~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:43.524704 7fdde6fb6700  0 log [WRN] : slow request 35.345598 seconds old, received at 2013-06-08 20:24:08.179050: osd_op(client.98909.0:8473969 rb.0.5298.2ae8944a.000000000457 [write 1285632~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:43.524710 7fdde6fb6700  0 log [WRN] : slow request 35.345551 seconds old, received at 2013-06-08 20:24:08.179097: osd_op(client.98909.0:8473970 rb.0.5298.2ae8944a.000000000457 [write 1297920~28672] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:43.524712 7fdde6fb6700  0 log [WRN] : slow request 35.344870 seconds old, received at 2013-06-08 20:24:08.179778: osd_op(client.98909.0:8473971 rb.0.5298.2ae8944a.000000000457 [write 2223616~40960] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:43.602642 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:43.602648 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:43.777806 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:43.777811 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:44.523334 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:44.523337 7fddd8f25700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:44.524859 7fdde6fb6700  0 log [WRN] : 42 slow requests, 6 included below; oldest blocked for > 38.765976 secs
2013-06-08 20:24:44.524864 7fdde6fb6700  0 log [WRN] : slow request 36.343636 seconds old, received at 2013-06-08 20:24:08.181183: osd_sub_op(client.98909.0:8474077 2.43 7c48e843/rb.0.5298.2ae8944a.00000000041c/head//2 [] v 4628'4106316 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:24:44.524868 7fdde6fb6700  0 log [WRN] : slow request 36.344952 seconds old, received at 2013-06-08 20:24:08.179867: osd_op(client.98909.0:8473972 rb.0.5298.2ae8944a.000000000457 [write 2338304~172032] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:44.524870 7fdde6fb6700  0 log [WRN] : slow request 36.342704 seconds old, received at 2013-06-08 20:24:08.182115: osd_op(client.98909.0:8474085 rb.0.5298.2ae8944a.000000000457 [write 1269248~12288] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:44.524873 7fdde6fb6700  0 log [WRN] : slow request 36.342651 seconds old, received at 2013-06-08 20:24:08.182168: osd_op(client.98909.0:8474086 rb.0.5298.2ae8944a.000000000457 [write 1375744~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:44.524875 7fdde6fb6700  0 log [WRN] : slow request 36.342610 seconds old, received at 2013-06-08 20:24:08.182209: osd_op(client.98909.0:8474087 rb.0.5298.2ae8944a.000000000457 [write 1408512~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:44.748215 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:44.748235 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:44.863598 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :56988 s=2 pgs=22941 cs=4669 l=0).fault with nothing to send, going to standby
2013-06-08 20:24:44.867793 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51762 s=2 pgs=23051 cs=3971 l=0).fault with nothing to send, going to standby
2013-06-08 20:24:44.867844 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :56278 s=2 pgs=17411 cs=3485 l=0).fault with nothing to send, going to standby
2013-06-08 20:24:44.868209 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=32 :45232 s=2 pgs=14146 cs=1 l=0).fault with nothing to send, going to standby
2013-06-08 20:24:44.868908 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :35633 s=2 pgs=19863 cs=2513 l=0).fault with nothing to send, going to standby
2013-06-08 20:24:44.911241 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :35717 s=2 pgs=17647 cs=3451 l=0).fault with nothing to send, going to standby
2013-06-08 20:24:45.525044 7fdde6fb6700  0 log [WRN] : 47 slow requests, 6 included below; oldest blocked for > 39.766160 secs
2013-06-08 20:24:45.525051 7fdde6fb6700  0 log [WRN] : slow request 37.342747 seconds old, received at 2013-06-08 20:24:08.182256: osd_op(client.98909.0:8474089 rb.0.5298.2ae8944a.000000000457 [write 1469952~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:45.525056 7fdde6fb6700  0 log [WRN] : slow request 37.342703 seconds old, received at 2013-06-08 20:24:08.182300: osd_op(client.98909.0:8474090 rb.0.5298.2ae8944a.000000000457 [write 1596928~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:45.525059 7fdde6fb6700  0 log [WRN] : slow request 37.342453 seconds old, received at 2013-06-08 20:24:08.182550: osd_op(client.98909.0:8474091 rb.0.5298.2ae8944a.000000000457 [write 1625600~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:45.525063 7fdde6fb6700  0 log [WRN] : slow request 37.342235 seconds old, received at 2013-06-08 20:24:08.182768: osd_op(client.98909.0:8474092 rb.0.5298.2ae8944a.000000000457 [write 1809920~45056] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:45.525066 7fdde6fb6700  0 log [WRN] : slow request 37.341946 seconds old, received at 2013-06-08 20:24:08.183057: osd_op(client.98909.0:8474093 rb.0.5298.2ae8944a.000000000457 [write 1859072~53248] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:46.525235 7fdde6fb6700  0 log [WRN] : 52 slow requests, 6 included below; oldest blocked for > 40.766350 secs
2013-06-08 20:24:46.525242 7fdde6fb6700  0 log [WRN] : slow request 38.341336 seconds old, received at 2013-06-08 20:24:08.183857: osd_op(client.98909.0:8474094 rb.0.5298.2ae8944a.000000000457 [write 2063872~36864] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:46.525246 7fdde6fb6700  0 log [WRN] : slow request 38.340810 seconds old, received at 2013-06-08 20:24:08.184383: osd_op(client.98909.0:8474095 rb.0.5298.2ae8944a.000000000457 [write 2309632~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:46.525250 7fdde6fb6700  0 log [WRN] : slow request 38.340546 seconds old, received at 2013-06-08 20:24:08.184647: osd_op(client.98909.0:8474096 rb.0.5298.2ae8944a.000000000457 [write 2534912~28672] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:46.525253 7fdde6fb6700  0 log [WRN] : slow request 38.340319 seconds old, received at 2013-06-08 20:24:08.184874: osd_op(client.98909.0:8474097 rb.0.5298.2ae8944a.000000000457 [write 2567680~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:46.525256 7fdde6fb6700  0 log [WRN] : slow request 38.339971 seconds old, received at 2013-06-08 20:24:08.185222: osd_op(client.98909.0:8474098 rb.0.5298.2ae8944a.000000000457 [write 2596352~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:24:47.525399 7fdde6fb6700  0 log [WRN] : 57 slow requests, 6 included below; oldest blocked for > 41.766512 secs
2013-06-08 20:24:47.525404 7fdde6fb6700  0 log [WRN] : slow request 39.339931 seconds old, received at 2013-06-08 20:24:08.185424: osd_op(client.98909.0:8474099 rb.0.5298.2ae8944a.000000000457 [write 2625024~16384] 2.1047ecca e4628) v4 currently no flag points reached
2013-06-08 20:24:47.525407 7fdde6fb6700  0 log [WRN] : slow request 39.339883 seconds old, received at 2013-06-08 20:24:08.185472: osd_op(client.98909.0:8474100 rb.0.5298.2ae8944a.000000000457 [write 4132352~20480] 2.1047ecca e4628) v4 currently no flag points reached
2013-06-08 20:24:47.525410 7fdde6fb6700  0 log [WRN] : slow request 39.339457 seconds old, received at 2013-06-08 20:24:08.185898: osd_op(client.98909.0:8474111 rb.0.5298.2ae8944a.0000000012f4 [write 220672~114688] 2.7ec0b5bb e4628) v4 currently no flag points reached
2013-06-08 20:24:47.525412 7fdde6fb6700  0 log [WRN] : slow request 39.307993 seconds old, received at 2013-06-08 20:24:08.217362: osd_sub_op_reply(client.98909.0:8473937 2.18 916b9c18/rb.0.5298.2ae8944a.00000000066d/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:47.525414 7fdde6fb6700  0 log [WRN] : slow request 39.258089 seconds old, received at 2013-06-08 20:24:08.267266: osd_sub_op_reply(client.98909.0:8473931 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:48.525547 7fdde6fb6700  0 log [WRN] : 62 slow requests, 6 included below; oldest blocked for > 42.766665 secs
2013-06-08 20:24:48.525553 7fdde6fb6700  0 log [WRN] : slow request 40.258171 seconds old, received at 2013-06-08 20:24:08.267337: osd_sub_op_reply(client.98909.0:8473942 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:48.525556 7fdde6fb6700  0 log [WRN] : slow request 40.258158 seconds old, received at 2013-06-08 20:24:08.267350: osd_sub_op_reply(client.98909.0:8473943 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:48.525558 7fdde6fb6700  0 log [WRN] : slow request 40.258124 seconds old, received at 2013-06-08 20:24:08.267384: osd_sub_op_reply(client.98909.0:8473944 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:48.525560 7fdde6fb6700  0 log [WRN] : slow request 40.258110 seconds old, received at 2013-06-08 20:24:08.267398: osd_sub_op_reply(client.98909.0:8473945 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:48.525562 7fdde6fb6700  0 log [WRN] : slow request 40.258096 seconds old, received at 2013-06-08 20:24:08.267412: osd_sub_op_reply(client.98909.0:8473949 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:49.525703 7fdde6fb6700  0 log [WRN] : 67 slow requests, 6 included below; oldest blocked for > 43.766812 secs
2013-06-08 20:24:49.525708 7fdde6fb6700  0 log [WRN] : slow request 41.258137 seconds old, received at 2013-06-08 20:24:08.267518: osd_sub_op_reply(client.98909.0:8473950 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:49.525715 7fdde6fb6700  0 log [WRN] : slow request 41.258108 seconds old, received at 2013-06-08 20:24:08.267547: osd_sub_op_reply(client.98909.0:8473951 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:49.525720 7fdde6fb6700  0 log [WRN] : slow request 41.258092 seconds old, received at 2013-06-08 20:24:08.267563: osd_sub_op_reply(client.98909.0:8473952 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:49.525722 7fdde6fb6700  0 log [WRN] : slow request 41.258053 seconds old, received at 2013-06-08 20:24:08.267602: osd_sub_op_reply(client.98909.0:8473953 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:49.525724 7fdde6fb6700  0 log [WRN] : slow request 41.258038 seconds old, received at 2013-06-08 20:24:08.267617: osd_sub_op_reply(client.98909.0:8473954 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:49.748302 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:49.748322 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:50.525860 7fdde6fb6700  0 log [WRN] : 72 slow requests, 6 included below; oldest blocked for > 44.766974 secs
2013-06-08 20:24:50.525866 7fdde6fb6700  0 log [WRN] : slow request 42.258121 seconds old, received at 2013-06-08 20:24:08.267696: osd_sub_op_reply(client.98909.0:8473955 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:50.525869 7fdde6fb6700  0 log [WRN] : slow request 42.258080 seconds old, received at 2013-06-08 20:24:08.267737: osd_sub_op_reply(client.98909.0:8473956 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:50.525871 7fdde6fb6700  0 log [WRN] : slow request 42.258059 seconds old, received at 2013-06-08 20:24:08.267758: osd_sub_op_reply(client.98909.0:8473957 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:50.525873 7fdde6fb6700  0 log [WRN] : slow request 42.258027 seconds old, received at 2013-06-08 20:24:08.267790: osd_sub_op_reply(client.98909.0:8473958 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:50.525875 7fdde6fb6700  0 log [WRN] : slow request 42.258012 seconds old, received at 2013-06-08 20:24:08.267805: osd_sub_op_reply(client.98909.0:8473959 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:51.526038 7fdde6fb6700  0 log [WRN] : 77 slow requests, 6 included below; oldest blocked for > 45.767153 secs
2013-06-08 20:24:51.526044 7fdde6fb6700  0 log [WRN] : slow request 43.257599 seconds old, received at 2013-06-08 20:24:08.268397: osd_sub_op_reply(client.98909.0:8473960 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:51.526047 7fdde6fb6700  0 log [WRN] : slow request 43.257569 seconds old, received at 2013-06-08 20:24:08.268427: osd_sub_op_reply(client.98909.0:8473961 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:51.526049 7fdde6fb6700  0 log [WRN] : slow request 43.257554 seconds old, received at 2013-06-08 20:24:08.268442: osd_sub_op_reply(client.98909.0:8473962 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:51.526051 7fdde6fb6700  0 log [WRN] : slow request 43.257537 seconds old, received at 2013-06-08 20:24:08.268459: osd_sub_op_reply(client.98909.0:8473963 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:51.526053 7fdde6fb6700  0 log [WRN] : slow request 43.257509 seconds old, received at 2013-06-08 20:24:08.268487: osd_sub_op_reply(client.98909.0:8473964 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:52.526199 7fdde6fb6700  0 log [WRN] : 82 slow requests, 6 included below; oldest blocked for > 46.767313 secs
2013-06-08 20:24:52.526205 7fdde6fb6700  0 log [WRN] : slow request 44.257656 seconds old, received at 2013-06-08 20:24:08.268500: osd_sub_op_reply(client.98909.0:8473965 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:52.526208 7fdde6fb6700  0 log [WRN] : slow request 44.257643 seconds old, received at 2013-06-08 20:24:08.268513: osd_sub_op_reply(client.98909.0:8473966 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:52.526210 7fdde6fb6700  0 log [WRN] : slow request 44.257628 seconds old, received at 2013-06-08 20:24:08.268528: osd_sub_op_reply(client.98909.0:8473967 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:52.526212 7fdde6fb6700  0 log [WRN] : slow request 44.257614 seconds old, received at 2013-06-08 20:24:08.268542: osd_sub_op_reply(client.98909.0:8473968 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:52.526213 7fdde6fb6700  0 log [WRN] : slow request 44.257601 seconds old, received at 2013-06-08 20:24:08.268555: osd_sub_op_reply(client.98909.0:8473969 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:53.526384 7fdde6fb6700  0 log [WRN] : 87 slow requests, 6 included below; oldest blocked for > 47.767498 secs
2013-06-08 20:24:53.526390 7fdde6fb6700  0 log [WRN] : slow request 45.257762 seconds old, received at 2013-06-08 20:24:08.268579: osd_sub_op_reply(client.98909.0:8473970 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:53.526393 7fdde6fb6700  0 log [WRN] : slow request 45.257744 seconds old, received at 2013-06-08 20:24:08.268597: osd_sub_op_reply(client.98909.0:8473971 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:53.526395 7fdde6fb6700  0 log [WRN] : slow request 45.257711 seconds old, received at 2013-06-08 20:24:08.268630: osd_sub_op_reply(client.98909.0:8473972 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:53.526397 7fdde6fb6700  0 log [WRN] : slow request 45.257615 seconds old, received at 2013-06-08 20:24:08.268726: osd_sub_op_reply(client.98909.0:8474085 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:53.526398 7fdde6fb6700  0 log [WRN] : slow request 45.257579 seconds old, received at 2013-06-08 20:24:08.268762: osd_sub_op_reply(client.98909.0:8474086 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:54.526566 7fdde6fb6700  0 log [WRN] : 92 slow requests, 6 included below; oldest blocked for > 48.767680 secs
2013-06-08 20:24:54.526571 7fdde6fb6700  0 log [WRN] : slow request 46.257742 seconds old, received at 2013-06-08 20:24:08.268781: osd_sub_op_reply(client.98909.0:8474087 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:54.526574 7fdde6fb6700  0 log [WRN] : slow request 46.257717 seconds old, received at 2013-06-08 20:24:08.268806: osd_sub_op_reply(client.98909.0:8474089 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:54.526576 7fdde6fb6700  0 log [WRN] : slow request 46.257704 seconds old, received at 2013-06-08 20:24:08.268819: osd_sub_op_reply(client.98909.0:8474090 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:54.526578 7fdde6fb6700  0 log [WRN] : slow request 46.257639 seconds old, received at 2013-06-08 20:24:08.268884: osd_sub_op_reply(client.98909.0:8474091 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:54.526580 7fdde6fb6700  0 log [WRN] : slow request 46.257609 seconds old, received at 2013-06-08 20:24:08.268914: osd_sub_op_reply(client.98909.0:8474092 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:54.748391 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:54.748416 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:24:55.526718 7fdde6fb6700  0 log [WRN] : 97 slow requests, 6 included below; oldest blocked for > 49.767828 secs
2013-06-08 20:24:55.526723 7fdde6fb6700  0 log [WRN] : slow request 47.257739 seconds old, received at 2013-06-08 20:24:08.268932: osd_sub_op_reply(client.98909.0:8474093 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:55.526727 7fdde6fb6700  0 log [WRN] : slow request 47.257722 seconds old, received at 2013-06-08 20:24:08.268949: osd_sub_op_reply(client.98909.0:8474094 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:55.526729 7fdde6fb6700  0 log [WRN] : slow request 47.257695 seconds old, received at 2013-06-08 20:24:08.268976: osd_sub_op_reply(client.98909.0:8474095 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:55.526731 7fdde6fb6700  0 log [WRN] : slow request 47.257682 seconds old, received at 2013-06-08 20:24:08.268989: osd_sub_op_reply(client.98909.0:8474096 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:55.526737 7fdde6fb6700  0 log [WRN] : slow request 47.257657 seconds old, received at 2013-06-08 20:24:08.269014: osd_sub_op_reply(client.98909.0:8474097 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:56.526876 7fdde6fb6700  0 log [WRN] : 102 slow requests, 6 included below; oldest blocked for > 50.767986 secs
2013-06-08 20:24:56.526881 7fdde6fb6700  0 log [WRN] : slow request 48.257796 seconds old, received at 2013-06-08 20:24:08.269033: osd_sub_op_reply(client.98909.0:8474098 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:24:56.526884 7fdde6fb6700  0 log [WRN] : slow request 48.084679 seconds old, received at 2013-06-08 20:24:08.442150: osd_op(client.91142.1:1878319 rb.0.1.000000000703 [write 2101248~4096] 2.1e3864bb e4628) currently no flag points reached
2013-06-08 20:24:56.526886 7fdde6fb6700  0 log [WRN] : slow request 48.022645 seconds old, received at 2013-06-08 20:24:08.504184: osd_op(client.91121.1:1825683 rb.0.1.0000000063cb [read 3760128~4096] 2.4bf54cda e4628) currently no flag points reached
2013-06-08 20:24:56.526889 7fdde6fb6700  0 log [WRN] : slow request 47.981741 seconds old, received at 2013-06-08 20:24:08.545088: osd_op(client.106364.0:485491 rb.0.598c.2ae8944a.00000002943e [write 368128~4096] 2.d2964d1e e4628) v4 currently no flag points reached
2013-06-08 20:24:56.526891 7fdde6fb6700  0 log [WRN] : slow request 47.981661 seconds old, received at 2013-06-08 20:24:08.545168: osd_op(client.106364.0:485492 rb.0.598c.2ae8944a.00000002943e [write 474624~4096] 2.d2964d1e e4628) v4 currently no flag points reached
2013-06-08 20:24:57.527045 7fdde6fb6700  0 log [WRN] : 107 slow requests, 6 included below; oldest blocked for > 51.768148 secs
2013-06-08 20:24:57.527051 7fdde6fb6700  0 log [WRN] : slow request 48.981700 seconds old, received at 2013-06-08 20:24:08.545291: osd_op(client.106364.0:485493 rb.0.598c.2ae8944a.00000002943e [write 794112~4096] 2.d2964d1e e4628) v4 currently no flag points reached
2013-06-08 20:24:57.527053 7fdde6fb6700  0 log [WRN] : slow request 48.981034 seconds old, received at 2013-06-08 20:24:08.545957: osd_sub_op(client.106364.0:485497 2.43 e665ea43/rb.0.598c.2ae8944a.000000029430/head//2 [] v 4628'4106317 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:57.527058 7fdde6fb6700  0 log [WRN] : slow request 48.980936 seconds old, received at 2013-06-08 20:24:08.546055: osd_sub_op(client.106364.0:485496 2.e4 7da6ebe4/rb.0.598c.2ae8944a.000000001008/head//2 [] v 4628'2349443 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:57.527060 7fdde6fb6700  0 log [WRN] : slow request 48.980612 seconds old, received at 2013-06-08 20:24:08.546379: osd_sub_op(client.106364.0:485490 2.b4 4d2a33b4/rb.0.598c.2ae8944a.000000029431/head//2 [] v 4628'2052017 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:57.527062 7fdde6fb6700  0 log [WRN] : slow request 47.507675 seconds old, received at 2013-06-08 20:24:10.019316: osd_op(client.61605.0:20616273 rb.0.5958.74b0dc51.000000039228 [write 2616832~4096] 2.4e341267 e4628) v4 currently no flag points reached
2013-06-08 20:24:58.527242 7fdde6fb6700  0 log [WRN] : 112 slow requests, 6 included below; oldest blocked for > 52.768348 secs
2013-06-08 20:24:58.527248 7fdde6fb6700  0 log [WRN] : slow request 48.506438 seconds old, received at 2013-06-08 20:24:10.020753: osd_sub_op(client.61605.0:20616274 2.c5 5c748ac5/rb.0.5958.74b0dc51.00000003cdcf/head//2 [] v 4628'1152143 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:58.527252 7fdde6fb6700  0 log [WRN] : slow request 48.329577 seconds old, received at 2013-06-08 20:24:10.197614: osd_op(client.91121.1:1825686 rb.0.1.0000000000f2 [write 839680~16384] 2.8682003f e4628) currently no flag points reached
2013-06-08 20:24:58.527254 7fdde6fb6700  0 log [WRN] : slow request 47.901329 seconds old, received at 2013-06-08 20:24:10.625862: osd_sub_op(client.106364.0:485499 2.1c 977d4e1c/rb.0.598c.2ae8944a.000000028cef/head//2 [] v 4628'2456504 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:58.527256 7fdde6fb6700  0 log [WRN] : slow request 47.901138 seconds old, received at 2013-06-08 20:24:10.626053: osd_sub_op(client.106364.0:485501 2.1c bf149f1c/rb.0.598c.2ae8944a.0000000017e8/head//2 [] v 4628'2456505 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:58.527258 7fdde6fb6700  0 log [WRN] : slow request 47.343823 seconds old, received at 2013-06-08 20:24:11.183368: osd_op(client.98909.0:8474112 rb.0.5298.2ae8944a.000000000000 [write 32256~8192] 2.267feaa8 e4628) v4 currently no flag points reached
2013-06-08 20:24:59.527407 7fdde6fb6700  0 log [WRN] : 117 slow requests, 6 included below; oldest blocked for > 53.768513 secs
2013-06-08 20:24:59.527412 7fdde6fb6700  0 log [WRN] : slow request 48.343906 seconds old, received at 2013-06-08 20:24:11.183450: osd_op(client.98909.0:8474117 rb.0.5298.2ae8944a.000000000460 [write 32256~4096] 2.350f976f e4628) v4 currently no flag points reached
2013-06-08 20:24:59.527415 7fdde6fb6700  0 log [WRN] : slow request 48.343862 seconds old, received at 2013-06-08 20:24:11.183494: osd_op(client.98909.0:8474121 rb.0.5298.2ae8944a.0000000006c0 [write 32256~4096] 2.1c213d41 e4628) v4 currently no flag points reached
2013-06-08 20:24:59.527417 7fdde6fb6700  0 log [WRN] : slow request 48.343139 seconds old, received at 2013-06-08 20:24:11.184217: osd_sub_op(client.98909.0:8474118 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239475 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:59.527425 7fdde6fb6700  0 log [WRN] : slow request 48.343065 seconds old, received at 2013-06-08 20:24:11.184291: osd_sub_op(client.98909.0:8474122 2.5a c6509d5a/rb.0.5298.2ae8944a.0000000006cc/head//2 [] v 4628'6887380 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:59.527427 7fdde6fb6700  0 log [WRN] : slow request 48.342983 seconds old, received at 2013-06-08 20:24:11.184373: osd_sub_op(client.98909.0:8474119 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239476 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:24:59.748503 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:24:59.748526 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:00.527594 7fdde6fb6700  0 log [WRN] : 122 slow requests, 6 included below; oldest blocked for > 54.768703 secs
2013-06-08 20:25:00.527599 7fdde6fb6700  0 log [WRN] : slow request 49.342981 seconds old, received at 2013-06-08 20:24:11.184565: osd_sub_op(client.98909.0:8474131 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239477 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:00.527608 7fdde6fb6700  0 log [WRN] : slow request 49.342829 seconds old, received at 2013-06-08 20:24:11.184717: osd_sub_op(client.98909.0:8474132 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239478 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:00.527610 7fdde6fb6700  0 log [WRN] : slow request 49.342709 seconds old, received at 2013-06-08 20:24:11.184837: osd_sub_op(client.98909.0:8474133 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239479 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:00.527612 7fdde6fb6700  0 log [WRN] : slow request 49.342595 seconds old, received at 2013-06-08 20:24:11.184951: osd_sub_op(client.98909.0:8474134 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239480 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:00.527616 7fdde6fb6700  0 log [WRN] : slow request 49.342656 seconds old, received at 2013-06-08 20:24:11.184890: osd_sub_op(client.98909.0:8474116 2.43 7c48e843/rb.0.5298.2ae8944a.00000000041c/head//2 [] v 4628'4106318 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:01.527811 7fdde6fb6700  0 log [WRN] : 127 slow requests, 6 included below; oldest blocked for > 55.768917 secs
2013-06-08 20:25:01.527818 7fdde6fb6700  0 log [WRN] : slow request 49.228343 seconds old, received at 2013-06-08 20:24:12.299417: osd_op(client.106359.0:382678 rb.0.c46a.2ae8944a.0000000028cc [write 3526656~8192] 2.da0d6e5c e4628) v4 currently no flag points reached
2013-06-08 20:25:01.527824 7fdde6fb6700  0 log [WRN] : slow request 49.228244 seconds old, received at 2013-06-08 20:24:12.299516: osd_op(client.106359.0:382680 rb.0.c46a.2ae8944a.0000000028de [write 139264~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:01.527826 7fdde6fb6700  0 log [WRN] : slow request 49.228191 seconds old, received at 2013-06-08 20:24:12.299569: osd_op(client.106359.0:382681 rb.0.c46a.2ae8944a.0000000028de [write 180224~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:01.527828 7fdde6fb6700  0 log [WRN] : slow request 49.228158 seconds old, received at 2013-06-08 20:24:12.299602: osd_op(client.106359.0:382683 rb.0.c46a.2ae8944a.0000000028ce [write 3846144~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:01.527830 7fdde6fb6700  0 log [WRN] : slow request 49.228125 seconds old, received at 2013-06-08 20:24:12.299635: osd_op(client.106359.0:382684 rb.0.c46a.2ae8944a.0000000028ce [write 4173824~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:02.528008 7fdde6fb6700  0 log [WRN] : 132 slow requests, 6 included below; oldest blocked for > 56.769117 secs
2013-06-08 20:25:02.528013 7fdde6fb6700  0 log [WRN] : slow request 50.228017 seconds old, received at 2013-06-08 20:24:12.299943: osd_op(client.106359.0:382687 rb.0.c46a.2ae8944a.0000000028de [write 16384~8192] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:02.528016 7fdde6fb6700  0 log [WRN] : slow request 50.227885 seconds old, received at 2013-06-08 20:24:12.300075: osd_op(client.106359.0:382688 rb.0.c46a.2ae8944a.0000000028de [write 49152~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:02.528018 7fdde6fb6700  0 log [WRN] : slow request 50.227812 seconds old, received at 2013-06-08 20:24:12.300148: osd_op(client.106359.0:382689 rb.0.c46a.2ae8944a.0000000028de [write 110592~8192] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:02.528020 7fdde6fb6700  0 log [WRN] : slow request 50.227697 seconds old, received at 2013-06-08 20:24:12.300263: osd_op(client.106359.0:382690 rb.0.c46a.2ae8944a.0000000028de [write 159744~8192] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:02.528022 7fdde6fb6700  0 log [WRN] : slow request 50.227513 seconds old, received at 2013-06-08 20:24:12.300447: osd_op(client.106359.0:382695 rb.0.c46a.2ae8944a.0000000028cc [write 65536~4096] 2.da0d6e5c e4628) v4 currently no flag points reached
2013-06-08 20:25:03.528168 7fdde6fb6700  0 log [WRN] : 137 slow requests, 6 included below; oldest blocked for > 57.769275 secs
2013-06-08 20:25:03.528174 7fdde6fb6700  0 log [WRN] : slow request 51.227642 seconds old, received at 2013-06-08 20:24:12.300476: osd_op(client.106359.0:382699 rb.0.c46a.2ae8944a.0000000028ce [write 2859008~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:03.528177 7fdde6fb6700  0 log [WRN] : slow request 51.227660 seconds old, received at 2013-06-08 20:24:12.300458: osd_sub_op(client.106359.0:382691 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594319 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:03.528179 7fdde6fb6700  0 log [WRN] : slow request 51.227611 seconds old, received at 2013-06-08 20:24:12.300507: osd_op(client.106359.0:382700 rb.0.c46a.2ae8944a.0000000028ce [write 3604480~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:03.528181 7fdde6fb6700  0 log [WRN] : slow request 51.227528 seconds old, received at 2013-06-08 20:24:12.300590: osd_op(client.106359.0:382704 rb.0.c46a.2ae8944a.0000000028de [write 151552~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:03.528183 7fdde6fb6700  0 log [WRN] : slow request 51.227499 seconds old, received at 2013-06-08 20:24:12.300619: osd_op(client.106359.0:382705 rb.0.c46a.2ae8944a.0000000028de [write 172032~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:04.528335 7fdde6fb6700  0 log [WRN] : 142 slow requests, 6 included below; oldest blocked for > 58.769437 secs
2013-06-08 20:25:04.528341 7fdde6fb6700  0 log [WRN] : slow request 52.227659 seconds old, received at 2013-06-08 20:24:12.300621: osd_sub_op(client.106359.0:382692 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594320 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:04.528344 7fdde6fb6700  0 log [WRN] : slow request 52.227673 seconds old, received at 2013-06-08 20:24:12.300607: osd_sub_op(client.106359.0:382696 2.d1 d586d0d1/rb.0.c46a.2ae8944a.000000002871/head//2 [] v 4628'3872773 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:04.528346 7fdde6fb6700  0 log [WRN] : slow request 52.227526 seconds old, received at 2013-06-08 20:24:12.300754: osd_sub_op(client.106359.0:382693 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594321 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:04.528349 7fdde6fb6700  0 log [WRN] : slow request 52.227339 seconds old, received at 2013-06-08 20:24:12.300941: osd_sub_op(client.106359.0:382694 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594322 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:04.528351 7fdde6fb6700  0 log [WRN] : slow request 52.227626 seconds old, received at 2013-06-08 20:24:12.300654: osd_op(client.106359.0:382707 rb.0.c46a.2ae8944a.000000002627 [write 4067328~90112] 2.a596c324 e4628) v4 currently no flag points reached
2013-06-08 20:25:04.748593 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:04.748612 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:05.528503 7fdde6fb6700  0 log [WRN] : 147 slow requests, 6 included below; oldest blocked for > 59.769607 secs
2013-06-08 20:25:05.528509 7fdde6fb6700  0 log [WRN] : slow request 53.226936 seconds old, received at 2013-06-08 20:24:12.301514: osd_sub_op(client.106359.0:382706 2.1a 9a85f51a/rb.0.c46a.2ae8944a.000000002899/head//2 [] v 4628'1016784 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:05.528512 7fdde6fb6700  0 log [WRN] : slow request 52.805736 seconds old, received at 2013-06-08 20:24:12.722714: osd_sub_op(client.106339.0:50104 2.b7 143f28b7/rb.0.2b91.427e3a13.000000000a43/head//2 [] v 4628'3297964 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:05.528514 7fdde6fb6700  0 log [WRN] : slow request 52.753030 seconds old, received at 2013-06-08 20:24:12.775420: osd_op(client.91142.1:1878330 rb.0.1.0000000069a0 [read 1724416~4096] 2.3bd597d5 e4628) currently no flag points reached
2013-06-08 20:25:05.528516 7fdde6fb6700  0 log [WRN] : slow request 52.234492 seconds old, received at 2013-06-08 20:24:13.293958: osd_op(client.91121.1:1825704 rb.0.1.00000000725b [write 2666496~4096] 2.bbd0223f e4628) currently no flag points reached
2013-06-08 20:25:05.528525 7fdde6fb6700  0 log [WRN] : slow request 52.234440 seconds old, received at 2013-06-08 20:24:13.294010: osd_op(client.91121.1:1825705 rb.0.1.00000000725b [write 2695168~4096] 2.bbd0223f e4628) currently no flag points reached
2013-06-08 20:25:06.528670 7fdde6fb6700  0 log [WRN] : 148 slow requests, 6 included below; oldest blocked for > 60.769774 secs
2013-06-08 20:25:06.528676 7fdde6fb6700  0 log [WRN] : slow request 60.769774 seconds old, received at 2013-06-08 20:24:05.758843: osd_op(client.108261.0:57 rb.0.a06a.238e1f29.000000000033 [delete] 2.cbc5115c e4628) v4 currently waiting for subops from [0]
2013-06-08 20:25:06.528679 7fdde6fb6700  0 log [WRN] : slow request 60.294300 seconds old, received at 2013-06-08 20:24:06.234317: osd_op(client.106250.0:445909 rb.0.6d52.238e1f29.00000003c6a2 [write 2354688~4096] 2.fd22f37b e4628) v4 currently waiting for subops from [5]
2013-06-08 20:25:06.528681 7fdde6fb6700  0 log [WRN] : slow request 60.055636 seconds old, received at 2013-06-08 20:24:06.472981: osd_sub_op(client.98906.0:295493 2.af 7ffe3daf/rb.0.2c10.1b8d3ce6.000000000380/head//2 [] v 4628'1987697 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:06.528688 7fdde6fb6700  0 log [WRN] : slow request 60.055549 seconds old, received at 2013-06-08 20:24:06.473068: osd_sub_op(client.98906.0:295492 2.6a 7d9bd26a/rb.0.2c10.1b8d3ce6.00000000039d/head//2 [] v 4628'3774779 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:06.528690 7fdde6fb6700  0 log [WRN] : slow request 53.234592 seconds old, received at 2013-06-08 20:24:13.294025: osd_op(client.91121.1:1825708 rb.0.1.000000007877 [write 2101248~4096] 2.5151018 e4628) currently no flag points reached
2013-06-08 20:25:07.528840 7fdde6fb6700  0 log [WRN] : 151 slow requests, 6 included below; oldest blocked for > 61.769942 secs
2013-06-08 20:25:07.528846 7fdde6fb6700  0 log [WRN] : slow request 60.391271 seconds old, received at 2013-06-08 20:24:07.137514: osd_sub_op(client.106248.0:110523 2.90 59ec7090/rb.0.14aef.238e1f29.0000000002bc/head//2 [] v 4628'2636937 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:07.528851 7fdde6fb6700  0 log [WRN] : slow request 60.391515 seconds old, received at 2013-06-08 20:24:07.137270: osd_op(client.106248.0:110526 rb.0.14aef.238e1f29.00000000126d [write 3039232~49152] 2.29b5f635 e4628) v4 currently waiting for subops from [2]
2013-06-08 20:25:07.528855 7fdde6fb6700  0 log [WRN] : slow request 54.234601 seconds old, received at 2013-06-08 20:24:13.294184: osd_op(client.91121.1:1825709 rb.0.1.000000007877 [write 2109440~4096] 2.5151018 e4628) currently no flag points reached
2013-06-08 20:25:07.528859 7fdde6fb6700  0 log [WRN] : slow request 54.234585 seconds old, received at 2013-06-08 20:24:13.294200: osd_op(client.91121.1:1825713 rb.0.1.000000000930 [write 929792~4096] 2.994e0641 e4628) currently no flag points reached
2013-06-08 20:25:07.528864 7fdde6fb6700  0 log [WRN] : slow request 54.234230 seconds old, received at 2013-06-08 20:24:13.294555: osd_sub_op(client.91121.1:1825706 2.19 8c8e0219/rb.0.1.000000007544/head//2 [] v 4628'1217259 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:08.529005 7fdde6fb6700  0 log [WRN] : 12 slow requests, 6 included below; oldest blocked for > 62.770123 secs
2013-06-08 20:25:08.529010 7fdde6fb6700  0 log [WRN] : slow request 60.358440 seconds old, received at 2013-06-08 20:24:08.170526: osd_op(client.98909.0:8473931 rb.0.5298.2ae8944a.000000000457 [write 1572352~20480] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:08.529013 7fdde6fb6700  0 log [WRN] : slow request 60.357994 seconds old, received at 2013-06-08 20:24:08.170972: osd_op(client.98909.0:8473937 rb.0.5298.2ae8944a.00000000066d [write 1957376~4096] 2.916b9c18 e4628) v4 currently waiting for subops from [1]
2013-06-08 20:25:08.529015 7fdde6fb6700  0 log [WRN] : slow request 60.357719 seconds old, received at 2013-06-08 20:24:08.171247: osd_op(client.98909.0:8473942 rb.0.5298.2ae8944a.000000000457 [write 2665984~40960] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:08.529017 7fdde6fb6700  0 log [WRN] : slow request 60.357148 seconds old, received at 2013-06-08 20:24:08.171818: osd_op(client.98909.0:8473943 rb.0.5298.2ae8944a.000000000457 [write 2739712~45056] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:08.529020 7fdde6fb6700  0 log [WRN] : slow request 60.356712 seconds old, received at 2013-06-08 20:24:08.172254: osd_op(client.98909.0:8473944 rb.0.5298.2ae8944a.000000000457 [write 2788864~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:09.529151 7fdde6fb6700  0 log [WRN] : 17 slow requests, 6 included below; oldest blocked for > 63.770270 secs
2013-06-08 20:25:09.529159 7fdde6fb6700  0 log [WRN] : slow request 61.356535 seconds old, received at 2013-06-08 20:24:08.172578: osd_op(client.98909.0:8473945 rb.0.5298.2ae8944a.000000000457 [write 4156928~37376] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:09.529162 7fdde6fb6700  0 log [WRN] : slow request 61.355991 seconds old, received at 2013-06-08 20:24:08.173122: osd_op(client.98909.0:8473949 rb.0.5298.2ae8944a.000000000457 [write 2514432~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:09.529163 7fdde6fb6700  0 log [WRN] : slow request 61.355934 seconds old, received at 2013-06-08 20:24:08.173179: osd_op(client.98909.0:8473950 rb.0.5298.2ae8944a.000000000457 [write 2649600~12288] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:09.529170 7fdde6fb6700  0 log [WRN] : slow request 61.355888 seconds old, received at 2013-06-08 20:24:08.173225: osd_op(client.98909.0:8473951 rb.0.5298.2ae8944a.000000000457 [write 2104832~94208] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:09.529172 7fdde6fb6700  0 log [WRN] : slow request 61.354635 seconds old, received at 2013-06-08 20:24:08.174478: osd_op(client.98909.0:8473952 rb.0.5298.2ae8944a.000000000457 [write 2203136~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:09.748691 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:09.748711 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:10.529308 7fdde6fb6700  0 log [WRN] : 22 slow requests, 6 included below; oldest blocked for > 64.770426 secs
2013-06-08 20:25:10.529314 7fdde6fb6700  0 log [WRN] : slow request 62.354741 seconds old, received at 2013-06-08 20:24:08.174528: osd_op(client.98909.0:8473953 rb.0.5298.2ae8944a.000000000457 [write 2268672~36864] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:10.529318 7fdde6fb6700  0 log [WRN] : slow request 62.354332 seconds old, received at 2013-06-08 20:24:08.174937: osd_op(client.98909.0:8473954 rb.0.5298.2ae8944a.000000000457 [write 1797632~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:10.529320 7fdde6fb6700  0 log [WRN] : slow request 62.354286 seconds old, received at 2013-06-08 20:24:08.174983: osd_op(client.98909.0:8473955 rb.0.5298.2ae8944a.000000000457 [write 1920512~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:10.529322 7fdde6fb6700  0 log [WRN] : slow request 62.354022 seconds old, received at 2013-06-08 20:24:08.175247: osd_op(client.98909.0:8473956 rb.0.5298.2ae8944a.000000000457 [write 1949184~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:10.529324 7fdde6fb6700  0 log [WRN] : slow request 62.353565 seconds old, received at 2013-06-08 20:24:08.175704: osd_op(client.98909.0:8473957 rb.0.5298.2ae8944a.000000000457 [write 1781248~12288] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:11.529460 7fdde6fb6700  0 log [WRN] : 27 slow requests, 6 included below; oldest blocked for > 65.770575 secs
2013-06-08 20:25:11.529466 7fdde6fb6700  0 log [WRN] : slow request 63.353672 seconds old, received at 2013-06-08 20:24:08.175746: osd_op(client.98909.0:8473958 rb.0.5298.2ae8944a.000000000457 [write 1711616~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:11.529469 7fdde6fb6700  0 log [WRN] : slow request 63.353457 seconds old, received at 2013-06-08 20:24:08.175961: osd_op(client.98909.0:8473959 rb.0.5298.2ae8944a.000000000457 [write 1732096~40960] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:11.529471 7fdde6fb6700  0 log [WRN] : slow request 63.352997 seconds old, received at 2013-06-08 20:24:08.176421: osd_sub_op(client.98909.0:8473983 2.d1 4c106ed1/rb.0.5298.2ae8944a.000000000459/head//2 [] v 4628'3872772 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:11.529473 7fdde6fb6700  0 log [WRN] : slow request 63.352979 seconds old, received at 2013-06-08 20:24:08.176439: osd_op(client.98909.0:8473960 rb.0.5298.2ae8944a.000000000457 [write 1482240~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:11.529475 7fdde6fb6700  0 log [WRN] : slow request 63.352712 seconds old, received at 2013-06-08 20:24:08.176706: osd_op(client.98909.0:8473961 rb.0.5298.2ae8944a.000000000457 [write 1510912~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:12.529609 7fdde6fb6700  0 log [WRN] : 32 slow requests, 6 included below; oldest blocked for > 66.770726 secs
2013-06-08 20:25:12.529615 7fdde6fb6700  0 log [WRN] : slow request 64.352597 seconds old, received at 2013-06-08 20:24:08.176972: osd_op(client.98909.0:8473962 rb.0.5298.2ae8944a.000000000457 [write 1551872~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:12.529618 7fdde6fb6700  0 log [WRN] : slow request 64.352383 seconds old, received at 2013-06-08 20:24:08.177186: osd_op(client.98909.0:8473963 rb.0.5298.2ae8944a.000000000457 [write 1633792~73728] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:12.529620 7fdde6fb6700  0 log [WRN] : slow request 64.351336 seconds old, received at 2013-06-08 20:24:08.178233: osd_op(client.98909.0:8473964 rb.0.5298.2ae8944a.000000000457 [write 1330688~16384] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:12.529622 7fdde6fb6700  0 log [WRN] : slow request 64.351105 seconds old, received at 2013-06-08 20:24:08.178464: osd_op(client.98909.0:8473965 rb.0.5298.2ae8944a.000000000457 [write 1351168~20480] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:12.529624 7fdde6fb6700  0 log [WRN] : slow request 64.350864 seconds old, received at 2013-06-08 20:24:08.178705: osd_op(client.98909.0:8473966 rb.0.5298.2ae8944a.000000000457 [write 1400320~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:13.529761 7fdde6fb6700  0 log [WRN] : 37 slow requests, 6 included below; oldest blocked for > 67.770877 secs
2013-06-08 20:25:13.529771 7fdde6fb6700  0 log [WRN] : slow request 65.350980 seconds old, received at 2013-06-08 20:24:08.178740: osd_op(client.98909.0:8473967 rb.0.5298.2ae8944a.000000000457 [write 1424896~32768] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:13.529774 7fdde6fb6700  0 log [WRN] : slow request 65.350712 seconds old, received at 2013-06-08 20:24:08.179008: osd_op(client.98909.0:8473968 rb.0.5298.2ae8944a.000000000457 [write 1502720~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:13.529776 7fdde6fb6700  0 log [WRN] : slow request 65.350670 seconds old, received at 2013-06-08 20:24:08.179050: osd_op(client.98909.0:8473969 rb.0.5298.2ae8944a.000000000457 [write 1285632~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:13.529778 7fdde6fb6700  0 log [WRN] : slow request 65.350623 seconds old, received at 2013-06-08 20:24:08.179097: osd_op(client.98909.0:8473970 rb.0.5298.2ae8944a.000000000457 [write 1297920~28672] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:13.529779 7fdde6fb6700  0 log [WRN] : slow request 65.349942 seconds old, received at 2013-06-08 20:24:08.179778: osd_op(client.98909.0:8473971 rb.0.5298.2ae8944a.000000000457 [write 2223616~40960] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:14.529926 7fdde6fb6700  0 log [WRN] : 42 slow requests, 6 included below; oldest blocked for > 68.771034 secs
2013-06-08 20:25:14.529931 7fdde6fb6700  0 log [WRN] : slow request 66.348694 seconds old, received at 2013-06-08 20:24:08.181183: osd_sub_op(client.98909.0:8474077 2.43 7c48e843/rb.0.5298.2ae8944a.00000000041c/head//2 [] v 4628'4106316 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:14.529935 7fdde6fb6700  0 log [WRN] : slow request 66.350010 seconds old, received at 2013-06-08 20:24:08.179867: osd_op(client.98909.0:8473972 rb.0.5298.2ae8944a.000000000457 [write 2338304~172032] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:14.529937 7fdde6fb6700  0 log [WRN] : slow request 66.347762 seconds old, received at 2013-06-08 20:24:08.182115: osd_op(client.98909.0:8474085 rb.0.5298.2ae8944a.000000000457 [write 1269248~12288] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:14.529939 7fdde6fb6700  0 log [WRN] : slow request 66.347709 seconds old, received at 2013-06-08 20:24:08.182168: osd_op(client.98909.0:8474086 rb.0.5298.2ae8944a.000000000457 [write 1375744~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:14.529940 7fdde6fb6700  0 log [WRN] : slow request 66.347668 seconds old, received at 2013-06-08 20:24:08.182209: osd_op(client.98909.0:8474087 rb.0.5298.2ae8944a.000000000457 [write 1408512~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:14.748781 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:14.748801 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:15.530113 7fdde6fb6700  0 log [WRN] : 47 slow requests, 6 included below; oldest blocked for > 69.771230 secs
2013-06-08 20:25:15.530119 7fdde6fb6700  0 log [WRN] : slow request 67.347817 seconds old, received at 2013-06-08 20:24:08.182256: osd_op(client.98909.0:8474089 rb.0.5298.2ae8944a.000000000457 [write 1469952~8192] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:15.530121 7fdde6fb6700  0 log [WRN] : slow request 67.347773 seconds old, received at 2013-06-08 20:24:08.182300: osd_op(client.98909.0:8474090 rb.0.5298.2ae8944a.000000000457 [write 1596928~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:15.530124 7fdde6fb6700  0 log [WRN] : slow request 67.347523 seconds old, received at 2013-06-08 20:24:08.182550: osd_op(client.98909.0:8474091 rb.0.5298.2ae8944a.000000000457 [write 1625600~4096] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:15.530127 7fdde6fb6700  0 log [WRN] : slow request 67.347305 seconds old, received at 2013-06-08 20:24:08.182768: osd_op(client.98909.0:8474092 rb.0.5298.2ae8944a.000000000457 [write 1809920~45056] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:15.530129 7fdde6fb6700  0 log [WRN] : slow request 67.347016 seconds old, received at 2013-06-08 20:24:08.183057: osd_op(client.98909.0:8474093 rb.0.5298.2ae8944a.000000000457 [write 1859072~53248] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:16.530286 7fdde6fb6700  0 log [WRN] : 52 slow requests, 6 included below; oldest blocked for > 70.771403 secs
2013-06-08 20:25:16.530291 7fdde6fb6700  0 log [WRN] : slow request 68.346389 seconds old, received at 2013-06-08 20:24:08.183857: osd_op(client.98909.0:8474094 rb.0.5298.2ae8944a.000000000457 [write 2063872~36864] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:16.530294 7fdde6fb6700  0 log [WRN] : slow request 68.345863 seconds old, received at 2013-06-08 20:24:08.184383: osd_op(client.98909.0:8474095 rb.0.5298.2ae8944a.000000000457 [write 2309632~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:16.530296 7fdde6fb6700  0 log [WRN] : slow request 68.345599 seconds old, received at 2013-06-08 20:24:08.184647: osd_op(client.98909.0:8474096 rb.0.5298.2ae8944a.000000000457 [write 2534912~28672] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:16.530298 7fdde6fb6700  0 log [WRN] : slow request 68.345372 seconds old, received at 2013-06-08 20:24:08.184874: osd_op(client.98909.0:8474097 rb.0.5298.2ae8944a.000000000457 [write 2567680~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:16.530300 7fdde6fb6700  0 log [WRN] : slow request 68.345024 seconds old, received at 2013-06-08 20:24:08.185222: osd_op(client.98909.0:8474098 rb.0.5298.2ae8944a.000000000457 [write 2596352~24576] 2.1047ecca e4628) v4 currently waiting for subops from [3]
2013-06-08 20:25:17.530466 7fdde6fb6700  0 log [WRN] : 57 slow requests, 6 included below; oldest blocked for > 71.771578 secs
2013-06-08 20:25:17.530472 7fdde6fb6700  0 log [WRN] : slow request 69.344997 seconds old, received at 2013-06-08 20:24:08.185424: osd_op(client.98909.0:8474099 rb.0.5298.2ae8944a.000000000457 [write 2625024~16384] 2.1047ecca e4628) v4 currently no flag points reached
2013-06-08 20:25:17.530475 7fdde6fb6700  0 log [WRN] : slow request 69.344949 seconds old, received at 2013-06-08 20:24:08.185472: osd_op(client.98909.0:8474100 rb.0.5298.2ae8944a.000000000457 [write 4132352~20480] 2.1047ecca e4628) v4 currently no flag points reached
2013-06-08 20:25:17.530477 7fdde6fb6700  0 log [WRN] : slow request 69.344523 seconds old, received at 2013-06-08 20:24:08.185898: osd_op(client.98909.0:8474111 rb.0.5298.2ae8944a.0000000012f4 [write 220672~114688] 2.7ec0b5bb e4628) v4 currently no flag points reached
2013-06-08 20:25:17.530479 7fdde6fb6700  0 log [WRN] : slow request 69.313059 seconds old, received at 2013-06-08 20:24:08.217362: osd_sub_op_reply(client.98909.0:8473937 2.18 916b9c18/rb.0.5298.2ae8944a.00000000066d/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:17.530481 7fdde6fb6700  0 log [WRN] : slow request 69.263155 seconds old, received at 2013-06-08 20:24:08.267266: osd_sub_op_reply(client.98909.0:8473931 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:18.530628 7fdde6fb6700  0 log [WRN] : 62 slow requests, 6 included below; oldest blocked for > 72.771744 secs
2013-06-08 20:25:18.530634 7fdde6fb6700  0 log [WRN] : slow request 70.263250 seconds old, received at 2013-06-08 20:24:08.267337: osd_sub_op_reply(client.98909.0:8473942 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:18.530637 7fdde6fb6700  0 log [WRN] : slow request 70.263237 seconds old, received at 2013-06-08 20:24:08.267350: osd_sub_op_reply(client.98909.0:8473943 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:18.530640 7fdde6fb6700  0 log [WRN] : slow request 70.263203 seconds old, received at 2013-06-08 20:24:08.267384: osd_sub_op_reply(client.98909.0:8473944 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:18.530642 7fdde6fb6700  0 log [WRN] : slow request 70.263189 seconds old, received at 2013-06-08 20:24:08.267398: osd_sub_op_reply(client.98909.0:8473945 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:18.530643 7fdde6fb6700  0 log [WRN] : slow request 70.263175 seconds old, received at 2013-06-08 20:24:08.267412: osd_sub_op_reply(client.98909.0:8473949 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:19.530822 7fdde6fb6700  0 log [WRN] : 67 slow requests, 6 included below; oldest blocked for > 73.771938 secs
2013-06-08 20:25:19.530828 7fdde6fb6700  0 log [WRN] : slow request 71.263263 seconds old, received at 2013-06-08 20:24:08.267518: osd_sub_op_reply(client.98909.0:8473950 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:19.530831 7fdde6fb6700  0 log [WRN] : slow request 71.263234 seconds old, received at 2013-06-08 20:24:08.267547: osd_sub_op_reply(client.98909.0:8473951 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:19.530834 7fdde6fb6700  0 log [WRN] : slow request 71.263218 seconds old, received at 2013-06-08 20:24:08.267563: osd_sub_op_reply(client.98909.0:8473952 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:19.530836 7fdde6fb6700  0 log [WRN] : slow request 71.263179 seconds old, received at 2013-06-08 20:24:08.267602: osd_sub_op_reply(client.98909.0:8473953 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:19.530838 7fdde6fb6700  0 log [WRN] : slow request 71.263164 seconds old, received at 2013-06-08 20:24:08.267617: osd_sub_op_reply(client.98909.0:8473954 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:19.748867 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:19.748887 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:20.531008 7fdde6fb6700  0 log [WRN] : 72 slow requests, 6 included below; oldest blocked for > 74.772124 secs
2013-06-08 20:25:20.531018 7fdde6fb6700  0 log [WRN] : slow request 72.263271 seconds old, received at 2013-06-08 20:24:08.267696: osd_sub_op_reply(client.98909.0:8473955 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:20.531021 7fdde6fb6700  0 log [WRN] : slow request 72.263230 seconds old, received at 2013-06-08 20:24:08.267737: osd_sub_op_reply(client.98909.0:8473956 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:20.531023 7fdde6fb6700  0 log [WRN] : slow request 72.263209 seconds old, received at 2013-06-08 20:24:08.267758: osd_sub_op_reply(client.98909.0:8473957 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:20.531025 7fdde6fb6700  0 log [WRN] : slow request 72.263177 seconds old, received at 2013-06-08 20:24:08.267790: osd_sub_op_reply(client.98909.0:8473958 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:20.531027 7fdde6fb6700  0 log [WRN] : slow request 72.263162 seconds old, received at 2013-06-08 20:24:08.267805: osd_sub_op_reply(client.98909.0:8473959 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:21.531171 7fdde6fb6700  0 log [WRN] : 77 slow requests, 6 included below; oldest blocked for > 75.772284 secs
2013-06-08 20:25:21.531178 7fdde6fb6700  0 log [WRN] : slow request 73.262730 seconds old, received at 2013-06-08 20:24:08.268397: osd_sub_op_reply(client.98909.0:8473960 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:21.531180 7fdde6fb6700  0 log [WRN] : slow request 73.262700 seconds old, received at 2013-06-08 20:24:08.268427: osd_sub_op_reply(client.98909.0:8473961 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:21.531182 7fdde6fb6700  0 log [WRN] : slow request 73.262685 seconds old, received at 2013-06-08 20:24:08.268442: osd_sub_op_reply(client.98909.0:8473962 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:21.531184 7fdde6fb6700  0 log [WRN] : slow request 73.262668 seconds old, received at 2013-06-08 20:24:08.268459: osd_sub_op_reply(client.98909.0:8473963 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:21.531186 7fdde6fb6700  0 log [WRN] : slow request 73.262640 seconds old, received at 2013-06-08 20:24:08.268487: osd_sub_op_reply(client.98909.0:8473964 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:22.531326 7fdde6fb6700  0 log [WRN] : 82 slow requests, 6 included below; oldest blocked for > 76.772440 secs
2013-06-08 20:25:22.531331 7fdde6fb6700  0 log [WRN] : slow request 74.262783 seconds old, received at 2013-06-08 20:24:08.268500: osd_sub_op_reply(client.98909.0:8473965 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:22.531335 7fdde6fb6700  0 log [WRN] : slow request 74.262770 seconds old, received at 2013-06-08 20:24:08.268513: osd_sub_op_reply(client.98909.0:8473966 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:22.531337 7fdde6fb6700  0 log [WRN] : slow request 74.262755 seconds old, received at 2013-06-08 20:24:08.268528: osd_sub_op_reply(client.98909.0:8473967 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:22.531339 7fdde6fb6700  0 log [WRN] : slow request 74.262741 seconds old, received at 2013-06-08 20:24:08.268542: osd_sub_op_reply(client.98909.0:8473968 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:22.531341 7fdde6fb6700  0 log [WRN] : slow request 74.262728 seconds old, received at 2013-06-08 20:24:08.268555: osd_sub_op_reply(client.98909.0:8473969 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:23.531483 7fdde6fb6700  0 log [WRN] : 87 slow requests, 6 included below; oldest blocked for > 77.772597 secs
2013-06-08 20:25:23.531489 7fdde6fb6700  0 log [WRN] : slow request 75.262861 seconds old, received at 2013-06-08 20:24:08.268579: osd_sub_op_reply(client.98909.0:8473970 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:23.531492 7fdde6fb6700  0 log [WRN] : slow request 75.262843 seconds old, received at 2013-06-08 20:24:08.268597: osd_sub_op_reply(client.98909.0:8473971 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:23.531494 7fdde6fb6700  0 log [WRN] : slow request 75.262810 seconds old, received at 2013-06-08 20:24:08.268630: osd_sub_op_reply(client.98909.0:8473972 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:23.531496 7fdde6fb6700  0 log [WRN] : slow request 75.262714 seconds old, received at 2013-06-08 20:24:08.268726: osd_sub_op_reply(client.98909.0:8474085 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:23.531498 7fdde6fb6700  0 log [WRN] : slow request 75.262678 seconds old, received at 2013-06-08 20:24:08.268762: osd_sub_op_reply(client.98909.0:8474086 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:24.531637 7fdde6fb6700  0 log [WRN] : 92 slow requests, 6 included below; oldest blocked for > 78.772751 secs
2013-06-08 20:25:24.531644 7fdde6fb6700  0 log [WRN] : slow request 76.262813 seconds old, received at 2013-06-08 20:24:08.268781: osd_sub_op_reply(client.98909.0:8474087 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:24.531646 7fdde6fb6700  0 log [WRN] : slow request 76.262788 seconds old, received at 2013-06-08 20:24:08.268806: osd_sub_op_reply(client.98909.0:8474089 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:24.531648 7fdde6fb6700  0 log [WRN] : slow request 76.262775 seconds old, received at 2013-06-08 20:24:08.268819: osd_sub_op_reply(client.98909.0:8474090 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:24.531650 7fdde6fb6700  0 log [WRN] : slow request 76.262710 seconds old, received at 2013-06-08 20:24:08.268884: osd_sub_op_reply(client.98909.0:8474091 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:24.531652 7fdde6fb6700  0 log [WRN] : slow request 76.262680 seconds old, received at 2013-06-08 20:24:08.268914: osd_sub_op_reply(client.98909.0:8474092 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:24.748957 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:24.748978 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:25.531838 7fdde6fb6700  0 log [WRN] : 97 slow requests, 6 included below; oldest blocked for > 79.772942 secs
2013-06-08 20:25:25.531847 7fdde6fb6700  0 log [WRN] : slow request 77.262853 seconds old, received at 2013-06-08 20:24:08.268932: osd_sub_op_reply(client.98909.0:8474093 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:25.531850 7fdde6fb6700  0 log [WRN] : slow request 77.262836 seconds old, received at 2013-06-08 20:24:08.268949: osd_sub_op_reply(client.98909.0:8474094 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:25.531852 7fdde6fb6700  0 log [WRN] : slow request 77.262809 seconds old, received at 2013-06-08 20:24:08.268976: osd_sub_op_reply(client.98909.0:8474095 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:25.531854 7fdde6fb6700  0 log [WRN] : slow request 77.262796 seconds old, received at 2013-06-08 20:24:08.268989: osd_sub_op_reply(client.98909.0:8474096 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:25.531856 7fdde6fb6700  0 log [WRN] : slow request 77.262771 seconds old, received at 2013-06-08 20:24:08.269014: osd_sub_op_reply(client.98909.0:8474097 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:26.532013 7fdde6fb6700  0 log [WRN] : 102 slow requests, 6 included below; oldest blocked for > 80.773115 secs
2013-06-08 20:25:26.532019 7fdde6fb6700  0 log [WRN] : slow request 78.262925 seconds old, received at 2013-06-08 20:24:08.269033: osd_sub_op_reply(client.98909.0:8474098 2.ca 1047ecca/rb.0.5298.2ae8944a.000000000457/head//2 [] ondisk, result = 0) v1 currently no flag points reached
2013-06-08 20:25:26.532021 7fdde6fb6700  0 log [WRN] : slow request 78.089808 seconds old, received at 2013-06-08 20:24:08.442150: osd_op(client.91142.1:1878319 rb.0.1.000000000703 [write 2101248~4096] 2.1e3864bb e4628) currently no flag points reached
2013-06-08 20:25:26.532023 7fdde6fb6700  0 log [WRN] : slow request 78.027774 seconds old, received at 2013-06-08 20:24:08.504184: osd_op(client.91121.1:1825683 rb.0.1.0000000063cb [read 3760128~4096] 2.4bf54cda e4628) currently no flag points reached
2013-06-08 20:25:26.532026 7fdde6fb6700  0 log [WRN] : slow request 77.986870 seconds old, received at 2013-06-08 20:24:08.545088: osd_op(client.106364.0:485491 rb.0.598c.2ae8944a.00000002943e [write 368128~4096] 2.d2964d1e e4628) v4 currently no flag points reached
2013-06-08 20:25:26.532028 7fdde6fb6700  0 log [WRN] : slow request 77.986790 seconds old, received at 2013-06-08 20:24:08.545168: osd_op(client.106364.0:485492 rb.0.598c.2ae8944a.00000002943e [write 474624~4096] 2.d2964d1e e4628) v4 currently no flag points reached
2013-06-08 20:25:27.532172 7fdde6fb6700  0 log [WRN] : 107 slow requests, 6 included below; oldest blocked for > 81.773278 secs
2013-06-08 20:25:27.532181 7fdde6fb6700  0 log [WRN] : slow request 78.986830 seconds old, received at 2013-06-08 20:24:08.545291: osd_op(client.106364.0:485493 rb.0.598c.2ae8944a.00000002943e [write 794112~4096] 2.d2964d1e e4628) v4 currently no flag points reached
2013-06-08 20:25:27.532183 7fdde6fb6700  0 log [WRN] : slow request 78.986164 seconds old, received at 2013-06-08 20:24:08.545957: osd_sub_op(client.106364.0:485497 2.43 e665ea43/rb.0.598c.2ae8944a.000000029430/head//2 [] v 4628'4106317 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:27.532186 7fdde6fb6700  0 log [WRN] : slow request 78.986066 seconds old, received at 2013-06-08 20:24:08.546055: osd_sub_op(client.106364.0:485496 2.e4 7da6ebe4/rb.0.598c.2ae8944a.000000001008/head//2 [] v 4628'2349443 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:27.532189 7fdde6fb6700  0 log [WRN] : slow request 78.985742 seconds old, received at 2013-06-08 20:24:08.546379: osd_sub_op(client.106364.0:485490 2.b4 4d2a33b4/rb.0.598c.2ae8944a.000000029431/head//2 [] v 4628'2052017 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:27.532191 7fdde6fb6700  0 log [WRN] : slow request 77.512805 seconds old, received at 2013-06-08 20:24:10.019316: osd_op(client.61605.0:20616273 rb.0.5958.74b0dc51.000000039228 [write 2616832~4096] 2.4e341267 e4628) v4 currently no flag points reached
2013-06-08 20:25:28.532373 7fdde6fb6700  0 log [WRN] : 112 slow requests, 6 included below; oldest blocked for > 82.773480 secs
2013-06-08 20:25:28.532378 7fdde6fb6700  0 log [WRN] : slow request 78.511570 seconds old, received at 2013-06-08 20:24:10.020753: osd_sub_op(client.61605.0:20616274 2.c5 5c748ac5/rb.0.5958.74b0dc51.00000003cdcf/head//2 [] v 4628'1152143 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:28.532382 7fdde6fb6700  0 log [WRN] : slow request 78.334709 seconds old, received at 2013-06-08 20:24:10.197614: osd_op(client.91121.1:1825686 rb.0.1.0000000000f2 [write 839680~16384] 2.8682003f e4628) currently no flag points reached
2013-06-08 20:25:28.532384 7fdde6fb6700  0 log [WRN] : slow request 77.906461 seconds old, received at 2013-06-08 20:24:10.625862: osd_sub_op(client.106364.0:485499 2.1c 977d4e1c/rb.0.598c.2ae8944a.000000028cef/head//2 [] v 4628'2456504 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:28.532387 7fdde6fb6700  0 log [WRN] : slow request 77.906270 seconds old, received at 2013-06-08 20:24:10.626053: osd_sub_op(client.106364.0:485501 2.1c bf149f1c/rb.0.598c.2ae8944a.0000000017e8/head//2 [] v 4628'2456505 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:28.532389 7fdde6fb6700  0 log [WRN] : slow request 77.348955 seconds old, received at 2013-06-08 20:24:11.183368: osd_op(client.98909.0:8474112 rb.0.5298.2ae8944a.000000000000 [write 32256~8192] 2.267feaa8 e4628) v4 currently no flag points reached
2013-06-08 20:25:29.532574 7fdde6fb6700  0 log [WRN] : 117 slow requests, 6 included below; oldest blocked for > 83.773678 secs
2013-06-08 20:25:29.532579 7fdde6fb6700  0 log [WRN] : slow request 78.349071 seconds old, received at 2013-06-08 20:24:11.183450: osd_op(client.98909.0:8474117 rb.0.5298.2ae8944a.000000000460 [write 32256~4096] 2.350f976f e4628) v4 currently no flag points reached
2013-06-08 20:25:29.532582 7fdde6fb6700  0 log [WRN] : slow request 78.349027 seconds old, received at 2013-06-08 20:24:11.183494: osd_op(client.98909.0:8474121 rb.0.5298.2ae8944a.0000000006c0 [write 32256~4096] 2.1c213d41 e4628) v4 currently no flag points reached
2013-06-08 20:25:29.532584 7fdde6fb6700  0 log [WRN] : slow request 78.348304 seconds old, received at 2013-06-08 20:24:11.184217: osd_sub_op(client.98909.0:8474118 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239475 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:29.532591 7fdde6fb6700  0 log [WRN] : slow request 78.348230 seconds old, received at 2013-06-08 20:24:11.184291: osd_sub_op(client.98909.0:8474122 2.5a c6509d5a/rb.0.5298.2ae8944a.0000000006cc/head//2 [] v 4628'6887380 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:29.532593 7fdde6fb6700  0 log [WRN] : slow request 78.348148 seconds old, received at 2013-06-08 20:24:11.184373: osd_sub_op(client.98909.0:8474119 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239476 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:29.749045 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:29.749065 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:30.532742 7fdde6fb6700  0 log [WRN] : 122 slow requests, 6 included below; oldest blocked for > 84.773848 secs
2013-06-08 20:25:30.532747 7fdde6fb6700  0 log [WRN] : slow request 79.348126 seconds old, received at 2013-06-08 20:24:11.184565: osd_sub_op(client.98909.0:8474131 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239477 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:30.532750 7fdde6fb6700  0 log [WRN] : slow request 79.347974 seconds old, received at 2013-06-08 20:24:11.184717: osd_sub_op(client.98909.0:8474132 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239478 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:30.532752 7fdde6fb6700  0 log [WRN] : slow request 79.347854 seconds old, received at 2013-06-08 20:24:11.184837: osd_sub_op(client.98909.0:8474133 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239479 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:30.532759 7fdde6fb6700  0 log [WRN] : slow request 79.347740 seconds old, received at 2013-06-08 20:24:11.184951: osd_sub_op(client.98909.0:8474134 2.dc ced1a3dc/rb.0.5298.2ae8944a.000000000660/head//2 [] v 4628'3239480 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:30.532761 7fdde6fb6700  0 log [WRN] : slow request 79.347801 seconds old, received at 2013-06-08 20:24:11.184890: osd_sub_op(client.98909.0:8474116 2.43 7c48e843/rb.0.5298.2ae8944a.00000000041c/head//2 [] v 4628'4106318 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:31.532900 7fdde6fb6700  0 log [WRN] : 127 slow requests, 6 included below; oldest blocked for > 85.774010 secs
2013-06-08 20:25:31.532905 7fdde6fb6700  0 log [WRN] : slow request 79.233436 seconds old, received at 2013-06-08 20:24:12.299417: osd_op(client.106359.0:382678 rb.0.c46a.2ae8944a.0000000028cc [write 3526656~8192] 2.da0d6e5c e4628) v4 currently no flag points reached
2013-06-08 20:25:31.532908 7fdde6fb6700  0 log [WRN] : slow request 79.233337 seconds old, received at 2013-06-08 20:24:12.299516: osd_op(client.106359.0:382680 rb.0.c46a.2ae8944a.0000000028de [write 139264~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:31.532910 7fdde6fb6700  0 log [WRN] : slow request 79.233284 seconds old, received at 2013-06-08 20:24:12.299569: osd_op(client.106359.0:382681 rb.0.c46a.2ae8944a.0000000028de [write 180224~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:31.532912 7fdde6fb6700  0 log [WRN] : slow request 79.233251 seconds old, received at 2013-06-08 20:24:12.299602: osd_op(client.106359.0:382683 rb.0.c46a.2ae8944a.0000000028ce [write 3846144~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:31.532914 7fdde6fb6700  0 log [WRN] : slow request 79.233218 seconds old, received at 2013-06-08 20:24:12.299635: osd_op(client.106359.0:382684 rb.0.c46a.2ae8944a.0000000028ce [write 4173824~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:32.533042 7fdde6fb6700  0 log [WRN] : 132 slow requests, 6 included below; oldest blocked for > 86.774151 secs
2013-06-08 20:25:32.533047 7fdde6fb6700  0 log [WRN] : slow request 80.233051 seconds old, received at 2013-06-08 20:24:12.299943: osd_op(client.106359.0:382687 rb.0.c46a.2ae8944a.0000000028de [write 16384~8192] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:32.533050 7fdde6fb6700  0 log [WRN] : slow request 80.232919 seconds old, received at 2013-06-08 20:24:12.300075: osd_op(client.106359.0:382688 rb.0.c46a.2ae8944a.0000000028de [write 49152~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:32.533052 7fdde6fb6700  0 log [WRN] : slow request 80.232846 seconds old, received at 2013-06-08 20:24:12.300148: osd_op(client.106359.0:382689 rb.0.c46a.2ae8944a.0000000028de [write 110592~8192] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:32.533054 7fdde6fb6700  0 log [WRN] : slow request 80.232731 seconds old, received at 2013-06-08 20:24:12.300263: osd_op(client.106359.0:382690 rb.0.c46a.2ae8944a.0000000028de [write 159744~8192] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:32.533059 7fdde6fb6700  0 log [WRN] : slow request 80.232547 seconds old, received at 2013-06-08 20:24:12.300447: osd_op(client.106359.0:382695 rb.0.c46a.2ae8944a.0000000028cc [write 65536~4096] 2.da0d6e5c e4628) v4 currently no flag points reached
2013-06-08 20:25:33.533204 7fdde6fb6700  0 log [WRN] : 137 slow requests, 6 included below; oldest blocked for > 87.774311 secs
2013-06-08 20:25:33.533211 7fdde6fb6700  0 log [WRN] : slow request 81.232678 seconds old, received at 2013-06-08 20:24:12.300476: osd_op(client.106359.0:382699 rb.0.c46a.2ae8944a.0000000028ce [write 2859008~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:33.533214 7fdde6fb6700  0 log [WRN] : slow request 81.232696 seconds old, received at 2013-06-08 20:24:12.300458: osd_sub_op(client.106359.0:382691 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594319 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:33.533217 7fdde6fb6700  0 log [WRN] : slow request 81.232647 seconds old, received at 2013-06-08 20:24:12.300507: osd_op(client.106359.0:382700 rb.0.c46a.2ae8944a.0000000028ce [write 3604480~4096] 2.1c000c73 e4628) v4 currently no flag points reached
2013-06-08 20:25:33.533219 7fdde6fb6700  0 log [WRN] : slow request 81.232564 seconds old, received at 2013-06-08 20:24:12.300590: osd_op(client.106359.0:382704 rb.0.c46a.2ae8944a.0000000028de [write 151552~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:33.533221 7fdde6fb6700  0 log [WRN] : slow request 81.232535 seconds old, received at 2013-06-08 20:24:12.300619: osd_op(client.106359.0:382705 rb.0.c46a.2ae8944a.0000000028de [write 172032~4096] 2.9f499ca8 e4628) v4 currently no flag points reached
2013-06-08 20:25:34.533407 7fdde6fb6700  0 log [WRN] : 142 slow requests, 6 included below; oldest blocked for > 88.774511 secs
2013-06-08 20:25:34.533412 7fdde6fb6700  0 log [WRN] : slow request 82.232733 seconds old, received at 2013-06-08 20:24:12.300621: osd_sub_op(client.106359.0:382692 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594320 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:34.533416 7fdde6fb6700  0 log [WRN] : slow request 82.232747 seconds old, received at 2013-06-08 20:24:12.300607: osd_sub_op(client.106359.0:382696 2.d1 d586d0d1/rb.0.c46a.2ae8944a.000000002871/head//2 [] v 4628'3872773 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:34.533418 7fdde6fb6700  0 log [WRN] : slow request 82.232600 seconds old, received at 2013-06-08 20:24:12.300754: osd_sub_op(client.106359.0:382693 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594321 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:34.533420 7fdde6fb6700  0 log [WRN] : slow request 82.232413 seconds old, received at 2013-06-08 20:24:12.300941: osd_sub_op(client.106359.0:382694 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594322 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:34.533422 7fdde6fb6700  0 log [WRN] : slow request 82.232700 seconds old, received at 2013-06-08 20:24:12.300654: osd_op(client.106359.0:382707 rb.0.c46a.2ae8944a.000000002627 [write 4067328~90112] 2.a596c324 e4628) v4 currently no flag points reached
2013-06-08 20:25:34.749162 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:34.749183 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:35.533575 7fdde6fb6700  0 log [WRN] : 147 slow requests, 6 included below; oldest blocked for > 89.774679 secs
2013-06-08 20:25:35.533580 7fdde6fb6700  0 log [WRN] : slow request 83.232008 seconds old, received at 2013-06-08 20:24:12.301514: osd_sub_op(client.106359.0:382706 2.1a 9a85f51a/rb.0.c46a.2ae8944a.000000002899/head//2 [] v 4628'1016784 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:35.533583 7fdde6fb6700  0 log [WRN] : slow request 82.810808 seconds old, received at 2013-06-08 20:24:12.722714: osd_sub_op(client.106339.0:50104 2.b7 143f28b7/rb.0.2b91.427e3a13.000000000a43/head//2 [] v 4628'3297964 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:35.533586 7fdde6fb6700  0 log [WRN] : slow request 82.758102 seconds old, received at 2013-06-08 20:24:12.775420: osd_op(client.91142.1:1878330 rb.0.1.0000000069a0 [read 1724416~4096] 2.3bd597d5 e4628) currently no flag points reached
2013-06-08 20:25:35.533588 7fdde6fb6700  0 log [WRN] : slow request 82.239564 seconds old, received at 2013-06-08 20:24:13.293958: osd_op(client.91121.1:1825704 rb.0.1.00000000725b [write 2666496~4096] 2.bbd0223f e4628) currently no flag points reached
2013-06-08 20:25:35.533589 7fdde6fb6700  0 log [WRN] : slow request 82.239512 seconds old, received at 2013-06-08 20:24:13.294010: osd_op(client.91121.1:1825705 rb.0.1.00000000725b [write 2695168~4096] 2.bbd0223f e4628) currently no flag points reached
2013-06-08 20:25:36.533751 7fdde6fb6700  0 log [WRN] : 152 slow requests, 6 included below; oldest blocked for > 90.774856 secs
2013-06-08 20:25:36.533757 7fdde6fb6700  0 log [WRN] : slow request 83.239674 seconds old, received at 2013-06-08 20:24:13.294025: osd_op(client.91121.1:1825708 rb.0.1.000000007877 [write 2101248~4096] 2.5151018 e4628) currently no flag points reached
2013-06-08 20:25:36.533759 7fdde6fb6700  0 log [WRN] : slow request 83.239515 seconds old, received at 2013-06-08 20:24:13.294184: osd_op(client.91121.1:1825709 rb.0.1.000000007877 [write 2109440~4096] 2.5151018 e4628) currently no flag points reached
2013-06-08 20:25:36.533761 7fdde6fb6700  0 log [WRN] : slow request 83.239499 seconds old, received at 2013-06-08 20:24:13.294200: osd_op(client.91121.1:1825713 rb.0.1.000000000930 [write 929792~4096] 2.994e0641 e4628) currently no flag points reached
2013-06-08 20:25:36.533763 7fdde6fb6700  0 log [WRN] : slow request 83.239144 seconds old, received at 2013-06-08 20:24:13.294555: osd_sub_op(client.91121.1:1825706 2.19 8c8e0219/rb.0.1.000000007544/head//2 [] v 4628'1217259 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:36.533765 7fdde6fb6700  0 log [WRN] : slow request 83.239028 seconds old, received at 2013-06-08 20:24:13.294671: osd_sub_op(client.91121.1:1825707 2.19 8c8e0219/rb.0.1.000000007544/head//2 [] v 4628'1217260 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:37.533942 7fdde6fb6700  0 log [WRN] : 156 slow requests, 6 included below; oldest blocked for > 91.775045 secs
2013-06-08 20:25:37.533951 7fdde6fb6700  0 log [WRN] : slow request 84.239217 seconds old, received at 2013-06-08 20:24:13.294671: osd_sub_op(client.91121.1:1825707 2.19 8c8e0219/rb.0.1.000000007544/head//2 [] v 4628'1217260 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:37.533954 7fdde6fb6700  0 log [WRN] : slow request 84.049746 seconds old, received at 2013-06-08 20:24:13.484142: osd_sub_op(client.61605.0:20616283 2.2a fd0a172a/rb.0.5958.74b0dc51.00000003ab25/head//2 [] v 4628'2817388 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:37.533957 7fdde6fb6700  0 log [WRN] : slow request 83.108469 seconds old, received at 2013-06-08 20:24:14.425419: osd_op(client.106018.0:54447 rb.0.4c40.2ae8944a.0000000001b4 [write 1052672~4096] 2.eb66214b e4628) v4 currently no flag points reached
2013-06-08 20:25:37.533958 7fdde6fb6700  0 log [WRN] : slow request 83.107669 seconds old, received at 2013-06-08 20:24:14.426219: osd_sub_op(client.106018.0:54448 2.53 536e5253/rb.0.4c40.2ae8944a.0000000004b4/head//2 [] v 4628'1973565 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:37.533962 7fdde6fb6700  0 log [WRN] : slow request 82.343574 seconds old, received at 2013-06-08 20:24:15.190314: osd_sub_op(client.98909.0:8474209 2.43 7c48e843/rb.0.5298.2ae8944a.00000000041c/head//2 [] v 4628'4106319 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:38.534116 7fdde6fb6700  0 log [WRN] : 157 slow requests, 6 included below; oldest blocked for > 92.775218 secs
2013-06-08 20:25:38.534122 7fdde6fb6700  0 log [WRN] : slow request 85.049919 seconds old, received at 2013-06-08 20:24:13.484142: osd_sub_op(client.61605.0:20616283 2.2a fd0a172a/rb.0.5958.74b0dc51.00000003ab25/head//2 [] v 4628'2817388 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:38.534125 7fdde6fb6700  0 log [WRN] : slow request 84.108642 seconds old, received at 2013-06-08 20:24:14.425419: osd_op(client.106018.0:54447 rb.0.4c40.2ae8944a.0000000001b4 [write 1052672~4096] 2.eb66214b e4628) v4 currently no flag points reached
2013-06-08 20:25:38.534127 7fdde6fb6700  0 log [WRN] : slow request 84.107842 seconds old, received at 2013-06-08 20:24:14.426219: osd_sub_op(client.106018.0:54448 2.53 536e5253/rb.0.4c40.2ae8944a.0000000004b4/head//2 [] v 4628'1973565 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:38.534129 7fdde6fb6700  0 log [WRN] : slow request 83.343747 seconds old, received at 2013-06-08 20:24:15.190314: osd_sub_op(client.98909.0:8474209 2.43 7c48e843/rb.0.5298.2ae8944a.00000000041c/head//2 [] v 4628'4106319 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:38.534131 7fdde6fb6700  0 log [WRN] : slow request 81.863303 seconds old, received at 2013-06-08 20:24:16.670758: osd_sub_op(client.106329.0:577428 2.1c 2c50511c/rb.0.3648.2ae8944a.0000000091a0/head//2 [] v 4628'2456506 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:39.534283 7fdde6fb6700  0 log [WRN] : 161 slow requests, 6 included below; oldest blocked for > 93.775385 secs
2013-06-08 20:25:39.534288 7fdde6fb6700  0 log [WRN] : slow request 82.863470 seconds old, received at 2013-06-08 20:24:16.670758: osd_sub_op(client.106329.0:577428 2.1c 2c50511c/rb.0.3648.2ae8944a.0000000091a0/head//2 [] v 4628'2456506 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:39.534292 7fdde6fb6700  0 log [WRN] : slow request 82.863324 seconds old, received at 2013-06-08 20:24:16.670904: osd_sub_op(client.106329.0:577429 2.1c 2c50511c/rb.0.3648.2ae8944a.0000000091a0/head//2 [] v 4628'2456507 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:39.534294 7fdde6fb6700  0 log [WRN] : slow request 82.863169 seconds old, received at 2013-06-08 20:24:16.671059: osd_sub_op(client.106329.0:577430 2.1c 2c50511c/rb.0.3648.2ae8944a.0000000091a0/head//2 [] v 4628'2456508 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:39.534296 7fdde6fb6700  0 log [WRN] : slow request 81.959167 seconds old, received at 2013-06-08 20:24:17.575061: osd_sub_op(client.106354.0:257625 2.2a a08f8d2a/rb.0.2b3d.2094edc6.00000000274e/head//2 [] v 4628'2817389 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:39.534298 7fdde6fb6700  0 log [WRN] : slow request 81.232446 seconds old, received at 2013-06-08 20:24:18.301782: osd_sub_op(client.106359.0:382713 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594323 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:39.749239 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:39.749260 7fdde8eec700  1 heartbeat_map is_healthy 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:40.534451 7fdde6fb6700  0 log [WRN] : 162 slow requests, 6 included below; oldest blocked for > 94.775554 secs
2013-06-08 20:25:40.534456 7fdde6fb6700  0 log [WRN] : slow request 83.863493 seconds old, received at 2013-06-08 20:24:16.670904: osd_sub_op(client.106329.0:577429 2.1c 2c50511c/rb.0.3648.2ae8944a.0000000091a0/head//2 [] v 4628'2456507 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:40.534463 7fdde6fb6700  0 log [WRN] : slow request 83.863338 seconds old, received at 2013-06-08 20:24:16.671059: osd_sub_op(client.106329.0:577430 2.1c 2c50511c/rb.0.3648.2ae8944a.0000000091a0/head//2 [] v 4628'2456508 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:40.534465 7fdde6fb6700  0 log [WRN] : slow request 82.959336 seconds old, received at 2013-06-08 20:24:17.575061: osd_sub_op(client.106354.0:257625 2.2a a08f8d2a/rb.0.2b3d.2094edc6.00000000274e/head//2 [] v 4628'2817389 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:40.534467 7fdde6fb6700  0 log [WRN] : slow request 82.232615 seconds old, received at 2013-06-08 20:24:18.301782: osd_sub_op(client.106359.0:382713 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594323 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:40.534469 7fdde6fb6700  0 log [WRN] : slow request 82.232449 seconds old, received at 2013-06-08 20:24:18.301948: osd_sub_op(client.106359.0:382708 2.1a 9a85f51a/rb.0.c46a.2ae8944a.000000002899/head//2 [] v 4628'1016785 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:41.534623 7fdde6fb6700  0 log [WRN] : 166 slow requests, 6 included below; oldest blocked for > 95.775726 secs
2013-06-08 20:25:41.534628 7fdde6fb6700  0 log [WRN] : slow request 83.232621 seconds old, received at 2013-06-08 20:24:18.301948: osd_sub_op(client.106359.0:382708 2.1a 9a85f51a/rb.0.c46a.2ae8944a.000000002899/head//2 [] v 4628'1016785 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:41.534636 7fdde6fb6700  0 log [WRN] : slow request 83.232515 seconds old, received at 2013-06-08 20:24:18.302054: osd_sub_op(client.106359.0:382722 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594324 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:41.534638 7fdde6fb6700  0 log [WRN] : slow request 83.232413 seconds old, received at 2013-06-08 20:24:18.302156: osd_sub_op(client.106359.0:382723 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594325 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:41.534645 7fdde6fb6700  0 log [WRN] : slow request 83.232351 seconds old, received at 2013-06-08 20:24:18.302218: osd_sub_op(client.106359.0:382724 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594326 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:41.534647 7fdde6fb6700  0 log [WRN] : slow request 83.231900 seconds old, received at 2013-06-08 20:24:18.302669: osd_sub_op(client.106359.0:382741 2.d1 d586d0d1/rb.0.c46a.2ae8944a.000000002871/head//2 [] v 4628'3872774 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:41.762810 7fddd6f21700  1 heartbeat_map reset_timeout 'OSD::op_tp thread 0x7fddd6f21700' had timed out after 15
2013-06-08 20:25:41.764490 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51859 s=2 pgs=23052 cs=3973 l=0).fault, initiating reconnect
2013-06-08 20:25:41.765603 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51860 s=2 pgs=23053 cs=3975 l=0).fault, initiating reconnect
2013-06-08 20:25:41.766777 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51861 s=2 pgs=23054 cs=3977 l=0).fault, initiating reconnect
2013-06-08 20:25:41.767909 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51862 s=2 pgs=23055 cs=3979 l=0).fault, initiating reconnect
2013-06-08 20:25:41.769011 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51863 s=2 pgs=23056 cs=3981 l=0).fault, initiating reconnect
2013-06-08 20:25:41.770246 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51864 s=2 pgs=23057 cs=3983 l=0).fault, initiating reconnect
2013-06-08 20:25:41.771449 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51865 s=2 pgs=23058 cs=3985 l=0).fault, initiating reconnect
2013-06-08 20:25:41.772607 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51866 s=2 pgs=23059 cs=3987 l=0).fault, initiating reconnect
2013-06-08 20:25:41.773739 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51867 s=2 pgs=23060 cs=3989 l=0).fault, initiating reconnect
2013-06-08 20:25:41.774920 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51868 s=2 pgs=23061 cs=3991 l=0).fault, initiating reconnect
2013-06-08 20:25:41.776074 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51869 s=2 pgs=23062 cs=3993 l=0).fault, initiating reconnect
2013-06-08 20:25:41.777158 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51870 s=2 pgs=23063 cs=3995 l=0).fault, initiating reconnect
2013-06-08 20:25:41.778298 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51871 s=2 pgs=23064 cs=3997 l=0).fault, initiating reconnect
2013-06-08 20:25:41.779446 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51872 s=2 pgs=23065 cs=3999 l=0).fault, initiating reconnect
2013-06-08 20:25:41.780570 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51873 s=2 pgs=23066 cs=4001 l=0).fault, initiating reconnect
2013-06-08 20:25:41.781666 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51874 s=2 pgs=23067 cs=4003 l=0).fault, initiating reconnect
2013-06-08 20:25:41.782708 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51875 s=2 pgs=23068 cs=4005 l=0).fault, initiating reconnect
2013-06-08 20:25:41.783757 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51876 s=2 pgs=23069 cs=4007 l=0).fault, initiating reconnect
2013-06-08 20:25:41.784829 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51877 s=2 pgs=23070 cs=4009 l=0).fault, initiating reconnect
2013-06-08 20:25:41.800445 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51878 s=2 pgs=23071 cs=4011 l=0).fault, initiating reconnect
2013-06-08 20:25:41.801805 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51879 s=2 pgs=23072 cs=4013 l=0).fault, initiating reconnect
2013-06-08 20:25:41.802887 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51880 s=2 pgs=23073 cs=4015 l=0).fault, initiating reconnect
2013-06-08 20:25:41.803992 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51881 s=2 pgs=23074 cs=4017 l=0).fault, initiating reconnect
2013-06-08 20:25:41.805043 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51882 s=2 pgs=23075 cs=4019 l=0).fault, initiating reconnect
2013-06-08 20:25:41.806151 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51883 s=2 pgs=23076 cs=4021 l=0).fault, initiating reconnect
2013-06-08 20:25:41.807233 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51884 s=2 pgs=23077 cs=4023 l=0).fault, initiating reconnect
2013-06-08 20:25:41.808349 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51885 s=2 pgs=23078 cs=4025 l=0).fault, initiating reconnect
2013-06-08 20:25:41.809469 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51886 s=2 pgs=23079 cs=4027 l=0).fault, initiating reconnect
2013-06-08 20:25:41.810656 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51887 s=2 pgs=23080 cs=4029 l=0).fault, initiating reconnect
2013-06-08 20:25:41.811803 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51888 s=2 pgs=23081 cs=4031 l=0).fault, initiating reconnect
2013-06-08 20:25:41.812865 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51889 s=2 pgs=23082 cs=4033 l=0).fault, initiating reconnect
2013-06-08 20:25:41.814664 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51890 s=2 pgs=23083 cs=4035 l=0).fault, initiating reconnect
2013-06-08 20:25:41.815782 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51891 s=2 pgs=23084 cs=4037 l=0).fault, initiating reconnect
2013-06-08 20:25:41.817141 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51892 s=2 pgs=23085 cs=4039 l=0).fault, initiating reconnect
2013-06-08 20:25:41.818429 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51893 s=2 pgs=23086 cs=4041 l=0).fault, initiating reconnect
2013-06-08 20:25:41.819766 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51894 s=2 pgs=23087 cs=4043 l=0).fault, initiating reconnect
2013-06-08 20:25:41.821119 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51895 s=2 pgs=23088 cs=4045 l=0).fault, initiating reconnect
2013-06-08 20:25:41.822405 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51896 s=2 pgs=23089 cs=4047 l=0).fault, initiating reconnect
2013-06-08 20:25:41.823575 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51897 s=2 pgs=23090 cs=4049 l=0).fault, initiating reconnect
2013-06-08 20:25:41.824776 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51898 s=2 pgs=23091 cs=4051 l=0).fault, initiating reconnect
2013-06-08 20:25:41.826042 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51899 s=2 pgs=23092 cs=4053 l=0).fault, initiating reconnect
2013-06-08 20:25:41.827506 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51900 s=2 pgs=23093 cs=4055 l=0).fault, initiating reconnect
2013-06-08 20:25:41.829002 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51901 s=2 pgs=23094 cs=4057 l=0).fault, initiating reconnect
2013-06-08 20:25:41.830175 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51902 s=2 pgs=23095 cs=4059 l=0).fault, initiating reconnect
2013-06-08 20:25:41.831484 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51903 s=2 pgs=23096 cs=4061 l=0).fault, initiating reconnect
2013-06-08 20:25:41.832748 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51904 s=2 pgs=23097 cs=4063 l=0).fault, initiating reconnect
2013-06-08 20:25:41.833916 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51905 s=2 pgs=23098 cs=4065 l=0).fault, initiating reconnect
2013-06-08 20:25:41.835043 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51906 s=2 pgs=23099 cs=4067 l=0).fault, initiating reconnect
2013-06-08 20:25:41.836160 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51907 s=2 pgs=23100 cs=4069 l=0).fault, initiating reconnect
2013-06-08 20:25:41.837402 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51908 s=2 pgs=23101 cs=4071 l=0).fault, initiating reconnect
2013-06-08 20:25:41.838619 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51909 s=2 pgs=23102 cs=4073 l=0).fault, initiating reconnect
2013-06-08 20:25:41.839789 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51910 s=2 pgs=23103 cs=4075 l=0).fault, initiating reconnect
2013-06-08 20:25:41.840961 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51911 s=2 pgs=23104 cs=4077 l=0).fault, initiating reconnect
2013-06-08 20:25:41.842209 7fdddfd57700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(445909 rb.0.6d52.238e1f29.00000003c6a2 [write 2354688~4096] ondisk = 0) v4 remote, 10.10.10.4:0/1024698, failed lossy con, dropping message 0xba4fe00
2013-06-08 20:25:41.842238 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51912 s=2 pgs=23105 cs=4079 l=0).fault, initiating reconnect
2013-06-08 20:25:41.842412 7fdddfd57700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(110526 rb.0.14aef.238e1f29.00000000126d [write 3039232~49152] ondisk = 0) v4 remote, 10.10.10.5:0/1021202, failed lossy con, dropping message 0xd40ac00
2013-06-08 20:25:41.843277 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57150 s=2 pgs=22942 cs=4671 l=0).fault, initiating reconnect
2013-06-08 20:25:41.843487 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51913 s=2 pgs=23106 cs=4081 l=0).fault, initiating reconnect
2013-06-08 20:25:41.843672 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57031 s=2 pgs=17412 cs=3487 l=0).fault, initiating reconnect
2013-06-08 20:25:41.844203 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57152 s=2 pgs=22943 cs=4673 l=0).fault, initiating reconnect
2013-06-08 20:25:41.844556 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57034 s=2 pgs=17413 cs=3489 l=0).fault, initiating reconnect
2013-06-08 20:25:41.844627 7fddd6720700  1 heartbeat_map reset_timeout 'OSD::op_tp thread 0x7fddd6720700' had timed out after 15
2013-06-08 20:25:41.844727 7fdddfd57700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473931 rb.0.5298.2ae8944a.000000000457 [write 1572352~20480] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xa960800
2013-06-08 20:25:41.844779 7fdddfd57700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473937 rb.0.5298.2ae8944a.00000000066d [write 1957376~4096] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xbad8000
2013-06-08 20:25:41.844781 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51917 s=2 pgs=23107 cs=4083 l=0).fault, initiating reconnect
2013-06-08 20:25:41.844908 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473942 rb.0.5298.2ae8944a.000000000457 [write 2665984~40960] ack = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xc165600
2013-06-08 20:25:41.844960 7fdddfd57700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473942 rb.0.5298.2ae8944a.000000000457 [write 2665984~40960] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xbad8000
2013-06-08 20:25:41.845057 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473943 rb.0.5298.2ae8944a.000000000457 [write 2739712~45056] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xa646e00
2013-06-08 20:25:41.845082 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :57155 s=2 pgs=22944 cs=4675 l=0).fault, initiating reconnect
2013-06-08 20:25:41.845171 7fdddfd57700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473944 rb.0.5298.2ae8944a.000000000457 [write 2788864~32768] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9f0c800
2013-06-08 20:25:41.845436 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57036 s=2 pgs=17414 cs=3491 l=0).fault, initiating reconnect
2013-06-08 20:25:41.845580 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473945 rb.0.5298.2ae8944a.000000000457 [write 4156928~37376] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xe4ebc00
2013-06-08 20:25:41.845655 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473949 rb.0.5298.2ae8944a.000000000457 [write 2514432~16384] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9f0c600
2013-06-08 20:25:41.845720 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473950 rb.0.5298.2ae8944a.000000000457 [write 2649600~12288] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xd07ee00
2013-06-08 20:25:41.845786 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473951 rb.0.5298.2ae8944a.000000000457 [write 2104832~94208] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xa0f4600
2013-06-08 20:25:41.845845 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473952 rb.0.5298.2ae8944a.000000000457 [write 2203136~16384] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xd29a200
2013-06-08 20:25:41.845906 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :57158 s=2 pgs=22945 cs=4677 l=0).fault, initiating reconnect
2013-06-08 20:25:41.845926 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473953 rb.0.5298.2ae8944a.000000000457 [write 2268672~36864] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xa0f4200
2013-06-08 20:25:41.845986 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473954 rb.0.5298.2ae8944a.000000000457 [write 1797632~8192] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb705400
2013-06-08 20:25:41.846015 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51921 s=2 pgs=23108 cs=4085 l=0).fault, initiating reconnect
2013-06-08 20:25:41.846082 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473955 rb.0.5298.2ae8944a.000000000457 [write 1920512~24576] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xf9dea00
2013-06-08 20:25:41.846136 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473956 rb.0.5298.2ae8944a.000000000457 [write 1949184~32768] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x124e6e00
2013-06-08 20:25:41.846206 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473957 rb.0.5298.2ae8944a.000000000457 [write 1781248~12288] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xab0f400
2013-06-08 20:25:41.846257 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473958 rb.0.5298.2ae8944a.000000000457 [write 1711616~16384] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xea98400
2013-06-08 20:25:41.846307 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473959 rb.0.5298.2ae8944a.000000000457 [write 1732096~40960] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x4b24c00
2013-06-08 20:25:41.846365 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57039 s=2 pgs=17415 cs=3493 l=0).fault, initiating reconnect
2013-06-08 20:25:41.846379 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473960 rb.0.5298.2ae8944a.000000000457 [write 1482240~16384] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xe94dc00
2013-06-08 20:25:41.846459 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473961 rb.0.5298.2ae8944a.000000000457 [write 1510912~32768] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xbce2600
2013-06-08 20:25:41.846511 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473962 rb.0.5298.2ae8944a.000000000457 [write 1551872~16384] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9d45c00
2013-06-08 20:25:41.846566 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473963 rb.0.5298.2ae8944a.000000000457 [write 1633792~73728] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xd36ea00
2013-06-08 20:25:41.846635 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473964 rb.0.5298.2ae8944a.000000000457 [write 1330688~16384] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9ad3800
2013-06-08 20:25:41.846719 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473965 rb.0.5298.2ae8944a.000000000457 [write 1351168~20480] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb06c400
2013-06-08 20:25:41.846722 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57160 s=2 pgs=22946 cs=4679 l=0).fault, initiating reconnect
2013-06-08 20:25:41.846796 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473966 rb.0.5298.2ae8944a.000000000457 [write 1400320~4096] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9d9d200
2013-06-08 20:25:41.846857 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473967 rb.0.5298.2ae8944a.000000000457 [write 1424896~32768] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x6fd2600
2013-06-08 20:25:41.846918 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473968 rb.0.5298.2ae8944a.000000000457 [write 1502720~4096] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x124aee00
2013-06-08 20:25:41.846978 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473969 rb.0.5298.2ae8944a.000000000457 [write 1285632~8192] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x6fd2400
2013-06-08 20:25:41.847085 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473970 rb.0.5298.2ae8944a.000000000457 [write 1297920~28672] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xe314600
2013-06-08 20:25:41.847148 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473971 rb.0.5298.2ae8944a.000000000457 [write 2223616~40960] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xbc22e00
2013-06-08 20:25:41.847197 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51925 s=2 pgs=23109 cs=4087 l=0).fault, initiating reconnect
2013-06-08 20:25:41.847214 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8473972 rb.0.5298.2ae8944a.000000000457 [write 2338304~172032] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x10517c00
2013-06-08 20:25:41.847279 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474085 rb.0.5298.2ae8944a.000000000457 [write 1269248~12288] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9924c00
2013-06-08 20:25:41.847348 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474086 rb.0.5298.2ae8944a.000000000457 [write 1375744~4096] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x10517800
2013-06-08 20:25:41.847400 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474087 rb.0.5298.2ae8944a.000000000457 [write 1408512~8192] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9924600
2013-06-08 20:25:41.847484 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474089 rb.0.5298.2ae8944a.000000000457 [write 1469952~8192] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x10517a00
2013-06-08 20:25:41.847482 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57042 s=2 pgs=17416 cs=3495 l=0).fault, initiating reconnect
2013-06-08 20:25:41.847533 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57163 s=2 pgs=22947 cs=4681 l=0).fault, initiating reconnect
2013-06-08 20:25:41.847555 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474090 rb.0.5298.2ae8944a.000000000457 [write 1596928~24576] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9924000
2013-06-08 20:25:41.847614 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474091 rb.0.5298.2ae8944a.000000000457 [write 1625600~4096] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x10517200
2013-06-08 20:25:41.847665 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474092 rb.0.5298.2ae8944a.000000000457 [write 1809920~45056] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb056000
2013-06-08 20:25:41.847721 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474093 rb.0.5298.2ae8944a.000000000457 [write 1859072~53248] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb68ea00
2013-06-08 20:25:41.847772 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474094 rb.0.5298.2ae8944a.000000000457 [write 2063872~36864] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb056e00
2013-06-08 20:25:41.847845 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474095 rb.0.5298.2ae8944a.000000000457 [write 2309632~24576] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb68e800
2013-06-08 20:25:41.847922 7fddd6720700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474096 rb.0.5298.2ae8944a.000000000457 [write 2534912~28672] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb056a00
2013-06-08 20:25:41.848029 7fddd6f21700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474097 rb.0.5298.2ae8944a.000000000457 [write 2567680~24576] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0xb68ee00
2013-06-08 20:25:41.848205 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57045 s=2 pgs=17417 cs=3497 l=0).fault, initiating reconnect
2013-06-08 20:25:41.848360 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51928 s=2 pgs=23110 cs=4089 l=0).fault, initiating reconnect
2013-06-08 20:25:41.848521 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57166 s=2 pgs=22948 cs=4683 l=0).fault, initiating reconnect
2013-06-08 20:25:41.849002 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57047 s=2 pgs=17418 cs=3499 l=0).fault, initiating reconnect
2013-06-08 20:25:41.849455 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57169 s=2 pgs=22949 cs=4685 l=0).fault, initiating reconnect
2013-06-08 20:25:41.849585 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51932 s=2 pgs=23111 cs=4091 l=0).fault, initiating reconnect
2013-06-08 20:25:41.850090 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57050 s=2 pgs=17419 cs=3501 l=0).fault, initiating reconnect
2013-06-08 20:25:41.850241 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57171 s=2 pgs=22950 cs=4687 l=0).fault, initiating reconnect
2013-06-08 20:25:41.850921 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :51936 s=2 pgs=23112 cs=4093 l=0).fault, initiating reconnect
2013-06-08 20:25:41.851032 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57053 s=2 pgs=17420 cs=3503 l=0).fault, initiating reconnect
2013-06-08 20:25:41.851107 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57174 s=2 pgs=22951 cs=4689 l=0).fault, initiating reconnect
2013-06-08 20:25:41.851779 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57056 s=2 pgs=17421 cs=3505 l=0).fault, initiating reconnect
2013-06-08 20:25:41.851989 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57177 s=2 pgs=22952 cs=4691 l=0).fault, initiating reconnect
2013-06-08 20:25:41.852186 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51939 s=2 pgs=23113 cs=4095 l=0).fault, initiating reconnect
2013-06-08 20:25:41.852547 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57058 s=2 pgs=17422 cs=3507 l=0).fault, initiating reconnect
2013-06-08 20:25:41.852820 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :57179 s=2 pgs=22953 cs=4693 l=0).fault, initiating reconnect
2013-06-08 20:25:41.853426 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51944 s=2 pgs=23114 cs=4097 l=0).fault, initiating reconnect
2013-06-08 20:25:41.853810 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :57182 s=2 pgs=22954 cs=4695 l=0).fault, initiating reconnect
2013-06-08 20:25:41.854592 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57184 s=2 pgs=22955 cs=4697 l=0).fault, initiating reconnect
2013-06-08 20:25:41.854658 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51947 s=2 pgs=23115 cs=4099 l=0).fault, initiating reconnect
2013-06-08 20:25:41.855470 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57185 s=2 pgs=22956 cs=4699 l=0).fault, initiating reconnect
2013-06-08 20:25:41.855763 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51950 s=2 pgs=23116 cs=4101 l=0).fault, initiating reconnect
2013-06-08 20:25:41.856272 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57187 s=2 pgs=22957 cs=4701 l=0).fault, initiating reconnect
2013-06-08 20:25:41.856868 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51952 s=2 pgs=23117 cs=4103 l=0).fault, initiating reconnect
2013-06-08 20:25:41.857191 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57189 s=2 pgs=22958 cs=4703 l=0).fault, initiating reconnect
2013-06-08 20:25:41.857981 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57191 s=2 pgs=22959 cs=4705 l=0).fault, initiating reconnect
2013-06-08 20:25:41.858166 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51954 s=2 pgs=23118 cs=4105 l=0).fault, initiating reconnect
2013-06-08 20:25:41.858796 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57192 s=2 pgs=22960 cs=4707 l=0).fault, initiating reconnect
2013-06-08 20:25:41.859275 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51957 s=2 pgs=23119 cs=4107 l=0).fault, initiating reconnect
2013-06-08 20:25:41.859666 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57194 s=2 pgs=22961 cs=4709 l=0).fault, initiating reconnect
2013-06-08 20:25:41.860465 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51959 s=2 pgs=23120 cs=4109 l=0).fault, initiating reconnect
2013-06-08 20:25:41.860576 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57196 s=2 pgs=22962 cs=4711 l=0).fault, initiating reconnect
2013-06-08 20:25:41.861486 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57198 s=2 pgs=22963 cs=4713 l=0).fault, initiating reconnect
2013-06-08 20:25:41.861619 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51961 s=2 pgs=23121 cs=4111 l=0).fault, initiating reconnect
2013-06-08 20:25:41.862311 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57199 s=2 pgs=22964 cs=4715 l=0).fault, initiating reconnect
2013-06-08 20:25:41.862864 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51964 s=2 pgs=23122 cs=4113 l=0).fault, initiating reconnect
2013-06-08 20:25:41.863218 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57201 s=2 pgs=22965 cs=4717 l=0).fault, initiating reconnect
2013-06-08 20:25:41.864014 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57203 s=2 pgs=22966 cs=4719 l=0).fault, initiating reconnect
2013-06-08 20:25:41.864015 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51966 s=2 pgs=23123 cs=4115 l=0).fault, initiating reconnect
2013-06-08 20:25:41.864838 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57204 s=2 pgs=22967 cs=4721 l=0).fault, initiating reconnect
2013-06-08 20:25:41.865322 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51969 s=2 pgs=23124 cs=4117 l=0).fault, initiating reconnect
2013-06-08 20:25:41.865730 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57206 s=2 pgs=22968 cs=4723 l=0).fault, initiating reconnect
2013-06-08 20:25:41.866626 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57208 s=2 pgs=22969 cs=4725 l=0).fault, initiating reconnect
2013-06-08 20:25:41.866633 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51971 s=2 pgs=23125 cs=4119 l=0).fault, initiating reconnect
2013-06-08 20:25:41.867505 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57210 s=2 pgs=22970 cs=4727 l=0).fault, initiating reconnect
2013-06-08 20:25:41.867827 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51973 s=2 pgs=23126 cs=4121 l=0).fault, initiating reconnect
2013-06-08 20:25:41.868484 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57211 s=2 pgs=22971 cs=4729 l=0).fault, initiating reconnect
2013-06-08 20:25:41.869076 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51976 s=2 pgs=23127 cs=4123 l=0).fault, initiating reconnect
2013-06-08 20:25:41.869390 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57213 s=2 pgs=22972 cs=4731 l=0).fault, initiating reconnect
2013-06-08 20:25:41.870168 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57215 s=2 pgs=22973 cs=4733 l=0).fault, initiating reconnect
2013-06-08 20:25:41.871129 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57216 s=2 pgs=22974 cs=4735 l=0).fault, initiating reconnect
2013-06-08 20:25:41.871358 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51978 s=2 pgs=23128 cs=4125 l=0).fault, initiating reconnect
2013-06-08 20:25:41.872005 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57217 s=2 pgs=22975 cs=4737 l=0).fault, initiating reconnect
2013-06-08 20:25:41.872610 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51982 s=2 pgs=23129 cs=4127 l=0).fault, initiating reconnect
2013-06-08 20:25:41.872906 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57219 s=2 pgs=22976 cs=4739 l=0).fault, initiating reconnect
2013-06-08 20:25:41.873777 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :51984 s=2 pgs=23130 cs=4129 l=0).fault, initiating reconnect
2013-06-08 20:25:41.873782 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57221 s=2 pgs=22977 cs=4741 l=0).fault, initiating reconnect
2013-06-08 20:25:41.874732 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57222 s=2 pgs=22978 cs=4743 l=0).fault, initiating reconnect
2013-06-08 20:25:41.875014 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51986 s=2 pgs=23131 cs=4131 l=0).fault, initiating reconnect
2013-06-08 20:25:41.875256 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57061 s=2 pgs=17423 cs=3509 l=0).fault, initiating reconnect
2013-06-08 20:25:41.875635 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57224 s=2 pgs=22979 cs=4745 l=0).fault, initiating reconnect
2013-06-08 20:25:41.876136 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57106 s=2 pgs=17424 cs=3511 l=0).fault, initiating reconnect
2013-06-08 20:25:41.876332 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51989 s=2 pgs=23132 cs=4133 l=0).fault, initiating reconnect
2013-06-08 20:25:41.876663 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57227 s=2 pgs=22980 cs=4747 l=0).fault, initiating reconnect
2013-06-08 20:25:41.877012 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57108 s=2 pgs=17425 cs=3513 l=0).fault, initiating reconnect
2013-06-08 20:25:41.877532 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57230 s=2 pgs=22981 cs=4749 l=0).fault, initiating reconnect
2013-06-08 20:25:41.877899 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57111 s=2 pgs=17426 cs=3515 l=0).fault, initiating reconnect
2013-06-08 20:25:41.878471 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57232 s=2 pgs=22982 cs=4751 l=0).fault, initiating reconnect
2013-06-08 20:25:41.878787 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57113 s=2 pgs=17427 cs=3517 l=0).fault, initiating reconnect
2013-06-08 20:25:41.879319 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57234 s=2 pgs=22983 cs=4753 l=0).fault, initiating reconnect
2013-06-08 20:25:41.879708 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57115 s=2 pgs=17428 cs=3519 l=0).fault, initiating reconnect
2013-06-08 20:25:41.880265 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57236 s=2 pgs=22984 cs=4755 l=0).fault, initiating reconnect
2013-06-08 20:25:41.880629 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57117 s=2 pgs=17429 cs=3521 l=0).fault, initiating reconnect
2013-06-08 20:25:41.881156 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57238 s=2 pgs=22985 cs=4757 l=0).fault, initiating reconnect
2013-06-08 20:25:41.881480 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57119 s=2 pgs=17430 cs=3523 l=0).fault, initiating reconnect
2013-06-08 20:25:41.882033 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57240 s=2 pgs=22986 cs=4759 l=0).fault, initiating reconnect
2013-06-08 20:25:41.882295 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57121 s=2 pgs=17431 cs=3525 l=0).fault, initiating reconnect
2013-06-08 20:25:41.882982 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57242 s=2 pgs=22987 cs=4761 l=0).fault, initiating reconnect
2013-06-08 20:25:41.883168 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57123 s=2 pgs=17432 cs=3527 l=0).fault, initiating reconnect
2013-06-08 20:25:41.883899 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57244 s=2 pgs=22988 cs=4763 l=0).fault, initiating reconnect
2013-06-08 20:25:41.884087 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57125 s=2 pgs=17433 cs=3529 l=0).fault, initiating reconnect
2013-06-08 20:25:41.884716 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57246 s=2 pgs=22989 cs=4765 l=0).fault, initiating reconnect
2013-06-08 20:25:41.884974 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57127 s=2 pgs=17434 cs=3531 l=0).fault, initiating reconnect
2013-06-08 20:25:41.885801 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57129 s=2 pgs=17435 cs=3533 l=0).fault, initiating reconnect
2013-06-08 20:25:41.886614 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57248 s=2 pgs=22990 cs=4767 l=0).fault, initiating reconnect
2013-06-08 20:25:41.886782 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57130 s=2 pgs=17436 cs=3535 l=0).fault, initiating reconnect
2013-06-08 20:25:41.887542 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57251 s=2 pgs=22991 cs=4769 l=0).fault, initiating reconnect
2013-06-08 20:25:41.887591 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57132 s=2 pgs=17437 cs=3537 l=0).fault, initiating reconnect
2013-06-08 20:25:41.888410 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :57134 s=2 pgs=17438 cs=3539 l=0).fault, initiating reconnect
2013-06-08 20:25:41.888413 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :57253 s=2 pgs=22992 cs=4771 l=0).fault, initiating reconnect
2013-06-08 20:25:41.889190 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57136 s=2 pgs=17439 cs=3541 l=0).fault, initiating reconnect
2013-06-08 20:25:41.889264 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57255 s=2 pgs=22993 cs=4773 l=0).fault, initiating reconnect
2013-06-08 20:25:41.890062 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57137 s=2 pgs=17440 cs=3543 l=0).fault, initiating reconnect
2013-06-08 20:25:41.890126 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57258 s=2 pgs=22994 cs=4775 l=0).fault, initiating reconnect
2013-06-08 20:25:41.890841 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57139 s=2 pgs=17441 cs=3545 l=0).fault, initiating reconnect
2013-06-08 20:25:41.890950 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57260 s=2 pgs=22995 cs=4777 l=0).fault, initiating reconnect
2013-06-08 20:25:41.891633 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57141 s=2 pgs=17442 cs=3547 l=0).fault, initiating reconnect
2013-06-08 20:25:41.891774 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57262 s=2 pgs=22996 cs=4779 l=0).fault, initiating reconnect
2013-06-08 20:25:41.892411 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57143 s=2 pgs=17443 cs=3549 l=0).fault, initiating reconnect
2013-06-08 20:25:41.892557 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57264 s=2 pgs=22997 cs=4781 l=0).fault, initiating reconnect
2013-06-08 20:25:41.893201 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57145 s=2 pgs=17444 cs=3551 l=0).fault, initiating reconnect
2013-06-08 20:25:41.893571 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57266 s=2 pgs=22998 cs=4783 l=0).fault, initiating reconnect
2013-06-08 20:25:41.894038 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57147 s=2 pgs=17445 cs=3553 l=0).fault, initiating reconnect
2013-06-08 20:25:41.894568 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57268 s=2 pgs=22999 cs=4785 l=0).fault, initiating reconnect
2013-06-08 20:25:41.894951 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57149 s=2 pgs=17446 cs=3555 l=0).fault, initiating reconnect
2013-06-08 20:25:41.895463 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57270 s=2 pgs=23000 cs=4787 l=0).fault, initiating reconnect
2013-06-08 20:25:41.896409 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57272 s=2 pgs=23001 cs=4789 l=0).fault, initiating reconnect
2013-06-08 20:25:41.896456 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57151 s=2 pgs=17447 cs=3557 l=0).fault, initiating reconnect
2013-06-08 20:25:41.897246 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57273 s=2 pgs=23002 cs=4791 l=0).fault, initiating reconnect
2013-06-08 20:25:41.897595 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57154 s=2 pgs=17448 cs=3559 l=0).fault, initiating reconnect
2013-06-08 20:25:41.898094 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57275 s=2 pgs=23003 cs=4793 l=0).fault, initiating reconnect
2013-06-08 20:25:41.898428 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57156 s=2 pgs=17449 cs=3561 l=0).fault, initiating reconnect
2013-06-08 20:25:41.898956 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57277 s=2 pgs=23004 cs=4795 l=0).fault, initiating reconnect
2013-06-08 20:25:41.899548 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57158 s=2 pgs=17450 cs=3563 l=0).fault, initiating reconnect
2013-06-08 20:25:41.899871 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57279 s=2 pgs=23005 cs=4797 l=0).fault, initiating reconnect
2013-06-08 20:25:41.900464 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57160 s=2 pgs=17451 cs=3565 l=0).fault, initiating reconnect
2013-06-08 20:25:41.900799 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57281 s=2 pgs=23006 cs=4799 l=0).fault, initiating reconnect
2013-06-08 20:25:41.901395 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57162 s=2 pgs=17452 cs=3567 l=0).fault, initiating reconnect
2013-06-08 20:25:41.901644 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57283 s=2 pgs=23007 cs=4801 l=0).fault, initiating reconnect
2013-06-08 20:25:41.902373 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :51993 s=2 pgs=23133 cs=4135 l=0).fault, initiating reconnect
2013-06-08 20:25:41.902375 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57164 s=2 pgs=17453 cs=3569 l=0).fault, initiating reconnect
2013-06-08 20:25:41.902604 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57285 s=2 pgs=23008 cs=4803 l=0).fault, initiating reconnect
2013-06-08 20:25:41.903382 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :57166 s=2 pgs=17454 cs=3571 l=0).fault, initiating reconnect
2013-06-08 20:25:41.903523 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57288 s=2 pgs=23009 cs=4805 l=0).fault, initiating reconnect
2013-06-08 20:25:41.903913 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52051 s=2 pgs=23134 cs=4137 l=0).fault, initiating reconnect
2013-06-08 20:25:41.904151 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :57169 s=2 pgs=17455 cs=3573 l=0).fault, initiating reconnect
2013-06-08 20:25:41.904358 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57290 s=2 pgs=23010 cs=4807 l=0).fault, initiating reconnect
2013-06-08 20:25:41.905118 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :57172 s=2 pgs=17456 cs=3575 l=0).fault, initiating reconnect
2013-06-08 20:25:41.905151 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57293 s=2 pgs=23011 cs=4809 l=0).fault, initiating reconnect
2013-06-08 20:25:41.905204 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52055 s=2 pgs=23135 cs=4139 l=0).fault, initiating reconnect
2013-06-08 20:25:41.905870 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57295 s=2 pgs=23012 cs=4811 l=0).fault, initiating reconnect
2013-06-08 20:25:41.905885 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :57174 s=2 pgs=17457 cs=3577 l=0).fault, initiating reconnect
2013-06-08 20:25:41.906504 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52060 s=2 pgs=23136 cs=4141 l=0).fault, initiating reconnect
2013-06-08 20:25:41.906850 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57297 s=2 pgs=23013 cs=4813 l=0).fault, initiating reconnect
2013-06-08 20:25:41.906852 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :57178 s=2 pgs=17458 cs=3579 l=0).fault, initiating reconnect
2013-06-08 20:25:41.907775 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52063 s=2 pgs=23137 cs=4143 l=0).fault, initiating reconnect
2013-06-08 20:25:41.907787 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57300 s=2 pgs=23014 cs=4815 l=0).fault, initiating reconnect
2013-06-08 20:25:41.907789 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :57181 s=2 pgs=17459 cs=3581 l=0).fault, initiating reconnect
2013-06-08 20:25:41.908626 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57303 s=2 pgs=23015 cs=4817 l=0).fault, initiating reconnect
2013-06-08 20:25:41.908875 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57184 s=2 pgs=17460 cs=3583 l=0).fault, initiating reconnect
2013-06-08 20:25:41.909028 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52066 s=2 pgs=23138 cs=4145 l=0).fault, initiating reconnect
2013-06-08 20:25:41.909470 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57305 s=2 pgs=23016 cs=4819 l=0).fault, initiating reconnect
2013-06-08 20:25:41.909721 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57186 s=2 pgs=17461 cs=3585 l=0).fault, initiating reconnect
2013-06-08 20:25:41.910328 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57308 s=2 pgs=23017 cs=4821 l=0).fault, initiating reconnect
2013-06-08 20:25:41.910330 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52071 s=2 pgs=23139 cs=4147 l=0).fault, initiating reconnect
2013-06-08 20:25:41.910803 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57189 s=2 pgs=17462 cs=3587 l=0).fault, initiating reconnect
2013-06-08 20:25:41.911296 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57310 s=2 pgs=23018 cs=4823 l=0).fault, initiating reconnect
2013-06-08 20:25:41.911537 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57192 s=2 pgs=17463 cs=3589 l=0).fault, initiating reconnect
2013-06-08 20:25:41.911688 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52075 s=2 pgs=23140 cs=4149 l=0).fault, initiating reconnect
2013-06-08 20:25:41.912256 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57313 s=2 pgs=23019 cs=4825 l=0).fault, initiating reconnect
2013-06-08 20:25:41.912302 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57194 s=2 pgs=17464 cs=3591 l=0).fault, initiating reconnect
2013-06-08 20:25:41.912972 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52079 s=2 pgs=23141 cs=4151 l=0).fault, initiating reconnect
2013-06-08 20:25:41.913217 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57197 s=2 pgs=17465 cs=3593 l=0).fault, initiating reconnect
2013-06-08 20:25:41.913238 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57316 s=2 pgs=23020 cs=4827 l=0).fault, initiating reconnect
2013-06-08 20:25:41.914120 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57320 s=2 pgs=23021 cs=4829 l=0).fault, initiating reconnect
2013-06-08 20:25:41.914124 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57199 s=2 pgs=17466 cs=3595 l=0).fault, initiating reconnect
2013-06-08 20:25:41.914200 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52082 s=2 pgs=23142 cs=4153 l=0).fault, initiating reconnect
2013-06-08 20:25:41.915031 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57321 s=2 pgs=23022 cs=4831 l=0).fault, initiating reconnect
2013-06-08 20:25:41.915036 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57202 s=2 pgs=17467 cs=3597 l=0).fault, initiating reconnect
2013-06-08 20:25:41.915481 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52087 s=2 pgs=23143 cs=4155 l=0).fault, initiating reconnect
2013-06-08 20:25:41.915839 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57205 s=2 pgs=17468 cs=3599 l=0).fault, initiating reconnect
2013-06-08 20:25:41.915903 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57324 s=2 pgs=23023 cs=4833 l=0).fault, initiating reconnect
2013-06-08 20:25:41.916784 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57328 s=2 pgs=23024 cs=4835 l=0).fault, initiating reconnect
2013-06-08 20:25:41.916790 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52090 s=2 pgs=23144 cs=4157 l=0).fault, initiating reconnect
2013-06-08 20:25:41.916961 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57207 s=2 pgs=17469 cs=3601 l=0).fault, initiating reconnect
2013-06-08 20:25:41.917581 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57329 s=2 pgs=23025 cs=4837 l=0).fault, initiating reconnect
2013-06-08 20:25:41.918004 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52094 s=2 pgs=23145 cs=4159 l=0).fault, initiating reconnect
2013-06-08 20:25:41.918293 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57211 s=2 pgs=17470 cs=3603 l=0).fault, initiating reconnect
2013-06-08 20:25:41.918401 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57332 s=2 pgs=23026 cs=4839 l=0).fault, initiating reconnect
2013-06-08 20:25:41.919076 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57214 s=2 pgs=17471 cs=3605 l=0).fault, initiating reconnect
2013-06-08 20:25:41.919111 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52097 s=2 pgs=23146 cs=4161 l=0).fault, initiating reconnect
2013-06-08 20:25:41.919212 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57335 s=2 pgs=23027 cs=4841 l=0).fault, initiating reconnect
2013-06-08 20:25:41.919955 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57216 s=2 pgs=17472 cs=3607 l=0).fault, initiating reconnect
2013-06-08 20:25:41.919988 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57338 s=2 pgs=23028 cs=4843 l=0).fault, initiating reconnect
2013-06-08 20:25:41.920173 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52101 s=2 pgs=23147 cs=4163 l=0).fault, initiating reconnect
2013-06-08 20:25:41.920631 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57219 s=2 pgs=17473 cs=3609 l=0).fault, initiating reconnect
2013-06-08 20:25:41.920751 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57340 s=2 pgs=23029 cs=4845 l=0).fault, initiating reconnect
2013-06-08 20:25:41.921412 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52105 s=2 pgs=23148 cs=4165 l=0).fault, initiating reconnect
2013-06-08 20:25:41.921597 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57222 s=2 pgs=17474 cs=3611 l=0).fault, initiating reconnect
2013-06-08 20:25:41.921701 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57343 s=2 pgs=23030 cs=4847 l=0).fault, initiating reconnect
2013-06-08 20:25:41.922428 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57225 s=2 pgs=17475 cs=3613 l=0).fault, initiating reconnect
2013-06-08 20:25:41.922478 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57346 s=2 pgs=23031 cs=4849 l=0).fault, initiating reconnect
2013-06-08 20:25:41.922646 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52108 s=2 pgs=23149 cs=4167 l=0).fault, initiating reconnect
2013-06-08 20:25:41.923161 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57227 s=2 pgs=17476 cs=3615 l=0).fault, initiating reconnect
2013-06-08 20:25:41.923253 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57348 s=2 pgs=23032 cs=4851 l=0).fault, initiating reconnect
2013-06-08 20:25:41.923775 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52113 s=2 pgs=23150 cs=4169 l=0).fault, initiating reconnect
2013-06-08 20:25:41.924078 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57351 s=2 pgs=23033 cs=4853 l=0).fault, initiating reconnect
2013-06-08 20:25:41.924890 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57353 s=2 pgs=23034 cs=4855 l=0).fault, initiating reconnect
2013-06-08 20:25:41.924990 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52116 s=2 pgs=23151 cs=4171 l=0).fault, initiating reconnect
2013-06-08 20:25:41.925026 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57230 s=2 pgs=17477 cs=3617 l=0).fault, initiating reconnect
2013-06-08 20:25:41.925792 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57236 s=2 pgs=17478 cs=3619 l=0).fault, initiating reconnect
2013-06-08 20:25:41.925944 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57354 s=2 pgs=23035 cs=4857 l=0).fault, initiating reconnect
2013-06-08 20:25:41.926144 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52119 s=2 pgs=23152 cs=4173 l=0).fault, initiating reconnect
2013-06-08 20:25:41.926578 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57237 s=2 pgs=17479 cs=3621 l=0).fault, initiating reconnect
2013-06-08 20:25:41.926700 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57358 s=2 pgs=23036 cs=4859 l=0).fault, initiating reconnect
2013-06-08 20:25:41.927262 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52123 s=2 pgs=23153 cs=4175 l=0).fault, initiating reconnect
2013-06-08 20:25:41.927561 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57240 s=2 pgs=17480 cs=3623 l=0).fault, initiating reconnect
2013-06-08 20:25:41.927621 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57361 s=2 pgs=23037 cs=4861 l=0).fault, initiating reconnect
2013-06-08 20:25:41.928374 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57364 s=2 pgs=23038 cs=4863 l=0).fault, initiating reconnect
2013-06-08 20:25:41.928381 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57243 s=2 pgs=17481 cs=3625 l=0).fault, initiating reconnect
2013-06-08 20:25:41.928546 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52126 s=2 pgs=23154 cs=4177 l=0).fault, initiating reconnect
2013-06-08 20:25:41.929176 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57365 s=2 pgs=23039 cs=4865 l=0).fault, initiating reconnect
2013-06-08 20:25:41.929339 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57246 s=2 pgs=17482 cs=3627 l=0).fault, initiating reconnect
2013-06-08 20:25:41.929633 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52131 s=2 pgs=23155 cs=4179 l=0).fault, initiating reconnect
2013-06-08 20:25:41.929956 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57368 s=2 pgs=23040 cs=4867 l=0).fault, initiating reconnect
2013-06-08 20:25:41.930021 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57249 s=2 pgs=17483 cs=3629 l=0).fault, initiating reconnect
2013-06-08 20:25:41.930710 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52134 s=2 pgs=23156 cs=4181 l=0).fault, initiating reconnect
2013-06-08 20:25:41.930726 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57371 s=2 pgs=23041 cs=4869 l=0).fault, initiating reconnect
2013-06-08 20:25:41.931093 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57252 s=2 pgs=17484 cs=3631 l=0).fault, initiating reconnect
2013-06-08 20:25:41.931508 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57374 s=2 pgs=23042 cs=4871 l=0).fault, initiating reconnect
2013-06-08 20:25:41.931786 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52137 s=2 pgs=23157 cs=4183 l=0).fault, initiating reconnect
2013-06-08 20:25:41.931922 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57255 s=2 pgs=17485 cs=3633 l=0).fault, initiating reconnect
2013-06-08 20:25:41.932221 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57376 s=2 pgs=23043 cs=4873 l=0).fault, initiating reconnect
2013-06-08 20:25:41.932888 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57258 s=2 pgs=17486 cs=3635 l=0).fault, initiating reconnect
2013-06-08 20:25:41.932956 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52141 s=2 pgs=23158 cs=4185 l=0).fault, initiating reconnect
2013-06-08 20:25:41.933075 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57379 s=2 pgs=23044 cs=4875 l=0).fault, initiating reconnect
2013-06-08 20:25:41.933634 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57260 s=2 pgs=17487 cs=3637 l=0).fault, initiating reconnect
2013-06-08 20:25:41.933748 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57382 s=2 pgs=23045 cs=4877 l=0).fault, initiating reconnect
2013-06-08 20:25:41.934034 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52145 s=2 pgs=23159 cs=4187 l=0).fault, initiating reconnect
2013-06-08 20:25:41.934492 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57263 s=2 pgs=17488 cs=3639 l=0).fault, initiating reconnect
2013-06-08 20:25:41.934507 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57384 s=2 pgs=23046 cs=4879 l=0).fault, initiating reconnect
2013-06-08 20:25:41.935238 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52149 s=2 pgs=23160 cs=4189 l=0).fault, initiating reconnect
2013-06-08 20:25:41.935392 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57387 s=2 pgs=23047 cs=4881 l=0).fault, initiating reconnect
2013-06-08 20:25:41.935438 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57266 s=2 pgs=17489 cs=3641 l=0).fault, initiating reconnect
2013-06-08 20:25:41.936087 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57389 s=2 pgs=23048 cs=4883 l=0).fault, initiating reconnect
2013-06-08 20:25:41.936321 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57270 s=2 pgs=17490 cs=3643 l=0).fault, initiating reconnect
2013-06-08 20:25:41.936442 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52152 s=2 pgs=23161 cs=4191 l=0).fault, initiating reconnect
2013-06-08 20:25:41.936821 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57391 s=2 pgs=23049 cs=4885 l=0).fault, initiating reconnect
2013-06-08 20:25:41.937130 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57272 s=2 pgs=17491 cs=3645 l=0).fault, initiating reconnect
2013-06-08 20:25:41.937694 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57394 s=2 pgs=23050 cs=4887 l=0).fault, initiating reconnect
2013-06-08 20:25:41.937696 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52157 s=2 pgs=23162 cs=4193 l=0).fault, initiating reconnect
2013-06-08 20:25:41.938072 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57275 s=2 pgs=17492 cs=3647 l=0).fault, initiating reconnect
2013-06-08 20:25:41.938481 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57397 s=2 pgs=23051 cs=4889 l=0).fault, initiating reconnect
2013-06-08 20:25:41.938789 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52160 s=2 pgs=23163 cs=4195 l=0).fault, initiating reconnect
2013-06-08 20:25:41.939163 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57278 s=2 pgs=17493 cs=3649 l=0).fault, initiating reconnect
2013-06-08 20:25:41.939218 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57399 s=2 pgs=23052 cs=4891 l=0).fault, initiating reconnect
2013-06-08 20:25:41.939783 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52164 s=2 pgs=23164 cs=4197 l=0).fault, initiating reconnect
2013-06-08 20:25:41.940059 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57402 s=2 pgs=23053 cs=4893 l=0).fault, initiating reconnect
2013-06-08 20:25:41.940065 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57281 s=2 pgs=17494 cs=3651 l=0).fault, initiating reconnect
2013-06-08 20:25:41.940789 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57404 s=2 pgs=23054 cs=4895 l=0).fault, initiating reconnect
2013-06-08 20:25:41.940945 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52167 s=2 pgs=23165 cs=4199 l=0).fault, initiating reconnect
2013-06-08 20:25:41.940963 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57285 s=2 pgs=17495 cs=3653 l=0).fault, initiating reconnect
2013-06-08 20:25:41.941572 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57406 s=2 pgs=23055 cs=4897 l=0).fault, initiating reconnect
2013-06-08 20:25:41.941631 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57288 s=2 pgs=17496 cs=3655 l=0).fault, initiating reconnect
2013-06-08 20:25:41.942179 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52171 s=2 pgs=23166 cs=4201 l=0).fault, initiating reconnect
2013-06-08 20:25:41.942550 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57290 s=2 pgs=17497 cs=3657 l=0).fault, initiating reconnect
2013-06-08 20:25:41.942602 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57409 s=2 pgs=23056 cs=4899 l=0).fault, initiating reconnect
2013-06-08 20:25:41.943288 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52175 s=2 pgs=23167 cs=4203 l=0).fault, initiating reconnect
2013-06-08 20:25:41.943363 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57292 s=2 pgs=17498 cs=3659 l=0).fault, initiating reconnect
2013-06-08 20:25:41.943379 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57413 s=2 pgs=23057 cs=4901 l=0).fault, initiating reconnect
2013-06-08 20:25:41.944219 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57416 s=2 pgs=23058 cs=4903 l=0).fault, initiating reconnect
2013-06-08 20:25:41.944323 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57295 s=2 pgs=17499 cs=3661 l=0).fault, initiating reconnect
2013-06-08 20:25:41.944468 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52178 s=2 pgs=23168 cs=4205 l=0).fault, initiating reconnect
2013-06-08 20:25:41.944969 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57417 s=2 pgs=23059 cs=4905 l=0).fault, initiating reconnect
2013-06-08 20:25:41.945061 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57298 s=2 pgs=17500 cs=3663 l=0).fault, initiating reconnect
2013-06-08 20:25:41.945565 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52183 s=2 pgs=23169 cs=4207 l=0).fault, initiating reconnect
2013-06-08 20:25:41.945824 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57420 s=2 pgs=23060 cs=4907 l=0).fault, initiating reconnect
2013-06-08 20:25:41.945862 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57301 s=2 pgs=17501 cs=3665 l=0).fault, initiating reconnect
2013-06-08 20:25:41.946566 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57423 s=2 pgs=23061 cs=4909 l=0).fault, initiating reconnect
2013-06-08 20:25:41.946676 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52186 s=2 pgs=23170 cs=4209 l=0).fault, initiating reconnect
2013-06-08 20:25:41.946731 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57304 s=2 pgs=17502 cs=3667 l=0).fault, initiating reconnect
2013-06-08 20:25:41.947386 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57425 s=2 pgs=23062 cs=4911 l=0).fault, initiating reconnect
2013-06-08 20:25:41.947704 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57307 s=2 pgs=17503 cs=3669 l=0).fault, initiating reconnect
2013-06-08 20:25:41.948168 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57428 s=2 pgs=23063 cs=4913 l=0).fault, initiating reconnect
2013-06-08 20:25:41.948481 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57309 s=2 pgs=17504 cs=3671 l=0).fault, initiating reconnect
2013-06-08 20:25:41.948987 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57430 s=2 pgs=23064 cs=4915 l=0).fault, initiating reconnect
2013-06-08 20:25:41.949271 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57311 s=2 pgs=17505 cs=3673 l=0).fault, initiating reconnect
2013-06-08 20:25:41.949806 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57432 s=2 pgs=23065 cs=4917 l=0).fault, initiating reconnect
2013-06-08 20:25:41.949981 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52190 s=2 pgs=23171 cs=4211 l=0).fault, initiating reconnect
2013-06-08 20:25:41.950084 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57313 s=2 pgs=17506 cs=3675 l=0).fault, initiating reconnect
2013-06-08 20:25:41.950586 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57434 s=2 pgs=23066 cs=4919 l=0).fault, initiating reconnect
2013-06-08 20:25:41.950827 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57316 s=2 pgs=17507 cs=3677 l=0).fault, initiating reconnect
2013-06-08 20:25:41.951253 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52199 s=2 pgs=23172 cs=4213 l=0).fault, initiating reconnect
2013-06-08 20:25:41.951440 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57437 s=2 pgs=23067 cs=4921 l=0).fault, initiating reconnect
2013-06-08 20:25:41.951500 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57318 s=2 pgs=17508 cs=3679 l=0).fault, initiating reconnect
2013-06-08 20:25:41.952131 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57440 s=2 pgs=23068 cs=4923 l=0).fault, initiating reconnect
2013-06-08 20:25:41.952431 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57321 s=2 pgs=17509 cs=3681 l=0).fault, initiating reconnect
2013-06-08 20:25:41.952806 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52203 s=2 pgs=23173 cs=4215 l=0).fault, initiating reconnect
2013-06-08 20:25:41.952893 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57442 s=2 pgs=23069 cs=4925 l=0).fault, initiating reconnect
2013-06-08 20:25:41.953225 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57323 s=2 pgs=17510 cs=3683 l=0).fault, initiating reconnect
2013-06-08 20:25:41.953606 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57445 s=2 pgs=23070 cs=4927 l=0).fault, initiating reconnect
2013-06-08 20:25:41.953847 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52208 s=2 pgs=23174 cs=4217 l=0).fault, initiating reconnect
2013-06-08 20:25:41.953951 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57326 s=2 pgs=17511 cs=3685 l=0).fault, initiating reconnect
2013-06-08 20:25:41.954374 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57447 s=2 pgs=23071 cs=4929 l=0).fault, initiating reconnect
2013-06-08 20:25:41.954754 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57329 s=2 pgs=17512 cs=3687 l=0).fault, initiating reconnect
2013-06-08 20:25:41.954827 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52212 s=2 pgs=23175 cs=4219 l=0).fault, initiating reconnect
2013-06-08 20:25:41.955258 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57450 s=2 pgs=23072 cs=4931 l=0).fault, initiating reconnect
2013-06-08 20:25:41.955755 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57331 s=2 pgs=17513 cs=3689 l=0).fault, initiating reconnect
2013-06-08 20:25:41.955810 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52216 s=2 pgs=23176 cs=4221 l=0).fault, initiating reconnect
2013-06-08 20:25:41.956132 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57453 s=2 pgs=23073 cs=4933 l=0).fault, initiating reconnect
2013-06-08 20:25:41.956542 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57334 s=2 pgs=17514 cs=3691 l=0).fault, initiating reconnect
2013-06-08 20:25:41.956916 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57456 s=2 pgs=23074 cs=4935 l=0).fault, initiating reconnect
2013-06-08 20:25:41.957296 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57337 s=2 pgs=17515 cs=3693 l=0).fault, initiating reconnect
2013-06-08 20:25:41.957641 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52219 s=2 pgs=23177 cs=4223 l=0).fault, initiating reconnect
2013-06-08 20:25:41.957773 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57458 s=2 pgs=23075 cs=4937 l=0).fault, initiating reconnect
2013-06-08 20:25:41.957994 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57339 s=2 pgs=17516 cs=3695 l=0).fault, initiating reconnect
2013-06-08 20:25:41.958582 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57461 s=2 pgs=23076 cs=4939 l=0).fault, initiating reconnect
2013-06-08 20:25:41.958764 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52224 s=2 pgs=23178 cs=4225 l=0).fault, initiating reconnect
2013-06-08 20:25:41.958816 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57342 s=2 pgs=17517 cs=3697 l=0).fault, initiating reconnect
2013-06-08 20:25:41.959375 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57463 s=2 pgs=23077 cs=4941 l=0).fault, initiating reconnect
2013-06-08 20:25:41.959742 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57345 s=2 pgs=17518 cs=3699 l=0).fault, initiating reconnect
2013-06-08 20:25:41.959893 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52228 s=2 pgs=23179 cs=4227 l=0).fault, initiating reconnect
2013-06-08 20:25:41.960277 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57466 s=2 pgs=23078 cs=4943 l=0).fault, initiating reconnect
2013-06-08 20:25:41.960843 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57347 s=2 pgs=17519 cs=3701 l=0).fault, initiating reconnect
2013-06-08 20:25:41.960928 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52232 s=2 pgs=23180 cs=4229 l=0).fault, initiating reconnect
2013-06-08 20:25:41.961222 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57469 s=2 pgs=23079 cs=4945 l=0).fault, initiating reconnect
2013-06-08 20:25:41.961702 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57350 s=2 pgs=17520 cs=3703 l=0).fault, initiating reconnect
2013-06-08 20:25:41.962018 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57472 s=2 pgs=23080 cs=4947 l=0).fault, initiating reconnect
2013-06-08 20:25:41.962099 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52235 s=2 pgs=23181 cs=4231 l=0).fault, initiating reconnect
2013-06-08 20:25:41.962544 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57353 s=2 pgs=17521 cs=3705 l=0).fault, initiating reconnect
2013-06-08 20:25:41.962791 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57474 s=2 pgs=23081 cs=4949 l=0).fault, initiating reconnect
2013-06-08 20:25:41.963263 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52239 s=2 pgs=23182 cs=4233 l=0).fault, initiating reconnect
2013-06-08 20:25:41.963482 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57356 s=2 pgs=17522 cs=3707 l=0).fault, initiating reconnect
2013-06-08 20:25:41.963628 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57477 s=2 pgs=23082 cs=4951 l=0).fault, initiating reconnect
2013-06-08 20:25:41.964259 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57359 s=2 pgs=17523 cs=3709 l=0).fault, initiating reconnect
2013-06-08 20:25:41.964425 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52242 s=2 pgs=23183 cs=4235 l=0).fault, initiating reconnect
2013-06-08 20:25:41.964510 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57480 s=2 pgs=23083 cs=4953 l=0).fault, initiating reconnect
2013-06-08 20:25:41.964935 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57361 s=2 pgs=17524 cs=3711 l=0).fault, initiating reconnect
2013-06-08 20:25:41.965249 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57483 s=2 pgs=23084 cs=4955 l=0).fault, initiating reconnect
2013-06-08 20:25:41.965516 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52246 s=2 pgs=23184 cs=4237 l=0).fault, initiating reconnect
2013-06-08 20:25:41.965953 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57485 s=2 pgs=23085 cs=4957 l=0).fault, initiating reconnect
2013-06-08 20:25:41.966398 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57364 s=2 pgs=17525 cs=3713 l=0).fault, initiating reconnect
2013-06-08 20:25:41.966700 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52250 s=2 pgs=23185 cs=4239 l=0).fault, initiating reconnect
2013-06-08 20:25:41.966718 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57487 s=2 pgs=23086 cs=4959 l=0).fault, initiating reconnect
2013-06-08 20:25:41.967127 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57368 s=2 pgs=17526 cs=3715 l=0).fault, initiating reconnect
2013-06-08 20:25:41.967472 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57490 s=2 pgs=23087 cs=4961 l=0).fault, initiating reconnect
2013-06-08 20:25:41.967833 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52253 s=2 pgs=23186 cs=4241 l=0).fault, initiating reconnect
2013-06-08 20:25:41.967893 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57371 s=2 pgs=17527 cs=3717 l=0).fault, initiating reconnect
2013-06-08 20:25:41.968270 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57492 s=2 pgs=23088 cs=4963 l=0).fault, initiating reconnect
2013-06-08 20:25:41.968856 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57374 s=2 pgs=17528 cs=3719 l=0).fault, initiating reconnect
2013-06-08 20:25:41.968961 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52257 s=2 pgs=23187 cs=4243 l=0).fault, initiating reconnect
2013-06-08 20:25:41.969054 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57495 s=2 pgs=23089 cs=4965 l=0).fault, initiating reconnect
2013-06-08 20:25:41.969597 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57376 s=2 pgs=17529 cs=3721 l=0).fault, initiating reconnect
2013-06-08 20:25:41.969912 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57498 s=2 pgs=23090 cs=4967 l=0).fault, initiating reconnect
2013-06-08 20:25:41.970095 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52261 s=2 pgs=23188 cs=4245 l=0).fault, initiating reconnect
2013-06-08 20:25:41.970402 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57379 s=2 pgs=17530 cs=3723 l=0).fault, initiating reconnect
2013-06-08 20:25:41.970726 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57500 s=2 pgs=23091 cs=4969 l=0).fault, initiating reconnect
2013-06-08 20:25:41.971234 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52265 s=2 pgs=23189 cs=4247 l=0).fault, initiating reconnect
2013-06-08 20:25:41.971369 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57382 s=2 pgs=17531 cs=3725 l=0).fault, initiating reconnect
2013-06-08 20:25:41.971518 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57503 s=2 pgs=23092 cs=4971 l=0).fault, initiating reconnect
2013-06-08 20:25:41.972230 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57385 s=2 pgs=17532 cs=3727 l=0).fault, initiating reconnect
2013-06-08 20:25:41.972285 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57506 s=2 pgs=23093 cs=4973 l=0).fault, initiating reconnect
2013-06-08 20:25:41.972289 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52268 s=2 pgs=23190 cs=4249 l=0).fault, initiating reconnect
2013-06-08 20:25:41.973092 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57508 s=2 pgs=23094 cs=4975 l=0).fault, initiating reconnect
2013-06-08 20:25:41.973365 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52273 s=2 pgs=23191 cs=4251 l=0).fault, initiating reconnect
2013-06-08 20:25:41.973490 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57387 s=2 pgs=17533 cs=3729 l=0).fault, initiating reconnect
2013-06-08 20:25:41.973838 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57510 s=2 pgs=23095 cs=4977 l=0).fault, initiating reconnect
2013-06-08 20:25:41.974362 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57392 s=2 pgs=17534 cs=3731 l=0).fault, initiating reconnect
2013-06-08 20:25:41.974594 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52275 s=2 pgs=23192 cs=4253 l=0).fault, initiating reconnect
2013-06-08 20:25:41.974595 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57513 s=2 pgs=23096 cs=4979 l=0).fault, initiating reconnect
2013-06-08 20:25:41.975197 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57394 s=2 pgs=17535 cs=3733 l=0).fault, initiating reconnect
2013-06-08 20:25:41.975459 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57516 s=2 pgs=23097 cs=4981 l=0).fault, initiating reconnect
2013-06-08 20:25:41.975847 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52279 s=2 pgs=23193 cs=4255 l=0).fault, initiating reconnect
2013-06-08 20:25:41.976048 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57397 s=2 pgs=17536 cs=3735 l=0).fault, initiating reconnect
2013-06-08 20:25:41.976263 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57518 s=2 pgs=23098 cs=4983 l=0).fault, initiating reconnect
2013-06-08 20:25:41.976809 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57400 s=2 pgs=17537 cs=3737 l=0).fault, initiating reconnect
2013-06-08 20:25:41.976871 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52283 s=2 pgs=23194 cs=4257 l=0).fault, initiating reconnect
2013-06-08 20:25:41.977134 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57521 s=2 pgs=23099 cs=4985 l=0).fault, initiating reconnect
2013-06-08 20:25:41.977872 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57402 s=2 pgs=17538 cs=3739 l=0).fault, initiating reconnect
2013-06-08 20:25:41.977908 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57524 s=2 pgs=23100 cs=4987 l=0).fault, initiating reconnect
2013-06-08 20:25:41.978072 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52287 s=2 pgs=23195 cs=4259 l=0).fault, initiating reconnect
2013-06-08 20:25:41.978703 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57526 s=2 pgs=23101 cs=4989 l=0).fault, initiating reconnect
2013-06-08 20:25:41.978873 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57405 s=2 pgs=17539 cs=3741 l=0).fault, initiating reconnect
2013-06-08 20:25:41.979172 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52291 s=2 pgs=23196 cs=4261 l=0).fault, initiating reconnect
2013-06-08 20:25:41.979557 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57528 s=2 pgs=23102 cs=4991 l=0).fault, initiating reconnect
2013-06-08 20:25:41.979721 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57409 s=2 pgs=17540 cs=3743 l=0).fault, initiating reconnect
2013-06-08 20:25:41.980341 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52294 s=2 pgs=23197 cs=4263 l=0).fault, initiating reconnect
2013-06-08 20:25:41.980454 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57531 s=2 pgs=23103 cs=4993 l=0).fault, initiating reconnect
2013-06-08 20:25:41.980660 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57412 s=2 pgs=17541 cs=3745 l=0).fault, initiating reconnect
2013-06-08 20:25:41.981227 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57534 s=2 pgs=23104 cs=4995 l=0).fault, initiating reconnect
2013-06-08 20:25:41.981343 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52297 s=2 pgs=23198 cs=4265 l=0).fault, initiating reconnect
2013-06-08 20:25:41.981606 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57415 s=2 pgs=17542 cs=3747 l=0).fault, initiating reconnect
2013-06-08 20:25:41.982061 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57536 s=2 pgs=23105 cs=4997 l=0).fault, initiating reconnect
2013-06-08 20:25:41.982312 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52301 s=2 pgs=23199 cs=4267 l=0).fault, initiating reconnect
2013-06-08 20:25:41.982653 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57418 s=2 pgs=17543 cs=3749 l=0).fault, initiating reconnect
2013-06-08 20:25:41.982811 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57539 s=2 pgs=23106 cs=4999 l=0).fault, initiating reconnect
2013-06-08 20:25:41.983481 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52304 s=2 pgs=23200 cs=4269 l=0).fault, initiating reconnect
2013-06-08 20:25:41.983557 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57421 s=2 pgs=17544 cs=3751 l=0).fault, initiating reconnect
2013-06-08 20:25:41.983764 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57542 s=2 pgs=23107 cs=5001 l=0).fault, initiating reconnect
2013-06-08 20:25:41.984470 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57424 s=2 pgs=17545 cs=3753 l=0).fault, initiating reconnect
2013-06-08 20:25:41.984581 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57545 s=2 pgs=23108 cs=5003 l=0).fault, initiating reconnect
2013-06-08 20:25:41.984589 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52307 s=2 pgs=23201 cs=4271 l=0).fault, initiating reconnect
2013-06-08 20:25:41.985328 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57547 s=2 pgs=23109 cs=5005 l=0).fault, initiating reconnect
2013-06-08 20:25:41.985360 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57426 s=2 pgs=17546 cs=3755 l=0).fault, initiating reconnect
2013-06-08 20:25:41.985602 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52312 s=2 pgs=23202 cs=4273 l=0).fault, initiating reconnect
2013-06-08 20:25:41.986072 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57549 s=2 pgs=23110 cs=5007 l=0).fault, initiating reconnect
2013-06-08 20:25:41.986262 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57430 s=2 pgs=17547 cs=3757 l=0).fault, initiating reconnect
2013-06-08 20:25:41.986790 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52315 s=2 pgs=23203 cs=4275 l=0).fault, initiating reconnect
2013-06-08 20:25:41.986843 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57552 s=2 pgs=23111 cs=5009 l=0).fault, initiating reconnect
2013-06-08 20:25:41.987131 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57433 s=2 pgs=17548 cs=3759 l=0).fault, initiating reconnect
2013-06-08 20:25:41.987573 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57555 s=2 pgs=23112 cs=5011 l=0).fault, initiating reconnect
2013-06-08 20:25:41.987951 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52318 s=2 pgs=23204 cs=4277 l=0).fault, initiating reconnect
2013-06-08 20:25:41.988050 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57436 s=2 pgs=17549 cs=3761 l=0).fault, initiating reconnect
2013-06-08 20:25:41.988310 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57557 s=2 pgs=23113 cs=5013 l=0).fault, initiating reconnect
2013-06-08 20:25:41.988945 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57439 s=2 pgs=17550 cs=3763 l=0).fault, initiating reconnect
2013-06-08 20:25:41.989047 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57560 s=2 pgs=23114 cs=5015 l=0).fault, initiating reconnect
2013-06-08 20:25:41.989131 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52322 s=2 pgs=23205 cs=4279 l=0).fault, initiating reconnect
2013-06-08 20:25:41.989762 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57441 s=2 pgs=17551 cs=3765 l=0).fault, initiating reconnect
2013-06-08 20:25:41.989888 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57562 s=2 pgs=23115 cs=5017 l=0).fault, initiating reconnect
2013-06-08 20:25:41.990167 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52327 s=2 pgs=23206 cs=4281 l=0).fault, initiating reconnect
2013-06-08 20:25:41.990640 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57565 s=2 pgs=23116 cs=5019 l=0).fault, initiating reconnect
2013-06-08 20:25:41.990641 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57444 s=2 pgs=17552 cs=3767 l=0).fault, initiating reconnect
2013-06-08 20:25:41.991352 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52330 s=2 pgs=23207 cs=4283 l=0).fault, initiating reconnect
2013-06-08 20:25:41.991354 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57567 s=2 pgs=23117 cs=5021 l=0).fault, initiating reconnect
2013-06-08 20:25:41.991396 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57448 s=2 pgs=17553 cs=3769 l=0).fault, initiating reconnect
2013-06-08 20:25:41.992166 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57570 s=2 pgs=23118 cs=5023 l=0).fault, initiating reconnect
2013-06-08 20:25:41.992249 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57451 s=2 pgs=17554 cs=3771 l=0).fault, initiating reconnect
2013-06-08 20:25:41.992426 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52333 s=2 pgs=23208 cs=4285 l=0).fault, initiating reconnect
2013-06-08 20:25:41.992851 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57572 s=2 pgs=23119 cs=5025 l=0).fault, initiating reconnect
2013-06-08 20:25:41.993043 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57453 s=2 pgs=17555 cs=3773 l=0).fault, initiating reconnect
2013-06-08 20:25:41.993397 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52338 s=2 pgs=23209 cs=4287 l=0).fault, initiating reconnect
2013-06-08 20:25:41.993730 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57575 s=2 pgs=23120 cs=5027 l=0).fault, initiating reconnect
2013-06-08 20:25:41.993769 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57456 s=2 pgs=17556 cs=3775 l=0).fault, initiating reconnect
2013-06-08 20:25:41.994475 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52341 s=2 pgs=23210 cs=4289 l=0).fault, initiating reconnect
2013-06-08 20:25:41.994579 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57459 s=2 pgs=17557 cs=3777 l=0).fault, initiating reconnect
2013-06-08 20:25:41.994607 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57578 s=2 pgs=23121 cs=5029 l=0).fault, initiating reconnect
2013-06-08 20:25:41.995381 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57582 s=2 pgs=23122 cs=5031 l=0).fault, initiating reconnect
2013-06-08 20:25:41.995505 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57461 s=2 pgs=17558 cs=3779 l=0).fault, initiating reconnect
2013-06-08 20:25:41.995650 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52344 s=2 pgs=23211 cs=4291 l=0).fault, initiating reconnect
2013-06-08 20:25:41.996130 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57583 s=2 pgs=23123 cs=5033 l=0).fault, initiating reconnect
2013-06-08 20:25:41.996280 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57464 s=2 pgs=17559 cs=3781 l=0).fault, initiating reconnect
2013-06-08 20:25:41.996806 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52349 s=2 pgs=23212 cs=4293 l=0).fault, initiating reconnect
2013-06-08 20:25:41.996909 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57586 s=2 pgs=23124 cs=5035 l=0).fault, initiating reconnect
2013-06-08 20:25:41.997071 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57467 s=2 pgs=17560 cs=3783 l=0).fault, initiating reconnect
2013-06-08 20:25:41.997625 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57589 s=2 pgs=23125 cs=5037 l=0).fault, initiating reconnect
2013-06-08 20:25:41.997851 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57470 s=2 pgs=17561 cs=3785 l=0).fault, initiating reconnect
2013-06-08 20:25:41.997890 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52352 s=2 pgs=23213 cs=4295 l=0).fault, initiating reconnect
2013-06-08 20:25:41.998448 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57591 s=2 pgs=23126 cs=5039 l=0).fault, initiating reconnect
2013-06-08 20:25:41.998789 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57472 s=2 pgs=17562 cs=3787 l=0).fault, initiating reconnect
2013-06-08 20:25:41.998968 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52357 s=2 pgs=23214 cs=4297 l=0).fault, initiating reconnect
2013-06-08 20:25:41.999339 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57594 s=2 pgs=23127 cs=5041 l=0).fault, initiating reconnect
2013-06-08 20:25:41.999576 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57475 s=2 pgs=17563 cs=3789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.000167 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57597 s=2 pgs=23128 cs=5043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.000168 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52360 s=2 pgs=23215 cs=4299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.000374 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57478 s=2 pgs=17564 cs=3791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.000895 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57599 s=2 pgs=23129 cs=5045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.001186 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57481 s=2 pgs=17565 cs=3793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.001351 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52364 s=2 pgs=23216 cs=4301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.001708 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57602 s=2 pgs=23130 cs=5047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.001895 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57483 s=2 pgs=17566 cs=3795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.002335 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52368 s=2 pgs=23217 cs=4303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.002481 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57605 s=2 pgs=23131 cs=5049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.002773 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57486 s=2 pgs=17567 cs=3797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.003292 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57608 s=2 pgs=23132 cs=5051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.003491 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52371 s=2 pgs=23218 cs=4305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.003731 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57489 s=2 pgs=17568 cs=3799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.004091 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57610 s=2 pgs=23133 cs=5053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.004567 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57492 s=2 pgs=17569 cs=3801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.004713 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52375 s=2 pgs=23219 cs=4307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.004864 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57613 s=2 pgs=23134 cs=5055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.005503 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57494 s=2 pgs=17570 cs=3803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.005667 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57616 s=2 pgs=23135 cs=5057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.006290 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57497 s=2 pgs=17571 cs=3805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.006493 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52379 s=2 pgs=23220 cs=4309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.006533 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57618 s=2 pgs=23136 cs=5059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.006958 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57499 s=2 pgs=17572 cs=3807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.007358 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57621 s=2 pgs=23137 cs=5061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.007674 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52384 s=2 pgs=23221 cs=4311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.007896 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57502 s=2 pgs=17573 cs=3809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.008061 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57623 s=2 pgs=23138 cs=5063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.008727 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57505 s=2 pgs=17574 cs=3811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.008768 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57626 s=2 pgs=23139 cs=5065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.008827 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52388 s=2 pgs=23222 cs=4313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.009484 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57507 s=2 pgs=17575 cs=3813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.009544 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57628 s=2 pgs=23140 cs=5067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.009843 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52393 s=2 pgs=23223 cs=4315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.010324 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57631 s=2 pgs=23141 cs=5069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.010360 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57510 s=2 pgs=17576 cs=3815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.010992 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52396 s=2 pgs=23224 cs=4317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.011077 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57633 s=2 pgs=23142 cs=5071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.011265 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57514 s=2 pgs=17577 cs=3817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.011851 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57636 s=2 pgs=23143 cs=5073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.012029 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57517 s=2 pgs=17578 cs=3819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.012151 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52399 s=2 pgs=23225 cs=4319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.012677 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57638 s=2 pgs=23144 cs=5075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.013122 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57519 s=2 pgs=17579 cs=3821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.013221 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52404 s=2 pgs=23226 cs=4321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.013537 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57641 s=2 pgs=23145 cs=5077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.013860 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57522 s=2 pgs=17580 cs=3823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.014303 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57644 s=2 pgs=23146 cs=5079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.014354 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52407 s=2 pgs=23227 cs=4323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.014657 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57525 s=2 pgs=17581 cs=3825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.015107 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57646 s=2 pgs=23147 cs=5081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.015409 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52411 s=2 pgs=23228 cs=4325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.015724 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57528 s=2 pgs=17582 cs=3827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.015830 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57649 s=2 pgs=23148 cs=5083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.016429 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57531 s=2 pgs=17583 cs=3829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.016503 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52414 s=2 pgs=23229 cs=4327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.016614 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57652 s=2 pgs=23149 cs=5085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.017259 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57533 s=2 pgs=17584 cs=3831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.017321 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57655 s=2 pgs=23150 cs=5087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.017657 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52418 s=2 pgs=23230 cs=4329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.017993 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57536 s=2 pgs=17585 cs=3833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.018047 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57657 s=2 pgs=23151 cs=5089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.018650 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52422 s=2 pgs=23231 cs=4331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.018788 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57660 s=2 pgs=23152 cs=5091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.018986 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57539 s=2 pgs=17586 cs=3835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.019573 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57662 s=2 pgs=23153 cs=5093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.019692 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52425 s=2 pgs=23232 cs=4333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.019880 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57543 s=2 pgs=17587 cs=3837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.020405 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57664 s=2 pgs=23154 cs=5095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.020729 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57546 s=2 pgs=17588 cs=3839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.020747 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52429 s=2 pgs=23233 cs=4335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.021130 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57667 s=2 pgs=23155 cs=5097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.021803 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57548 s=2 pgs=17589 cs=3841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.021870 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57670 s=2 pgs=23156 cs=5099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.022052 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52433 s=2 pgs=23234 cs=4337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.022599 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57551 s=2 pgs=17590 cs=3843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.022694 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57672 s=2 pgs=23157 cs=5101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.023198 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52437 s=2 pgs=23235 cs=4339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.023408 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57554 s=2 pgs=17591 cs=3845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.023579 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57675 s=2 pgs=23158 cs=5103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.024171 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57557 s=2 pgs=17592 cs=3847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.024413 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57678 s=2 pgs=23159 cs=5105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.024428 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52440 s=2 pgs=23236 cs=4341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.025058 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57559 s=2 pgs=17593 cs=3849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.025136 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57680 s=2 pgs=23160 cs=5107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.025424 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52445 s=2 pgs=23237 cs=4343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.025831 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57562 s=2 pgs=17594 cs=3851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.025890 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57683 s=2 pgs=23161 cs=5109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.026655 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52448 s=2 pgs=23238 cs=4345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.026656 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57686 s=2 pgs=23162 cs=5111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.026712 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57565 s=2 pgs=17595 cs=3853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.027468 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57569 s=2 pgs=17596 cs=3855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.027486 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57688 s=2 pgs=23163 cs=5113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.027828 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52451 s=2 pgs=23239 cs=4347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.028185 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57570 s=2 pgs=17597 cs=3857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.028278 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57691 s=2 pgs=23164 cs=5115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.028910 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52456 s=2 pgs=23240 cs=4349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.029069 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57694 s=2 pgs=23165 cs=5117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.029103 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57573 s=2 pgs=17598 cs=3859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.029855 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57696 s=2 pgs=23166 cs=5119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.029913 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57577 s=2 pgs=17599 cs=3861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.029977 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52459 s=2 pgs=23241 cs=4351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.030572 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57698 s=2 pgs=23167 cs=5121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.030631 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57579 s=2 pgs=17600 cs=3863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.031094 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52464 s=2 pgs=23242 cs=4353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.031342 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57701 s=2 pgs=23168 cs=5123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.031482 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57582 s=2 pgs=17601 cs=3865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.032062 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57704 s=2 pgs=23169 cs=5125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.032292 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52467 s=2 pgs=23243 cs=4355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.032535 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57585 s=2 pgs=17602 cs=3867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.032807 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57706 s=2 pgs=23170 cs=5127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.033305 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57588 s=2 pgs=17603 cs=3869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.033536 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52471 s=2 pgs=23244 cs=4357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.033713 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57709 s=2 pgs=23171 cs=5129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.033987 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57590 s=2 pgs=17604 cs=3871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.034488 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57712 s=2 pgs=23172 cs=5131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.034658 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52475 s=2 pgs=23245 cs=4359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.034865 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57593 s=2 pgs=17605 cs=3873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.035283 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57714 s=2 pgs=23173 cs=5133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.035741 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52479 s=2 pgs=23246 cs=4361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.035755 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57596 s=2 pgs=17606 cs=3875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.036106 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57717 s=2 pgs=23174 cs=5135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.036486 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57599 s=2 pgs=17607 cs=3877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.036860 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52482 s=2 pgs=23247 cs=4363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.036961 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57720 s=2 pgs=23175 cs=5137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.037246 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57601 s=2 pgs=17608 cs=3879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.037634 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57723 s=2 pgs=23176 cs=5139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.037961 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52486 s=2 pgs=23248 cs=4365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.038259 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57604 s=2 pgs=17609 cs=3881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.038438 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57725 s=2 pgs=23177 cs=5141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.038977 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57607 s=2 pgs=17610 cs=3883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.039361 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57728 s=2 pgs=23178 cs=5143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.039669 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57609 s=2 pgs=17611 cs=3885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.040301 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52490 s=2 pgs=23249 cs=4367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.040300 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57730 s=2 pgs=23179 cs=5145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.040438 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57611 s=2 pgs=17612 cs=3887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.041035 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57732 s=2 pgs=23180 cs=5147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.041331 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57614 s=2 pgs=17613 cs=3889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.041413 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52496 s=2 pgs=23250 cs=4369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.041878 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57735 s=2 pgs=23181 cs=5149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.042145 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57616 s=2 pgs=17614 cs=3891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.042563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52501 s=2 pgs=23251 cs=4371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.042751 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57738 s=2 pgs=23182 cs=5151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.042878 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57619 s=2 pgs=17615 cs=3893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.043526 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57741 s=2 pgs=23183 cs=5153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.043651 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52504 s=2 pgs=23252 cs=4373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.043698 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57622 s=2 pgs=17616 cs=3895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.044299 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57743 s=2 pgs=23184 cs=5155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.044488 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57625 s=2 pgs=17617 cs=3897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.044629 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52508 s=2 pgs=23253 cs=4375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.045061 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57746 s=2 pgs=23185 cs=5157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.045348 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57627 s=2 pgs=17618 cs=3899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.045687 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52512 s=2 pgs=23254 cs=4377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.045838 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57749 s=2 pgs=23186 cs=5159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.046062 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57630 s=2 pgs=17619 cs=3901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.046695 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57752 s=2 pgs=23187 cs=5161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.046818 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52515 s=2 pgs=23255 cs=4379 l=0).fault, initiating reconnect
2013-06-08 20:25:42.046971 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57633 s=2 pgs=17620 cs=3903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.047461 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57754 s=2 pgs=23188 cs=5163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.047728 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57636 s=2 pgs=17621 cs=3905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.047808 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52519 s=2 pgs=23256 cs=4381 l=0).fault, initiating reconnect
2013-06-08 20:25:42.048245 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57757 s=2 pgs=23189 cs=5165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.048470 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57638 s=2 pgs=17622 cs=3907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.048950 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52523 s=2 pgs=23257 cs=4383 l=0).fault, initiating reconnect
2013-06-08 20:25:42.049038 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57760 s=2 pgs=23190 cs=5167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.049358 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57641 s=2 pgs=17623 cs=3909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.049733 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57763 s=2 pgs=23191 cs=5169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.050024 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52526 s=2 pgs=23258 cs=4385 l=0).fault, initiating reconnect
2013-06-08 20:25:42.050371 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57644 s=2 pgs=17624 cs=3911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.050514 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57765 s=2 pgs=23192 cs=5171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.051214 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52530 s=2 pgs=23259 cs=4387 l=0).fault, initiating reconnect
2013-06-08 20:25:42.051396 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57768 s=2 pgs=23193 cs=5173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.051524 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57647 s=2 pgs=17625 cs=3913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.052229 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57770 s=2 pgs=23194 cs=5175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.052302 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57651 s=2 pgs=17626 cs=3915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.052365 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52533 s=2 pgs=23260 cs=4389 l=0).fault, initiating reconnect
2013-06-08 20:25:42.053035 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57772 s=2 pgs=23195 cs=5177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.053171 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57653 s=2 pgs=17627 cs=3917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.053582 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52538 s=2 pgs=23261 cs=4391 l=0).fault, initiating reconnect
2013-06-08 20:25:42.053891 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57656 s=2 pgs=17628 cs=3919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.054039 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57775 s=2 pgs=23196 cs=5179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.054685 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57658 s=2 pgs=17629 cs=3921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.054753 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52541 s=2 pgs=23262 cs=4393 l=0).fault, initiating reconnect
2013-06-08 20:25:42.054850 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57779 s=2 pgs=23197 cs=5181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.055467 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57660 s=2 pgs=17630 cs=3923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.055597 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57782 s=2 pgs=23198 cs=5183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.055918 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52545 s=2 pgs=23263 cs=4395 l=0).fault, initiating reconnect
2013-06-08 20:25:42.056311 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57663 s=2 pgs=17631 cs=3925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.056434 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57784 s=2 pgs=23199 cs=5185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.057155 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52549 s=2 pgs=23264 cs=4397 l=0).fault, initiating reconnect
2013-06-08 20:25:42.057157 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57666 s=2 pgs=17632 cs=3927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.057416 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57787 s=2 pgs=23200 cs=5187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.057991 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57669 s=2 pgs=17633 cs=3929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.058132 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57790 s=2 pgs=23201 cs=5189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.058313 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52552 s=2 pgs=23265 cs=4399 l=0).fault, initiating reconnect
2013-06-08 20:25:42.058734 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57671 s=2 pgs=17634 cs=3931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.058921 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57792 s=2 pgs=23202 cs=5191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.059581 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52557 s=2 pgs=23266 cs=4401 l=0).fault, initiating reconnect
2013-06-08 20:25:42.059632 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57674 s=2 pgs=17635 cs=3933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.059766 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57795 s=2 pgs=23203 cs=5193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.060374 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57677 s=2 pgs=17636 cs=3935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.060596 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57798 s=2 pgs=23204 cs=5195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.060788 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52560 s=2 pgs=23267 cs=4403 l=0).fault, initiating reconnect
2013-06-08 20:25:42.061229 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57679 s=2 pgs=17637 cs=3937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.061435 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57800 s=2 pgs=23205 cs=5197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.061917 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52565 s=2 pgs=23268 cs=4405 l=0).fault, initiating reconnect
2013-06-08 20:25:42.062234 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57682 s=2 pgs=17638 cs=3939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.062526 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57803 s=2 pgs=23206 cs=5199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.062921 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57685 s=2 pgs=17639 cs=3941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.063050 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52568 s=2 pgs=23269 cs=4407 l=0).fault, initiating reconnect
2013-06-08 20:25:42.063376 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57806 s=2 pgs=23207 cs=5201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.063652 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57687 s=2 pgs=17640 cs=3943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.064089 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52572 s=2 pgs=23270 cs=4409 l=0).fault, initiating reconnect
2013-06-08 20:25:42.064206 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57809 s=2 pgs=23208 cs=5203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.064597 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57690 s=2 pgs=17641 cs=3945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.064947 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57812 s=2 pgs=23209 cs=5205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.065060 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52575 s=2 pgs=23271 cs=4411 l=0).fault, initiating reconnect
2013-06-08 20:25:42.065420 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57693 s=2 pgs=17642 cs=3947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.065715 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57814 s=2 pgs=23210 cs=5207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.066017 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52579 s=2 pgs=23272 cs=4413 l=0).fault, initiating reconnect
2013-06-08 20:25:42.066264 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57696 s=2 pgs=17643 cs=3949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.066441 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57817 s=2 pgs=23211 cs=5209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.066917 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57699 s=2 pgs=17644 cs=3951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.067090 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52582 s=2 pgs=23273 cs=4415 l=0).fault, initiating reconnect
2013-06-08 20:25:42.067354 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57820 s=2 pgs=23212 cs=5211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.067748 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57701 s=2 pgs=17645 cs=3953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.068105 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57823 s=2 pgs=23213 cs=5213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.068597 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57704 s=2 pgs=17646 cs=3955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.068871 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57825 s=2 pgs=23214 cs=5215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.069328 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57706 s=2 pgs=17647 cs=3957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.069665 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57827 s=2 pgs=23215 cs=5217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.070121 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57708 s=2 pgs=17648 cs=3959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.070453 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57829 s=2 pgs=23216 cs=5219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.070942 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57710 s=2 pgs=17649 cs=3961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.071244 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57831 s=2 pgs=23217 cs=5221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.071726 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57712 s=2 pgs=17650 cs=3963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.072026 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57833 s=2 pgs=23218 cs=5223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.072475 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57714 s=2 pgs=17651 cs=3965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.072787 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57835 s=2 pgs=23219 cs=5225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.073179 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57716 s=2 pgs=17652 cs=3967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.073580 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57837 s=2 pgs=23220 cs=5227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.073876 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57718 s=2 pgs=17653 cs=3969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.074368 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57839 s=2 pgs=23221 cs=5229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.074622 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57720 s=2 pgs=17654 cs=3971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.075096 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52586 s=2 pgs=23274 cs=4417 l=0).fault, initiating reconnect
2013-06-08 20:25:42.075148 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57841 s=2 pgs=23222 cs=5231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.075377 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57722 s=2 pgs=17655 cs=3973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.075849 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57844 s=2 pgs=23223 cs=5233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.076091 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57725 s=2 pgs=17656 cs=3975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.076269 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52607 s=2 pgs=23275 cs=4419 l=0).fault, initiating reconnect
2013-06-08 20:25:42.076627 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57846 s=2 pgs=23224 cs=5235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.076753 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57727 s=2 pgs=17657 cs=3977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.077436 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52612 s=2 pgs=23276 cs=4421 l=0).fault, initiating reconnect
2013-06-08 20:25:42.077495 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57849 s=2 pgs=23225 cs=5237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.077660 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57730 s=2 pgs=17658 cs=3979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.078205 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57852 s=2 pgs=23226 cs=5239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.078587 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57733 s=2 pgs=17659 cs=3981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.078698 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52615 s=2 pgs=23277 cs=4423 l=0).fault, initiating reconnect
2013-06-08 20:25:42.078948 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57854 s=2 pgs=23227 cs=5241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.079734 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57735 s=2 pgs=17660 cs=3983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.079774 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57857 s=2 pgs=23228 cs=5243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.079800 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52620 s=2 pgs=23278 cs=4425 l=0).fault, initiating reconnect
2013-06-08 20:25:42.080524 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57738 s=2 pgs=17661 cs=3985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.080573 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57859 s=2 pgs=23229 cs=5245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.080872 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52624 s=2 pgs=23279 cs=4427 l=0).fault, initiating reconnect
2013-06-08 20:25:42.081281 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57862 s=2 pgs=23230 cs=5247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.081397 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57741 s=2 pgs=17662 cs=3987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.082047 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52627 s=2 pgs=23280 cs=4429 l=0).fault, initiating reconnect
2013-06-08 20:25:42.082058 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57864 s=2 pgs=23231 cs=5249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.082187 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57745 s=2 pgs=17663 cs=3989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.082781 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57867 s=2 pgs=23232 cs=5251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.083080 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57748 s=2 pgs=17664 cs=3991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.083454 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52630 s=2 pgs=23281 cs=4431 l=0).fault, initiating reconnect
2013-06-08 20:25:42.083823 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57750 s=2 pgs=17665 cs=3993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.083846 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57869 s=2 pgs=23233 cs=5253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.084594 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52635 s=2 pgs=23282 cs=4433 l=0).fault, initiating reconnect
2013-06-08 20:25:42.084754 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57873 s=2 pgs=23234 cs=5255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.084825 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57752 s=2 pgs=17666 cs=3995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.085567 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57756 s=2 pgs=17667 cs=3997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.085598 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57875 s=2 pgs=23235 cs=5257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.085719 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52638 s=2 pgs=23283 cs=4435 l=0).fault, initiating reconnect
2013-06-08 20:25:42.086396 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57757 s=2 pgs=17668 cs=3999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.086477 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57878 s=2 pgs=23236 cs=5259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.086878 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52643 s=2 pgs=23284 cs=4437 l=0).fault, initiating reconnect
2013-06-08 20:25:42.087239 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57760 s=2 pgs=17669 cs=4001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.087275 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57881 s=2 pgs=23237 cs=5261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.088019 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52646 s=2 pgs=23285 cs=4439 l=0).fault, initiating reconnect
2013-06-08 20:25:42.088083 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57763 s=2 pgs=17670 cs=4003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.088127 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57884 s=2 pgs=23238 cs=5263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.088928 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57887 s=2 pgs=23239 cs=5265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.088982 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57766 s=2 pgs=17671 cs=4005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.089114 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52649 s=2 pgs=23286 cs=4441 l=0).fault, initiating reconnect
2013-06-08 20:25:42.089673 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57769 s=2 pgs=17672 cs=4007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.089719 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57888 s=2 pgs=23240 cs=5267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.090148 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52654 s=2 pgs=23287 cs=4443 l=0).fault, initiating reconnect
2013-06-08 20:25:42.090521 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57892 s=2 pgs=23241 cs=5269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.090559 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57771 s=2 pgs=17673 cs=4009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.091295 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52657 s=2 pgs=23288 cs=4445 l=0).fault, initiating reconnect
2013-06-08 20:25:42.091389 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57894 s=2 pgs=23242 cs=5271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.092139 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57897 s=2 pgs=23243 cs=5273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.092485 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52660 s=2 pgs=23289 cs=4447 l=0).fault, initiating reconnect
2013-06-08 20:25:42.092829 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57898 s=2 pgs=23244 cs=5275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.093738 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52663 s=2 pgs=23290 cs=4449 l=0).fault, initiating reconnect
2013-06-08 20:25:42.093746 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57900 s=2 pgs=23245 cs=5277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.094513 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57901 s=2 pgs=23246 cs=5279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.094845 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52666 s=2 pgs=23291 cs=4451 l=0).fault, initiating reconnect
2013-06-08 20:25:42.095327 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57903 s=2 pgs=23247 cs=5281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.095870 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52668 s=2 pgs=23292 cs=4453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.096145 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57905 s=2 pgs=23248 cs=5283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.096863 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57907 s=2 pgs=23249 cs=5285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.096983 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52670 s=2 pgs=23293 cs=4455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.097623 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57908 s=2 pgs=23250 cs=5287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.098034 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52673 s=2 pgs=23294 cs=4457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.098375 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57910 s=2 pgs=23251 cs=5289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.099207 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52675 s=2 pgs=23295 cs=4459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.099276 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57912 s=2 pgs=23252 cs=5291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.100208 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57914 s=2 pgs=23253 cs=5293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.100392 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52677 s=2 pgs=23296 cs=4461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.100965 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57915 s=2 pgs=23254 cs=5295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.101737 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52680 s=2 pgs=23297 cs=4463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.101837 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57917 s=2 pgs=23255 cs=5297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.102557 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57919 s=2 pgs=23256 cs=5299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.102866 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52682 s=2 pgs=23298 cs=4465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.103342 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57920 s=2 pgs=23257 cs=5301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.104101 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :57922 s=2 pgs=23258 cs=5303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.104102 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52685 s=2 pgs=23299 cs=4467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.104886 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57923 s=2 pgs=23259 cs=5305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.105299 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52688 s=2 pgs=23300 cs=4469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.105542 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57925 s=2 pgs=23260 cs=5307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.106324 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52690 s=2 pgs=23301 cs=4471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.106421 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57927 s=2 pgs=23261 cs=5309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.107156 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57929 s=2 pgs=23262 cs=5311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.107501 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52692 s=2 pgs=23302 cs=4473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.107895 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57930 s=2 pgs=23263 cs=5313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.108597 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57932 s=2 pgs=23264 cs=5315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.108777 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52695 s=2 pgs=23303 cs=4475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.109299 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57933 s=2 pgs=23265 cs=5317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.109767 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52698 s=2 pgs=23304 cs=4477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.110121 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57935 s=2 pgs=23266 cs=5319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.110819 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52700 s=2 pgs=23305 cs=4479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.110870 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57937 s=2 pgs=23267 cs=5321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.111632 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57939 s=2 pgs=23268 cs=5323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.111903 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52702 s=2 pgs=23306 cs=4481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.112291 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57940 s=2 pgs=23269 cs=5325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.113046 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52705 s=2 pgs=23307 cs=4483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.113175 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57942 s=2 pgs=23270 cs=5327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.113932 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57944 s=2 pgs=23271 cs=5329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.114050 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52707 s=2 pgs=23308 cs=4485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.114678 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57945 s=2 pgs=23272 cs=5331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.115177 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52710 s=2 pgs=23309 cs=4487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.115426 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57947 s=2 pgs=23273 cs=5333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.116285 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57949 s=2 pgs=23274 cs=5335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.116338 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52712 s=2 pgs=23310 cs=4489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.116994 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57950 s=2 pgs=23275 cs=5337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.117319 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52715 s=2 pgs=23311 cs=4491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.117707 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57952 s=2 pgs=23276 cs=5339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.118483 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52717 s=2 pgs=23312 cs=4493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.118622 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57954 s=2 pgs=23277 cs=5341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.119437 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57956 s=2 pgs=23278 cs=5343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.119531 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52719 s=2 pgs=23313 cs=4495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.120257 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57957 s=2 pgs=23279 cs=5345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.120609 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52722 s=2 pgs=23314 cs=4497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.120976 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57959 s=2 pgs=23280 cs=5347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.121818 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52724 s=2 pgs=23315 cs=4499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.121874 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57961 s=2 pgs=23281 cs=5349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.122872 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57963 s=2 pgs=23282 cs=5351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.122874 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52726 s=2 pgs=23316 cs=4501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.123666 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57964 s=2 pgs=23283 cs=5353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.123945 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52729 s=2 pgs=23317 cs=4503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.124452 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57966 s=2 pgs=23284 cs=5355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.124982 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52731 s=2 pgs=23318 cs=4505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.125341 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57968 s=2 pgs=23285 cs=5357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.126111 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52733 s=2 pgs=23319 cs=4507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.126204 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57970 s=2 pgs=23286 cs=5359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.126996 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57972 s=2 pgs=23287 cs=5361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.127213 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52735 s=2 pgs=23320 cs=4509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.127734 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57973 s=2 pgs=23288 cs=5363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.128358 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52738 s=2 pgs=23321 cs=4511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.128505 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57975 s=2 pgs=23289 cs=5365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.129241 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57977 s=2 pgs=23290 cs=5367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.129614 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52740 s=2 pgs=23322 cs=4513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.129974 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57978 s=2 pgs=23291 cs=5369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.130788 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52743 s=2 pgs=23323 cs=4515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.130865 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57980 s=2 pgs=23292 cs=5371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.131674 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57982 s=2 pgs=23293 cs=5373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.131979 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52745 s=2 pgs=23324 cs=4517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.132429 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57983 s=2 pgs=23294 cs=5375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.133061 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52748 s=2 pgs=23325 cs=4519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.133167 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57985 s=2 pgs=23295 cs=5377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.133826 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57987 s=2 pgs=23296 cs=5379 l=0).fault, initiating reconnect
2013-06-08 20:25:42.134199 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52750 s=2 pgs=23326 cs=4521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.134580 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57988 s=2 pgs=23297 cs=5381 l=0).fault, initiating reconnect
2013-06-08 20:25:42.135311 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57990 s=2 pgs=23298 cs=5383 l=0).fault, initiating reconnect
2013-06-08 20:25:42.135487 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52753 s=2 pgs=23327 cs=4523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.136227 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57991 s=2 pgs=23299 cs=5385 l=0).fault, initiating reconnect
2013-06-08 20:25:42.136735 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52756 s=2 pgs=23328 cs=4525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.137062 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57993 s=2 pgs=23300 cs=5387 l=0).fault, initiating reconnect
2013-06-08 20:25:42.137816 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52758 s=2 pgs=23329 cs=4527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.137896 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57995 s=2 pgs=23301 cs=5389 l=0).fault, initiating reconnect
2013-06-08 20:25:42.138669 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57997 s=2 pgs=23302 cs=5391 l=0).fault, initiating reconnect
2013-06-08 20:25:42.138936 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52760 s=2 pgs=23330 cs=4529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.139390 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :57998 s=2 pgs=23303 cs=5393 l=0).fault, initiating reconnect
2013-06-08 20:25:42.140001 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52763 s=2 pgs=23331 cs=4531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.140294 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58000 s=2 pgs=23304 cs=5395 l=0).fault, initiating reconnect
2013-06-08 20:25:42.141015 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58002 s=2 pgs=23305 cs=5397 l=0).fault, initiating reconnect
2013-06-08 20:25:42.141194 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52765 s=2 pgs=23332 cs=4533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.141760 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58003 s=2 pgs=23306 cs=5399 l=0).fault, initiating reconnect
2013-06-08 20:25:42.142417 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52768 s=2 pgs=23333 cs=4535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.142589 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58005 s=2 pgs=23307 cs=5401 l=0).fault, initiating reconnect
2013-06-08 20:25:42.143421 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58007 s=2 pgs=23308 cs=5403 l=0).fault, initiating reconnect
2013-06-08 20:25:42.143503 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52770 s=2 pgs=23334 cs=4537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.144475 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58008 s=2 pgs=23309 cs=5405 l=0).fault, initiating reconnect
2013-06-08 20:25:42.144722 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52773 s=2 pgs=23335 cs=4539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.145295 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58010 s=2 pgs=23310 cs=5407 l=0).fault, initiating reconnect
2013-06-08 20:25:42.145916 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52775 s=2 pgs=23336 cs=4541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.146083 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58012 s=2 pgs=23311 cs=5409 l=0).fault, initiating reconnect
2013-06-08 20:25:42.146820 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58014 s=2 pgs=23312 cs=5411 l=0).fault, initiating reconnect
2013-06-08 20:25:42.146996 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52777 s=2 pgs=23337 cs=4543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.147582 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58015 s=2 pgs=23313 cs=5413 l=0).fault, initiating reconnect
2013-06-08 20:25:42.148110 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52780 s=2 pgs=23338 cs=4545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.148505 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58017 s=2 pgs=23314 cs=5415 l=0).fault, initiating reconnect
2013-06-08 20:25:42.149123 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52782 s=2 pgs=23339 cs=4547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.149296 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58019 s=2 pgs=23315 cs=5417 l=0).fault, initiating reconnect
2013-06-08 20:25:42.150132 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58021 s=2 pgs=23316 cs=5419 l=0).fault, initiating reconnect
2013-06-08 20:25:42.150390 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52784 s=2 pgs=23340 cs=4549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.150832 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58022 s=2 pgs=23317 cs=5421 l=0).fault, initiating reconnect
2013-06-08 20:25:42.151638 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52787 s=2 pgs=23341 cs=4551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.151640 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58024 s=2 pgs=23318 cs=5423 l=0).fault, initiating reconnect
2013-06-08 20:25:42.152412 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58026 s=2 pgs=23319 cs=5425 l=0).fault, initiating reconnect
2013-06-08 20:25:42.152686 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52789 s=2 pgs=23342 cs=4553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.153095 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58027 s=2 pgs=23320 cs=5427 l=0).fault, initiating reconnect
2013-06-08 20:25:42.153785 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52792 s=2 pgs=23343 cs=4555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.153835 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58029 s=2 pgs=23321 cs=5429 l=0).fault, initiating reconnect
2013-06-08 20:25:42.154757 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58031 s=2 pgs=23322 cs=5431 l=0).fault, initiating reconnect
2013-06-08 20:25:42.154921 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52794 s=2 pgs=23344 cs=4557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.155567 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58032 s=2 pgs=23323 cs=5433 l=0).fault, initiating reconnect
2013-06-08 20:25:42.156049 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52797 s=2 pgs=23345 cs=4559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.156416 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58034 s=2 pgs=23324 cs=5435 l=0).fault, initiating reconnect
2013-06-08 20:25:42.157172 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52799 s=2 pgs=23346 cs=4561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.157201 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58036 s=2 pgs=23325 cs=5437 l=0).fault, initiating reconnect
2013-06-08 20:25:42.158049 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58038 s=2 pgs=23326 cs=5439 l=0).fault, initiating reconnect
2013-06-08 20:25:42.158414 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52801 s=2 pgs=23347 cs=4563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.158851 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58039 s=2 pgs=23327 cs=5441 l=0).fault, initiating reconnect
2013-06-08 20:25:42.159614 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58041 s=2 pgs=23328 cs=5443 l=0).fault, initiating reconnect
2013-06-08 20:25:42.159764 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52804 s=2 pgs=23348 cs=4565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.160446 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58042 s=2 pgs=23329 cs=5445 l=0).fault, initiating reconnect
2013-06-08 20:25:42.161035 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52807 s=2 pgs=23349 cs=4567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.161383 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58044 s=2 pgs=23330 cs=5447 l=0).fault, initiating reconnect
2013-06-08 20:25:42.162103 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58046 s=2 pgs=23331 cs=5449 l=0).fault, initiating reconnect
2013-06-08 20:25:42.162303 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52809 s=2 pgs=23350 cs=4569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.162907 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58047 s=2 pgs=23332 cs=5451 l=0).fault, initiating reconnect
2013-06-08 20:25:42.163441 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52812 s=2 pgs=23351 cs=4571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.163771 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58049 s=2 pgs=23333 cs=5453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.164507 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52814 s=2 pgs=23352 cs=4573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.164591 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58051 s=2 pgs=23334 cs=5455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.165318 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58053 s=2 pgs=23335 cs=5457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.165635 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52816 s=2 pgs=23353 cs=4575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.166044 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58054 s=2 pgs=23336 cs=5459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.166732 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52819 s=2 pgs=23354 cs=4577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.166818 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58056 s=2 pgs=23337 cs=5461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.167614 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58058 s=2 pgs=23338 cs=5463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.167717 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52821 s=2 pgs=23355 cs=4579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.168390 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58059 s=2 pgs=23339 cs=5465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.168821 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52824 s=2 pgs=23356 cs=4581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.169135 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58061 s=2 pgs=23340 cs=5467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.169896 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52826 s=2 pgs=23357 cs=4583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.169902 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58063 s=2 pgs=23341 cs=5469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.170668 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58065 s=2 pgs=23342 cs=5471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.170947 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52828 s=2 pgs=23358 cs=4585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.171403 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58066 s=2 pgs=23343 cs=5473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.172040 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52831 s=2 pgs=23359 cs=4587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.172217 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58068 s=2 pgs=23344 cs=5475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.172949 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58070 s=2 pgs=23345 cs=5477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.173139 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52833 s=2 pgs=23360 cs=4589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.173580 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58071 s=2 pgs=23346 cs=5479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.174249 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52836 s=2 pgs=23361 cs=4591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.174314 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58073 s=2 pgs=23347 cs=5481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.175064 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58075 s=2 pgs=23348 cs=5483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.175462 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52838 s=2 pgs=23362 cs=4593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.175823 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58076 s=2 pgs=23349 cs=5485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.175979 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57775 s=2 pgs=17674 cs=4011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.176660 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58078 s=2 pgs=23350 cs=5487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.176668 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52841 s=2 pgs=23363 cs=4595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.176992 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57959 s=2 pgs=17675 cs=4013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.177447 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58080 s=2 pgs=23351 cs=5489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.177771 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52845 s=2 pgs=23364 cs=4597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.178121 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57962 s=2 pgs=17676 cs=4015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.178290 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58083 s=2 pgs=23352 cs=5491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.178948 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57965 s=2 pgs=17677 cs=4017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.179069 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58086 s=2 pgs=23353 cs=5493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.179091 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52848 s=2 pgs=23365 cs=4599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.179810 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58088 s=2 pgs=23354 cs=5495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.179951 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57967 s=2 pgs=17678 cs=4019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.180315 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52853 s=2 pgs=23366 cs=4601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.180666 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58090 s=2 pgs=23355 cs=5497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.180697 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57971 s=2 pgs=17679 cs=4021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.181519 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52856 s=2 pgs=23367 cs=4603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.181527 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58093 s=2 pgs=23356 cs=5499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.181746 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57974 s=2 pgs=17680 cs=4023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.182342 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58096 s=2 pgs=23357 cs=5501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.182602 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57977 s=2 pgs=17681 cs=4025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.182756 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52859 s=2 pgs=23368 cs=4605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.183104 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58098 s=2 pgs=23358 cs=5503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.183465 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57979 s=2 pgs=17682 cs=4027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.183839 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52864 s=2 pgs=23369 cs=4607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.183905 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58101 s=2 pgs=23359 cs=5505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.184434 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57982 s=2 pgs=17683 cs=4029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.184811 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58104 s=2 pgs=23360 cs=5507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.184916 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52867 s=2 pgs=23370 cs=4609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.185282 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57985 s=2 pgs=17684 cs=4031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.185597 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58106 s=2 pgs=23361 cs=5509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.186015 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57988 s=2 pgs=17685 cs=4033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.186393 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58109 s=2 pgs=23362 cs=5511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.186409 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52871 s=2 pgs=23371 cs=4611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.186924 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57990 s=2 pgs=17686 cs=4035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.187152 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58111 s=2 pgs=23363 cs=5513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.187571 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52876 s=2 pgs=23372 cs=4613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.187886 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58114 s=2 pgs=23364 cs=5515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.187913 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57993 s=2 pgs=17687 cs=4037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.188647 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58116 s=2 pgs=23365 cs=5517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.188830 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52879 s=2 pgs=23373 cs=4615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.188874 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :57997 s=2 pgs=17688 cs=4039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.189419 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58118 s=2 pgs=23366 cs=5519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.189588 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58000 s=2 pgs=17689 cs=4041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.189837 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52883 s=2 pgs=23374 cs=4617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.190166 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58121 s=2 pgs=23367 cs=5521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.190987 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52887 s=2 pgs=23375 cs=4619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.190993 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58124 s=2 pgs=23368 cs=5523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.191380 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58002 s=2 pgs=17690 cs=4043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.191746 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58126 s=2 pgs=23369 cs=5525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.192104 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52889 s=2 pgs=23376 cs=4621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.192386 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58007 s=2 pgs=17691 cs=4045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.192539 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58128 s=2 pgs=23370 cs=5527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.193082 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58010 s=2 pgs=17692 cs=4047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.193233 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58131 s=2 pgs=23371 cs=5529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.193292 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52893 s=2 pgs=23377 cs=4623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.193914 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58012 s=2 pgs=17693 cs=4049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.194046 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58133 s=2 pgs=23372 cs=5531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.194584 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52898 s=2 pgs=23378 cs=4625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.194667 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58015 s=2 pgs=17694 cs=4051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.194919 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58136 s=2 pgs=23373 cs=5533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.195337 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58018 s=2 pgs=17695 cs=4053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.195730 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58139 s=2 pgs=23374 cs=5535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.195733 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :52901 s=2 pgs=23379 cs=4627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.196177 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58020 s=2 pgs=17696 cs=4055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.196404 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58141 s=2 pgs=23375 cs=5537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.196769 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52905 s=2 pgs=23380 cs=4629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.197061 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58144 s=2 pgs=23376 cs=5539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.197078 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58023 s=2 pgs=17697 cs=4057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.197795 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58146 s=2 pgs=23377 cs=5541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.197849 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52909 s=2 pgs=23381 cs=4631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.197963 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58027 s=2 pgs=17698 cs=4059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.198534 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58148 s=2 pgs=23378 cs=5543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.198731 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58030 s=2 pgs=17699 cs=4061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.198848 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52913 s=2 pgs=23382 cs=4633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.199304 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58151 s=2 pgs=23379 cs=5545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.199446 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58032 s=2 pgs=17700 cs=4063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.200016 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52917 s=2 pgs=23383 cs=4635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.200170 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58154 s=2 pgs=23380 cs=5547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.200193 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58035 s=2 pgs=17701 cs=4065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.200922 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58157 s=2 pgs=23381 cs=5549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.200963 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58038 s=2 pgs=17702 cs=4067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.201110 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52920 s=2 pgs=23384 cs=4637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.201608 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58040 s=2 pgs=17703 cs=4069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.201685 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58159 s=2 pgs=23382 cs=5551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.202290 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52925 s=2 pgs=23385 cs=4639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.202408 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58163 s=2 pgs=23383 cs=5553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.202458 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58042 s=2 pgs=17704 cs=4071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.203116 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58046 s=2 pgs=17705 cs=4073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.203123 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58165 s=2 pgs=23384 cs=5555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.203529 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52928 s=2 pgs=23386 cs=4641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.203764 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58047 s=2 pgs=17706 cs=4075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.203882 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58168 s=2 pgs=23385 cs=5557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.204504 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58050 s=2 pgs=17707 cs=4077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.204618 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52933 s=2 pgs=23387 cs=4643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.204705 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58171 s=2 pgs=23386 cs=5559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.205249 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58052 s=2 pgs=17708 cs=4079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.205418 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58174 s=2 pgs=23387 cs=5561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.205754 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52937 s=2 pgs=23388 cs=4645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.206044 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58055 s=2 pgs=17709 cs=4081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.206135 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58176 s=2 pgs=23388 cs=5563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.206743 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58058 s=2 pgs=17710 cs=4083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.206908 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52941 s=2 pgs=23389 cs=4647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.206956 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58179 s=2 pgs=23389 cs=5565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.207560 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58060 s=2 pgs=17711 cs=4085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.207692 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58182 s=2 pgs=23390 cs=5567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.208097 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52945 s=2 pgs=23390 cs=4649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.208380 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58063 s=2 pgs=17712 cs=4087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.208474 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58184 s=2 pgs=23391 cs=5569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.209122 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58066 s=2 pgs=17713 cs=4089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.209196 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58187 s=2 pgs=23392 cs=5571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.209199 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :52949 s=2 pgs=23391 cs=4651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.209916 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58068 s=2 pgs=17714 cs=4091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.209925 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58189 s=2 pgs=23393 cs=5573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.210279 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52954 s=2 pgs=23392 cs=4653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.210720 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58192 s=2 pgs=23394 cs=5575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.210756 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58071 s=2 pgs=17715 cs=4093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.211393 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52957 s=2 pgs=23393 cs=4655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.211543 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58194 s=2 pgs=23395 cs=5577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.211587 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58075 s=2 pgs=17716 cs=4095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.212285 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58197 s=2 pgs=23396 cs=5579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.212335 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58078 s=2 pgs=17717 cs=4097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.212557 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52960 s=2 pgs=23394 cs=4657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.212908 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58080 s=2 pgs=17718 cs=4099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.213027 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58199 s=2 pgs=23397 cs=5581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.213676 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52965 s=2 pgs=23395 cs=4659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.213737 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58203 s=2 pgs=23398 cs=5583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.213820 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58082 s=2 pgs=17719 cs=4101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.214475 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58205 s=2 pgs=23399 cs=5585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.214622 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58086 s=2 pgs=17720 cs=4103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.214809 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52968 s=2 pgs=23396 cs=4661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.215270 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58207 s=2 pgs=23400 cs=5587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.215361 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58088 s=2 pgs=17721 cs=4105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.215958 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52973 s=2 pgs=23397 cs=4663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.216038 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58210 s=2 pgs=23401 cs=5589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.216184 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58091 s=2 pgs=17722 cs=4107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.216784 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58213 s=2 pgs=23402 cs=5591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.216922 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58094 s=2 pgs=17723 cs=4109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.217122 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52976 s=2 pgs=23398 cs=4665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.217532 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58096 s=2 pgs=17724 cs=4111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.217579 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58215 s=2 pgs=23403 cs=5593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.218446 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58219 s=2 pgs=23404 cs=5595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.218635 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58098 s=2 pgs=17725 cs=4113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.219286 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58101 s=2 pgs=17726 cs=4115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.219295 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58220 s=2 pgs=23405 cs=5597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.220093 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58102 s=2 pgs=17727 cs=4117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.220117 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58223 s=2 pgs=23406 cs=5599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.220804 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58104 s=2 pgs=17728 cs=4119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.220880 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58225 s=2 pgs=23407 cs=5601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.221497 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58106 s=2 pgs=17729 cs=4121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.221601 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58227 s=2 pgs=23408 cs=5603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.222164 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58108 s=2 pgs=17730 cs=4123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.222344 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58229 s=2 pgs=23409 cs=5605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.222922 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58110 s=2 pgs=17731 cs=4125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.223172 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58231 s=2 pgs=23410 cs=5607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.223614 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58112 s=2 pgs=17732 cs=4127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.223937 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58233 s=2 pgs=23411 cs=5609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.224304 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58114 s=2 pgs=17733 cs=4129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.224344 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :52981 s=2 pgs=23399 cs=4667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.224757 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58235 s=2 pgs=23412 cs=5611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.225003 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58116 s=2 pgs=17734 cs=4131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.225542 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58238 s=2 pgs=23413 cs=5613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.225749 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53001 s=2 pgs=23400 cs=4669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.225784 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58119 s=2 pgs=17735 cs=4133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.226357 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58240 s=2 pgs=23414 cs=5615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.226730 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58122 s=2 pgs=17736 cs=4135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.226930 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53005 s=2 pgs=23401 cs=4671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.227279 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58243 s=2 pgs=23415 cs=5617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.227510 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58124 s=2 pgs=17737 cs=4137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.228041 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53009 s=2 pgs=23402 cs=4673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.228115 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58246 s=2 pgs=23416 cs=5619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.228236 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58127 s=2 pgs=17738 cs=4139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.228839 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58249 s=2 pgs=23417 cs=5621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.228971 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58130 s=2 pgs=17739 cs=4141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.229085 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53012 s=2 pgs=23403 cs=4675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.229576 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58251 s=2 pgs=23418 cs=5623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.229616 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58132 s=2 pgs=17740 cs=4143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.230046 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53017 s=2 pgs=23404 cs=4677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.230364 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58254 s=2 pgs=23419 cs=5625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.230440 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58135 s=2 pgs=17741 cs=4145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.231149 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53020 s=2 pgs=23405 cs=4679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.231247 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58257 s=2 pgs=23420 cs=5627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.231409 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58138 s=2 pgs=17742 cs=4147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.231974 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58260 s=2 pgs=23421 cs=5629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.232167 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58141 s=2 pgs=17743 cs=4149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.232273 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53023 s=2 pgs=23406 cs=4681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.232717 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58262 s=2 pgs=23422 cs=5631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.232745 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58143 s=2 pgs=17744 cs=4151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.233412 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53028 s=2 pgs=23407 cs=4683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.233496 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58265 s=2 pgs=23423 cs=5633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.233563 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58146 s=2 pgs=17745 cs=4153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.234271 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58149 s=2 pgs=17746 cs=4155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.234294 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58268 s=2 pgs=23424 cs=5635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.234726 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53031 s=2 pgs=23408 cs=4685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.234849 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58150 s=2 pgs=17747 cs=4157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.235059 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58271 s=2 pgs=23425 cs=5637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.235667 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58153 s=2 pgs=17748 cs=4159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.235795 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53036 s=2 pgs=23409 cs=4687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.235893 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58274 s=2 pgs=23426 cs=5639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.236414 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58155 s=2 pgs=17749 cs=4161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.236547 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58277 s=2 pgs=23427 cs=5641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.236954 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53040 s=2 pgs=23410 cs=4689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.237261 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58158 s=2 pgs=17750 cs=4163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.237306 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58279 s=2 pgs=23428 cs=5643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.237952 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53044 s=2 pgs=23411 cs=4691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.238050 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58282 s=2 pgs=23429 cs=5645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.238213 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58161 s=2 pgs=17751 cs=4165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.238736 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58284 s=2 pgs=23430 cs=5647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.238872 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58165 s=2 pgs=17752 cs=4167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.239072 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53047 s=2 pgs=23412 cs=4693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.239466 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58286 s=2 pgs=23431 cs=5649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.239522 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58167 s=2 pgs=17753 cs=4169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.240163 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53052 s=2 pgs=23413 cs=4695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.240335 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58289 s=2 pgs=23432 cs=5651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.240355 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58170 s=2 pgs=17754 cs=4171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.241139 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58173 s=2 pgs=17755 cs=4173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.241182 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58292 s=2 pgs=23433 cs=5653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.241243 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53055 s=2 pgs=23414 cs=4697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.241773 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58174 s=2 pgs=17756 cs=4175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.241956 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58295 s=2 pgs=23434 cs=5655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.242393 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53060 s=2 pgs=23415 cs=4699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.242546 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58177 s=2 pgs=17757 cs=4177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.242798 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58298 s=2 pgs=23435 cs=5657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.243325 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58180 s=2 pgs=17758 cs=4179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.243415 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53063 s=2 pgs=23416 cs=4701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.243764 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58301 s=2 pgs=23436 cs=5659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.244263 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58182 s=2 pgs=17759 cs=4181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.244584 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58304 s=2 pgs=23437 cs=5661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.244585 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53067 s=2 pgs=23417 cs=4703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.245074 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58185 s=2 pgs=17760 cs=4183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.245392 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58306 s=2 pgs=23438 cs=5663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.245634 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53071 s=2 pgs=23418 cs=4705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.245964 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58188 s=2 pgs=17761 cs=4185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.246201 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58309 s=2 pgs=23439 cs=5665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.246918 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53074 s=2 pgs=23419 cs=4707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.246959 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58191 s=2 pgs=17762 cs=4187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.247119 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58312 s=2 pgs=23440 cs=5667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.247603 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58194 s=2 pgs=17763 cs=4189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.247901 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58315 s=2 pgs=23441 cs=5669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.248087 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53077 s=2 pgs=23420 cs=4709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.248535 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58196 s=2 pgs=17764 cs=4191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.248669 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58317 s=2 pgs=23442 cs=5671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.249193 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53082 s=2 pgs=23421 cs=4711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.249302 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58199 s=2 pgs=17765 cs=4193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.249380 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58320 s=2 pgs=23443 cs=5673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.250148 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58323 s=2 pgs=23444 cs=5675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.250277 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58202 s=2 pgs=17766 cs=4195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.250403 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53085 s=2 pgs=23422 cs=4713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.250920 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58324 s=2 pgs=23445 cs=5677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.251066 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58205 s=2 pgs=17767 cs=4197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.251624 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53090 s=2 pgs=23423 cs=4715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.251794 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58327 s=2 pgs=23446 cs=5679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.251868 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58208 s=2 pgs=17768 cs=4199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.252543 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58330 s=2 pgs=23447 cs=5681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.252783 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53093 s=2 pgs=23424 cs=4717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.252981 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58211 s=2 pgs=17769 cs=4201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.253339 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58332 s=2 pgs=23448 cs=5683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.253843 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53097 s=2 pgs=23425 cs=4719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.254256 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58335 s=2 pgs=23449 cs=5685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.255091 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53100 s=2 pgs=23426 cs=4721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.255127 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58337 s=2 pgs=23450 cs=5687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.255922 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58339 s=2 pgs=23451 cs=5689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.256237 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53102 s=2 pgs=23427 cs=4723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.256703 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58340 s=2 pgs=23452 cs=5691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.257545 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53105 s=2 pgs=23428 cs=4725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.257543 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58342 s=2 pgs=23453 cs=5693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.258359 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58344 s=2 pgs=23454 cs=5695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.258760 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53107 s=2 pgs=23429 cs=4727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.259129 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58345 s=2 pgs=23455 cs=5697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.259982 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58347 s=2 pgs=23456 cs=5699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.260008 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53110 s=2 pgs=23430 cs=4729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.260772 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58348 s=2 pgs=23457 cs=5701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.261161 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53113 s=2 pgs=23431 cs=4731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.261595 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58350 s=2 pgs=23458 cs=5703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.262384 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53115 s=2 pgs=23432 cs=4733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.262414 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58352 s=2 pgs=23459 cs=5705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.263202 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58354 s=2 pgs=23460 cs=5707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.263597 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53117 s=2 pgs=23433 cs=4735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.264000 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58355 s=2 pgs=23461 cs=5709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.264885 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53120 s=2 pgs=23434 cs=4737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.264989 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58357 s=2 pgs=23462 cs=5711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.265709 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58359 s=2 pgs=23463 cs=5713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.266054 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53122 s=2 pgs=23435 cs=4739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.266488 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58360 s=2 pgs=23464 cs=5715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.267194 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53125 s=2 pgs=23436 cs=4741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.267368 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58362 s=2 pgs=23465 cs=5717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.268272 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58364 s=2 pgs=23466 cs=5719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.268395 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53127 s=2 pgs=23437 cs=4743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.269007 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58365 s=2 pgs=23467 cs=5721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.269563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53130 s=2 pgs=23438 cs=4745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.269912 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58367 s=2 pgs=23468 cs=5723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.270727 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53132 s=2 pgs=23439 cs=4747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.270746 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58369 s=2 pgs=23469 cs=5725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.271565 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58371 s=2 pgs=23470 cs=5727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.271910 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53134 s=2 pgs=23440 cs=4749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.272345 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58372 s=2 pgs=23471 cs=5729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.273133 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53137 s=2 pgs=23441 cs=4751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.273224 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58374 s=2 pgs=23472 cs=5731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.274062 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58376 s=2 pgs=23473 cs=5733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.274299 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53139 s=2 pgs=23442 cs=4753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.274789 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58377 s=2 pgs=23474 cs=5735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.275148 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58214 s=2 pgs=17770 cs=4203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.275495 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53142 s=2 pgs=23443 cs=4755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.275671 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58379 s=2 pgs=23475 cs=5737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.276157 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58260 s=2 pgs=17771 cs=4205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.276532 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58382 s=2 pgs=23476 cs=5739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.276652 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53145 s=2 pgs=23444 cs=4757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.277114 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58263 s=2 pgs=17772 cs=4207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.277300 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58384 s=2 pgs=23477 cs=5741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.277750 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53149 s=2 pgs=23445 cs=4759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.278066 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58266 s=2 pgs=17773 cs=4209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.278319 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58387 s=2 pgs=23478 cs=5743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.278878 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58269 s=2 pgs=17774 cs=4211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.279025 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53152 s=2 pgs=23446 cs=4761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.279206 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58390 s=2 pgs=23479 cs=5745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.279757 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58271 s=2 pgs=17775 cs=4213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.279985 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58393 s=2 pgs=23480 cs=5747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.280175 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53156 s=2 pgs=23447 cs=4763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.280414 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58274 s=2 pgs=17776 cs=4215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.280803 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58395 s=2 pgs=23481 cs=5749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.281205 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58277 s=2 pgs=17777 cs=4217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.281403 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53160 s=2 pgs=23448 cs=4765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.281714 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58398 s=2 pgs=23482 cs=5751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.281951 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58279 s=2 pgs=17778 cs=4219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.282440 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58401 s=2 pgs=23483 cs=5753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.282581 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53164 s=2 pgs=23449 cs=4767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.282731 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58282 s=2 pgs=17779 cs=4221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.283165 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58403 s=2 pgs=23484 cs=5755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.283557 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58285 s=2 pgs=17780 cs=4223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.283669 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53168 s=2 pgs=23450 cs=4769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.284014 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58406 s=2 pgs=23485 cs=5757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.284306 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58287 s=2 pgs=17781 cs=4225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.284700 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53172 s=2 pgs=23451 cs=4771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.285045 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58409 s=2 pgs=23486 cs=5759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.285238 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58290 s=2 pgs=17782 cs=4227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.285784 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53175 s=2 pgs=23452 cs=4773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.285930 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58412 s=2 pgs=23487 cs=5761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.286094 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58293 s=2 pgs=17783 cs=4229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.286772 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58415 s=2 pgs=23488 cs=5763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.286962 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53178 s=2 pgs=23453 cs=4775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.287147 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58296 s=2 pgs=17784 cs=4231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.287582 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58417 s=2 pgs=23489 cs=5765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.288001 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53182 s=2 pgs=23454 cs=4777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.288052 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58299 s=2 pgs=17785 cs=4233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.288406 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58420 s=2 pgs=23490 cs=5767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.288802 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58302 s=2 pgs=17786 cs=4235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.289175 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58423 s=2 pgs=23491 cs=5769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.289185 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53185 s=2 pgs=23455 cs=4779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.289700 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58304 s=2 pgs=17787 cs=4237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.289981 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58425 s=2 pgs=23492 cs=5771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.290308 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53190 s=2 pgs=23456 cs=4781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.290604 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58307 s=2 pgs=17788 cs=4239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.290758 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58428 s=2 pgs=23493 cs=5773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.291453 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58310 s=2 pgs=17789 cs=4241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.291477 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53193 s=2 pgs=23457 cs=4783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.291574 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58431 s=2 pgs=23494 cs=5775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.292154 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58312 s=2 pgs=17790 cs=4243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.292378 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58434 s=2 pgs=23495 cs=5777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.292675 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53197 s=2 pgs=23458 cs=4785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.292921 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58315 s=2 pgs=17791 cs=4245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.293142 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58436 s=2 pgs=23496 cs=5779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.293775 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58318 s=2 pgs=17792 cs=4247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.293841 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53201 s=2 pgs=23459 cs=4787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.294007 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58439 s=2 pgs=23497 cs=5781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.294595 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58320 s=2 pgs=17793 cs=4249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.294798 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58442 s=2 pgs=23498 cs=5783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.294915 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53205 s=2 pgs=23460 cs=4789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.295290 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58323 s=2 pgs=17794 cs=4251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.295642 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58444 s=2 pgs=23499 cs=5785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.296035 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53209 s=2 pgs=23461 cs=4791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.296060 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58326 s=2 pgs=17795 cs=4253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.296451 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58447 s=2 pgs=23500 cs=5787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.296985 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58329 s=2 pgs=17796 cs=4255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.297063 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53212 s=2 pgs=23462 cs=4793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.297394 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58450 s=2 pgs=23501 cs=5789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.297751 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58331 s=2 pgs=17797 cs=4257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.298126 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58453 s=2 pgs=23502 cs=5791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.298135 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53216 s=2 pgs=23463 cs=4795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.298524 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58334 s=2 pgs=17798 cs=4259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.298908 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58455 s=2 pgs=23503 cs=5793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.299299 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53220 s=2 pgs=23464 cs=4797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.299447 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58337 s=2 pgs=17799 cs=4261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.299706 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58458 s=2 pgs=23504 cs=5795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.300303 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58340 s=2 pgs=17800 cs=4263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.300349 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53223 s=2 pgs=23465 cs=4799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.300471 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58461 s=2 pgs=23505 cs=5797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.301234 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58464 s=2 pgs=23506 cs=5799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.301245 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58342 s=2 pgs=17801 cs=4265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.301352 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53227 s=2 pgs=23466 cs=4801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.302034 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58346 s=2 pgs=17802 cs=4267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.302057 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58465 s=2 pgs=23507 cs=5801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.302537 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53231 s=2 pgs=23467 cs=4803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.302877 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58469 s=2 pgs=23508 cs=5803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.302927 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58348 s=2 pgs=17803 cs=4269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.303547 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53234 s=2 pgs=23468 cs=4805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.303641 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58471 s=2 pgs=23509 cs=5805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.303859 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58352 s=2 pgs=17804 cs=4271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.304514 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58474 s=2 pgs=23510 cs=5807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.304687 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53237 s=2 pgs=23469 cs=4807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.305244 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58476 s=2 pgs=23511 cs=5809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.305672 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53241 s=2 pgs=23470 cs=4809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.305995 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58478 s=2 pgs=23512 cs=5811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.306746 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53243 s=2 pgs=23471 cs=4811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.306814 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58480 s=2 pgs=23513 cs=5813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.307560 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58482 s=2 pgs=23514 cs=5815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.307861 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53245 s=2 pgs=23472 cs=4813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.308264 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58483 s=2 pgs=23515 cs=5817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.309040 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53248 s=2 pgs=23473 cs=4815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.309042 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58485 s=2 pgs=23516 cs=5819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.309805 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58487 s=2 pgs=23517 cs=5821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.310143 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53250 s=2 pgs=23474 cs=4817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.310521 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58488 s=2 pgs=23518 cs=5823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.311308 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58490 s=2 pgs=23519 cs=5825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.311350 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53253 s=2 pgs=23475 cs=4819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.312075 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58491 s=2 pgs=23520 cs=5827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.312468 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53256 s=2 pgs=23476 cs=4821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.312841 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58493 s=2 pgs=23521 cs=5829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.313596 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53258 s=2 pgs=23477 cs=4823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.313720 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58495 s=2 pgs=23522 cs=5831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.314460 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58497 s=2 pgs=23523 cs=5833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.314710 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53260 s=2 pgs=23478 cs=4825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.315259 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58498 s=2 pgs=23524 cs=5835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.315812 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53263 s=2 pgs=23479 cs=4827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.316134 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58500 s=2 pgs=23525 cs=5837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.316859 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58502 s=2 pgs=23526 cs=5839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.316973 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53265 s=2 pgs=23480 cs=4829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.317608 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58503 s=2 pgs=23527 cs=5841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.318060 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53268 s=2 pgs=23481 cs=4831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.318477 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58505 s=2 pgs=23528 cs=5843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.319246 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58507 s=2 pgs=23529 cs=5845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.319269 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53270 s=2 pgs=23482 cs=4833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.320019 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58508 s=2 pgs=23530 cs=5847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.320449 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53273 s=2 pgs=23483 cs=4835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.320810 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58510 s=2 pgs=23531 cs=5849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.321542 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53275 s=2 pgs=23484 cs=4837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.321642 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58512 s=2 pgs=23532 cs=5851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.322498 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58514 s=2 pgs=23533 cs=5853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.322680 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53277 s=2 pgs=23485 cs=4839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.323325 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58515 s=2 pgs=23534 cs=5855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.323754 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53280 s=2 pgs=23486 cs=4841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.324158 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58517 s=2 pgs=23535 cs=5857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.324839 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53282 s=2 pgs=23487 cs=4843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.324902 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58519 s=2 pgs=23536 cs=5859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.325694 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58521 s=2 pgs=23537 cs=5861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.326099 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53284 s=2 pgs=23488 cs=4845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.326483 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58522 s=2 pgs=23538 cs=5863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.327245 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53287 s=2 pgs=23489 cs=4847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.327262 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58524 s=2 pgs=23539 cs=5865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.327539 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58355 s=2 pgs=17805 cs=4273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.328093 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58526 s=2 pgs=23540 cs=5867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.328344 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58407 s=2 pgs=17806 cs=4275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.328513 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53289 s=2 pgs=23490 cs=4849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.328864 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58528 s=2 pgs=23541 cs=5869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.329164 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58409 s=2 pgs=17807 cs=4277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.329709 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58531 s=2 pgs=23542 cs=5871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.329722 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53294 s=2 pgs=23491 cs=4851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.330065 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58412 s=2 pgs=17808 cs=4279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.330478 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58533 s=2 pgs=23543 cs=5873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.330903 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53298 s=2 pgs=23492 cs=4853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.330940 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58415 s=2 pgs=17809 cs=4281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.331239 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58536 s=2 pgs=23544 cs=5875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.331825 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58418 s=2 pgs=17810 cs=4283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.332126 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53301 s=2 pgs=23493 cs=4855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.332211 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58539 s=2 pgs=23545 cs=5877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.332741 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58420 s=2 pgs=17811 cs=4285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.332998 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58542 s=2 pgs=23546 cs=5879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.333385 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53305 s=2 pgs=23494 cs=4857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.333584 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58423 s=2 pgs=17812 cs=4287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.333728 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58544 s=2 pgs=23547 cs=5881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.334406 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58426 s=2 pgs=17813 cs=4289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.334461 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58547 s=2 pgs=23548 cs=5883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.334601 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53309 s=2 pgs=23495 cs=4859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.335147 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58549 s=2 pgs=23549 cs=5885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.335184 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58428 s=2 pgs=17814 cs=4291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.335746 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53314 s=2 pgs=23496 cs=4861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.336073 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58551 s=2 pgs=23550 cs=5887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.336119 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58432 s=2 pgs=17815 cs=4293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.336807 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58554 s=2 pgs=23551 cs=5889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.336832 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53317 s=2 pgs=23497 cs=4863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.336938 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58435 s=2 pgs=17816 cs=4295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.337577 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58556 s=2 pgs=23552 cs=5891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.337838 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58438 s=2 pgs=17817 cs=4297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.338044 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53321 s=2 pgs=23498 cs=4865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.338267 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58559 s=2 pgs=23553 cs=5893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.338675 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58440 s=2 pgs=17818 cs=4299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.339009 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58562 s=2 pgs=23554 cs=5895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.339190 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53325 s=2 pgs=23499 cs=4867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.339504 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58443 s=2 pgs=17819 cs=4301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.339793 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58564 s=2 pgs=23555 cs=5897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.340428 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53329 s=2 pgs=23500 cs=4869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.340431 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58446 s=2 pgs=17820 cs=4303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.340534 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58567 s=2 pgs=23556 cs=5899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.341236 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58570 s=2 pgs=23557 cs=5901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.341419 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58449 s=2 pgs=17821 cs=4305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.341620 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53332 s=2 pgs=23501 cs=4871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.342011 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58571 s=2 pgs=23558 cs=5903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.342290 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58452 s=2 pgs=17822 cs=4307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.342721 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58574 s=2 pgs=23559 cs=5905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.342746 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53337 s=2 pgs=23502 cs=4873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.343182 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58455 s=2 pgs=17823 cs=4309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.343495 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58577 s=2 pgs=23560 cs=5907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.343769 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53340 s=2 pgs=23503 cs=4875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.344099 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58458 s=2 pgs=17824 cs=4311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.344240 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58579 s=2 pgs=23561 cs=5909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.344818 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53344 s=2 pgs=23504 cs=4877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.345125 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58582 s=2 pgs=23562 cs=5911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.345964 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53347 s=2 pgs=23505 cs=4879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.345990 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58584 s=2 pgs=23563 cs=5913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.346753 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58586 s=2 pgs=23564 cs=5915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.347184 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53349 s=2 pgs=23506 cs=4881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.347465 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58587 s=2 pgs=23565 cs=5917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.348295 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58589 s=2 pgs=23566 cs=5919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.348398 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53352 s=2 pgs=23507 cs=4883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.348981 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58590 s=2 pgs=23567 cs=5921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.349562 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53355 s=2 pgs=23508 cs=4885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.349735 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58592 s=2 pgs=23568 cs=5923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.350611 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58594 s=2 pgs=23569 cs=5925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.350803 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53357 s=2 pgs=23509 cs=4887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.351390 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58595 s=2 pgs=23570 cs=5927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.351974 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53360 s=2 pgs=23510 cs=4889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.352313 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58597 s=2 pgs=23571 cs=5929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.353147 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53362 s=2 pgs=23511 cs=4891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.353173 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58599 s=2 pgs=23572 cs=5931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.353952 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58601 s=2 pgs=23573 cs=5933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.354377 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53364 s=2 pgs=23512 cs=4893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.354756 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58602 s=2 pgs=23574 cs=5935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.355609 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53367 s=2 pgs=23513 cs=4895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.355619 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58604 s=2 pgs=23575 cs=5937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.356447 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58606 s=2 pgs=23576 cs=5939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.356756 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53369 s=2 pgs=23514 cs=4897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.357166 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58607 s=2 pgs=23577 cs=5941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.357782 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53372 s=2 pgs=23515 cs=4899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.358087 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58609 s=2 pgs=23578 cs=5943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.358871 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58611 s=2 pgs=23579 cs=5945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.358991 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53374 s=2 pgs=23516 cs=4901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.359714 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58612 s=2 pgs=23580 cs=5947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.360048 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53377 s=2 pgs=23517 cs=4903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.360413 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58614 s=2 pgs=23581 cs=5949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.361142 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53379 s=2 pgs=23518 cs=4905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.361264 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58616 s=2 pgs=23582 cs=5951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.362104 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58618 s=2 pgs=23583 cs=5953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.362290 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53381 s=2 pgs=23519 cs=4907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.362947 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58619 s=2 pgs=23584 cs=5955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.363471 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53384 s=2 pgs=23520 cs=4909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.363824 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58621 s=2 pgs=23585 cs=5957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.364576 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53386 s=2 pgs=23521 cs=4911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.364672 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58623 s=2 pgs=23586 cs=5959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.365460 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58625 s=2 pgs=23587 cs=5961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.365752 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53388 s=2 pgs=23522 cs=4913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.366196 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58626 s=2 pgs=23588 cs=5963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.366848 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53391 s=2 pgs=23523 cs=4915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.367020 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58628 s=2 pgs=23589 cs=5965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.367773 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58630 s=2 pgs=23590 cs=5967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.367913 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53393 s=2 pgs=23524 cs=4917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.368572 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58631 s=2 pgs=23591 cs=5969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.368993 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53396 s=2 pgs=23525 cs=4919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.369325 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58633 s=2 pgs=23592 cs=5971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.370092 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53398 s=2 pgs=23526 cs=4921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.370267 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58635 s=2 pgs=23593 cs=5973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.371083 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58637 s=2 pgs=23594 cs=5975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.371258 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53400 s=2 pgs=23527 cs=4923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.371881 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58638 s=2 pgs=23595 cs=5977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.372563 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53403 s=2 pgs=23528 cs=4925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.372847 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58640 s=2 pgs=23596 cs=5979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.373598 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53405 s=2 pgs=23529 cs=4927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.373717 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58642 s=2 pgs=23597 cs=5981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.374506 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58644 s=2 pgs=23598 cs=5983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.374618 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53407 s=2 pgs=23530 cs=4929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.375013 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58461 s=2 pgs=17825 cs=4313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.375365 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58645 s=2 pgs=23599 cs=5985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.375791 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53410 s=2 pgs=23531 cs=4931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.376019 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58527 s=2 pgs=17826 cs=4315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.376160 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58648 s=2 pgs=23600 cs=5987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.376838 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58530 s=2 pgs=17827 cs=4317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.376915 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53413 s=2 pgs=23532 cs=4933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.377019 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58651 s=2 pgs=23601 cs=5989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.377605 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58532 s=2 pgs=17828 cs=4319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.377738 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58654 s=2 pgs=23602 cs=5991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.378076 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53417 s=2 pgs=23533 cs=4935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.378499 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58535 s=2 pgs=17829 cs=4321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.378573 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58656 s=2 pgs=23603 cs=5993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.379183 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53421 s=2 pgs=23534 cs=4937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.379319 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58538 s=2 pgs=17830 cs=4323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.379471 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58659 s=2 pgs=23604 cs=5995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.380240 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58541 s=2 pgs=17831 cs=4325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.380253 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58662 s=2 pgs=23605 cs=5997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.380373 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53424 s=2 pgs=23535 cs=4939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.380917 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58543 s=2 pgs=17832 cs=4327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.381033 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58664 s=2 pgs=23606 cs=5999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.381459 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53429 s=2 pgs=23536 cs=4941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.381745 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58546 s=2 pgs=17833 cs=4329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.381830 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58667 s=2 pgs=23607 cs=6001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.382554 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58549 s=2 pgs=17834 cs=4331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.382595 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53432 s=2 pgs=23537 cs=4943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.382691 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58670 s=2 pgs=23608 cs=6003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.383542 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58673 s=2 pgs=23609 cs=6005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.383659 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53436 s=2 pgs=23538 cs=4945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.383661 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :58551 s=2 pgs=17835 cs=4333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.384317 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58674 s=2 pgs=23610 cs=6007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.384643 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58555 s=2 pgs=17836 cs=4335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.385023 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53440 s=2 pgs=23539 cs=4947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.385132 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58677 s=2 pgs=23611 cs=6009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.385536 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58558 s=2 pgs=17837 cs=4337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.385937 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58680 s=2 pgs=23612 cs=6011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.386063 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53443 s=2 pgs=23540 cs=4949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.386360 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58561 s=2 pgs=17838 cs=4339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.386689 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58682 s=2 pgs=23613 cs=6013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.387088 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53447 s=2 pgs=23541 cs=4951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.387284 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58564 s=2 pgs=17839 cs=4341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.387489 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58685 s=2 pgs=23614 cs=6015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.388174 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58567 s=2 pgs=17840 cs=4343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.388269 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53450 s=2 pgs=23542 cs=4953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.388358 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58688 s=2 pgs=23615 cs=6017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.388920 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58569 s=2 pgs=17841 cs=4345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.389062 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58691 s=2 pgs=23616 cs=6019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.389412 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53454 s=2 pgs=23543 cs=4955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.389758 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58572 s=2 pgs=17842 cs=4347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.389773 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58693 s=2 pgs=23617 cs=6021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.390515 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53458 s=2 pgs=23544 cs=4957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.390617 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58575 s=2 pgs=17843 cs=4349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.390627 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58696 s=2 pgs=23618 cs=6023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.391417 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58578 s=2 pgs=17844 cs=4351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.391598 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58699 s=2 pgs=23619 cs=6025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.391774 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53461 s=2 pgs=23545 cs=4959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.392224 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58580 s=2 pgs=17845 cs=4353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.392367 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58701 s=2 pgs=23620 cs=6027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.392821 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53466 s=2 pgs=23546 cs=4961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.393087 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58583 s=2 pgs=17846 cs=4355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.393183 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58704 s=2 pgs=23621 cs=6029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.393866 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58586 s=2 pgs=17847 cs=4357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.393987 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58707 s=2 pgs=23622 cs=6031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.394020 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53469 s=2 pgs=23547 cs=4963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.394756 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58588 s=2 pgs=17848 cs=4359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.394758 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58709 s=2 pgs=23623 cs=6033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.395110 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53474 s=2 pgs=23548 cs=4965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.395556 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58711 s=2 pgs=23624 cs=6035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.395597 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58592 s=2 pgs=17849 cs=4361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.396249 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53477 s=2 pgs=23549 cs=4967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.396416 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58714 s=2 pgs=23625 cs=6037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.396481 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58595 s=2 pgs=17850 cs=4363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.397227 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58717 s=2 pgs=23626 cs=6039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.397333 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53480 s=2 pgs=23550 cs=4969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.397365 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58598 s=2 pgs=17851 cs=4365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.397992 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58719 s=2 pgs=23627 cs=6041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.398041 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58601 s=2 pgs=17852 cs=4367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.398337 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53484 s=2 pgs=23551 cs=4971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.398718 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58603 s=2 pgs=17853 cs=4369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.398762 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58722 s=2 pgs=23628 cs=6043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.399380 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53488 s=2 pgs=23552 cs=4973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.399546 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58726 s=2 pgs=23629 cs=6045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.399598 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58605 s=2 pgs=17854 cs=4371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.400316 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58728 s=2 pgs=23630 cs=6047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.400337 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58609 s=2 pgs=17855 cs=4373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.400489 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53491 s=2 pgs=23553 cs=4975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.401114 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58730 s=2 pgs=23631 cs=6049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.401531 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58611 s=2 pgs=17856 cs=4375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.401641 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53496 s=2 pgs=23554 cs=4977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.401997 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58733 s=2 pgs=23632 cs=6051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.402329 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58614 s=2 pgs=17857 cs=4377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.402648 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53499 s=2 pgs=23555 cs=4979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.402767 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58736 s=2 pgs=23633 cs=6053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.403270 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58617 s=2 pgs=17858 cs=4379 l=0).fault, initiating reconnect
2013-06-08 20:25:42.403661 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58739 s=2 pgs=23634 cs=6055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.403715 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53502 s=2 pgs=23556 cs=4981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.404182 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58620 s=2 pgs=17859 cs=4381 l=0).fault, initiating reconnect
2013-06-08 20:25:42.404467 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58741 s=2 pgs=23635 cs=6057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.404819 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53506 s=2 pgs=23557 cs=4983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.405077 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58623 s=2 pgs=17860 cs=4383 l=0).fault, initiating reconnect
2013-06-08 20:25:42.405296 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58744 s=2 pgs=23636 cs=6059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.405883 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58626 s=2 pgs=17861 cs=4385 l=0).fault, initiating reconnect
2013-06-08 20:25:42.406013 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53509 s=2 pgs=23558 cs=4985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.406118 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58747 s=2 pgs=23637 cs=6061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.406660 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58628 s=2 pgs=17862 cs=4387 l=0).fault, initiating reconnect
2013-06-08 20:25:42.406815 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58750 s=2 pgs=23638 cs=6063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.407155 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53513 s=2 pgs=23559 cs=4987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.407572 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58631 s=2 pgs=17863 cs=4389 l=0).fault, initiating reconnect
2013-06-08 20:25:42.407616 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58752 s=2 pgs=23639 cs=6065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.408267 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53517 s=2 pgs=23560 cs=4989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.408485 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58755 s=2 pgs=23640 cs=6067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.408536 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58634 s=2 pgs=17864 cs=4391 l=0).fault, initiating reconnect
2013-06-08 20:25:42.409275 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58757 s=2 pgs=23641 cs=6069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.409399 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58638 s=2 pgs=17865 cs=4393 l=0).fault, initiating reconnect
2013-06-08 20:25:42.409458 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53520 s=2 pgs=23561 cs=4991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.410073 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58759 s=2 pgs=23642 cs=6071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.410285 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58640 s=2 pgs=17866 cs=4395 l=0).fault, initiating reconnect
2013-06-08 20:25:42.410573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53525 s=2 pgs=23562 cs=4993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.410967 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58762 s=2 pgs=23643 cs=6073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.411010 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58643 s=2 pgs=17867 cs=4397 l=0).fault, initiating reconnect
2013-06-08 20:25:42.411663 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53528 s=2 pgs=23563 cs=4995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.411747 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58765 s=2 pgs=23644 cs=6075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.412077 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58646 s=2 pgs=17868 cs=4399 l=0).fault, initiating reconnect
2013-06-08 20:25:42.412656 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58768 s=2 pgs=23645 cs=6077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.412729 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53531 s=2 pgs=23564 cs=4997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.413001 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58649 s=2 pgs=17869 cs=4401 l=0).fault, initiating reconnect
2013-06-08 20:25:42.413387 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58770 s=2 pgs=23646 cs=6079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.413724 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58652 s=2 pgs=17870 cs=4403 l=0).fault, initiating reconnect
2013-06-08 20:25:42.413855 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53535 s=2 pgs=23565 cs=4999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.414181 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58773 s=2 pgs=23647 cs=6081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.414600 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58654 s=2 pgs=17871 cs=4405 l=0).fault, initiating reconnect
2013-06-08 20:25:42.414896 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53539 s=2 pgs=23566 cs=5001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.414999 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58776 s=2 pgs=23648 cs=6083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.415314 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58657 s=2 pgs=17872 cs=4407 l=0).fault, initiating reconnect
2013-06-08 20:25:42.415704 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58779 s=2 pgs=23649 cs=6085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.416040 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53542 s=2 pgs=23567 cs=5003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.416091 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58660 s=2 pgs=17873 cs=4409 l=0).fault, initiating reconnect
2013-06-08 20:25:42.416508 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58781 s=2 pgs=23650 cs=6087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.417027 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58663 s=2 pgs=17874 cs=4411 l=0).fault, initiating reconnect
2013-06-08 20:25:42.417202 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53546 s=2 pgs=23568 cs=5005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.417523 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58784 s=2 pgs=23651 cs=6089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.417818 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58665 s=2 pgs=17875 cs=4413 l=0).fault, initiating reconnect
2013-06-08 20:25:42.418287 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53550 s=2 pgs=23569 cs=5007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.418400 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58787 s=2 pgs=23652 cs=6091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.418815 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58668 s=2 pgs=17876 cs=4415 l=0).fault, initiating reconnect
2013-06-08 20:25:42.419130 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58790 s=2 pgs=23653 cs=6093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.419476 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53553 s=2 pgs=23570 cs=5009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.419784 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58671 s=2 pgs=17877 cs=4417 l=0).fault, initiating reconnect
2013-06-08 20:25:42.419891 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58792 s=2 pgs=23654 cs=6095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.420486 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53557 s=2 pgs=23571 cs=5011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.420816 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58674 s=2 pgs=17878 cs=4419 l=0).fault, initiating reconnect
2013-06-08 20:25:42.420821 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :58795 s=2 pgs=23655 cs=6097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.421612 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58798 s=2 pgs=23656 cs=6099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.421618 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58677 s=2 pgs=17879 cs=4421 l=0).fault, initiating reconnect
2013-06-08 20:25:42.421760 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53560 s=2 pgs=23572 cs=5013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.422413 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58800 s=2 pgs=23657 cs=6101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.422502 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58679 s=2 pgs=17880 cs=4423 l=0).fault, initiating reconnect
2013-06-08 20:25:42.422831 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53565 s=2 pgs=23573 cs=5015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.423266 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58802 s=2 pgs=23658 cs=6103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.423288 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58683 s=2 pgs=17881 cs=4425 l=0).fault, initiating reconnect
2013-06-08 20:25:42.424059 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53568 s=2 pgs=23574 cs=5017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.424063 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58805 s=2 pgs=23659 cs=6105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.424220 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58686 s=2 pgs=17882 cs=4427 l=0).fault, initiating reconnect
2013-06-08 20:25:42.424872 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58689 s=2 pgs=17883 cs=4429 l=0).fault, initiating reconnect
2013-06-08 20:25:42.424876 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58808 s=2 pgs=23660 cs=6107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.425306 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53571 s=2 pgs=23575 cs=5019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.425708 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58811 s=2 pgs=23661 cs=6109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.425774 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58690 s=2 pgs=17884 cs=4431 l=0).fault, initiating reconnect
2013-06-08 20:25:42.426398 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58813 s=2 pgs=23662 cs=6111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.426570 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53576 s=2 pgs=23576 cs=5021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.426772 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58694 s=2 pgs=17885 cs=4433 l=0).fault, initiating reconnect
2013-06-08 20:25:42.427298 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58815 s=2 pgs=23663 cs=6113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.427623 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58697 s=2 pgs=17886 cs=4435 l=0).fault, initiating reconnect
2013-06-08 20:25:42.427793 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53580 s=2 pgs=23577 cs=5023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.428149 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58818 s=2 pgs=23664 cs=6115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.428480 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58699 s=2 pgs=17887 cs=4437 l=0).fault, initiating reconnect
2013-06-08 20:25:42.428931 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58821 s=2 pgs=23665 cs=6117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.429267 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58702 s=2 pgs=17888 cs=4439 l=0).fault, initiating reconnect
2013-06-08 20:25:42.429728 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58823 s=2 pgs=23666 cs=6119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.430066 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58704 s=2 pgs=17889 cs=4441 l=0).fault, initiating reconnect
2013-06-08 20:25:42.430489 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58825 s=2 pgs=23667 cs=6121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.431077 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58706 s=2 pgs=17890 cs=4443 l=0).fault, initiating reconnect
2013-06-08 20:25:42.431305 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58827 s=2 pgs=23668 cs=6123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.431778 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53584 s=2 pgs=23578 cs=5025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.431908 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58708 s=2 pgs=17891 cs=4445 l=0).fault, initiating reconnect
2013-06-08 20:25:42.432040 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58829 s=2 pgs=23669 cs=6125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.432842 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58832 s=2 pgs=23670 cs=6127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.432880 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58711 s=2 pgs=17892 cs=4447 l=0).fault, initiating reconnect
2013-06-08 20:25:42.433020 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53594 s=2 pgs=23579 cs=5027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.433625 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58833 s=2 pgs=23671 cs=6129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.433697 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58714 s=2 pgs=17893 cs=4449 l=0).fault, initiating reconnect
2013-06-08 20:25:42.433983 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53599 s=2 pgs=23580 cs=5029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.434421 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58717 s=2 pgs=17894 cs=4451 l=0).fault, initiating reconnect
2013-06-08 20:25:42.434443 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58836 s=2 pgs=23672 cs=6131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.435170 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53602 s=2 pgs=23581 cs=5031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.435199 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58840 s=2 pgs=23673 cs=6133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.435389 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58719 s=2 pgs=17895 cs=4453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.435946 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58842 s=2 pgs=23674 cs=6135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.436246 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58723 s=2 pgs=17896 cs=4455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.436384 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53605 s=2 pgs=23582 cs=5033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.436739 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58844 s=2 pgs=23675 cs=6137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.437074 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58725 s=2 pgs=17897 cs=4457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.437573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53610 s=2 pgs=23583 cs=5035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.437598 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58847 s=2 pgs=23676 cs=6139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.437967 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58728 s=2 pgs=17898 cs=4459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.438352 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58850 s=2 pgs=23677 cs=6141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.438614 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53613 s=2 pgs=23584 cs=5037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.439148 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58852 s=2 pgs=23678 cs=6143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.439696 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53617 s=2 pgs=23585 cs=5039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.440002 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58854 s=2 pgs=23679 cs=6145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.440719 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58856 s=2 pgs=23680 cs=6147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.440797 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53619 s=2 pgs=23586 cs=5041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.441505 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58857 s=2 pgs=23681 cs=6149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.441967 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53622 s=2 pgs=23587 cs=5043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.442327 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58859 s=2 pgs=23682 cs=6151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.443161 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53624 s=2 pgs=23588 cs=5045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.443192 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58861 s=2 pgs=23683 cs=6153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.443904 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58863 s=2 pgs=23684 cs=6155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.444392 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53626 s=2 pgs=23589 cs=5047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.444760 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58864 s=2 pgs=23685 cs=6157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.445583 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53629 s=2 pgs=23590 cs=5049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.445659 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58866 s=2 pgs=23686 cs=6159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.446491 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58868 s=2 pgs=23687 cs=6161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.446749 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53631 s=2 pgs=23591 cs=5051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.447278 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58869 s=2 pgs=23688 cs=6163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.447857 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53634 s=2 pgs=23592 cs=5053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.448164 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58871 s=2 pgs=23689 cs=6165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.448951 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53636 s=2 pgs=23593 cs=5055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.449021 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58873 s=2 pgs=23690 cs=6167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.449823 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58875 s=2 pgs=23691 cs=6169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.450143 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53638 s=2 pgs=23594 cs=5057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.450528 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58876 s=2 pgs=23692 cs=6171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.451225 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53641 s=2 pgs=23595 cs=5059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.451314 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58878 s=2 pgs=23693 cs=6173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.452276 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58880 s=2 pgs=23694 cs=6175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.452399 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53643 s=2 pgs=23596 cs=5061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.453062 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58881 s=2 pgs=23695 cs=6177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.453377 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53646 s=2 pgs=23597 cs=5063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.453782 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58883 s=2 pgs=23696 cs=6179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.454668 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58885 s=2 pgs=23697 cs=6181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.454836 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53648 s=2 pgs=23598 cs=5065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.455465 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58886 s=2 pgs=23698 cs=6183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.456029 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53651 s=2 pgs=23599 cs=5067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.456362 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58888 s=2 pgs=23699 cs=6185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.457162 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53653 s=2 pgs=23600 cs=5069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.457216 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58890 s=2 pgs=23700 cs=6187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.458231 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58892 s=2 pgs=23701 cs=6189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.458340 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53655 s=2 pgs=23601 cs=5071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.459068 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58893 s=2 pgs=23702 cs=6191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.459487 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53658 s=2 pgs=23602 cs=5073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.459887 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58895 s=2 pgs=23703 cs=6193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.460473 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53660 s=2 pgs=23603 cs=5075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.460837 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58897 s=2 pgs=23704 cs=6195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.461700 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :58899 s=2 pgs=23705 cs=6197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.461704 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :53662 s=2 pgs=23604 cs=5077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.462060 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58731 s=2 pgs=17899 cs=4461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.462556 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58900 s=2 pgs=23706 cs=6199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.462976 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53665 s=2 pgs=23605 cs=5079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.463205 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58782 s=2 pgs=17900 cs=4463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.463501 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58903 s=2 pgs=23707 cs=6201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.464168 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53668 s=2 pgs=23606 cs=5081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.464209 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58785 s=2 pgs=17901 cs=4465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.464415 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58906 s=2 pgs=23708 cs=6203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.465570 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58788 s=2 pgs=17902 cs=4467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.465622 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58909 s=2 pgs=23709 cs=6205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.465994 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53671 s=2 pgs=23607 cs=5083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.466532 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58911 s=2 pgs=23710 cs=6207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.466580 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58790 s=2 pgs=17903 cs=4469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.467233 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53676 s=2 pgs=23608 cs=5085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.467513 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58794 s=2 pgs=17904 cs=4471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.467517 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58913 s=2 pgs=23711 cs=6209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.468398 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58917 s=2 pgs=23712 cs=6211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.468560 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53679 s=2 pgs=23609 cs=5087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.468563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58796 s=2 pgs=17905 cs=4473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.469241 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58918 s=2 pgs=23713 cs=6213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.469559 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58800 s=2 pgs=17906 cs=4475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.469914 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53683 s=2 pgs=23610 cs=5089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.470302 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58921 s=2 pgs=23714 cs=6215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.470427 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58802 s=2 pgs=17907 cs=4477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.471098 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58924 s=2 pgs=23715 cs=6217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.471180 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53687 s=2 pgs=23611 cs=5091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.471375 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58805 s=2 pgs=17908 cs=4479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.472042 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58926 s=2 pgs=23716 cs=6219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.472390 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53691 s=2 pgs=23612 cs=5093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.472570 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58808 s=2 pgs=17909 cs=4481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.472852 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58929 s=2 pgs=23717 cs=6221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.473434 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58811 s=2 pgs=17910 cs=4483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.473656 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53694 s=2 pgs=23613 cs=5095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.473708 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58932 s=2 pgs=23718 cs=6223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.474509 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58813 s=2 pgs=17911 cs=4485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.474544 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58935 s=2 pgs=23719 cs=6225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.474993 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53698 s=2 pgs=23614 cs=5097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.475415 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58937 s=2 pgs=23720 cs=6227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.475643 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58816 s=2 pgs=17912 cs=4487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.476281 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58939 s=2 pgs=23721 cs=6229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.476395 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53702 s=2 pgs=23615 cs=5099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.476675 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58820 s=2 pgs=17913 cs=4489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.477203 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58941 s=2 pgs=23722 cs=6231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.477658 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58823 s=2 pgs=17914 cs=4491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.477742 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53706 s=2 pgs=23616 cs=5101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.478039 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58944 s=2 pgs=23723 cs=6233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.478700 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58825 s=2 pgs=17915 cs=4493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.478963 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58947 s=2 pgs=23724 cs=6235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.479033 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53710 s=2 pgs=23617 cs=5103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.479441 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58828 s=2 pgs=17916 cs=4495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.479971 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58949 s=2 pgs=23725 cs=6237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.480296 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53714 s=2 pgs=23618 cs=5105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.480388 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58831 s=2 pgs=17917 cs=4497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.480821 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58952 s=2 pgs=23726 cs=6239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.481367 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58834 s=2 pgs=17918 cs=4499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.481415 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53717 s=2 pgs=23619 cs=5107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.481604 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58955 s=2 pgs=23727 cs=6241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.482182 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58836 s=2 pgs=17919 cs=4501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.482387 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58958 s=2 pgs=23728 cs=6243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.482807 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53721 s=2 pgs=23620 cs=5109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.483236 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58839 s=2 pgs=17920 cs=4503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.483256 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58960 s=2 pgs=23729 cs=6245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.484174 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53725 s=2 pgs=23621 cs=5111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.484243 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58963 s=2 pgs=23730 cs=6247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.484542 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58842 s=2 pgs=17921 cs=4505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.485091 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58965 s=2 pgs=23731 cs=6249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.485427 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53728 s=2 pgs=23622 cs=5113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.485458 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58846 s=2 pgs=17922 cs=4507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.485927 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58967 s=2 pgs=23732 cs=6251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.486375 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58849 s=2 pgs=17923 cs=4509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.486403 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53732 s=2 pgs=23623 cs=5115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.486805 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58970 s=2 pgs=23733 cs=6253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.487082 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58851 s=2 pgs=17924 cs=4511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.487692 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53736 s=2 pgs=23624 cs=5117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.487712 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58973 s=2 pgs=23734 cs=6255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.488097 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58854 s=2 pgs=17925 cs=4513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.488543 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58976 s=2 pgs=23735 cs=6257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.488929 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53739 s=2 pgs=23625 cs=5119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.489159 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58857 s=2 pgs=17926 cs=4515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.489360 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58978 s=2 pgs=23736 cs=6259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.490045 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58860 s=2 pgs=17927 cs=4517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.490287 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58981 s=2 pgs=23737 cs=6261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.490889 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58862 s=2 pgs=17928 cs=4519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.491169 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58983 s=2 pgs=23738 cs=6263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.491794 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58864 s=2 pgs=17929 cs=4521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.492029 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58985 s=2 pgs=23739 cs=6265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.492791 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58987 s=2 pgs=23740 cs=6267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.493514 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58988 s=2 pgs=23741 cs=6269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.493992 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58866 s=2 pgs=17930 cs=4523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.494295 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58989 s=2 pgs=23742 cs=6271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.494893 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58870 s=2 pgs=17931 cs=4525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.495147 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58991 s=2 pgs=23743 cs=6273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.495780 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58872 s=2 pgs=17932 cs=4527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.496065 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58993 s=2 pgs=23744 cs=6275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.496592 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58874 s=2 pgs=17933 cs=4529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.496842 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58995 s=2 pgs=23745 cs=6277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.497324 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58876 s=2 pgs=17934 cs=4531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.497649 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58997 s=2 pgs=23746 cs=6279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.498136 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58878 s=2 pgs=17935 cs=4533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.498625 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :58999 s=2 pgs=23747 cs=6281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.499106 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58880 s=2 pgs=17936 cs=4535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.499582 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59001 s=2 pgs=23748 cs=6283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.499985 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :53743 s=2 pgs=23626 cs=5121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.499991 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :58882 s=2 pgs=17937 cs=4537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.500464 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59003 s=2 pgs=23749 cs=6285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.501042 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58884 s=2 pgs=17938 cs=4539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.501111 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53769 s=2 pgs=23627 cs=5123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.501261 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59006 s=2 pgs=23750 cs=6287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.502084 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58887 s=2 pgs=17939 cs=4541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.502265 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53772 s=2 pgs=23628 cs=5125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.502368 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59009 s=2 pgs=23751 cs=6289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.503038 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58890 s=2 pgs=17940 cs=4543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.503313 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59012 s=2 pgs=23752 cs=6291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.503622 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53775 s=2 pgs=23629 cs=5127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.504078 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58893 s=2 pgs=17941 cs=4545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.504145 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59014 s=2 pgs=23753 cs=6293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.504807 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53779 s=2 pgs=23630 cs=5129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.505025 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59017 s=2 pgs=23754 cs=6295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.505315 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58896 s=2 pgs=17942 cs=4547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.505844 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59019 s=2 pgs=23755 cs=6297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.506151 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53782 s=2 pgs=23631 cs=5131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.506386 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58900 s=2 pgs=17943 cs=4549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.506710 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59021 s=2 pgs=23756 cs=6299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.507130 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58903 s=2 pgs=17944 cs=4551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.507538 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53786 s=2 pgs=23632 cs=5133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.507654 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59024 s=2 pgs=23757 cs=6301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.508133 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58905 s=2 pgs=17945 cs=4553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.508523 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59027 s=2 pgs=23758 cs=6303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.509074 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53790 s=2 pgs=23633 cs=5135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.509477 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58908 s=2 pgs=17946 cs=4555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.509507 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59029 s=2 pgs=23759 cs=6305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.510450 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53794 s=2 pgs=23634 cs=5137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.510493 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59032 s=2 pgs=23760 cs=6307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.510747 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58911 s=2 pgs=17947 cs=4557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.511391 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59034 s=2 pgs=23761 cs=6309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.511588 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58915 s=2 pgs=17948 cs=4559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.511645 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53797 s=2 pgs=23635 cs=5139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.512064 7fdddfd57700  0 -- 10.10.10.10:6801/17115 submit_message osd_op_reply(8474098 rb.0.5298.2ae8944a.000000000457 [write 2596352~24576] ondisk = 0) v4 remote, 10.10.10.9:0/1005106, failed lossy con, dropping message 0x9989c00
2013-06-08 20:25:42.512196 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59036 s=2 pgs=23762 cs=6311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.512454 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58917 s=2 pgs=17949 cs=4561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.512940 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53802 s=2 pgs=23636 cs=5141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.512971 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59039 s=2 pgs=23763 cs=6313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.513452 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58920 s=2 pgs=17950 cs=4563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.514016 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59042 s=2 pgs=23764 cs=6315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.514150 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53805 s=2 pgs=23637 cs=5143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.514412 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58923 s=2 pgs=17951 cs=4565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.514778 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59044 s=2 pgs=23765 cs=6317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.515228 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58926 s=2 pgs=17952 cs=4567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.515517 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53809 s=2 pgs=23638 cs=5145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.515763 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59047 s=2 pgs=23766 cs=6319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.516056 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58928 s=2 pgs=17953 cs=4569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.516564 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59050 s=2 pgs=23767 cs=6321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.516771 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53813 s=2 pgs=23639 cs=5147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.517219 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58931 s=2 pgs=17954 cs=4571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.517544 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59052 s=2 pgs=23768 cs=6323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.517963 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53817 s=2 pgs=23640 cs=5149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.518319 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58934 s=2 pgs=17955 cs=4573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.518509 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59055 s=2 pgs=23769 cs=6325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.519220 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53820 s=2 pgs=23641 cs=5151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.519427 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58937 s=2 pgs=17956 cs=4575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.519557 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59058 s=2 pgs=23770 cs=6327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.520280 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53823 s=2 pgs=23642 cs=5153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.520303 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58940 s=2 pgs=17957 cs=4577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.520467 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59061 s=2 pgs=23771 cs=6329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.521321 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59064 s=2 pgs=23772 cs=6331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.521392 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58943 s=2 pgs=17958 cs=4579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.521451 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53826 s=2 pgs=23643 cs=5155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.522147 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59065 s=2 pgs=23773 cs=6333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.522417 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58946 s=2 pgs=17959 cs=4581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.522795 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53831 s=2 pgs=23644 cs=5157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.523182 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59068 s=2 pgs=23774 cs=6335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.523552 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58949 s=2 pgs=17960 cs=4583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.524003 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59071 s=2 pgs=23775 cs=6337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.524853 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58952 s=2 pgs=17961 cs=4585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.524912 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59073 s=2 pgs=23776 cs=6339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.524918 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53834 s=2 pgs=23645 cs=5159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.525809 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59075 s=2 pgs=23777 cs=6341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.525833 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58954 s=2 pgs=17962 cs=4587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.526713 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58958 s=2 pgs=17963 cs=4589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.526723 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59077 s=2 pgs=23778 cs=6343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.527168 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53840 s=2 pgs=23646 cs=5161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.527640 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58959 s=2 pgs=17964 cs=4591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.527678 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59080 s=2 pgs=23779 cs=6345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.528443 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58962 s=2 pgs=17965 cs=4593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.528647 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59083 s=2 pgs=23780 cs=6347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.529131 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53845 s=2 pgs=23647 cs=5163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.529497 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58964 s=2 pgs=17966 cs=4595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.529544 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59085 s=2 pgs=23781 cs=6349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.530347 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59088 s=2 pgs=23782 cs=6351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.530633 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58967 s=2 pgs=17967 cs=4597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.531254 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59089 s=2 pgs=23783 cs=6353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.531527 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58970 s=2 pgs=17968 cs=4599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.532188 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59091 s=2 pgs=23784 cs=6355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.532379 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53850 s=2 pgs=23648 cs=5165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.532537 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58972 s=2 pgs=17969 cs=4601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.533038 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59093 s=2 pgs=23785 cs=6357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.533636 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58975 s=2 pgs=17970 cs=4603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.533642 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53858 s=2 pgs=23649 cs=5167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.534012 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59096 s=2 pgs=23786 cs=6359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.534744 7fdde6fb6700  0 log [WRN] : 64 slow requests, 6 included below; oldest blocked for > 94.349285 secs
2013-06-08 20:25:42.534744 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58977 s=2 pgs=17971 cs=4605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.534749 7fdde6fb6700  0 log [WRN] : slow request 84.232655 seconds old, received at 2013-06-08 20:24:18.302054: osd_sub_op(client.106359.0:382722 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594324 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:42.534753 7fdde6fb6700  0 log [WRN] : slow request 84.232553 seconds old, received at 2013-06-08 20:24:18.302156: osd_sub_op(client.106359.0:382723 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594325 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:42.534758 7fdde6fb6700  0 log [WRN] : slow request 84.232491 seconds old, received at 2013-06-08 20:24:18.302218: osd_sub_op(client.106359.0:382724 2.11 907c8211/rb.0.c46a.2ae8944a.0000000028c2/head//2 [] v 4628'2594326 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:42.534938 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59099 s=2 pgs=23787 cs=6361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.534948 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53862 s=2 pgs=23650 cs=5169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.534760 7fdde6fb6700  0 log [WRN] : slow request 84.232040 seconds old, received at 2013-06-08 20:24:18.302669: osd_sub_op(client.106359.0:382741 2.d1 d586d0d1/rb.0.c46a.2ae8944a.000000002871/head//2 [] v 4628'3872774 snapset=0=[]:[] snapc=0=[]) v7 currently no flag points reached
2013-06-08 20:25:42.535567 7fdde6fb6700  0 log [WRN] : slow request 82.910697 seconds old, received at 2013-06-08 20:24:19.624012: osd_sub_op(client.106332.0:40958 2.9e 2228699e/rb.0.6.000000001380/head//2 [] v 4628'4524481 snapset=0=[]:[] snapc=0=[]) v7 currently started
2013-06-08 20:25:42.535698 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59101 s=2 pgs=23788 cs=6363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.535799 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58980 s=2 pgs=17972 cs=4607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.536037 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53866 s=2 pgs=23651 cs=5171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.536487 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59103 s=2 pgs=23789 cs=6365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.536571 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58984 s=2 pgs=17973 cs=4609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.537100 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53869 s=2 pgs=23652 cs=5173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.537418 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58987 s=2 pgs=17974 cs=4611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.537427 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59106 s=2 pgs=23790 cs=6367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.538227 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53872 s=2 pgs=23653 cs=5175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.538337 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58990 s=2 pgs=17975 cs=4613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.538341 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59109 s=2 pgs=23791 cs=6369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.539173 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59113 s=2 pgs=23792 cs=6371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.539211 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58992 s=2 pgs=17976 cs=4615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.539285 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53875 s=2 pgs=23654 cs=5177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.539955 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59114 s=2 pgs=23793 cs=6373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.540035 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58995 s=2 pgs=17977 cs=4617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.540550 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53880 s=2 pgs=23655 cs=5179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.540782 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59117 s=2 pgs=23794 cs=6375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.541007 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :58998 s=2 pgs=17978 cs=4619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.541572 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59120 s=2 pgs=23795 cs=6377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.541883 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53883 s=2 pgs=23656 cs=5181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.542154 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59001 s=2 pgs=17979 cs=4621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.542288 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59122 s=2 pgs=23796 cs=6379 l=0).fault, initiating reconnect
2013-06-08 20:25:42.543095 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59125 s=2 pgs=23797 cs=6381 l=0).fault, initiating reconnect
2013-06-08 20:25:42.543100 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59004 s=2 pgs=17980 cs=4623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.543145 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53887 s=2 pgs=23657 cs=5183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.544058 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59128 s=2 pgs=23798 cs=6383 l=0).fault, initiating reconnect
2013-06-08 20:25:42.544308 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59006 s=2 pgs=17981 cs=4625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.544340 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53891 s=2 pgs=23658 cs=5185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.544827 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59129 s=2 pgs=23799 cs=6385 l=0).fault, initiating reconnect
2013-06-08 20:25:42.545402 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59010 s=2 pgs=17982 cs=4627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.545555 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53895 s=2 pgs=23659 cs=5187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.545742 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59132 s=2 pgs=23800 cs=6387 l=0).fault, initiating reconnect
2013-06-08 20:25:42.546137 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59013 s=2 pgs=17983 cs=4629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.546643 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59135 s=2 pgs=23801 cs=6389 l=0).fault, initiating reconnect
2013-06-08 20:25:42.546800 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53898 s=2 pgs=23660 cs=5189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.547152 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59016 s=2 pgs=17984 cs=4631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.547503 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59137 s=2 pgs=23802 cs=6391 l=0).fault, initiating reconnect
2013-06-08 20:25:42.548109 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53902 s=2 pgs=23661 cs=5191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.548323 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59019 s=2 pgs=17985 cs=4633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.548446 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37772 s=2 pgs=19864 cs=2515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.548475 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59143 s=2 pgs=23803 cs=6393 l=0).fault, initiating reconnect
2013-06-08 20:25:42.548503 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59143 s=1 pgs=23803 cs=6394 l=0).fault
2013-06-08 20:25:42.548751 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :37864 s=2 pgs=17648 cs=3453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.548876 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :56321 s=2 pgs=14147 cs=3 l=0).fault, initiating reconnect
2013-06-08 20:25:42.549341 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59147 s=2 pgs=23804 cs=6395 l=0).fault, initiating reconnect
2013-06-08 20:25:42.549476 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59025 s=2 pgs=17986 cs=4635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.549636 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37778 s=2 pgs=19865 cs=2517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.549803 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :37870 s=2 pgs=17649 cs=3455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.550067 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59150 s=2 pgs=23805 cs=6397 l=0).fault, initiating reconnect
2013-06-08 20:25:42.550065 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=32 :56329 s=2 pgs=14148 cs=5 l=0).fault, initiating reconnect
2013-06-08 20:25:42.550143 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53908 s=2 pgs=23662 cs=5193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.550346 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59031 s=2 pgs=17987 cs=4637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.550577 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37784 s=2 pgs=19866 cs=2519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.550876 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59154 s=2 pgs=23806 cs=6399 l=0).fault, initiating reconnect
2013-06-08 20:25:42.550891 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :37875 s=2 pgs=17650 cs=3457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.551334 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59037 s=2 pgs=17988 cs=4639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.551410 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53920 s=2 pgs=23663 cs=5195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.551526 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37790 s=2 pgs=19867 cs=2521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.551611 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=32 :56335 s=2 pgs=14149 cs=7 l=0).fault, initiating reconnect
2013-06-08 20:25:42.551760 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59159 s=2 pgs=23807 cs=6401 l=0).fault, initiating reconnect
2013-06-08 20:25:42.552075 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :37882 s=2 pgs=17651 cs=3459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.552401 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59041 s=2 pgs=17989 cs=4641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.552767 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :56344 s=2 pgs=14150 cs=9 l=0).fault, initiating reconnect
2013-06-08 20:25:42.552795 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53926 s=2 pgs=23664 cs=5197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.553150 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :37888 s=2 pgs=17652 cs=3461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.553430 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37795 s=2 pgs=19868 cs=2523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.553447 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59165 s=2 pgs=23808 cs=6403 l=0).fault, initiating reconnect
2013-06-08 20:25:42.553552 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59047 s=2 pgs=17990 cs=4643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.554095 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :56348 s=2 pgs=14151 cs=11 l=0).fault, initiating reconnect
2013-06-08 20:25:42.554161 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53933 s=2 pgs=23665 cs=5199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.554471 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :37803 s=2 pgs=19869 cs=2525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.554665 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=32 :59172 s=2 pgs=23809 cs=6405 l=0).fault, initiating reconnect
2013-06-08 20:25:42.554784 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59053 s=2 pgs=17991 cs=4645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.555246 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :37892 s=2 pgs=17653 cs=3463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.555304 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :56354 s=2 pgs=14152 cs=13 l=0).fault, initiating reconnect
2013-06-08 20:25:42.555579 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53939 s=2 pgs=23666 cs=5201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.555630 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :37808 s=2 pgs=19870 cs=2527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.555924 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :59177 s=2 pgs=23810 cs=6407 l=0).fault, initiating reconnect
2013-06-08 20:25:42.555955 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :59177 s=1 pgs=23810 cs=6408 l=0).fault
2013-06-08 20:25:42.556590 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :37901 s=2 pgs=17654 cs=3465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.556587 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=32 :56360 s=2 pgs=14153 cs=15 l=0).fault, initiating reconnect
2013-06-08 20:25:42.556733 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37814 s=2 pgs=19871 cs=2529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.556813 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53945 s=2 pgs=23667 cs=5203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.556884 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59183 s=2 pgs=23811 cs=6409 l=0).fault, initiating reconnect
2013-06-08 20:25:42.556985 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59058 s=2 pgs=17992 cs=4647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.557646 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=32 :37818 s=2 pgs=19872 cs=2531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.557719 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59188 s=2 pgs=23812 cs=6411 l=0).fault, initiating reconnect
2013-06-08 20:25:42.557770 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56364 s=2 pgs=14154 cs=17 l=0).fault, initiating reconnect
2013-06-08 20:25:42.557873 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59069 s=2 pgs=17993 cs=4649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.558150 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37907 s=2 pgs=17655 cs=3467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.558296 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53951 s=2 pgs=23668 cs=5205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.558664 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59191 s=2 pgs=23813 cs=6413 l=0).fault, initiating reconnect
2013-06-08 20:25:42.558845 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56372 s=2 pgs=14155 cs=19 l=0).fault, initiating reconnect
2013-06-08 20:25:42.558940 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37822 s=2 pgs=19873 cs=2533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.559363 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59196 s=2 pgs=23814 cs=6415 l=0).fault, initiating reconnect
2013-06-08 20:25:42.559389 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59073 s=2 pgs=17994 cs=4651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.559518 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53959 s=2 pgs=23669 cs=5207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.559660 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37916 s=2 pgs=17656 cs=3469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.560019 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56377 s=2 pgs=14156 cs=21 l=0).fault, initiating reconnect
2013-06-08 20:25:42.560025 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37830 s=2 pgs=19874 cs=2535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.560340 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59079 s=2 pgs=17995 cs=4653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.560719 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53965 s=2 pgs=23670 cs=5209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.560952 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59200 s=2 pgs=23815 cs=6417 l=0).fault, initiating reconnect
2013-06-08 20:25:42.561091 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=35 :37836 s=2 pgs=19875 cs=2537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.561217 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37924 s=2 pgs=17657 cs=3471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.561723 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56383 s=2 pgs=14157 cs=23 l=0).fault, initiating reconnect
2013-06-08 20:25:42.561746 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59207 s=2 pgs=23816 cs=6419 l=0).fault, initiating reconnect
2013-06-08 20:25:42.561814 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59085 s=2 pgs=17996 cs=4655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.562035 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37840 s=2 pgs=19876 cs=2539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.562322 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37931 s=2 pgs=17658 cs=3473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.562453 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53970 s=2 pgs=23671 cs=5211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.562752 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59211 s=2 pgs=23817 cs=6421 l=0).fault, initiating reconnect
2013-06-08 20:25:42.562861 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59092 s=2 pgs=17997 cs=4657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.563004 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37845 s=2 pgs=19877 cs=2541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.563014 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56390 s=2 pgs=14158 cs=25 l=0).fault, initiating reconnect
2013-06-08 20:25:42.563416 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37936 s=2 pgs=17659 cs=3475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.563726 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59216 s=2 pgs=23818 cs=6423 l=0).fault, initiating reconnect
2013-06-08 20:25:42.563957 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53979 s=2 pgs=23672 cs=5213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.564077 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37851 s=2 pgs=19878 cs=2543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.564128 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59097 s=2 pgs=17998 cs=4659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.564282 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56398 s=2 pgs=14159 cs=27 l=0).fault, initiating reconnect
2013-06-08 20:25:42.564491 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37942 s=2 pgs=17660 cs=3477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.564555 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59221 s=2 pgs=23819 cs=6425 l=0).fault, initiating reconnect
2013-06-08 20:25:42.565089 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53986 s=2 pgs=23673 cs=5215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.565143 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59104 s=2 pgs=17999 cs=4661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.565175 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37855 s=2 pgs=19879 cs=2545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.565360 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59227 s=2 pgs=23820 cs=6427 l=0).fault, initiating reconnect
2013-06-08 20:25:42.565541 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56405 s=2 pgs=14160 cs=29 l=0).fault, initiating reconnect
2013-06-08 20:25:42.565733 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37948 s=2 pgs=17661 cs=3479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.566013 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37862 s=2 pgs=19880 cs=2547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.566184 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59109 s=2 pgs=18000 cs=4663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.566212 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :53992 s=2 pgs=23674 cs=5217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.566234 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59231 s=2 pgs=23821 cs=6429 l=0).fault, initiating reconnect
2013-06-08 20:25:42.566804 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56412 s=2 pgs=14161 cs=31 l=0).fault, initiating reconnect
2013-06-08 20:25:42.566930 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37955 s=2 pgs=17662 cs=3481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.567006 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59237 s=2 pgs=23822 cs=6431 l=0).fault, initiating reconnect
2013-06-08 20:25:42.567279 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37866 s=2 pgs=19881 cs=2549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.567305 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59115 s=2 pgs=18001 cs=4665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.567395 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54000 s=2 pgs=23675 cs=5219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.567965 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37873 s=2 pgs=19882 cs=2551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.567966 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37961 s=2 pgs=17663 cs=3483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.568050 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56418 s=2 pgs=14162 cs=33 l=0).fault, initiating reconnect
2013-06-08 20:25:42.568060 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :59240 s=2 pgs=23823 cs=6433 l=0).fault, initiating reconnect
2013-06-08 20:25:42.568176 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59122 s=2 pgs=18002 cs=4667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.568755 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54007 s=2 pgs=23676 cs=5221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.568988 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59247 s=2 pgs=23824 cs=6435 l=0).fault, initiating reconnect
2013-06-08 20:25:42.569123 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37876 s=2 pgs=19883 cs=2553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.569176 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37967 s=2 pgs=17664 cs=3485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.569278 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59128 s=2 pgs=18003 cs=4669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.569263 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56426 s=2 pgs=14163 cs=35 l=0).fault, initiating reconnect
2013-06-08 20:25:42.569839 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59250 s=2 pgs=23825 cs=6437 l=0).fault, initiating reconnect
2013-06-08 20:25:42.569927 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54013 s=2 pgs=23677 cs=5223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.570105 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37883 s=2 pgs=19884 cs=2555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.570169 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59133 s=2 pgs=18004 cs=4671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.570237 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37974 s=2 pgs=17665 cs=3487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.570523 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56434 s=2 pgs=14164 cs=37 l=0).fault, initiating reconnect
2013-06-08 20:25:42.571035 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54019 s=2 pgs=23678 cs=5225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.571039 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37889 s=2 pgs=19885 cs=2557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.571295 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59138 s=2 pgs=18005 cs=4673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.571444 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59256 s=2 pgs=23826 cs=6439 l=0).fault, initiating reconnect
2013-06-08 20:25:42.571474 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :37981 s=2 pgs=17666 cs=3489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.571844 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=34 :37894 s=2 pgs=19886 cs=2559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.572010 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56440 s=2 pgs=14165 cs=39 l=0).fault, initiating reconnect
2013-06-08 20:25:42.572244 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54025 s=2 pgs=23679 cs=5227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.572300 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59143 s=2 pgs=18006 cs=4675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.572357 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59264 s=2 pgs=23827 cs=6441 l=0).fault, initiating reconnect
2013-06-08 20:25:42.572411 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :37987 s=2 pgs=17667 cs=3491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.572780 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37898 s=2 pgs=19887 cs=2561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.572870 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56447 s=2 pgs=14166 cs=41 l=0).fault, initiating reconnect
2013-06-08 20:25:42.573067 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59270 s=2 pgs=23828 cs=6443 l=0).fault, initiating reconnect
2013-06-08 20:25:42.573405 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59149 s=2 pgs=18007 cs=4677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.573464 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :37993 s=2 pgs=17668 cs=3493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.573477 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54032 s=2 pgs=23680 cs=5229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.573801 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37904 s=2 pgs=19888 cs=2563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.573984 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56453 s=2 pgs=14167 cs=43 l=0).fault, initiating reconnect
2013-06-08 20:25:42.573995 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59274 s=2 pgs=23829 cs=6445 l=0).fault, initiating reconnect
2013-06-08 20:25:42.574374 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59155 s=2 pgs=18008 cs=4679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.574660 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54041 s=2 pgs=23681 cs=5231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.574769 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37910 s=2 pgs=19889 cs=2565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.574782 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :37998 s=2 pgs=17669 cs=3495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.574837 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59280 s=2 pgs=23830 cs=6447 l=0).fault, initiating reconnect
2013-06-08 20:25:42.574951 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59280 s=1 pgs=23830 cs=6448 l=0).fault
2013-06-08 20:25:42.575158 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59161 s=2 pgs=18009 cs=4681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.575242 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56459 s=2 pgs=14168 cs=45 l=0).fault, initiating reconnect
2013-06-08 20:25:42.575835 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59285 s=2 pgs=23831 cs=6449 l=0).fault, initiating reconnect
2013-06-08 20:25:42.575832 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54046 s=2 pgs=23682 cs=5233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.575918 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37915 s=2 pgs=19890 cs=2567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.575991 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38006 s=2 pgs=17670 cs=3497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.576173 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59166 s=2 pgs=18010 cs=4683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.576551 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56467 s=2 pgs=14169 cs=47 l=0).fault, initiating reconnect
2013-06-08 20:25:42.576696 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59288 s=2 pgs=23832 cs=6451 l=0).fault, initiating reconnect
2013-06-08 20:25:42.576867 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37922 s=2 pgs=19891 cs=2569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.576914 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54053 s=2 pgs=23683 cs=5235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.576916 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38013 s=2 pgs=17671 cs=3499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.577491 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59294 s=2 pgs=23833 cs=6453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.577516 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59172 s=2 pgs=18011 cs=4685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.577722 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37927 s=2 pgs=19892 cs=2571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.577837 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56473 s=2 pgs=14170 cs=49 l=0).fault, initiating reconnect
2013-06-08 20:25:42.578157 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54061 s=2 pgs=23684 cs=5237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.578175 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38018 s=2 pgs=17672 cs=3501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.578643 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59299 s=2 pgs=23834 cs=6455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.579033 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56481 s=2 pgs=14171 cs=51 l=0).fault, initiating reconnect
2013-06-08 20:25:42.579382 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54066 s=2 pgs=23685 cs=5239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.579504 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38025 s=2 pgs=17673 cs=3503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.579509 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59304 s=2 pgs=23835 cs=6457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.579804 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59178 s=2 pgs=18012 cs=4687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.579825 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37932 s=2 pgs=19893 cs=2573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.580040 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56485 s=2 pgs=14172 cs=53 l=0).fault, initiating reconnect
2013-06-08 20:25:42.580468 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59308 s=2 pgs=23836 cs=6459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.580595 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54070 s=2 pgs=23686 cs=5241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.580658 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38029 s=2 pgs=17674 cs=3505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.580767 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37942 s=2 pgs=19894 cs=2575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.580804 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59189 s=2 pgs=18013 cs=4689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.581254 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59312 s=2 pgs=23837 cs=6461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.581371 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56491 s=2 pgs=14173 cs=55 l=0).fault, initiating reconnect
2013-06-08 20:25:42.581661 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59196 s=2 pgs=18014 cs=4691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.581680 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37947 s=2 pgs=19895 cs=2577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.581900 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38036 s=2 pgs=17675 cs=3507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.581924 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54077 s=2 pgs=23687 cs=5243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.582234 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59317 s=2 pgs=23838 cs=6463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.582505 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37952 s=2 pgs=19896 cs=2579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.582615 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59199 s=2 pgs=18015 cs=4693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.582637 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56498 s=2 pgs=14174 cs=57 l=0).fault, initiating reconnect
2013-06-08 20:25:42.582803 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38044 s=2 pgs=17676 cs=3509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.582985 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59323 s=2 pgs=23839 cs=6465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.583346 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54085 s=2 pgs=23688 cs=5245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.583728 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37956 s=2 pgs=19897 cs=2581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.583746 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59328 s=2 pgs=23840 cs=6467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.583770 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56506 s=2 pgs=14175 cs=59 l=0).fault, initiating reconnect
2013-06-08 20:25:42.583890 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38049 s=2 pgs=17677 cs=3511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.584259 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59205 s=2 pgs=18016 cs=4695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.584691 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54093 s=2 pgs=23689 cs=5247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.584699 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37962 s=2 pgs=19898 cs=2583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.584864 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56512 s=2 pgs=14176 cs=61 l=0).fault, initiating reconnect
2013-06-08 20:25:42.585162 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38055 s=2 pgs=17678 cs=3513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.585168 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59214 s=2 pgs=18017 cs=4697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.585329 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59331 s=2 pgs=23841 cs=6469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.585875 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37968 s=2 pgs=19899 cs=2585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.585903 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54099 s=2 pgs=23690 cs=5249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.585924 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56517 s=2 pgs=14177 cs=63 l=0).fault, initiating reconnect
2013-06-08 20:25:42.586260 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59340 s=2 pgs=23842 cs=6471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.586266 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59219 s=2 pgs=18018 cs=4699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.586393 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38060 s=2 pgs=17679 cs=3515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.586962 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :37973 s=2 pgs=19900 cs=2587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.586964 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54106 s=2 pgs=23691 cs=5251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.587369 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59226 s=2 pgs=18019 cs=4701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.587705 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38067 s=2 pgs=17680 cs=3517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.587735 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37979 s=2 pgs=19901 cs=2589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.588086 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54112 s=2 pgs=23692 cs=5253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.588159 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56523 s=2 pgs=14178 cs=65 l=0).fault, initiating reconnect
2013-06-08 20:25:42.588176 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59344 s=2 pgs=23843 cs=6473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.588990 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37983 s=2 pgs=19902 cs=2591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.589035 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38072 s=2 pgs=17681 cs=3519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.589108 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59354 s=2 pgs=23844 cs=6475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.589123 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59229 s=2 pgs=18020 cs=4703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.589200 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56533 s=2 pgs=14179 cs=67 l=0).fault, initiating reconnect
2013-06-08 20:25:42.589833 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59357 s=2 pgs=23845 cs=6477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.589889 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54116 s=2 pgs=23693 cs=5255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.589911 7fddd0228700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54116 s=1 pgs=23693 cs=5256 l=0).fault
2013-06-08 20:25:42.590023 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59238 s=2 pgs=18021 cs=4705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.590043 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37987 s=2 pgs=19903 cs=2593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.590200 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56539 s=2 pgs=14180 cs=69 l=0).fault, initiating reconnect
2013-06-08 20:25:42.590211 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38078 s=2 pgs=17682 cs=3521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.590618 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59360 s=2 pgs=23846 cs=6479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.591078 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59242 s=2 pgs=18022 cs=4707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.591105 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56545 s=2 pgs=14181 cs=71 l=0).fault, initiating reconnect
2013-06-08 20:25:42.591292 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54125 s=2 pgs=23694 cs=5257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.591558 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38086 s=2 pgs=17683 cs=3523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.591634 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59366 s=2 pgs=23847 cs=6481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.591867 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :37995 s=2 pgs=19904 cs=2595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.592309 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59247 s=2 pgs=18023 cs=4709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.592471 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54133 s=2 pgs=23695 cs=5259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.592527 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38092 s=2 pgs=17684 cs=3525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.592583 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56548 s=2 pgs=14182 cs=73 l=0).fault, initiating reconnect
2013-06-08 20:25:42.592560 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59371 s=2 pgs=23848 cs=6483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.593310 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38004 s=2 pgs=19905 cs=2597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.593401 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59253 s=2 pgs=18024 cs=4711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.593453 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59377 s=2 pgs=23849 cs=6485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.593522 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38097 s=2 pgs=17685 cs=3527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.593570 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56556 s=2 pgs=14183 cs=75 l=0).fault, initiating reconnect
2013-06-08 20:25:42.593585 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54138 s=2 pgs=23696 cs=5261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.594129 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38010 s=2 pgs=19906 cs=2599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.594175 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59259 s=2 pgs=18025 cs=4713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.594231 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59380 s=2 pgs=23850 cs=6487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.594637 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56563 s=2 pgs=14184 cs=77 l=0).fault, initiating reconnect
2013-06-08 20:25:42.594652 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54146 s=2 pgs=23697 cs=5263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.594770 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38103 s=2 pgs=17686 cs=3529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.595094 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59265 s=2 pgs=18026 cs=4715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.595104 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38016 s=2 pgs=19907 cs=2601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.595204 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59386 s=2 pgs=23851 cs=6489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.595755 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56567 s=2 pgs=14185 cs=79 l=0).fault, initiating reconnect
2013-06-08 20:25:42.595801 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54152 s=2 pgs=23698 cs=5265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596009 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38111 s=2 pgs=17687 cs=3531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596097 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59270 s=2 pgs=18027 cs=4717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596141 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38023 s=2 pgs=19908 cs=2603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596137 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59392 s=2 pgs=23852 cs=6491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596657 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56573 s=2 pgs=14186 cs=81 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596920 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59276 s=2 pgs=18028 cs=4719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596926 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54158 s=2 pgs=23699 cs=5267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.596985 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59398 s=2 pgs=23853 cs=6493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.597102 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38029 s=2 pgs=19909 cs=2605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.597143 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38117 s=2 pgs=17688 cs=3533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.597703 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59402 s=2 pgs=23854 cs=6495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.597739 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59280 s=2 pgs=18029 cs=4721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.597783 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56579 s=2 pgs=14187 cs=83 l=0).fault, initiating reconnect
2013-06-08 20:25:42.598190 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38035 s=2 pgs=19910 cs=2607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.598217 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38126 s=2 pgs=17689 cs=3535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.598276 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54165 s=2 pgs=23700 cs=5269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.598526 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59405 s=2 pgs=23855 cs=6497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.598705 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59286 s=2 pgs=18030 cs=4723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.599137 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38131 s=2 pgs=17690 cs=3537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.599175 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56587 s=2 pgs=14188 cs=85 l=0).fault, initiating reconnect
2013-06-08 20:25:42.599277 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59411 s=2 pgs=23856 cs=6499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.599677 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54174 s=2 pgs=23701 cs=5271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.599805 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59292 s=2 pgs=18031 cs=4725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.600202 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59415 s=2 pgs=23857 cs=6501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.600207 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56594 s=2 pgs=14189 cs=87 l=0).fault, initiating reconnect
2013-06-08 20:25:42.600333 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38135 s=2 pgs=17691 cs=3539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.600932 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59297 s=2 pgs=18032 cs=4727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.600991 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59418 s=2 pgs=23858 cs=6503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.600992 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54180 s=2 pgs=23702 cs=5273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.601282 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38040 s=2 pgs=19911 cs=2609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.601317 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56599 s=2 pgs=14190 cs=89 l=0).fault, initiating reconnect
2013-06-08 20:25:42.601744 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59301 s=2 pgs=18033 cs=4729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.601864 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38142 s=2 pgs=17692 cs=3541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.601893 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59422 s=2 pgs=23859 cs=6505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.602213 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54187 s=2 pgs=23703 cs=5275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.602266 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56605 s=2 pgs=14191 cs=91 l=0).fault, initiating reconnect
2013-06-08 20:25:42.602350 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38056 s=2 pgs=19912 cs=2611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.602737 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59306 s=2 pgs=18034 cs=4731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.602863 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59428 s=2 pgs=23860 cs=6507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.602862 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38149 s=2 pgs=17693 cs=3543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.603301 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56610 s=2 pgs=14192 cs=93 l=0).fault, initiating reconnect
2013-06-08 20:25:42.603354 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38063 s=2 pgs=19913 cs=2613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.603390 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54193 s=2 pgs=23704 cs=5277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.603882 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59312 s=2 pgs=18035 cs=4733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.603931 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59433 s=2 pgs=23861 cs=6509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.604075 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38156 s=2 pgs=17694 cs=3545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.604239 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38068 s=2 pgs=19914 cs=2615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.604271 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56615 s=2 pgs=14193 cs=95 l=0).fault, initiating reconnect
2013-06-08 20:25:42.604665 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54201 s=2 pgs=23705 cs=5279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.605006 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59318 s=2 pgs=18036 cs=4735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.605156 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38162 s=2 pgs=17695 cs=3547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.605273 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56622 s=2 pgs=14194 cs=97 l=0).fault, initiating reconnect
2013-06-08 20:25:42.605820 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54207 s=2 pgs=23706 cs=5281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.605892 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59439 s=2 pgs=23862 cs=6511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.605894 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59324 s=2 pgs=18037 cs=4737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.606168 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38167 s=2 pgs=17696 cs=3549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.606334 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56626 s=2 pgs=14195 cs=99 l=0).fault, initiating reconnect
2013-06-08 20:25:42.606440 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38073 s=2 pgs=19915 cs=2617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.606694 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59329 s=2 pgs=18038 cs=4739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.606875 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59448 s=2 pgs=23863 cs=6513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.607007 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54211 s=2 pgs=23707 cs=5283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.607333 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38172 s=2 pgs=17697 cs=3551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.607363 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38084 s=2 pgs=19916 cs=2619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.607554 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56631 s=2 pgs=14196 cs=101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.607645 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59333 s=2 pgs=18039 cs=4741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.607726 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59454 s=2 pgs=23864 cs=6515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.608043 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38089 s=2 pgs=19917 cs=2621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.608062 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54219 s=2 pgs=23708 cs=5285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.608360 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38178 s=2 pgs=17698 cs=3553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.608477 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59460 s=2 pgs=23865 cs=6517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.608490 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56638 s=2 pgs=14197 cs=103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.608735 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59339 s=2 pgs=18040 cs=4743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.609057 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38094 s=2 pgs=19918 cs=2623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.609311 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54225 s=2 pgs=23709 cs=5287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.609431 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38185 s=2 pgs=17699 cs=3555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.609654 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56645 s=2 pgs=14198 cs=105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.609708 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59464 s=2 pgs=23866 cs=6519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.609831 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59346 s=2 pgs=18041 cs=4745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.610061 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38099 s=2 pgs=19919 cs=2625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.610476 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54232 s=2 pgs=23710 cs=5289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.610722 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59471 s=2 pgs=23867 cs=6521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.610727 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38191 s=2 pgs=17700 cs=3557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.611032 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38105 s=2 pgs=19920 cs=2627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.611058 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59352 s=2 pgs=18042 cs=4747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.611162 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56650 s=2 pgs=14199 cs=107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.611507 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59475 s=2 pgs=23868 cs=6523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.611995 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38109 s=2 pgs=19921 cs=2629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.612015 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54238 s=2 pgs=23711 cs=5291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.612046 7fddd0228700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54238 s=1 pgs=23711 cs=5292 l=0).fault
2013-06-08 20:25:42.612166 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38198 s=2 pgs=17701 cs=3559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.612198 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59358 s=2 pgs=18043 cs=4749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.612244 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59480 s=2 pgs=23869 cs=6525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.612813 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38113 s=2 pgs=19922 cs=2631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.612957 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59485 s=2 pgs=23870 cs=6527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.613057 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56659 s=2 pgs=14200 cs=109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.613122 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54246 s=2 pgs=23712 cs=5293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.613229 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59364 s=2 pgs=18044 cs=4751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.613643 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38118 s=2 pgs=19923 cs=2633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.613716 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38205 s=2 pgs=17702 cs=3561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.613725 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59487 s=2 pgs=23871 cs=6529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.613926 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56668 s=2 pgs=14201 cs=111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.614067 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59370 s=2 pgs=18045 cs=4753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.614450 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38123 s=2 pgs=19924 cs=2635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.614468 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59493 s=2 pgs=23872 cs=6531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.614602 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38214 s=2 pgs=17703 cs=3563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.614861 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56674 s=2 pgs=14202 cs=113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.615015 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59375 s=2 pgs=18046 cs=4755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.615226 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54253 s=2 pgs=23713 cs=5295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.615247 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59497 s=2 pgs=23873 cs=6533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.615328 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38128 s=2 pgs=19925 cs=2637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.615793 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38220 s=2 pgs=17704 cs=3565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.615872 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59380 s=2 pgs=18047 cs=4757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.616037 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59502 s=2 pgs=23874 cs=6535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.616091 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56679 s=2 pgs=14203 cs=115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.616455 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54265 s=2 pgs=23714 cs=5297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.616785 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59506 s=2 pgs=23875 cs=6537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.616904 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38226 s=2 pgs=17705 cs=3567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.616957 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59385 s=2 pgs=18048 cs=4759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.617098 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38135 s=2 pgs=19926 cs=2639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.617248 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56687 s=2 pgs=14204 cs=117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.617612 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59509 s=2 pgs=23876 cs=6539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.617958 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38232 s=2 pgs=17706 cs=3569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.617972 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54272 s=2 pgs=23715 cs=5299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.618134 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38144 s=2 pgs=19927 cs=2641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.618146 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59391 s=2 pgs=18049 cs=4761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.618496 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56693 s=2 pgs=14205 cs=119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.618498 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59514 s=2 pgs=23877 cs=6541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.619036 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59398 s=2 pgs=18050 cs=4763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.619046 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38149 s=2 pgs=19928 cs=2643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.619145 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38237 s=2 pgs=17707 cs=3571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.619186 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54280 s=2 pgs=23716 cs=5301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.619536 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59519 s=2 pgs=23878 cs=6543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.619711 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56700 s=2 pgs=14206 cs=121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.620204 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38154 s=2 pgs=19929 cs=2645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.620271 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38245 s=2 pgs=17708 cs=3573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.620348 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59525 s=2 pgs=23879 cs=6545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.620354 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54288 s=2 pgs=23717 cs=5303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.620882 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56706 s=2 pgs=14207 cs=123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.621079 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59529 s=2 pgs=23880 cs=6547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.621160 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59401 s=2 pgs=18051 cs=4765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.621174 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38250 s=2 pgs=17709 cs=3575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.621246 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38159 s=2 pgs=19930 cs=2647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.621889 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59532 s=2 pgs=23881 cs=6549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.622004 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54294 s=2 pgs=23718 cs=5305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.622099 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38256 s=2 pgs=17710 cs=3577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.622107 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56711 s=2 pgs=14208 cs=125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.622619 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59413 s=2 pgs=18052 cs=4767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.622870 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59536 s=2 pgs=23882 cs=6551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.623160 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38261 s=2 pgs=17711 cs=3579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.623698 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59420 s=2 pgs=18053 cs=4769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.623732 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54301 s=2 pgs=23719 cs=5307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.623794 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38167 s=2 pgs=19931 cs=2649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.623833 7fddd1d65700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38167 s=1 pgs=19931 cs=2650 l=0).fault
2013-06-08 20:25:42.624064 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59541 s=2 pgs=23883 cs=6553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.624601 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56718 s=2 pgs=14209 cs=127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.624885 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38177 s=2 pgs=19932 cs=2651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.625073 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54308 s=2 pgs=23720 cs=5309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.625420 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59423 s=2 pgs=18054 cs=4771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.625429 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38264 s=2 pgs=17712 cs=3581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.625877 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38180 s=2 pgs=19933 cs=2653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.626087 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59547 s=2 pgs=23884 cs=6555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.626507 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59430 s=2 pgs=18055 cs=4773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.626695 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38273 s=2 pgs=17713 cs=3583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.626778 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38184 s=2 pgs=19934 cs=2655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.626962 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54313 s=2 pgs=23721 cs=5311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.627008 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59553 s=2 pgs=23885 cs=6557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.627443 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59434 s=2 pgs=18056 cs=4775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.627548 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56726 s=2 pgs=14210 cs=129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.627689 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56726 s=1 pgs=14210 cs=130 l=0).fault
2013-06-08 20:25:42.627700 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38277 s=2 pgs=17714 cs=3585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.627714 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38188 s=2 pgs=19935 cs=2657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.628182 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54321 s=2 pgs=23722 cs=5313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.628258 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59558 s=2 pgs=23886 cs=6559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.628361 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :59439 s=2 pgs=18057 cs=4777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.628834 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38283 s=2 pgs=17715 cs=3587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.628860 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38194 s=2 pgs=19936 cs=2659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.629054 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56740 s=2 pgs=14211 cs=131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.629273 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=34 :59445 s=2 pgs=18058 cs=4779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.629801 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38199 s=2 pgs=19937 cs=2661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.630054 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56748 s=2 pgs=14212 cs=133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.630085 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54327 s=2 pgs=23723 cs=5315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.630123 7fddd0228700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54327 s=1 pgs=23723 cs=5316 l=0).fault
2013-06-08 20:25:42.630182 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :59449 s=2 pgs=18059 cs=4781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.630273 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59564 s=2 pgs=23887 cs=6561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.630345 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38288 s=2 pgs=17716 cs=3589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.630847 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38202 s=2 pgs=19938 cs=2663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.631097 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59574 s=2 pgs=23888 cs=6563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.631112 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :59453 s=2 pgs=18060 cs=4783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.631547 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38297 s=2 pgs=17717 cs=3591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.631722 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54336 s=2 pgs=23724 cs=5317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.631808 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56751 s=2 pgs=14213 cs=135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.631922 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38208 s=2 pgs=19939 cs=2665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.632598 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38301 s=2 pgs=17718 cs=3593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.632794 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :59458 s=2 pgs=18061 cs=4785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.632809 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59577 s=2 pgs=23889 cs=6565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.633585 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38305 s=2 pgs=17719 cs=3595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.633746 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59585 s=2 pgs=23890 cs=6567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.633842 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38214 s=2 pgs=19940 cs=2667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.635064 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54345 s=2 pgs=23725 cs=5319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.635094 7fddd0228700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54345 s=1 pgs=23725 cs=5320 l=0).fault
2013-06-08 20:25:42.635222 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38220 s=2 pgs=19941 cs=2669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.635261 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38308 s=2 pgs=17720 cs=3597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.635457 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56760 s=2 pgs=14214 cs=137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.635469 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59587 s=2 pgs=23891 cs=6569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.635577 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :59464 s=2 pgs=18062 cs=4787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.636231 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38313 s=2 pgs=17721 cs=3599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.636396 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54353 s=2 pgs=23726 cs=5321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.636453 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38222 s=2 pgs=19942 cs=2671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.636845 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59593 s=2 pgs=23892 cs=6571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.636971 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :59474 s=2 pgs=18063 cs=4789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.637202 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56772 s=2 pgs=14215 cs=139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.637424 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54360 s=2 pgs=23727 cs=5323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.637501 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38317 s=2 pgs=17722 cs=3601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.637886 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38229 s=2 pgs=19943 cs=2673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.637988 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59598 s=2 pgs=23893 cs=6573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.638316 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54365 s=2 pgs=23728 cs=5325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.638325 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59480 s=2 pgs=18064 cs=4791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.638382 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56779 s=2 pgs=14216 cs=141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.638696 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38324 s=2 pgs=17723 cs=3603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.638884 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38235 s=2 pgs=19944 cs=2675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.639242 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59486 s=2 pgs=18065 cs=4793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.639388 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54369 s=2 pgs=23729 cs=5327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.639693 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38330 s=2 pgs=17724 cs=3605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.640054 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38241 s=2 pgs=19945 cs=2677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.640088 7fddd1d65700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38241 s=1 pgs=19945 cs=2678 l=0).fault
2013-06-08 20:25:42.640091 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56787 s=2 pgs=14217 cs=143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.640161 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59604 s=2 pgs=23894 cs=6575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.640219 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59490 s=2 pgs=18066 cs=4795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.640291 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54375 s=2 pgs=23730 cs=5329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.640934 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59614 s=2 pgs=23895 cs=6577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.641059 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38334 s=2 pgs=17725 cs=3607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.641094 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59496 s=2 pgs=18067 cs=4797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.641104 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38245 s=2 pgs=19946 cs=2679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.641168 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54381 s=2 pgs=23731 cs=5331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.641218 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56795 s=2 pgs=14218 cs=145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.641884 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59618 s=2 pgs=23896 cs=6579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.641951 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59500 s=2 pgs=18068 cs=4799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.642043 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54386 s=2 pgs=23732 cs=5333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.642210 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :56803 s=2 pgs=14219 cs=147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.642210 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38341 s=2 pgs=17726 cs=3609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.642797 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38253 s=2 pgs=19947 cs=2681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.642810 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59624 s=2 pgs=23897 cs=6581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.642939 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54390 s=2 pgs=23733 cs=5335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.643201 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59505 s=2 pgs=18069 cs=4801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.643254 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56807 s=2 pgs=14220 cs=149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.643705 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59630 s=2 pgs=23898 cs=6583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.643745 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59630 s=1 pgs=23898 cs=6584 l=0).fault
2013-06-08 20:25:42.644025 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54395 s=2 pgs=23734 cs=5337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.644194 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59512 s=2 pgs=18070 cs=4803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.644248 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56813 s=2 pgs=14221 cs=151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.644420 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38261 s=2 pgs=19948 cs=2683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.644608 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59634 s=2 pgs=23899 cs=6585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.645196 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54399 s=2 pgs=23735 cs=5339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.645310 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56817 s=2 pgs=14222 cs=153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.645377 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59516 s=2 pgs=18071 cs=4805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.645439 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59639 s=2 pgs=23900 cs=6587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.645487 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38270 s=2 pgs=19949 cs=2685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.646174 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54404 s=2 pgs=23736 cs=5341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.646263 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59643 s=2 pgs=23901 cs=6589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.646301 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56821 s=2 pgs=14223 cs=155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.646317 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38350 s=2 pgs=17727 cs=3611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.646398 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38276 s=2 pgs=19950 cs=2687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.646558 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=34 :59522 s=2 pgs=18072 cs=4807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.647016 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59646 s=2 pgs=23902 cs=6591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.647139 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54409 s=2 pgs=23737 cs=5343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.647334 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56827 s=2 pgs=14224 cs=157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.647376 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38281 s=2 pgs=19951 cs=2689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.647560 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38370 s=2 pgs=17728 cs=3613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.647564 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59530 s=2 pgs=18073 cs=4809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.647965 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :59651 s=2 pgs=23903 cs=6593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.648054 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38286 s=2 pgs=19952 cs=2691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.648123 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54416 s=2 pgs=23738 cs=5345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.648263 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56833 s=2 pgs=14225 cs=159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.648429 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38377 s=2 pgs=17729 cs=3615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.648661 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59536 s=2 pgs=18074 cs=4811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.648989 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54422 s=2 pgs=23739 cs=5347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.649053 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38289 s=2 pgs=19953 cs=2693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.649370 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59659 s=2 pgs=23904 cs=6595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.649477 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38383 s=2 pgs=17730 cs=3617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.649500 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56840 s=2 pgs=14226 cs=161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.649576 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59542 s=2 pgs=18075 cs=4813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.649903 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54427 s=2 pgs=23740 cs=5349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.650021 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38296 s=2 pgs=19954 cs=2695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.650109 7fddd1d65700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38296 s=1 pgs=19954 cs=2696 l=0).fault
2013-06-08 20:25:42.650296 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59665 s=2 pgs=23905 cs=6597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.650459 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59547 s=2 pgs=18076 cs=4815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.650611 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38388 s=2 pgs=17731 cs=3619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.650713 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56848 s=2 pgs=14227 cs=163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.650867 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54433 s=2 pgs=23741 cs=5351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.651193 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59671 s=2 pgs=23906 cs=6599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.651231 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59552 s=2 pgs=18077 cs=4817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.651259 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38302 s=2 pgs=19955 cs=2697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.651757 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38395 s=2 pgs=17732 cs=3621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.651847 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54439 s=2 pgs=23742 cs=5353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.651941 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56854 s=2 pgs=14228 cs=165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.652149 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38310 s=2 pgs=19956 cs=2699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.652481 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59557 s=2 pgs=18078 cs=4819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.652784 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59676 s=2 pgs=23907 cs=6601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.652852 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54444 s=2 pgs=23743 cs=5355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.652978 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56861 s=2 pgs=14229 cs=167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.653210 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38314 s=2 pgs=19957 cs=2701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.653213 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59563 s=2 pgs=18079 cs=4821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.653693 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59684 s=2 pgs=23908 cs=6603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654009 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54449 s=2 pgs=23744 cs=5357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654025 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56866 s=2 pgs=14230 cs=169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654159 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38319 s=2 pgs=19958 cs=2703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654141 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59568 s=2 pgs=18080 cs=4823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654689 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38401 s=2 pgs=17733 cs=3623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654694 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59689 s=2 pgs=23909 cs=6605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654896 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56871 s=2 pgs=14231 cs=171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.654977 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54454 s=2 pgs=23745 cs=5359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.655128 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59573 s=2 pgs=18081 cs=4825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.655546 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38324 s=2 pgs=19959 cs=2705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.655553 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59695 s=2 pgs=23910 cs=6607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.655571 7fddd1d65700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38324 s=1 pgs=19959 cs=2706 l=0).fault
2013-06-08 20:25:42.655755 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38416 s=2 pgs=17734 cs=3625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.655922 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56876 s=2 pgs=14232 cs=173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.655950 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54461 s=2 pgs=23746 cs=5361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.656312 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59699 s=2 pgs=23911 cs=6609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.656826 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54467 s=2 pgs=23747 cs=5363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.656916 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56882 s=2 pgs=14233 cs=175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.656939 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38423 s=2 pgs=17735 cs=3627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.657004 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59704 s=2 pgs=23912 cs=6611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.657374 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59578 s=2 pgs=18082 cs=4827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.657403 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38332 s=2 pgs=19960 cs=2707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.657823 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59708 s=2 pgs=23913 cs=6613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.657958 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38429 s=2 pgs=17736 cs=3629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.658176 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56886 s=2 pgs=14234 cs=177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.658294 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59589 s=2 pgs=18083 cs=4829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.658303 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54469 s=2 pgs=23748 cs=5365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.658378 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38342 s=2 pgs=19961 cs=2709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.658613 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59711 s=2 pgs=23914 cs=6615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.659014 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59594 s=2 pgs=18084 cs=4831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.659067 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38434 s=2 pgs=17737 cs=3631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.659221 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56893 s=2 pgs=14235 cs=179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.659259 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38347 s=2 pgs=19962 cs=2711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.659318 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59717 s=2 pgs=23915 cs=6617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.659368 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54480 s=2 pgs=23749 cs=5367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.660001 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59599 s=2 pgs=18085 cs=4833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.660150 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38440 s=2 pgs=17738 cs=3633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.660209 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56900 s=2 pgs=14236 cs=181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.660386 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38353 s=2 pgs=19963 cs=2713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.660606 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59722 s=2 pgs=23916 cs=6619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.660827 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59604 s=2 pgs=18086 cs=4835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.661131 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54487 s=2 pgs=23750 cs=5369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.661155 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38447 s=2 pgs=17739 cs=3635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.661177 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56906 s=2 pgs=14237 cs=183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.661536 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38359 s=2 pgs=19964 cs=2715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.661612 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59728 s=2 pgs=23917 cs=6621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.661928 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :59609 s=2 pgs=18087 cs=4837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.662069 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54494 s=2 pgs=23751 cs=5371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.662101 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :56911 s=2 pgs=14238 cs=185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.662494 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38364 s=2 pgs=19965 cs=2717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.662598 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59733 s=2 pgs=23918 cs=6623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.662676 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38456 s=2 pgs=17740 cs=3637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.662782 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59615 s=2 pgs=18088 cs=4839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.663014 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54501 s=2 pgs=23752 cs=5373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.663288 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56916 s=2 pgs=14239 cs=187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.663508 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38370 s=2 pgs=19966 cs=2719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.663533 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59739 s=2 pgs=23919 cs=6625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.663583 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59621 s=2 pgs=18089 cs=4841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.663657 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38462 s=2 pgs=17741 cs=3639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.664159 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54506 s=2 pgs=23753 cs=5375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.664240 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56923 s=2 pgs=14240 cs=189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.664263 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59745 s=2 pgs=23920 cs=6627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.664466 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38376 s=2 pgs=19967 cs=2721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.664548 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59626 s=2 pgs=18090 cs=4843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.664719 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38469 s=2 pgs=17742 cs=3641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.665017 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59750 s=2 pgs=23921 cs=6629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.665057 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54512 s=2 pgs=23754 cs=5377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.665328 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56929 s=2 pgs=14241 cs=191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.665380 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59632 s=2 pgs=18091 cs=4845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.665530 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38383 s=2 pgs=19968 cs=2723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.665872 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38475 s=2 pgs=17743 cs=3643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.666036 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54519 s=2 pgs=23755 cs=5379 l=0).fault, initiating reconnect
2013-06-08 20:25:42.666083 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59754 s=2 pgs=23922 cs=6631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.666113 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59754 s=1 pgs=23922 cs=6632 l=0).fault
2013-06-08 20:25:42.666437 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59637 s=2 pgs=18092 cs=4847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.666922 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56936 s=2 pgs=14242 cs=193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.666956 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54524 s=2 pgs=23756 cs=5381 l=0).fault, initiating reconnect
2013-06-08 20:25:42.667014 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59761 s=2 pgs=23923 cs=6633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.667024 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38390 s=2 pgs=19969 cs=2725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.667083 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38481 s=2 pgs=17744 cs=3645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.667272 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59642 s=2 pgs=18093 cs=4849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.667761 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59765 s=2 pgs=23924 cs=6635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.667904 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54528 s=2 pgs=23757 cs=5383 l=0).fault, initiating reconnect
2013-06-08 20:25:42.667964 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56943 s=2 pgs=14243 cs=195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.668110 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38398 s=2 pgs=19970 cs=2727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.668186 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59648 s=2 pgs=18094 cs=4851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.668657 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59769 s=2 pgs=23925 cs=6637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.668818 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54534 s=2 pgs=23758 cs=5385 l=0).fault, initiating reconnect
2013-06-08 20:25:42.668946 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56951 s=2 pgs=14244 cs=197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.669035 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38404 s=2 pgs=19971 cs=2729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.669140 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38489 s=2 pgs=17745 cs=3647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.669201 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38489 s=1 pgs=17745 cs=3648 l=0).fault
2013-06-08 20:25:42.669346 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :59774 s=2 pgs=23926 cs=6639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.669743 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54539 s=2 pgs=23759 cs=5387 l=0).fault, initiating reconnect
2013-06-08 20:25:42.669788 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59653 s=2 pgs=18095 cs=4853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.669986 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56956 s=2 pgs=14245 cs=199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.670111 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38409 s=2 pgs=19972 cs=2731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.670247 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59779 s=2 pgs=23927 cs=6641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.670409 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38500 s=2 pgs=17746 cs=3649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.670922 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54544 s=2 pgs=23760 cs=5389 l=0).fault, initiating reconnect
2013-06-08 20:25:42.670980 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56962 s=2 pgs=14246 cs=201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.671011 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59784 s=2 pgs=23928 cs=6643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.671462 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59661 s=2 pgs=18096 cs=4855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.671490 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38507 s=2 pgs=17747 cs=3651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.671886 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38415 s=2 pgs=19973 cs=2733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.671912 7fddd1d65700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38415 s=1 pgs=19973 cs=2734 l=0).fault
2013-06-08 20:25:42.671933 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59788 s=2 pgs=23929 cs=6645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.671987 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56967 s=2 pgs=14247 cs=203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.672472 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59670 s=2 pgs=18097 cs=4857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.672768 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59792 s=2 pgs=23930 cs=6647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.672811 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38511 s=2 pgs=17748 cs=3653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.672886 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38423 s=2 pgs=19974 cs=2735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.672933 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54550 s=2 pgs=23761 cs=5391 l=0).fault, initiating reconnect
2013-06-08 20:25:42.673088 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56973 s=2 pgs=14248 cs=205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.673516 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59795 s=2 pgs=23931 cs=6649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.673732 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38518 s=2 pgs=17749 cs=3655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.674051 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59674 s=2 pgs=18098 cs=4859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.674063 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38429 s=2 pgs=19975 cs=2737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.674220 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56979 s=2 pgs=14249 cs=207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.674285 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59800 s=2 pgs=23932 cs=6651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.674790 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38523 s=2 pgs=17750 cs=3657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.675032 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54562 s=2 pgs=23762 cs=5393 l=0).fault, initiating reconnect
2013-06-08 20:25:42.675032 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38434 s=2 pgs=19976 cs=2739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.675135 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59805 s=2 pgs=23933 cs=6653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.675223 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59683 s=2 pgs=18099 cs=4861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.675827 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38528 s=2 pgs=17751 cs=3659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.675867 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59809 s=2 pgs=23934 cs=6655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.675941 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56984 s=2 pgs=14250 cs=209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.676199 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54571 s=2 pgs=23763 cs=5395 l=0).fault, initiating reconnect
2013-06-08 20:25:42.676392 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59690 s=2 pgs=18100 cs=4863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.676651 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59812 s=2 pgs=23935 cs=6657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.676848 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38533 s=2 pgs=17752 cs=3661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.676976 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56993 s=2 pgs=14251 cs=211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.676988 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38440 s=2 pgs=19977 cs=2741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.677015 7fddd1d65700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38440 s=1 pgs=19977 cs=2742 l=0).fault
2013-06-08 20:25:42.677310 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59695 s=2 pgs=18101 cs=4865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.677348 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54578 s=2 pgs=23764 cs=5397 l=0).fault, initiating reconnect
2013-06-08 20:25:42.677397 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59816 s=2 pgs=23936 cs=6659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.677935 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :56998 s=2 pgs=14252 cs=213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.677979 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38451 s=2 pgs=19978 cs=2743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.678005 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38539 s=2 pgs=17753 cs=3663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.678159 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59822 s=2 pgs=23937 cs=6661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.678219 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59700 s=2 pgs=18102 cs=4867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.678299 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54585 s=2 pgs=23765 cs=5399 l=0).fault, initiating reconnect
2013-06-08 20:25:42.678812 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38456 s=2 pgs=19979 cs=2745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.678860 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57003 s=2 pgs=14253 cs=215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.678865 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59826 s=2 pgs=23938 cs=6663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.679163 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59707 s=2 pgs=18103 cs=4869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.679212 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54592 s=2 pgs=23766 cs=5401 l=0).fault, initiating reconnect
2013-06-08 20:25:42.679328 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38547 s=2 pgs=17754 cs=3665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.679646 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59831 s=2 pgs=23939 cs=6665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.679765 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38461 s=2 pgs=19980 cs=2747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.679855 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57010 s=2 pgs=14254 cs=217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.680083 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54597 s=2 pgs=23767 cs=5403 l=0).fault, initiating reconnect
2013-06-08 20:25:42.680110 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59712 s=2 pgs=18104 cs=4871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.680496 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38556 s=2 pgs=17755 cs=3667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.680562 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59835 s=2 pgs=23940 cs=6667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.680623 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38468 s=2 pgs=19981 cs=2749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.680818 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57017 s=2 pgs=14255 cs=219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681014 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59719 s=2 pgs=18105 cs=4873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681056 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54602 s=2 pgs=23768 cs=5405 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681419 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38562 s=2 pgs=17756 cs=3669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681362 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59841 s=2 pgs=23941 cs=6669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681544 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38474 s=2 pgs=19982 cs=2751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681864 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57023 s=2 pgs=14256 cs=221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681866 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59724 s=2 pgs=18106 cs=4875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.681943 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54609 s=2 pgs=23769 cs=5407 l=0).fault, initiating reconnect
2013-06-08 20:25:42.682130 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59847 s=2 pgs=23942 cs=6671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.682299 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38568 s=2 pgs=17757 cs=3671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.682586 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38480 s=2 pgs=19983 cs=2753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.682799 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54615 s=2 pgs=23770 cs=5409 l=0).fault, initiating reconnect
2013-06-08 20:25:42.682817 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57029 s=2 pgs=14257 cs=223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.682824 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59730 s=2 pgs=18107 cs=4877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.682878 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59852 s=2 pgs=23943 cs=6673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.683332 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38575 s=2 pgs=17758 cs=3673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.683645 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59736 s=2 pgs=18108 cs=4879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.683690 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54619 s=2 pgs=23771 cs=5411 l=0).fault, initiating reconnect
2013-06-08 20:25:42.683679 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59858 s=2 pgs=23944 cs=6675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.683745 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38486 s=2 pgs=19984 cs=2755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.683791 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57037 s=2 pgs=14258 cs=225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.684326 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38581 s=2 pgs=17759 cs=3675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.684467 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59862 s=2 pgs=23945 cs=6677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.684589 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59740 s=2 pgs=18109 cs=4881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.684612 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54625 s=2 pgs=23772 cs=5413 l=0).fault, initiating reconnect
2013-06-08 20:25:42.684782 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38495 s=2 pgs=19985 cs=2757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.684816 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57044 s=2 pgs=14259 cs=227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.685321 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59866 s=2 pgs=23946 cs=6679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.685407 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59747 s=2 pgs=18110 cs=4883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.685482 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38587 s=2 pgs=17760 cs=3677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.685614 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54632 s=2 pgs=23773 cs=5415 l=0).fault, initiating reconnect
2013-06-08 20:25:42.685767 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57050 s=2 pgs=14260 cs=229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.685821 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38501 s=2 pgs=19986 cs=2759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.686118 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59871 s=2 pgs=23947 cs=6681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.686353 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59752 s=2 pgs=18111 cs=4885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.686551 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54638 s=2 pgs=23774 cs=5417 l=0).fault, initiating reconnect
2013-06-08 20:25:42.686557 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57055 s=2 pgs=14261 cs=231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.686758 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38508 s=2 pgs=19987 cs=2761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.686837 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59877 s=2 pgs=23948 cs=6683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.687233 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59758 s=2 pgs=18112 cs=4887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.687411 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38595 s=2 pgs=17761 cs=3679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.687427 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38595 s=1 pgs=17761 cs=3680 l=0).fault
2013-06-08 20:25:42.687593 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38513 s=2 pgs=19988 cs=2763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.687598 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59882 s=2 pgs=23949 cs=6685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.687628 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57059 s=2 pgs=14262 cs=233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.687747 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54644 s=2 pgs=23775 cs=5419 l=0).fault, initiating reconnect
2013-06-08 20:25:42.688185 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59763 s=2 pgs=18113 cs=4889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.688398 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59885 s=2 pgs=23950 cs=6687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.688462 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38519 s=2 pgs=19989 cs=2765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.688470 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57066 s=2 pgs=14263 cs=235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.689066 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59769 s=2 pgs=18114 cs=4891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.689185 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59890 s=2 pgs=23951 cs=6689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.689255 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38606 s=2 pgs=17762 cs=3681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.689428 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38523 s=2 pgs=19990 cs=2767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.689558 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57072 s=2 pgs=14264 cs=237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.689866 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54652 s=2 pgs=23776 cs=5421 l=0).fault, initiating reconnect
2013-06-08 20:25:42.689946 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59773 s=2 pgs=18115 cs=4893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.690115 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59894 s=2 pgs=23952 cs=6691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.690423 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38528 s=2 pgs=19991 cs=2769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.690579 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57077 s=2 pgs=14265 cs=239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.690596 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38617 s=2 pgs=17763 cs=3683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.690807 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59779 s=2 pgs=18116 cs=4895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.690834 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54662 s=2 pgs=23777 cs=5423 l=0).fault, initiating reconnect
2013-06-08 20:25:42.691074 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59900 s=2 pgs=23953 cs=6693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.691353 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38533 s=2 pgs=19992 cs=2771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.691553 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57083 s=2 pgs=14266 cs=241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.691714 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54669 s=2 pgs=23778 cs=5425 l=0).fault, initiating reconnect
2013-06-08 20:25:42.691744 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59784 s=2 pgs=18117 cs=4897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.691765 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :38624 s=2 pgs=17764 cs=3685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.691781 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59906 s=2 pgs=23954 cs=6695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.692224 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38539 s=2 pgs=19993 cs=2773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.692526 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59912 s=2 pgs=23955 cs=6697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.692558 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57088 s=2 pgs=14267 cs=243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.692693 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54673 s=2 pgs=23779 cs=5427 l=0).fault, initiating reconnect
2013-06-08 20:25:42.692736 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59791 s=2 pgs=18118 cs=4899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.692751 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38632 s=2 pgs=17765 cs=3687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.693096 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38545 s=2 pgs=19994 cs=2775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.693238 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59914 s=2 pgs=23956 cs=6699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.693397 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57095 s=2 pgs=14268 cs=245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.693558 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59797 s=2 pgs=18119 cs=4901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.693595 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54680 s=2 pgs=23780 cs=5429 l=0).fault, initiating reconnect
2013-06-08 20:25:42.693768 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38640 s=2 pgs=17766 cs=3689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.693928 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59920 s=2 pgs=23957 cs=6701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.694087 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38551 s=2 pgs=19995 cs=2777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.694177 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57101 s=2 pgs=14269 cs=247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.694400 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59802 s=2 pgs=18120 cs=4903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.694501 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54687 s=2 pgs=23781 cs=5431 l=0).fault, initiating reconnect
2013-06-08 20:25:42.694756 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38646 s=2 pgs=17767 cs=3691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.694915 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38558 s=2 pgs=19996 cs=2779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.694975 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57107 s=2 pgs=14270 cs=249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.695199 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59808 s=2 pgs=18121 cs=4905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.695235 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59925 s=2 pgs=23958 cs=6703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.695409 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54693 s=2 pgs=23782 cs=5433 l=0).fault, initiating reconnect
2013-06-08 20:25:42.695814 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38652 s=2 pgs=17768 cs=3693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.695961 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57112 s=2 pgs=14271 cs=251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.695986 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59934 s=2 pgs=23959 cs=6705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.696091 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59813 s=2 pgs=18122 cs=4907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.696150 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38563 s=2 pgs=19997 cs=2781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.696329 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54699 s=2 pgs=23783 cs=5435 l=0).fault, initiating reconnect
2013-06-08 20:25:42.696770 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59938 s=2 pgs=23960 cs=6707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.696791 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57117 s=2 pgs=14272 cs=253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.696842 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38658 s=2 pgs=17769 cs=3695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.697010 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59819 s=2 pgs=18123 cs=4909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.697065 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38572 s=2 pgs=19998 cs=2783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.697261 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54705 s=2 pgs=23784 cs=5437 l=0).fault, initiating reconnect
2013-06-08 20:25:42.697499 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59942 s=2 pgs=23961 cs=6709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.697836 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57123 s=2 pgs=14273 cs=255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.697947 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59825 s=2 pgs=18124 cs=4911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.698026 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38666 s=2 pgs=17770 cs=3697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.698139 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38578 s=2 pgs=19999 cs=2785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.698363 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54711 s=2 pgs=23785 cs=5439 l=0).fault, initiating reconnect
2013-06-08 20:25:42.698369 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59948 s=2 pgs=23962 cs=6711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.698818 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57129 s=2 pgs=14274 cs=257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.698923 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38673 s=2 pgs=17771 cs=3699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.698965 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59830 s=2 pgs=18125 cs=4913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.699127 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38584 s=2 pgs=20000 cs=2787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.699208 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59953 s=2 pgs=23963 cs=6713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.699422 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54718 s=2 pgs=23786 cs=5441 l=0).fault, initiating reconnect
2013-06-08 20:25:42.699811 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38679 s=2 pgs=17772 cs=3701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.699876 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57135 s=2 pgs=14275 cs=259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.700155 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59959 s=2 pgs=23964 cs=6715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.700293 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59836 s=2 pgs=18126 cs=4915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.700470 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38590 s=2 pgs=20001 cs=2789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.700602 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54724 s=2 pgs=23787 cs=5443 l=0).fault, initiating reconnect
2013-06-08 20:25:42.700762 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38683 s=2 pgs=17773 cs=3703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.700859 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57142 s=2 pgs=14276 cs=261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.701000 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59963 s=2 pgs=23965 cs=6717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.701294 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59844 s=2 pgs=18127 cs=4917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.701616 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :54730 s=2 pgs=23788 cs=5445 l=0).fault, initiating reconnect
2013-06-08 20:25:42.701620 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :38597 s=2 pgs=20002 cs=2791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.701761 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59969 s=2 pgs=23966 cs=6719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.701860 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57148 s=2 pgs=14277 cs=263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.702005 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38689 s=2 pgs=17774 cs=3705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.702231 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59850 s=2 pgs=18128 cs=4919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.702555 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38604 s=2 pgs=20003 cs=2793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.702555 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54735 s=2 pgs=23789 cs=5447 l=0).fault, initiating reconnect
2013-06-08 20:25:42.702661 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59973 s=2 pgs=23967 cs=6721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.702853 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57154 s=2 pgs=14278 cs=265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.703115 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38697 s=2 pgs=17775 cs=3707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.703153 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59856 s=2 pgs=18129 cs=4921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.703558 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59979 s=2 pgs=23968 cs=6723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.703638 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38609 s=2 pgs=20004 cs=2795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.703708 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54742 s=2 pgs=23790 cs=5449 l=0).fault, initiating reconnect
2013-06-08 20:25:42.704044 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57160 s=2 pgs=14279 cs=267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.704363 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59862 s=2 pgs=18130 cs=4923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.704600 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54748 s=2 pgs=23791 cs=5451 l=0).fault, initiating reconnect
2013-06-08 20:25:42.704647 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38703 s=2 pgs=17776 cs=3709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.704794 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38617 s=2 pgs=20005 cs=2797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.704830 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59983 s=2 pgs=23969 cs=6725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.704866 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59983 s=1 pgs=23969 cs=6726 l=0).fault
2013-06-08 20:25:42.705117 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57166 s=2 pgs=14280 cs=269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.705558 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59867 s=2 pgs=18131 cs=4925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.705720 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :54752 s=2 pgs=23792 cs=5453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.705725 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :59990 s=2 pgs=23970 cs=6727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.705792 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38711 s=2 pgs=17777 cs=3711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.706111 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57172 s=2 pgs=14281 cs=271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.706119 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38623 s=2 pgs=20006 cs=2799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.706543 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59995 s=2 pgs=23971 cs=6729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.706633 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54758 s=2 pgs=23793 cs=5455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.707115 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59873 s=2 pgs=18132 cs=4927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.707159 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38629 s=2 pgs=20007 cs=2801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.707181 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57177 s=2 pgs=14282 cs=273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.707248 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38718 s=2 pgs=17778 cs=3713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.707548 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54764 s=2 pgs=23794 cs=5457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.707931 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38634 s=2 pgs=20008 cs=2803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.708013 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59881 s=2 pgs=18133 cs=4929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.708239 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59999 s=2 pgs=23972 cs=6731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.708286 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :59999 s=1 pgs=23972 cs=6732 l=0).fault
2013-06-08 20:25:42.708347 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57183 s=2 pgs=14283 cs=275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.708454 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54769 s=2 pgs=23795 cs=5459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.708505 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38726 s=2 pgs=17779 cs=3715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.708868 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38638 s=2 pgs=20009 cs=2805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.708991 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60008 s=2 pgs=23973 cs=6733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.709322 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57189 s=2 pgs=14284 cs=277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.709416 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54774 s=2 pgs=23796 cs=5461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.709808 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60013 s=2 pgs=23974 cs=6735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.709884 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :38644 s=2 pgs=20010 cs=2807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.709889 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :38733 s=2 pgs=17780 cs=3717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.710078 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59887 s=2 pgs=18134 cs=4931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.710342 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57194 s=2 pgs=14285 cs=279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.710448 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54779 s=2 pgs=23797 cs=5463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.710781 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60016 s=2 pgs=23975 cs=6737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.710781 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38649 s=2 pgs=20011 cs=2809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.711052 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59899 s=2 pgs=18135 cs=4933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.711200 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38740 s=2 pgs=17781 cs=3719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.711277 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=32 :57200 s=2 pgs=14286 cs=281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.711582 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60022 s=2 pgs=23976 cs=6739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.711645 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54785 s=2 pgs=23798 cs=5465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.711661 7fddd0228700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54785 s=1 pgs=23798 cs=5466 l=0).fault
2013-06-08 20:25:42.711768 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38654 s=2 pgs=20012 cs=2811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.712009 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59904 s=2 pgs=18136 cs=4935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.712245 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57206 s=2 pgs=14287 cs=283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.712354 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38747 s=2 pgs=17782 cs=3721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.712738 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54792 s=2 pgs=23799 cs=5467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.712744 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=32 :38661 s=2 pgs=20013 cs=2813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.712916 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60027 s=2 pgs=23977 cs=6741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.713094 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59910 s=2 pgs=18137 cs=4937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.713224 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57211 s=2 pgs=14288 cs=285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.713926 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60035 s=2 pgs=23978 cs=6743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.714093 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59916 s=2 pgs=18138 cs=4939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.714113 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38754 s=2 pgs=17783 cs=3723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.714107 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=32 :38665 s=2 pgs=20014 cs=2815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.714187 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38754 s=1 pgs=17783 cs=3724 l=0).fault
2013-06-08 20:25:42.714858 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59919 s=2 pgs=18139 cs=4941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.714884 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57217 s=2 pgs=14289 cs=287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.714938 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :54798 s=2 pgs=23800 cs=5469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.715076 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60038 s=2 pgs=23979 cs=6745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.715173 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38672 s=2 pgs=20015 cs=2817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.715394 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38763 s=2 pgs=17784 cs=3725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.715765 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54807 s=2 pgs=23801 cs=5471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.715870 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :59924 s=2 pgs=18140 cs=4943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.715892 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57222 s=2 pgs=14290 cs=289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.716435 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60046 s=2 pgs=23980 cs=6747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.716553 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38769 s=2 pgs=17785 cs=3727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.716756 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54812 s=2 pgs=23802 cs=5473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.717065 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38677 s=2 pgs=20016 cs=2819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.717342 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60051 s=2 pgs=23981 cs=6749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.717363 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60051 s=1 pgs=23981 cs=6750 l=0).fault
2013-06-08 20:25:42.717456 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57230 s=2 pgs=14291 cs=291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.717487 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57230 s=1 pgs=14291 cs=292 l=0).fault
2013-06-08 20:25:42.717544 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59929 s=2 pgs=18141 cs=4945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.717690 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54817 s=2 pgs=23803 cs=5475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.718046 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38686 s=2 pgs=20017 cs=2821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.718239 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60055 s=2 pgs=23982 cs=6751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.718341 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59937 s=2 pgs=18142 cs=4947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.718398 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38774 s=2 pgs=17786 cs=3729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.718597 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54822 s=2 pgs=23804 cs=5477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.718808 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57236 s=2 pgs=14292 cs=293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.719013 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38691 s=2 pgs=20018 cs=2823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.719069 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60060 s=2 pgs=23983 cs=6753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.719386 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :59941 s=2 pgs=18143 cs=4949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.719507 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54827 s=2 pgs=23805 cs=5479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.719849 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57244 s=2 pgs=14293 cs=295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.719987 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38784 s=2 pgs=17787 cs=3731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.720225 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=34 :59947 s=2 pgs=18144 cs=4951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.720465 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54832 s=2 pgs=23806 cs=5481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.720803 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60066 s=2 pgs=23984 cs=6755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.720851 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57249 s=2 pgs=14294 cs=297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.721023 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38697 s=2 pgs=20019 cs=2825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.721029 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :59951 s=2 pgs=18145 cs=4953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.721224 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38792 s=2 pgs=17788 cs=3733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.721574 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=32 :54836 s=2 pgs=23807 cs=5483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.721883 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59956 s=2 pgs=18146 cs=4955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.722065 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38707 s=2 pgs=20020 cs=2827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.722336 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38799 s=2 pgs=17789 cs=3735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.722596 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54842 s=2 pgs=23808 cs=5485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.722745 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59959 s=2 pgs=18147 cs=4957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.722817 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60073 s=2 pgs=23985 cs=6757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.722858 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57254 s=2 pgs=14295 cs=299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.722863 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60073 s=1 pgs=23985 cs=6758 l=0).fault
2013-06-08 20:25:42.723133 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38712 s=2 pgs=20021 cs=2829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.723339 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38803 s=2 pgs=17790 cs=3737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.723704 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54846 s=2 pgs=23809 cs=5487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.723829 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59963 s=2 pgs=18148 cs=4959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.723956 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57265 s=2 pgs=14296 cs=301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.723987 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60084 s=2 pgs=23986 cs=6759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.724260 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38718 s=2 pgs=20022 cs=2831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.724335 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38809 s=2 pgs=17791 cs=3739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.724612 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54852 s=2 pgs=23810 cs=5489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.724672 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59969 s=2 pgs=18149 cs=4961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.724901 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60091 s=2 pgs=23987 cs=6761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.724929 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57270 s=2 pgs=14297 cs=303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.725177 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38724 s=2 pgs=20023 cs=2833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.725429 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38815 s=2 pgs=17792 cs=3741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.725647 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59975 s=2 pgs=18150 cs=4963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.725742 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54858 s=2 pgs=23811 cs=5491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.726288 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60096 s=2 pgs=23988 cs=6763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.726360 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38730 s=2 pgs=20024 cs=2835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.726421 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57277 s=2 pgs=14298 cs=305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.726584 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38821 s=2 pgs=17793 cs=3743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.726634 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59980 s=2 pgs=18151 cs=4965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.726889 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54865 s=2 pgs=23812 cs=5493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.727137 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60102 s=2 pgs=23989 cs=6765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.727432 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38735 s=2 pgs=20025 cs=2837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.727457 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59986 s=2 pgs=18152 cs=4967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.728091 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60108 s=2 pgs=23990 cs=6767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.728136 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54871 s=2 pgs=23813 cs=5495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.728371 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59990 s=2 pgs=18153 cs=4969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.728372 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38741 s=2 pgs=20026 cs=2839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.728563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57284 s=2 pgs=14299 cs=307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.729298 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :59993 s=2 pgs=18154 cs=4971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.729386 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38744 s=2 pgs=20027 cs=2841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.729443 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60115 s=2 pgs=23991 cs=6769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.729598 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54875 s=2 pgs=23814 cs=5497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.730157 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :59996 s=2 pgs=18155 cs=4973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.730176 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57294 s=2 pgs=14300 cs=309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.730251 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38749 s=2 pgs=20028 cs=2843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.730360 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60118 s=2 pgs=23992 cs=6771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.730596 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54883 s=2 pgs=23815 cs=5499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.730741 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38827 s=2 pgs=17794 cs=3745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.731109 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :60000 s=2 pgs=18156 cs=4975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.731204 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38754 s=2 pgs=20029 cs=2845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.731445 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60123 s=2 pgs=23993 cs=6773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.731615 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54888 s=2 pgs=23816 cs=5501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.731980 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38847 s=2 pgs=17795 cs=3747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.732113 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :60006 s=2 pgs=18157 cs=4977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.732262 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57301 s=2 pgs=14301 cs=311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.732268 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60128 s=2 pgs=23994 cs=6775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.732364 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54893 s=2 pgs=23817 cs=5503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.732963 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38759 s=2 pgs=20030 cs=2847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.733208 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57313 s=2 pgs=14302 cs=313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.733270 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60132 s=2 pgs=23995 cs=6777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.733299 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=34 :60011 s=2 pgs=18158 cs=4979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.733307 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60132 s=1 pgs=23995 cs=6778 l=0).fault
2013-06-08 20:25:42.733935 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38767 s=2 pgs=20031 cs=2849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.734020 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38852 s=2 pgs=17796 cs=3749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.734099 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54898 s=2 pgs=23818 cs=5505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.734133 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=34 :60018 s=2 pgs=18159 cs=4981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.734223 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57316 s=2 pgs=14303 cs=315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.734434 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60137 s=2 pgs=23996 cs=6779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.734788 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38771 s=2 pgs=20032 cs=2851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.734982 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60022 s=2 pgs=18160 cs=4983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.735079 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54905 s=2 pgs=23819 cs=5507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.735199 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57323 s=2 pgs=14304 cs=317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.735329 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60144 s=2 pgs=23997 cs=6781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.735450 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38862 s=2 pgs=17797 cs=3751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.735814 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60026 s=2 pgs=18161 cs=4985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.735832 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38777 s=2 pgs=20033 cs=2853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.735983 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54911 s=2 pgs=23820 cs=5509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.736411 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60149 s=2 pgs=23998 cs=6783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.736466 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57328 s=2 pgs=14305 cs=319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.736774 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60031 s=2 pgs=18162 cs=4987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.737078 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54917 s=2 pgs=23821 cs=5511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.737150 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38784 s=2 pgs=20034 cs=2855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.737425 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=32 :38872 s=2 pgs=17798 cs=3753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.737527 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60036 s=2 pgs=18163 cs=4989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.737592 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57335 s=2 pgs=14306 cs=321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.737924 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54921 s=2 pgs=23822 cs=5513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.738159 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38790 s=2 pgs=20035 cs=2857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.738161 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60154 s=2 pgs=23999 cs=6785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.738180 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60154 s=1 pgs=23999 cs=6786 l=0).fault
2013-06-08 20:25:42.738498 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60040 s=2 pgs=18164 cs=4991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.738709 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :38881 s=2 pgs=17799 cs=3755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.738789 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57341 s=2 pgs=14307 cs=323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.738940 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60164 s=2 pgs=24000 cs=6787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.739096 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38795 s=2 pgs=20036 cs=2859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.739181 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54926 s=2 pgs=23823 cs=5515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.739467 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60045 s=2 pgs=18165 cs=4993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.739758 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60168 s=2 pgs=24001 cs=6789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.739810 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :38888 s=2 pgs=17800 cs=3757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.739903 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57347 s=2 pgs=14308 cs=325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.740084 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38801 s=2 pgs=20037 cs=2861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.740202 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54934 s=2 pgs=23824 cs=5517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.740583 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60051 s=2 pgs=18166 cs=4995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.741063 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57353 s=2 pgs=14309 cs=327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.741273 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :38894 s=2 pgs=17801 cs=3759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.741435 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38806 s=2 pgs=20038 cs=2863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.741855 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :60175 s=2 pgs=24002 cs=6791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.741866 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :54940 s=2 pgs=23825 cs=5519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.741927 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60057 s=2 pgs=18167 cs=4997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.742155 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :57358 s=2 pgs=14310 cs=329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.742442 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38812 s=2 pgs=20039 cs=2865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.742580 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :38901 s=2 pgs=17802 cs=3761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.742754 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :54946 s=2 pgs=23826 cs=5521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.742782 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60181 s=2 pgs=24003 cs=6793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.742862 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :60063 s=2 pgs=18168 cs=4999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.743252 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57364 s=2 pgs=14311 cs=331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.743478 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38817 s=2 pgs=20040 cs=2867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.743756 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60188 s=2 pgs=24004 cs=6795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.743822 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60069 s=2 pgs=18169 cs=5001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.743849 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :38908 s=2 pgs=17803 cs=3763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.744419 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38823 s=2 pgs=20041 cs=2869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.744426 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54951 s=2 pgs=23827 cs=5523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.744806 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=34 :57370 s=2 pgs=14312 cs=333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.744997 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60073 s=2 pgs=18170 cs=5003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.745170 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :38916 s=2 pgs=17804 cs=3765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.745407 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38827 s=2 pgs=20042 cs=2871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.745560 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54960 s=2 pgs=23828 cs=5525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.745647 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60192 s=2 pgs=24005 cs=6797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.745667 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60192 s=1 pgs=24005 cs=6798 l=0).fault
2013-06-08 20:25:42.745811 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=34 :60078 s=2 pgs=18171 cs=5005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.745920 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :57377 s=2 pgs=14313 cs=335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.746700 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38832 s=2 pgs=20043 cs=2873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.746909 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60202 s=2 pgs=24006 cs=6799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.746906 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :38921 s=2 pgs=17805 cs=3767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.746927 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60202 s=1 pgs=24006 cs=6800 l=0).fault
2013-06-08 20:25:42.747498 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54965 s=2 pgs=23829 cs=5527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.747580 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38837 s=2 pgs=20044 cs=2875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.747740 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :60083 s=2 pgs=18172 cs=5007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.747825 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60206 s=2 pgs=24007 cs=6801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.747990 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57384 s=2 pgs=14314 cs=337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.748370 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38841 s=2 pgs=20045 cs=2877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.748427 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54972 s=2 pgs=23830 cs=5529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.748446 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38929 s=2 pgs=17806 cs=3769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.748611 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60211 s=2 pgs=24008 cs=6803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.748661 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60090 s=2 pgs=18173 cs=5009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.748965 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57392 s=2 pgs=14315 cs=339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.749317 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54978 s=2 pgs=23831 cs=5531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.749371 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38845 s=2 pgs=20046 cs=2879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.749774 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60097 s=2 pgs=18174 cs=5011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.750058 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57398 s=2 pgs=14316 cs=341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.750209 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54983 s=2 pgs=23832 cs=5533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.750372 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60216 s=2 pgs=24009 cs=6805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.750377 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38937 s=2 pgs=17807 cs=3771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.750393 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60216 s=1 pgs=24009 cs=6806 l=0).fault
2013-06-08 20:25:42.750418 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :38937 s=1 pgs=17807 cs=3772 l=0).fault
2013-06-08 20:25:42.750776 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=32 :60101 s=2 pgs=18175 cs=5013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.751073 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38852 s=2 pgs=20047 cs=2881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.751088 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54987 s=2 pgs=23833 cs=5535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.751306 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60224 s=2 pgs=24010 cs=6807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.751465 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38947 s=2 pgs=17808 cs=3773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.751659 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60106 s=2 pgs=18176 cs=5015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.751999 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57402 s=2 pgs=14317 cs=343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.752012 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :38859 s=2 pgs=20048 cs=2883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.752020 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57402 s=1 pgs=14317 cs=344 l=0).fault
2013-06-08 20:25:42.752106 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60229 s=2 pgs=24011 cs=6809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.752179 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54992 s=2 pgs=23834 cs=5537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.752538 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38952 s=2 pgs=17809 cs=3775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.752566 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60111 s=2 pgs=18177 cs=5017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.752880 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60234 s=2 pgs=24012 cs=6811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.753067 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :54999 s=2 pgs=23835 cs=5539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.753097 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38865 s=2 pgs=20049 cs=2885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.753163 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57412 s=2 pgs=14318 cs=345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.753427 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60117 s=2 pgs=18178 cs=5019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.753749 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60238 s=2 pgs=24013 cs=6813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.754035 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38958 s=2 pgs=17810 cs=3777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.754031 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :55003 s=2 pgs=23836 cs=5541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.754057 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :38958 s=1 pgs=17810 cs=3778 l=0).fault
2013-06-08 20:25:42.754090 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38872 s=2 pgs=20050 cs=2887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.754180 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60122 s=2 pgs=18179 cs=5021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.754652 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57421 s=2 pgs=14319 cs=347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.754662 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60243 s=2 pgs=24014 cs=6815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.754678 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57421 s=1 pgs=14319 cs=348 l=0).fault
2013-06-08 20:25:42.755031 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38878 s=2 pgs=20051 cs=2889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.755033 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55008 s=2 pgs=23837 cs=5543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.755234 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38967 s=2 pgs=17811 cs=3779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.755559 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60249 s=2 pgs=24015 cs=6817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.755744 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57428 s=2 pgs=14320 cs=349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.755838 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55014 s=2 pgs=23838 cs=5545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.755945 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38883 s=2 pgs=20052 cs=2891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.756340 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60127 s=2 pgs=18180 cs=5023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.756411 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60253 s=2 pgs=24016 cs=6819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.756500 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38974 s=2 pgs=17812 cs=3781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.756841 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55019 s=2 pgs=23839 cs=5547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.756899 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38888 s=2 pgs=20053 cs=2893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.757143 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60258 s=2 pgs=24017 cs=6821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.757181 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60137 s=2 pgs=18181 cs=5025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.757451 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57434 s=2 pgs=14321 cs=351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.757522 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38981 s=2 pgs=17813 cs=3783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.757818 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38893 s=2 pgs=20054 cs=2895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.757993 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60262 s=2 pgs=24018 cs=6823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.758090 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60143 s=2 pgs=18182 cs=5027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.758315 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55024 s=2 pgs=23840 cs=5549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.758381 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57444 s=2 pgs=14322 cs=353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.758708 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38898 s=2 pgs=20055 cs=2897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.758799 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60267 s=2 pgs=24019 cs=6825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.758963 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38987 s=2 pgs=17814 cs=3785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.759197 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55033 s=2 pgs=23841 cs=5551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.759291 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57450 s=2 pgs=14323 cs=355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.759491 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38903 s=2 pgs=20056 cs=2899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.759651 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60272 s=2 pgs=24020 cs=6827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.759702 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60148 s=2 pgs=18183 cs=5029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.759969 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55038 s=2 pgs=23842 cs=5553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.760088 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :38995 s=2 pgs=17815 cs=3787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.760444 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60277 s=2 pgs=24021 cs=6829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.760538 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60158 s=2 pgs=18184 cs=5031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.760916 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55043 s=2 pgs=23843 cs=5555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.761247 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60281 s=2 pgs=24022 cs=6831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.761313 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38908 s=2 pgs=20057 cs=2901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.761323 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57455 s=2 pgs=14324 cs=357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.761567 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60162 s=2 pgs=18185 cs=5033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.761579 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39002 s=2 pgs=17816 cs=3789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.761597 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39002 s=1 pgs=17816 cs=3790 l=0).fault
2013-06-08 20:25:42.762397 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38917 s=2 pgs=20058 cs=2903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.762420 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60167 s=2 pgs=18186 cs=5035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.762976 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55047 s=2 pgs=23844 cs=5557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.762979 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60284 s=2 pgs=24023 cs=6833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.763314 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60170 s=2 pgs=18187 cs=5037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.763322 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38921 s=2 pgs=20059 cs=2905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.763507 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57466 s=2 pgs=14325 cs=359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.763507 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39010 s=2 pgs=17817 cs=3791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.763531 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57466 s=1 pgs=14325 cs=360 l=0).fault
2013-06-08 20:25:42.763952 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55055 s=2 pgs=23845 cs=5559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.764236 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60173 s=2 pgs=18188 cs=5039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.764309 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38926 s=2 pgs=20060 cs=2907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.764773 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57476 s=2 pgs=14326 cs=361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.764910 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55061 s=2 pgs=23846 cs=5561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.764960 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39017 s=2 pgs=17818 cs=3793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.765589 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38931 s=2 pgs=20061 cs=2909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.765697 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60292 s=2 pgs=24024 cs=6835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.765745 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60292 s=1 pgs=24024 cs=6836 l=0).fault
2013-06-08 20:25:42.765796 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55065 s=2 pgs=23847 cs=5563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.765832 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57480 s=2 pgs=14327 cs=363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.766037 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39024 s=2 pgs=17819 cs=3795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.766227 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60178 s=2 pgs=18189 cs=5041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.766554 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60304 s=2 pgs=24025 cs=6837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.766563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38935 s=2 pgs=20062 cs=2911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.766932 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57486 s=2 pgs=14328 cs=365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.767026 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55069 s=2 pgs=23848 cs=5565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.767152 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39029 s=2 pgs=17820 cs=3797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.767460 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60309 s=2 pgs=24026 cs=6839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.767514 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38942 s=2 pgs=20063 cs=2913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.767544 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60188 s=2 pgs=18190 cs=5043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.767961 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55076 s=2 pgs=23849 cs=5567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.768012 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57491 s=2 pgs=14329 cs=367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.768336 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60314 s=2 pgs=24027 cs=6841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.768428 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39035 s=2 pgs=17821 cs=3799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.768457 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60196 s=2 pgs=18191 cs=5045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.769083 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60319 s=2 pgs=24028 cs=6843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.769154 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38947 s=2 pgs=20064 cs=2915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.769253 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60201 s=2 pgs=18192 cs=5047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.769341 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55082 s=2 pgs=23850 cs=5569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.769977 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60322 s=2 pgs=24029 cs=6845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.770186 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39042 s=2 pgs=17822 cs=3801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.770198 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60204 s=2 pgs=18193 cs=5049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.770211 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55089 s=2 pgs=23851 cs=5571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.770218 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57497 s=2 pgs=14330 cs=369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.770203 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38955 s=2 pgs=20065 cs=2917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.770896 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60326 s=2 pgs=24030 cs=6847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.770921 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60326 s=1 pgs=24030 cs=6848 l=0).fault
2013-06-08 20:25:42.771203 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55093 s=2 pgs=23852 cs=5573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.771230 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60208 s=2 pgs=18194 cs=5051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.771325 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :38963 s=2 pgs=20066 cs=2919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.771364 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39049 s=2 pgs=17823 cs=3803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.771705 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57510 s=2 pgs=14331 cs=371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.771856 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60332 s=2 pgs=24031 cs=6849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.772043 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55097 s=2 pgs=23853 cs=5575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.772215 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60214 s=2 pgs=18195 cs=5053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.772226 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38967 s=2 pgs=20067 cs=2921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.772487 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39058 s=2 pgs=17824 cs=3805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.772660 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60338 s=2 pgs=24032 cs=6851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.772771 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57517 s=2 pgs=14332 cs=373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.772962 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55103 s=2 pgs=23854 cs=5577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.773063 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38973 s=2 pgs=20068 cs=2923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.773403 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60220 s=2 pgs=18196 cs=5055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.773501 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60343 s=2 pgs=24033 cs=6853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.773537 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39064 s=2 pgs=17825 cs=3807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.773825 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55109 s=2 pgs=23855 cs=5579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.773869 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57524 s=2 pgs=14333 cs=375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.774268 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38978 s=2 pgs=20069 cs=2925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.774308 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60348 s=2 pgs=24034 cs=6855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.774341 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60227 s=2 pgs=18197 cs=5057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.774765 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39071 s=2 pgs=17826 cs=3809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.774848 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55114 s=2 pgs=23856 cs=5581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.774895 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57531 s=2 pgs=14334 cs=377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.775166 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60353 s=2 pgs=24035 cs=6857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.775239 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60234 s=2 pgs=18198 cs=5059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.775286 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38984 s=2 pgs=20070 cs=2927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.775695 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55120 s=2 pgs=23857 cs=5583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.775802 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39077 s=2 pgs=17827 cs=3811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.775822 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57537 s=2 pgs=14335 cs=379 l=0).fault, initiating reconnect
2013-06-08 20:25:42.776048 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60239 s=2 pgs=18199 cs=5061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.776189 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38992 s=2 pgs=20071 cs=2929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.776216 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60358 s=2 pgs=24036 cs=6859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.776671 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55125 s=2 pgs=23858 cs=5585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.776790 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57543 s=2 pgs=14336 cs=381 l=0).fault, initiating reconnect
2013-06-08 20:25:42.776896 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39084 s=2 pgs=17828 cs=3813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.776955 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60244 s=2 pgs=18200 cs=5063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.777050 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60366 s=2 pgs=24037 cs=6861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.777269 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :38997 s=2 pgs=20072 cs=2931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.777479 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55131 s=2 pgs=23859 cs=5587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.777866 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39091 s=2 pgs=17829 cs=3815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.777876 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60371 s=2 pgs=24038 cs=6863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.777898 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :57548 s=2 pgs=14337 cs=383 l=0).fault, initiating reconnect
2013-06-08 20:25:42.777916 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60250 s=2 pgs=18201 cs=5065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.778239 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39004 s=2 pgs=20073 cs=2933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.778306 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55137 s=2 pgs=23860 cs=5589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.778758 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60257 s=2 pgs=18202 cs=5067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.778858 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60374 s=2 pgs=24039 cs=6865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.778907 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :57556 s=2 pgs=14338 cs=385 l=0).fault, initiating reconnect
2013-06-08 20:25:42.778894 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :60374 s=1 pgs=24039 cs=6866 l=0).fault
2013-06-08 20:25:42.779089 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39097 s=2 pgs=17830 cs=3817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.779261 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39010 s=2 pgs=20074 cs=2935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.779285 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55143 s=2 pgs=23861 cs=5591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.779639 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60260 s=2 pgs=18203 cs=5069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.779864 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60382 s=2 pgs=24040 cs=6867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.780062 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57561 s=2 pgs=14339 cs=387 l=0).fault, initiating reconnect
2013-06-08 20:25:42.780225 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39016 s=2 pgs=20075 cs=2937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.780231 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55149 s=2 pgs=23862 cs=5593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.780267 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39105 s=2 pgs=17831 cs=3819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.780701 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60266 s=2 pgs=18204 cs=5071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.780751 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60387 s=2 pgs=24041 cs=6869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.781034 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55154 s=2 pgs=23863 cs=5595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.781119 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57568 s=2 pgs=14340 cs=389 l=0).fault, initiating reconnect
2013-06-08 20:25:42.781150 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39021 s=2 pgs=20076 cs=2939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.781321 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39113 s=2 pgs=17832 cs=3821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.781566 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60393 s=2 pgs=24042 cs=6871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.781621 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60272 s=2 pgs=18205 cs=5073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.781866 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55158 s=2 pgs=23864 cs=5597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.782144 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39028 s=2 pgs=20077 cs=2941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.782430 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60398 s=2 pgs=24043 cs=6873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.782541 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39119 s=2 pgs=17833 cs=3823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.782676 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60279 s=2 pgs=18206 cs=5075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.782699 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55164 s=2 pgs=23865 cs=5599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.783170 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39033 s=2 pgs=20078 cs=2943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.783194 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57575 s=2 pgs=14341 cs=391 l=0).fault, initiating reconnect
2013-06-08 20:25:42.783228 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60402 s=2 pgs=24044 cs=6875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.783547 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60284 s=2 pgs=18207 cs=5077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.783548 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39125 s=2 pgs=17834 cs=3825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.783624 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55169 s=2 pgs=23866 cs=5601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784023 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60407 s=2 pgs=24045 cs=6877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784133 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39038 s=2 pgs=20079 cs=2945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784308 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60290 s=2 pgs=18208 cs=5079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784480 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57588 s=2 pgs=14342 cs=393 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784504 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39131 s=2 pgs=17835 cs=3827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784588 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55175 s=2 pgs=23867 cs=5603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784869 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60412 s=2 pgs=24046 cs=6879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.784982 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39045 s=2 pgs=20080 cs=2947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.785274 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60294 s=2 pgs=18209 cs=5081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.785454 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55181 s=2 pgs=23868 cs=5605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.785469 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57595 s=2 pgs=14343 cs=395 l=0).fault, initiating reconnect
2013-06-08 20:25:42.785573 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39138 s=2 pgs=17836 cs=3829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.785705 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60418 s=2 pgs=24047 cs=6881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.786108 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60300 s=2 pgs=18210 cs=5083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.786173 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39051 s=2 pgs=20081 cs=2949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.786330 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55185 s=2 pgs=23869 cs=5607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.786518 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60424 s=2 pgs=24048 cs=6883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.786687 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57602 s=2 pgs=14344 cs=397 l=0).fault, initiating reconnect
2013-06-08 20:25:42.786980 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39058 s=2 pgs=20082 cs=2951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.787226 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55191 s=2 pgs=23870 cs=5609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.787563 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39145 s=2 pgs=17837 cs=3831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.787590 7fddd2913700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39145 s=1 pgs=17837 cs=3832 l=0).fault
2013-06-08 20:25:42.787613 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60305 s=2 pgs=18211 cs=5085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.787711 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60428 s=2 pgs=24049 cs=6885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.787806 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57609 s=2 pgs=14345 cs=399 l=0).fault, initiating reconnect
2013-06-08 20:25:42.787870 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39062 s=2 pgs=20083 cs=2953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.788460 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60313 s=2 pgs=18212 cs=5087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.788651 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39068 s=2 pgs=20084 cs=2955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.788762 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39154 s=2 pgs=17838 cs=3833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.788864 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57615 s=2 pgs=14346 cs=401 l=0).fault, initiating reconnect
2013-06-08 20:25:42.789051 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55195 s=2 pgs=23871 cs=5611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.789281 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60434 s=2 pgs=24050 cs=6887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.789425 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60434 s=1 pgs=24050 cs=6888 l=0).fault
2013-06-08 20:25:42.789578 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39070 s=2 pgs=20085 cs=2957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.789742 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60317 s=2 pgs=18213 cs=5089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.789746 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39161 s=2 pgs=17839 cs=3835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.789949 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :57620 s=2 pgs=14347 cs=403 l=0).fault, initiating reconnect
2013-06-08 20:25:42.789948 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55205 s=2 pgs=23872 cs=5613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.790128 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60442 s=2 pgs=24051 cs=6889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.790435 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39075 s=2 pgs=20086 cs=2959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.790725 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60324 s=2 pgs=18214 cs=5091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.790807 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39167 s=2 pgs=17840 cs=3837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.790933 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55210 s=2 pgs=23873 cs=5615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.790938 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57627 s=2 pgs=14348 cs=405 l=0).fault, initiating reconnect
2013-06-08 20:25:42.791320 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39081 s=2 pgs=20087 cs=2961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.791652 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60330 s=2 pgs=18215 cs=5093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.791778 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60448 s=2 pgs=24052 cs=6891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.791796 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60448 s=1 pgs=24052 cs=6892 l=0).fault
2013-06-08 20:25:42.791890 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55216 s=2 pgs=23874 cs=5617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.792066 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39173 s=2 pgs=17841 cs=3839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.792085 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57633 s=2 pgs=14349 cs=407 l=0).fault, initiating reconnect
2013-06-08 20:25:42.792235 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39086 s=2 pgs=20088 cs=2963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.792606 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60456 s=2 pgs=24053 cs=6893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.792620 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60335 s=2 pgs=18216 cs=5095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.792818 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55221 s=2 pgs=23875 cs=5619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.793071 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57639 s=2 pgs=14350 cs=409 l=0).fault, initiating reconnect
2013-06-08 20:25:42.793177 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39092 s=2 pgs=20089 cs=2965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.793335 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39180 s=2 pgs=17842 cs=3841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.793553 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60461 s=2 pgs=24054 cs=6895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.793601 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60342 s=2 pgs=18217 cs=5097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.793876 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55227 s=2 pgs=23876 cs=5621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.794064 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39097 s=2 pgs=20090 cs=2967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.794195 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57644 s=2 pgs=14351 cs=411 l=0).fault, initiating reconnect
2013-06-08 20:25:42.794398 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39188 s=2 pgs=17843 cs=3843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.794466 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60467 s=2 pgs=24055 cs=6897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.794476 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60348 s=2 pgs=18218 cs=5099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.794742 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55233 s=2 pgs=23877 cs=5623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.795010 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39102 s=2 pgs=20091 cs=2969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.795245 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57651 s=2 pgs=14352 cs=413 l=0).fault, initiating reconnect
2013-06-08 20:25:42.795339 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60353 s=2 pgs=18219 cs=5101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.795573 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39194 s=2 pgs=17844 cs=3845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.795590 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55239 s=2 pgs=23878 cs=5625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.795623 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60474 s=2 pgs=24056 cs=6899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796004 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39108 s=2 pgs=20092 cs=2971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796195 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57657 s=2 pgs=14353 cs=415 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796325 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60358 s=2 pgs=18220 cs=5103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796416 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55244 s=2 pgs=23879 cs=5627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796781 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60481 s=2 pgs=24057 cs=6901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796811 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39201 s=2 pgs=17845 cs=3847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796863 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39114 s=2 pgs=20093 cs=2973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.796931 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60481 s=1 pgs=24057 cs=6902 l=0).fault
2013-06-08 20:25:42.797153 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60364 s=2 pgs=18221 cs=5105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.797288 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55249 s=2 pgs=23880 cs=5629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.797361 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57663 s=2 pgs=14354 cs=417 l=0).fault, initiating reconnect
2013-06-08 20:25:42.797637 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60488 s=2 pgs=24058 cs=6903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.797717 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39119 s=2 pgs=20094 cs=2975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.797934 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39208 s=2 pgs=17846 cs=3849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.798086 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55254 s=2 pgs=23881 cs=5631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.798098 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :60369 s=2 pgs=18222 cs=5107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.798452 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60492 s=2 pgs=24059 cs=6905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.798681 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39125 s=2 pgs=20095 cs=2977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.798701 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57671 s=2 pgs=14355 cs=419 l=0).fault, initiating reconnect
2013-06-08 20:25:42.798750 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57671 s=1 pgs=14355 cs=420 l=0).fault
2013-06-08 20:25:42.799026 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55259 s=2 pgs=23882 cs=5633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.799042 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :60376 s=2 pgs=18223 cs=5109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.799198 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39216 s=2 pgs=17847 cs=3851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.799442 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60497 s=2 pgs=24060 cs=6907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.799650 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39130 s=2 pgs=20096 cs=2979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.799913 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57679 s=2 pgs=14356 cs=421 l=0).fault, initiating reconnect
2013-06-08 20:25:42.799926 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55264 s=2 pgs=23883 cs=5635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.799998 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :60381 s=2 pgs=18224 cs=5111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.800284 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60503 s=2 pgs=24061 cs=6909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.800396 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39224 s=2 pgs=17848 cs=3853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.800559 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39136 s=2 pgs=20097 cs=2981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.800738 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55270 s=2 pgs=23884 cs=5637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.800820 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57685 s=2 pgs=14357 cs=423 l=0).fault, initiating reconnect
2013-06-08 20:25:42.800999 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :60387 s=2 pgs=18225 cs=5113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.801079 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60508 s=2 pgs=24062 cs=6911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.801565 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39142 s=2 pgs=20098 cs=2983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.801574 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39231 s=2 pgs=17849 cs=3855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.801631 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55275 s=2 pgs=23885 cs=5639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.801891 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60514 s=2 pgs=24063 cs=6913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.801910 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57692 s=2 pgs=14358 cs=425 l=0).fault, initiating reconnect
2013-06-08 20:25:42.801935 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :60393 s=2 pgs=18226 cs=5115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.802657 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55281 s=2 pgs=23886 cs=5641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.802716 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39237 s=2 pgs=17850 cs=3857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.802828 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :39148 s=2 pgs=20099 cs=2985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.802837 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60518 s=2 pgs=24064 cs=6915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.802838 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :60400 s=2 pgs=18227 cs=5117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.803071 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57699 s=2 pgs=14359 cs=427 l=0).fault, initiating reconnect
2013-06-08 20:25:42.803551 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55285 s=2 pgs=23887 cs=5643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.803764 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60405 s=2 pgs=18228 cs=5119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.803824 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39244 s=2 pgs=17851 cs=3859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.803835 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39155 s=2 pgs=20100 cs=2987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.804042 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57706 s=2 pgs=14360 cs=429 l=0).fault, initiating reconnect
2013-06-08 20:25:42.804458 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55291 s=2 pgs=23888 cs=5645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.804811 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39162 s=2 pgs=20101 cs=2989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.804832 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60524 s=2 pgs=24065 cs=6917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.804846 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60408 s=2 pgs=18229 cs=5121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.804878 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39251 s=2 pgs=17852 cs=3861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.805035 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57711 s=2 pgs=14361 cs=431 l=0).fault, initiating reconnect
2013-06-08 20:25:42.805280 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55296 s=2 pgs=23889 cs=5647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.805638 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60534 s=2 pgs=24066 cs=6919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.805728 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60415 s=2 pgs=18230 cs=5123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.805826 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39165 s=2 pgs=20102 cs=2991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.805949 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39258 s=2 pgs=17853 cs=3863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.806070 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57717 s=2 pgs=14362 cs=433 l=0).fault, initiating reconnect
2013-06-08 20:25:42.806232 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55302 s=2 pgs=23890 cs=5649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.806424 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60539 s=2 pgs=24067 cs=6921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.806628 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39173 s=2 pgs=20103 cs=2993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.806671 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60420 s=2 pgs=18231 cs=5125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.807173 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55308 s=2 pgs=23891 cs=5651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.807370 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57723 s=2 pgs=14363 cs=435 l=0).fault, initiating reconnect
2013-06-08 20:25:42.807369 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39264 s=2 pgs=17854 cs=3865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.807393 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57723 s=1 pgs=14363 cs=436 l=0).fault
2013-06-08 20:25:42.807518 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60427 s=2 pgs=18232 cs=5127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.807560 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39178 s=2 pgs=20104 cs=2995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.807572 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60545 s=2 pgs=24068 cs=6923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.808122 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55312 s=2 pgs=23892 cs=5653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.808278 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39184 s=2 pgs=20105 cs=2997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.808460 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57730 s=2 pgs=14364 cs=437 l=0).fault, initiating reconnect
2013-06-08 20:25:42.808465 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60431 s=2 pgs=18233 cs=5129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.808517 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60553 s=2 pgs=24069 cs=6925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.808831 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39271 s=2 pgs=17855 cs=3867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.808954 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55318 s=2 pgs=23893 cs=5655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.809225 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39187 s=2 pgs=20106 cs=2999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.809423 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60437 s=2 pgs=18234 cs=5131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.809435 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57736 s=2 pgs=14365 cs=439 l=0).fault, initiating reconnect
2013-06-08 20:25:42.809648 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60558 s=2 pgs=24070 cs=6927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.809837 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55324 s=2 pgs=23894 cs=5657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.810438 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60443 s=2 pgs=18235 cs=5133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.810526 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57742 s=2 pgs=14366 cs=441 l=0).fault, initiating reconnect
2013-06-08 20:25:42.810541 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60564 s=2 pgs=24071 cs=6929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.810584 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39193 s=2 pgs=20107 cs=3001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.810781 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55329 s=2 pgs=23895 cs=5659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.810873 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39281 s=2 pgs=17856 cs=3869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.811332 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60446 s=2 pgs=18236 cs=5135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.811361 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60568 s=2 pgs=24072 cs=6931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.811379 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60568 s=1 pgs=24072 cs=6932 l=0).fault
2013-06-08 20:25:42.811432 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57747 s=2 pgs=14367 cs=443 l=0).fault, initiating reconnect
2013-06-08 20:25:42.811523 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39201 s=2 pgs=20108 cs=3003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.811698 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55334 s=2 pgs=23896 cs=5661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.812227 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39293 s=2 pgs=17857 cs=3871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.812273 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60573 s=2 pgs=24073 cs=6933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.812306 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60452 s=2 pgs=18237 cs=5137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.812324 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57754 s=2 pgs=14368 cs=445 l=0).fault, initiating reconnect
2013-06-08 20:25:42.812494 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39207 s=2 pgs=20109 cs=3005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.812780 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55340 s=2 pgs=23897 cs=5663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813128 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60578 s=2 pgs=24074 cs=6935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813213 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60459 s=2 pgs=18238 cs=5139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813298 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57760 s=2 pgs=14369 cs=447 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813454 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39213 s=2 pgs=20110 cs=3007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813641 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55346 s=2 pgs=23898 cs=5665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813655 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39299 s=2 pgs=17858 cs=3873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813953 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :60464 s=2 pgs=18239 cs=5141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.813960 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60583 s=2 pgs=24075 cs=6937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.814354 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39218 s=2 pgs=20111 cs=3009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.814524 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55351 s=2 pgs=23899 cs=5667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.814622 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57765 s=2 pgs=14370 cs=449 l=0).fault, initiating reconnect
2013-06-08 20:25:42.814881 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60469 s=2 pgs=18240 cs=5143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.814887 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39310 s=2 pgs=17859 cs=3875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.814922 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60590 s=2 pgs=24076 cs=6939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.815283 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39223 s=2 pgs=20112 cs=3011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.815347 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55356 s=2 pgs=23900 cs=5669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.815624 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57773 s=2 pgs=14371 cs=451 l=0).fault, initiating reconnect
2013-06-08 20:25:42.815830 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60596 s=2 pgs=24077 cs=6941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.815868 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60474 s=2 pgs=18241 cs=5145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.815984 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39317 s=2 pgs=17860 cs=3877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.816005 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55362 s=2 pgs=23901 cs=5671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.816614 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57779 s=2 pgs=14372 cs=453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.816641 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60600 s=2 pgs=24078 cs=6943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.816695 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60481 s=2 pgs=18242 cs=5147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.816668 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39229 s=2 pgs=20113 cs=3013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.816979 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55367 s=2 pgs=23902 cs=5673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.817221 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39324 s=2 pgs=17861 cs=3879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.817516 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60605 s=2 pgs=24079 cs=6945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.817518 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60486 s=2 pgs=18243 cs=5149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.817803 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39239 s=2 pgs=20114 cs=3015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.817835 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55372 s=2 pgs=23903 cs=5675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.817858 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57784 s=2 pgs=14373 cs=455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.818326 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60491 s=2 pgs=18244 cs=5151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.818387 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60610 s=2 pgs=24080 cs=6947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.818422 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39331 s=2 pgs=17862 cs=3881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.818790 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55377 s=2 pgs=23904 cs=5677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.818807 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57794 s=2 pgs=14374 cs=457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.818886 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39244 s=2 pgs=20115 cs=3017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.819276 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60495 s=2 pgs=18245 cs=5153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.819467 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39338 s=2 pgs=17863 cs=3883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.819635 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55382 s=2 pgs=23905 cs=5679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.819777 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39252 s=2 pgs=20116 cs=3019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.819832 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57799 s=2 pgs=14375 cs=459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.819869 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60617 s=2 pgs=24081 cs=6949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.820216 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60501 s=2 pgs=18246 cs=5155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.820563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39344 s=2 pgs=17864 cs=3885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.820634 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60626 s=2 pgs=24082 cs=6951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.820644 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39256 s=2 pgs=20117 cs=3021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.820673 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55387 s=2 pgs=23906 cs=5681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.820849 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57805 s=2 pgs=14376 cs=461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.821149 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60507 s=2 pgs=18247 cs=5157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.821552 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60629 s=2 pgs=24083 cs=6953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.821678 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55395 s=2 pgs=23907 cs=5683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.821832 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57812 s=2 pgs=14377 cs=463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.821974 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39350 s=2 pgs=17865 cs=3887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.822318 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60634 s=2 pgs=24084 cs=6955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.822535 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60513 s=2 pgs=18248 cs=5159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.822574 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39262 s=2 pgs=20118 cs=3023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.823056 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :39359 s=2 pgs=17866 cs=3889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.823059 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55399 s=2 pgs=23908 cs=5685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.823186 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60638 s=2 pgs=24085 cs=6957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.823420 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60519 s=2 pgs=18249 cs=5161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.823539 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39272 s=2 pgs=20119 cs=3025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.823767 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57816 s=2 pgs=14378 cs=465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.823921 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55405 s=2 pgs=23909 cs=5687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.824088 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60643 s=2 pgs=24086 cs=6959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.824434 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39363 s=2 pgs=17867 cs=3891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.824537 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39277 s=2 pgs=20120 cs=3027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.824801 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60524 s=2 pgs=18250 cs=5163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.824994 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57826 s=2 pgs=14379 cs=467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.825000 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55411 s=2 pgs=23910 cs=5689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.825610 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39282 s=2 pgs=20121 cs=3029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.825617 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39371 s=2 pgs=17868 cs=3893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.825698 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60531 s=2 pgs=18251 cs=5165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.825953 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55417 s=2 pgs=23911 cs=5691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.825990 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57832 s=2 pgs=14380 cs=469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.826043 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60648 s=2 pgs=24087 cs=6961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.826069 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60648 s=1 pgs=24087 cs=6962 l=0).fault
2013-06-08 20:25:42.826478 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39286 s=2 pgs=20122 cs=3031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.826656 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60536 s=2 pgs=18252 cs=5167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.826824 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55421 s=2 pgs=23912 cs=5693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.826878 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60659 s=2 pgs=24088 cs=6963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.827034 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57838 s=2 pgs=14381 cs=471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.827061 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39377 s=2 pgs=17869 cs=3895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.827292 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39292 s=2 pgs=20123 cs=3033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.827500 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60541 s=2 pgs=18253 cs=5169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.827697 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60662 s=2 pgs=24089 cs=6965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.828066 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39298 s=2 pgs=20124 cs=3035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.828094 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55427 s=2 pgs=23913 cs=5695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.828115 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57844 s=2 pgs=14382 cs=473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.828197 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39387 s=2 pgs=17870 cs=3897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.828610 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60668 s=2 pgs=24090 cs=6967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.828972 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55434 s=2 pgs=23914 cs=5697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.828998 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39301 s=2 pgs=20125 cs=3037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.829205 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57851 s=2 pgs=14383 cs=475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.829333 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60673 s=2 pgs=24091 cs=6969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.829640 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60547 s=2 pgs=18254 cs=5171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.829715 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39394 s=2 pgs=17871 cs=3899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.829872 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39307 s=2 pgs=20126 cs=3039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.829904 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55438 s=2 pgs=23915 cs=5699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.830072 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60677 s=2 pgs=24092 cs=6971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.830246 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57856 s=2 pgs=14384 cs=477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.830842 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39312 s=2 pgs=20127 cs=3041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.830893 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60558 s=2 pgs=18255 cs=5173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.830909 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55445 s=2 pgs=23916 cs=5701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.831012 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39401 s=2 pgs=17872 cs=3901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.831254 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57863 s=2 pgs=14385 cs=479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.831719 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60682 s=2 pgs=24093 cs=6973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.831758 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55450 s=2 pgs=23917 cs=5703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.831765 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60682 s=1 pgs=24093 cs=6974 l=0).fault
2013-06-08 20:25:42.831819 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60565 s=2 pgs=18256 cs=5175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.831947 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39316 s=2 pgs=20128 cs=3043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.832115 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57868 s=2 pgs=14386 cs=481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.832159 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39409 s=2 pgs=17873 cs=3903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.832568 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60689 s=2 pgs=24094 cs=6975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.832598 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :55454 s=2 pgs=23918 cs=5705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.832828 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39324 s=2 pgs=20129 cs=3045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.832895 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60571 s=2 pgs=18257 cs=5177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.833250 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57873 s=2 pgs=14387 cs=483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.833462 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :55459 s=2 pgs=23919 cs=5707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.833464 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :39416 s=2 pgs=17874 cs=3905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.833637 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60696 s=2 pgs=24095 cs=6977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.833836 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60578 s=2 pgs=18258 cs=5179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.834189 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39329 s=2 pgs=20130 cs=3047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.834280 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55464 s=2 pgs=23920 cs=5709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.834420 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57879 s=2 pgs=14388 cs=485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.834503 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60702 s=2 pgs=24096 cs=6979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.834628 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39423 s=2 pgs=17875 cs=3907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.834731 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60583 s=2 pgs=18259 cs=5181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.835306 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39337 s=2 pgs=20131 cs=3049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.835407 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57884 s=2 pgs=14389 cs=487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.835444 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55470 s=2 pgs=23921 cs=5711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.835462 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60707 s=2 pgs=24097 cs=6981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.835492 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60707 s=1 pgs=24097 cs=6982 l=0).fault
2013-06-08 20:25:42.835679 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60589 s=2 pgs=18260 cs=5183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.836283 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60713 s=2 pgs=24098 cs=6983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.836293 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39430 s=2 pgs=17876 cs=3909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.836317 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55476 s=2 pgs=23922 cs=5713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.836364 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39342 s=2 pgs=20132 cs=3051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.836553 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57891 s=2 pgs=14390 cs=489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.836740 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60594 s=2 pgs=18261 cs=5185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.837158 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60715 s=2 pgs=24099 cs=6985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.837160 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55481 s=2 pgs=23923 cs=5715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.837289 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39350 s=2 pgs=20133 cs=3053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.837620 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60600 s=2 pgs=18262 cs=5187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.837636 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57899 s=2 pgs=14391 cs=491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.837971 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55486 s=2 pgs=23924 cs=5717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.837986 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :60721 s=2 pgs=24100 cs=6987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.838138 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39355 s=2 pgs=20134 cs=3055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.838533 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57905 s=2 pgs=14392 cs=493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.838575 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60604 s=2 pgs=18263 cs=5189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.838672 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39438 s=2 pgs=17877 cs=3911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.839045 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55490 s=2 pgs=23925 cs=5719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.839062 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39360 s=2 pgs=20135 cs=3057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.839412 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60609 s=2 pgs=18264 cs=5191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.839770 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :60727 s=2 pgs=24101 cs=6989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.839992 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39452 s=2 pgs=17878 cs=3913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.840022 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57911 s=2 pgs=14393 cs=495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.840068 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55496 s=2 pgs=23926 cs=5721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.840099 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39365 s=2 pgs=20136 cs=3059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.840379 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60614 s=2 pgs=18265 cs=5193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.840567 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :60735 s=2 pgs=24102 cs=6991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.841032 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57917 s=2 pgs=14394 cs=497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.841059 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55502 s=2 pgs=23927 cs=5723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.841060 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39371 s=2 pgs=20137 cs=3061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.841228 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60620 s=2 pgs=18266 cs=5195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.841242 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39458 s=2 pgs=17879 cs=3915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.842156 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :60741 s=2 pgs=24103 cs=6993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.842196 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60625 s=2 pgs=18267 cs=5197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.842450 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57922 s=2 pgs=14395 cs=499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.842460 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39468 s=2 pgs=17880 cs=3917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.842959 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60628 s=2 pgs=18268 cs=5199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.843039 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55507 s=2 pgs=23928 cs=5725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.843097 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39376 s=2 pgs=20138 cs=3063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.843132 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :60747 s=2 pgs=24104 cs=6995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.843157 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :60747 s=1 pgs=24104 cs=6996 l=0).fault
2013-06-08 20:25:42.843557 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39472 s=2 pgs=17881 cs=3919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.843936 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57929 s=2 pgs=14396 cs=501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.843941 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60631 s=2 pgs=18269 cs=5201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.844104 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :55516 s=2 pgs=23929 cs=5727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.844108 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :60754 s=2 pgs=24105 cs=6997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.844126 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39385 s=2 pgs=20139 cs=3065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.844556 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39477 s=2 pgs=17882 cs=3921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.844850 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60637 s=2 pgs=18270 cs=5203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.844888 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60758 s=2 pgs=24106 cs=6999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.845025 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55523 s=2 pgs=23930 cs=5729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.845043 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57936 s=2 pgs=14397 cs=503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.845130 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39392 s=2 pgs=20140 cs=3067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.845596 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39483 s=2 pgs=17883 cs=3923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.845616 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60762 s=2 pgs=24107 cs=7001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.845916 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55528 s=2 pgs=23931 cs=5731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.845985 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60643 s=2 pgs=18271 cs=5205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.846121 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57945 s=2 pgs=14398 cs=505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.846182 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39398 s=2 pgs=20141 cs=3069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.846434 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60768 s=2 pgs=24108 cs=7003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.846665 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39489 s=2 pgs=17884 cs=3925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.846825 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55533 s=2 pgs=23932 cs=5733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.846975 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60650 s=2 pgs=18272 cs=5207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847099 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39404 s=2 pgs=20142 cs=3071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847208 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60773 s=2 pgs=24109 cs=7005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847272 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57951 s=2 pgs=14399 cs=507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847608 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39496 s=2 pgs=17885 cs=3927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847660 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55539 s=2 pgs=23933 cs=5735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847872 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39409 s=2 pgs=20143 cs=3073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847943 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60656 s=2 pgs=18273 cs=5209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.847975 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60778 s=2 pgs=24110 cs=7007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.848376 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57959 s=2 pgs=14400 cs=509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.848568 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39414 s=2 pgs=20144 cs=3075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.848721 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39502 s=2 pgs=17886 cs=3929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.848714 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55545 s=2 pgs=23934 cs=5737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.848839 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60784 s=2 pgs=24111 cs=7009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.848985 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60663 s=2 pgs=18274 cs=5211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.849378 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57965 s=2 pgs=14401 cs=511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.849510 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39418 s=2 pgs=20145 cs=3077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.849602 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55552 s=2 pgs=23935 cs=5739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.849876 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60789 s=2 pgs=24112 cs=7011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.849982 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39509 s=2 pgs=17887 cs=3931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.850254 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57971 s=2 pgs=14402 cs=513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.850475 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55557 s=2 pgs=23936 cs=5741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.850727 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60794 s=2 pgs=24113 cs=7013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.850807 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60670 s=2 pgs=18275 cs=5213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.851291 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57976 s=2 pgs=14403 cs=515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.851297 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39517 s=2 pgs=17888 cs=3933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.851458 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55561 s=2 pgs=23937 cs=5743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.851527 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39424 s=2 pgs=20146 cs=3079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.851565 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60679 s=2 pgs=18276 cs=5215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.851586 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60798 s=2 pgs=24114 cs=7015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.852399 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57980 s=2 pgs=14404 cs=517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.852407 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39435 s=2 pgs=20147 cs=3081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.852490 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60684 s=2 pgs=18277 cs=5217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.852582 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39523 s=2 pgs=17889 cs=3935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.853335 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60688 s=2 pgs=18278 cs=5219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.853341 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60805 s=2 pgs=24115 cs=7017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.853364 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60805 s=1 pgs=24115 cs=7018 l=0).fault
2013-06-08 20:25:42.853397 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57986 s=2 pgs=14405 cs=519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.853548 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55566 s=2 pgs=23938 cs=5745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.853903 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39531 s=2 pgs=17890 cs=3937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.854247 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60690 s=2 pgs=18279 cs=5221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.854277 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60811 s=2 pgs=24116 cs=7019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.854329 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57992 s=2 pgs=14406 cs=521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.854454 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39439 s=2 pgs=20148 cs=3083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.854717 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55577 s=2 pgs=23939 cs=5747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.855077 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60816 s=2 pgs=24117 cs=7021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.855176 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :60695 s=2 pgs=18280 cs=5223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.855184 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :57997 s=2 pgs=14407 cs=523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.855180 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39536 s=2 pgs=17891 cs=3939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.855601 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55583 s=2 pgs=23940 cs=5749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.855779 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39450 s=2 pgs=20149 cs=3085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.856068 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60823 s=2 pgs=24118 cs=7023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.856120 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60700 s=2 pgs=18281 cs=5225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.856123 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58002 s=2 pgs=14408 cs=525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.856473 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39543 s=2 pgs=17892 cs=3941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.856622 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55588 s=2 pgs=23941 cs=5751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.856788 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39457 s=2 pgs=20150 cs=3087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.856851 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60826 s=2 pgs=24119 cs=7025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.857150 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58007 s=2 pgs=14409 cs=527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.857197 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60708 s=2 pgs=18282 cs=5227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.857410 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55594 s=2 pgs=23942 cs=5753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.857418 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39551 s=2 pgs=17893 cs=3943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.857526 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39463 s=2 pgs=20151 cs=3089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.857562 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60832 s=2 pgs=24120 cs=7027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.858118 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60714 s=2 pgs=18283 cs=5229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.858166 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58013 s=2 pgs=14410 cs=529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.858364 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55599 s=2 pgs=23943 cs=5755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.858368 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39469 s=2 pgs=20152 cs=3091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.858562 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60838 s=2 pgs=24121 cs=7029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.858581 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39558 s=2 pgs=17894 cs=3945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.858987 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60719 s=2 pgs=18284 cs=5231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.859180 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55605 s=2 pgs=23944 cs=5757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.859181 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58020 s=2 pgs=14411 cs=531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.859400 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39474 s=2 pgs=20153 cs=3093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.859588 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39566 s=2 pgs=17895 cs=3947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.859880 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60725 s=2 pgs=18285 cs=5233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.860204 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60843 s=2 pgs=24122 cs=7031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.860256 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58026 s=2 pgs=14412 cs=533 l=0).fault, initiating reconnect
2013-06-08 20:25:42.860315 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39480 s=2 pgs=20154 cs=3095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.860509 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :55611 s=2 pgs=23945 cs=5759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.860524 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39571 s=2 pgs=17896 cs=3949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.860669 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60730 s=2 pgs=18286 cs=5235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.861080 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60851 s=2 pgs=24123 cs=7033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.861321 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58032 s=2 pgs=14413 cs=535 l=0).fault, initiating reconnect
2013-06-08 20:25:42.861370 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39485 s=2 pgs=20155 cs=3097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.861388 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :55618 s=2 pgs=23946 cs=5761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.861433 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60736 s=2 pgs=18287 cs=5237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.861448 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39577 s=2 pgs=17897 cs=3951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.862012 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60857 s=2 pgs=24124 cs=7035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.862107 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58038 s=2 pgs=14414 cs=537 l=0).fault, initiating reconnect
2013-06-08 20:25:42.862166 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39491 s=2 pgs=20156 cs=3099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.862169 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :55624 s=2 pgs=23947 cs=5763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.862394 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60741 s=2 pgs=18288 cs=5239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.862614 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39584 s=2 pgs=17898 cs=3953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.863087 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60863 s=2 pgs=24125 cs=7037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.863107 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :39497 s=2 pgs=20157 cs=3101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.863110 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55629 s=2 pgs=23948 cs=5765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.863336 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58044 s=2 pgs=14415 cs=539 l=0).fault, initiating reconnect
2013-06-08 20:25:42.863343 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60747 s=2 pgs=18289 cs=5241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.863720 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39590 s=2 pgs=17899 cs=3955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864091 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55635 s=2 pgs=23949 cs=5767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864099 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60869 s=2 pgs=24126 cs=7039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864112 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :39502 s=2 pgs=20158 cs=3103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864713 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58052 s=2 pgs=14416 cs=541 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864796 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39596 s=2 pgs=17900 cs=3957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864815 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60753 s=2 pgs=18290 cs=5243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864854 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60876 s=2 pgs=24127 cs=7041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.864938 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :39509 s=2 pgs=20159 cs=3105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.865058 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55639 s=2 pgs=23950 cs=5769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.865645 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60881 s=2 pgs=24128 cs=7043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.865754 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60760 s=2 pgs=18291 cs=5245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.865787 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :39514 s=2 pgs=20160 cs=3107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.865847 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58058 s=2 pgs=14417 cs=543 l=0).fault, initiating reconnect
2013-06-08 20:25:42.865913 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39601 s=2 pgs=17901 cs=3959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.866009 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55647 s=2 pgs=23951 cs=5771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.866387 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60884 s=2 pgs=24129 cs=7045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.866555 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60765 s=2 pgs=18292 cs=5247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.866704 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :39518 s=2 pgs=20161 cs=3109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.866935 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55653 s=2 pgs=23952 cs=5773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.867034 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58067 s=2 pgs=14418 cs=545 l=0).fault, initiating reconnect
2013-06-08 20:25:42.867193 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39610 s=2 pgs=17902 cs=3961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.867201 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60890 s=2 pgs=24130 cs=7047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.867539 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60771 s=2 pgs=18293 cs=5249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.867557 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :39524 s=2 pgs=20162 cs=3111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.867940 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55657 s=2 pgs=23953 cs=5775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.868076 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60896 s=2 pgs=24131 cs=7049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.868212 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58074 s=2 pgs=14419 cs=547 l=0).fault, initiating reconnect
2013-06-08 20:25:42.868247 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58074 s=1 pgs=14419 cs=548 l=0).fault
2013-06-08 20:25:42.868293 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :39530 s=2 pgs=20163 cs=3113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.868316 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39617 s=2 pgs=17903 cs=3963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.868532 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60777 s=2 pgs=18294 cs=5251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.868883 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55663 s=2 pgs=23954 cs=5777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.868903 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60900 s=2 pgs=24132 cs=7051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.869137 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39625 s=2 pgs=17904 cs=3965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.869342 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39533 s=2 pgs=20164 cs=3115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.869441 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58082 s=2 pgs=14420 cs=549 l=0).fault, initiating reconnect
2013-06-08 20:25:42.869755 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55669 s=2 pgs=23955 cs=5779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.869804 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60784 s=2 pgs=18295 cs=5253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.869827 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60906 s=2 pgs=24133 cs=7053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.870125 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39629 s=2 pgs=17905 cs=3967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.870248 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39540 s=2 pgs=20165 cs=3117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.870378 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58089 s=2 pgs=14421 cs=551 l=0).fault, initiating reconnect
2013-06-08 20:25:42.870602 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55674 s=2 pgs=23956 cs=5781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.870652 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60912 s=2 pgs=24134 cs=7055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.870771 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60791 s=2 pgs=18296 cs=5255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.871129 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39546 s=2 pgs=20166 cs=3119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.871137 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39635 s=2 pgs=17906 cs=3969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.871498 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55680 s=2 pgs=23957 cs=5783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.871523 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58095 s=2 pgs=14422 cs=553 l=0).fault, initiating reconnect
2013-06-08 20:25:42.871529 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :60917 s=2 pgs=24135 cs=7057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.871716 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60798 s=2 pgs=18297 cs=5257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.872085 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39551 s=2 pgs=20167 cs=3121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.872194 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39642 s=2 pgs=17907 cs=3971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.872276 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55685 s=2 pgs=23958 cs=5785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.872329 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60923 s=2 pgs=24136 cs=7059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.872630 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58102 s=2 pgs=14423 cs=555 l=0).fault, initiating reconnect
2013-06-08 20:25:42.872633 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :60804 s=2 pgs=18298 cs=5259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.872997 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39557 s=2 pgs=20168 cs=3123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.873061 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39648 s=2 pgs=17908 cs=3973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.873082 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55691 s=2 pgs=23959 cs=5787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.873629 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60810 s=2 pgs=18299 cs=5261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.873659 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58109 s=2 pgs=14424 cs=557 l=0).fault, initiating reconnect
2013-06-08 20:25:42.873843 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39563 s=2 pgs=20169 cs=3125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.874049 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55697 s=2 pgs=23960 cs=5789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.874315 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60928 s=2 pgs=24137 cs=7061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.874318 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39654 s=2 pgs=17909 cs=3975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.874336 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60928 s=1 pgs=24137 cs=7062 l=0).fault
2013-06-08 20:25:42.874672 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58115 s=2 pgs=14425 cs=559 l=0).fault, initiating reconnect
2013-06-08 20:25:42.874685 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60814 s=2 pgs=18300 cs=5263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.875008 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55701 s=2 pgs=23961 cs=5791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.875123 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60938 s=2 pgs=24138 cs=7063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.875379 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39661 s=2 pgs=17910 cs=3977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.875580 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60821 s=2 pgs=18301 cs=5265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.875838 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55706 s=2 pgs=23962 cs=5793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.875943 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39568 s=2 pgs=20170 cs=3127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.876016 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60943 s=2 pgs=24139 cs=7065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.876434 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58120 s=2 pgs=14426 cs=561 l=0).fault, initiating reconnect
2013-06-08 20:25:42.876458 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60825 s=2 pgs=18302 cs=5267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.876462 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58120 s=1 pgs=14426 cs=562 l=0).fault
2013-06-08 20:25:42.876507 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39666 s=2 pgs=17911 cs=3979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.876743 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55710 s=2 pgs=23963 cs=5795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.876753 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60948 s=2 pgs=24140 cs=7067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.876841 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39579 s=2 pgs=20171 cs=3129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.877492 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60830 s=2 pgs=18303 cs=5269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.877513 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39673 s=2 pgs=17912 cs=3981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.877694 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58129 s=2 pgs=14427 cs=563 l=0).fault, initiating reconnect
2013-06-08 20:25:42.877701 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55716 s=2 pgs=23964 cs=5797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.877701 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39586 s=2 pgs=20172 cs=3131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.877861 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60953 s=2 pgs=24141 cs=7069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.878561 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39678 s=2 pgs=17913 cs=3983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.878584 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55721 s=2 pgs=23965 cs=5799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.878583 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60835 s=2 pgs=18304 cs=5271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.878750 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39590 s=2 pgs=20173 cs=3133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.878768 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58139 s=2 pgs=14428 cs=565 l=0).fault, initiating reconnect
2013-06-08 20:25:42.879385 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55726 s=2 pgs=23966 cs=5801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.879458 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60843 s=2 pgs=18305 cs=5273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.879538 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39596 s=2 pgs=20174 cs=3135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.879635 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60960 s=2 pgs=24142 cs=7071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.879655 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39683 s=2 pgs=17914 cs=3985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.879659 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :60960 s=1 pgs=24142 cs=7072 l=0).fault
2013-06-08 20:25:42.879769 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58145 s=2 pgs=14429 cs=567 l=0).fault, initiating reconnect
2013-06-08 20:25:42.880325 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39600 s=2 pgs=20175 cs=3137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.880434 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60969 s=2 pgs=24143 cs=7073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.880454 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60847 s=2 pgs=18306 cs=5275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.880465 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60969 s=1 pgs=24143 cs=7074 l=0).fault
2013-06-08 20:25:42.880376 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55730 s=2 pgs=23967 cs=5803 l=0).fault, initiating reconnect
2013-06-08 20:25:42.880676 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39692 s=2 pgs=17915 cs=3987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.880714 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58151 s=2 pgs=14430 cs=569 l=0).fault, initiating reconnect
2013-06-08 20:25:42.881296 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60853 s=2 pgs=18307 cs=5277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.881308 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55739 s=2 pgs=23968 cs=5805 l=0).fault, initiating reconnect
2013-06-08 20:25:42.881335 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39604 s=2 pgs=20176 cs=3139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.881586 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58157 s=2 pgs=14431 cs=571 l=0).fault, initiating reconnect
2013-06-08 20:25:42.881858 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39698 s=2 pgs=17916 cs=3989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.882276 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39612 s=2 pgs=20177 cs=3141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.882283 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55742 s=2 pgs=23969 cs=5807 l=0).fault, initiating reconnect
2013-06-08 20:25:42.882325 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60859 s=2 pgs=18308 cs=5279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.882374 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60974 s=2 pgs=24144 cs=7075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.882525 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58161 s=2 pgs=14432 cs=573 l=0).fault, initiating reconnect
2013-06-08 20:25:42.882775 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39704 s=2 pgs=17917 cs=3991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.883137 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55748 s=2 pgs=23970 cs=5809 l=0).fault, initiating reconnect
2013-06-08 20:25:42.883154 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60986 s=2 pgs=24145 cs=7077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.883200 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60865 s=2 pgs=18309 cs=5281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.883312 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39615 s=2 pgs=20178 cs=3143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.883716 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58167 s=2 pgs=14433 cs=575 l=0).fault, initiating reconnect
2013-06-08 20:25:42.883923 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39710 s=2 pgs=17918 cs=3993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.883966 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60990 s=2 pgs=24146 cs=7079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.884038 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55753 s=2 pgs=23971 cs=5811 l=0).fault, initiating reconnect
2013-06-08 20:25:42.884272 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60871 s=2 pgs=18310 cs=5283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.884509 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58173 s=2 pgs=14434 cs=577 l=0).fault, initiating reconnect
2013-06-08 20:25:42.884573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39624 s=2 pgs=20179 cs=3145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.884740 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :60995 s=2 pgs=24147 cs=7081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.884940 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39716 s=2 pgs=17919 cs=3995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.885174 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60877 s=2 pgs=18311 cs=5285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.885187 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55760 s=2 pgs=23972 cs=5813 l=0).fault, initiating reconnect
2013-06-08 20:25:42.885543 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39631 s=2 pgs=20180 cs=3147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.885564 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58178 s=2 pgs=14435 cs=579 l=0).fault, initiating reconnect
2013-06-08 20:25:42.885660 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :61000 s=2 pgs=24148 cs=7083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.885946 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39723 s=2 pgs=17920 cs=3997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.886042 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55767 s=2 pgs=23973 cs=5815 l=0).fault, initiating reconnect
2013-06-08 20:25:42.886222 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60882 s=2 pgs=18312 cs=5287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.886521 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32773 s=2 pgs=24149 cs=7085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.886561 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39636 s=2 pgs=20181 cs=3149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.886659 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58185 s=2 pgs=14436 cs=581 l=0).fault, initiating reconnect
2013-06-08 20:25:42.887078 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60889 s=2 pgs=18313 cs=5289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.887250 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39729 s=2 pgs=17921 cs=3999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.887364 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32777 s=2 pgs=24150 cs=7087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.887439 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39643 s=2 pgs=20182 cs=3151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.887714 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58192 s=2 pgs=14437 cs=583 l=0).fault, initiating reconnect
2013-06-08 20:25:42.887895 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55772 s=2 pgs=23974 cs=5817 l=0).fault, initiating reconnect
2013-06-08 20:25:42.888078 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60893 s=2 pgs=18314 cs=5291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.888153 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39648 s=2 pgs=20183 cs=3153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.888242 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32782 s=2 pgs=24151 cs=7089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.888351 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39736 s=2 pgs=17922 cs=4001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.888580 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58197 s=2 pgs=14438 cs=585 l=0).fault, initiating reconnect
2013-06-08 20:25:42.888870 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55782 s=2 pgs=23975 cs=5819 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889024 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39652 s=2 pgs=20184 cs=3155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889048 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32788 s=2 pgs=24152 cs=7091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889052 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60899 s=2 pgs=18315 cs=5293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889572 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58203 s=2 pgs=14439 cs=587 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889604 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39744 s=2 pgs=17923 cs=4003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889676 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55788 s=2 pgs=23976 cs=5821 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889899 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32794 s=2 pgs=24153 cs=7093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.889953 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60906 s=2 pgs=18316 cs=5295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.890029 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39657 s=2 pgs=20185 cs=3157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.890554 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55794 s=2 pgs=23977 cs=5823 l=0).fault, initiating reconnect
2013-06-08 20:25:42.890629 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58208 s=2 pgs=14440 cs=589 l=0).fault, initiating reconnect
2013-06-08 20:25:42.890640 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32798 s=2 pgs=24154 cs=7095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.890718 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39751 s=2 pgs=17924 cs=4005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.890748 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60912 s=2 pgs=18317 cs=5297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.890939 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39665 s=2 pgs=20186 cs=3159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.891453 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55798 s=2 pgs=23978 cs=5825 l=0).fault, initiating reconnect
2013-06-08 20:25:42.891469 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32803 s=2 pgs=24155 cs=7097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.891666 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58215 s=2 pgs=14441 cs=591 l=0).fault, initiating reconnect
2013-06-08 20:25:42.891824 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60918 s=2 pgs=18318 cs=5299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.891841 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39759 s=2 pgs=17925 cs=4007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.892357 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55805 s=2 pgs=23979 cs=5827 l=0).fault, initiating reconnect
2013-06-08 20:25:42.892410 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32807 s=2 pgs=24156 cs=7099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.892433 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32807 s=1 pgs=24156 cs=7100 l=0).fault
2013-06-08 20:25:42.892479 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58222 s=2 pgs=14442 cs=593 l=0).fault, initiating reconnect
2013-06-08 20:25:42.892707 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60923 s=2 pgs=18319 cs=5301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.892790 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39671 s=2 pgs=20187 cs=3161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.892881 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39766 s=2 pgs=17926 cs=4009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.893328 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32813 s=2 pgs=24157 cs=7101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.893399 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55809 s=2 pgs=23980 cs=5829 l=0).fault, initiating reconnect
2013-06-08 20:25:42.893437 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58227 s=2 pgs=14443 cs=595 l=0).fault, initiating reconnect
2013-06-08 20:25:42.893772 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60928 s=2 pgs=18320 cs=5303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.893873 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39772 s=2 pgs=17927 cs=4011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.893900 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39681 s=2 pgs=20188 cs=3163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.894210 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55816 s=2 pgs=23981 cs=5831 l=0).fault, initiating reconnect
2013-06-08 20:25:42.894241 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32818 s=2 pgs=24158 cs=7103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.894271 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58233 s=2 pgs=14444 cs=597 l=0).fault, initiating reconnect
2013-06-08 20:25:42.894769 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60934 s=2 pgs=18321 cs=5305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.894895 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39687 s=2 pgs=20189 cs=3165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.895091 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55821 s=2 pgs=23982 cs=5833 l=0).fault, initiating reconnect
2013-06-08 20:25:42.895099 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39778 s=2 pgs=17928 cs=4013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.895162 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32825 s=2 pgs=24159 cs=7105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.895293 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58239 s=2 pgs=14445 cs=599 l=0).fault, initiating reconnect
2013-06-08 20:25:42.895740 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60940 s=2 pgs=18322 cs=5307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.895957 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32831 s=2 pgs=24160 cs=7107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.895992 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55827 s=2 pgs=23983 cs=5835 l=0).fault, initiating reconnect
2013-06-08 20:25:42.896062 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39693 s=2 pgs=20190 cs=3167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.896228 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39784 s=2 pgs=17929 cs=4015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.896267 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58245 s=2 pgs=14446 cs=601 l=0).fault, initiating reconnect
2013-06-08 20:25:42.896633 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60946 s=2 pgs=18323 cs=5309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.896827 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55832 s=2 pgs=23984 cs=5837 l=0).fault, initiating reconnect
2013-06-08 20:25:42.896843 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32834 s=2 pgs=24161 cs=7109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.896873 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32834 s=1 pgs=24161 cs=7110 l=0).fault
2013-06-08 20:25:42.896989 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39701 s=2 pgs=20191 cs=3169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.897234 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39792 s=2 pgs=17930 cs=4017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.897258 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58251 s=2 pgs=14447 cs=603 l=0).fault, initiating reconnect
2013-06-08 20:25:42.897638 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60952 s=2 pgs=18324 cs=5311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.897754 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32841 s=2 pgs=24162 cs=7111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.898012 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :55837 s=2 pgs=23985 cs=5839 l=0).fault, initiating reconnect
2013-06-08 20:25:42.898015 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39707 s=2 pgs=20192 cs=3171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.898255 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58257 s=2 pgs=14448 cs=605 l=0).fault, initiating reconnect
2013-06-08 20:25:42.898405 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39798 s=2 pgs=17931 cs=4019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.898594 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32846 s=2 pgs=24163 cs=7113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.898621 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60958 s=2 pgs=18325 cs=5313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.898826 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55844 s=2 pgs=23986 cs=5841 l=0).fault, initiating reconnect
2013-06-08 20:25:42.899133 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39713 s=2 pgs=20193 cs=3173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.899297 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58262 s=2 pgs=14449 cs=607 l=0).fault, initiating reconnect
2013-06-08 20:25:42.899403 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39805 s=2 pgs=17932 cs=4021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.899503 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32851 s=2 pgs=24164 cs=7115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.899503 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60965 s=2 pgs=18326 cs=5315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.899611 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32851 s=1 pgs=24164 cs=7116 l=0).fault
2013-06-08 20:25:42.899783 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55850 s=2 pgs=23987 cs=5843 l=0).fault, initiating reconnect
2013-06-08 20:25:42.900086 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39719 s=2 pgs=20194 cs=3175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.900144 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58268 s=2 pgs=14450 cs=609 l=0).fault, initiating reconnect
2013-06-08 20:25:42.900499 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60970 s=2 pgs=18327 cs=5317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.900550 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55856 s=2 pgs=23988 cs=5845 l=0).fault, initiating reconnect
2013-06-08 20:25:42.900549 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39811 s=2 pgs=17933 cs=4023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901097 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32858 s=2 pgs=24165 cs=7117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901196 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39725 s=2 pgs=20195 cs=3177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901414 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60975 s=2 pgs=18328 cs=5319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901440 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55860 s=2 pgs=23989 cs=5847 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901639 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39819 s=2 pgs=17934 cs=4025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901836 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32865 s=2 pgs=24166 cs=7119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901917 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58274 s=2 pgs=14451 cs=611 l=0).fault, initiating reconnect
2013-06-08 20:25:42.901947 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58274 s=1 pgs=14451 cs=612 l=0).fault
2013-06-08 20:25:42.902058 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39731 s=2 pgs=20196 cs=3179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.902499 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60980 s=2 pgs=18329 cs=5321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.902631 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32870 s=2 pgs=24167 cs=7121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.902694 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39824 s=2 pgs=17935 cs=4027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.902675 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55865 s=2 pgs=23990 cs=5849 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903006 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39737 s=2 pgs=20197 cs=3181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903020 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58284 s=2 pgs=14452 cs=613 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903419 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60986 s=2 pgs=18330 cs=5323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903432 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32874 s=2 pgs=24168 cs=7123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903590 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55873 s=2 pgs=23991 cs=5851 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903677 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39830 s=2 pgs=17936 cs=4029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903804 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39742 s=2 pgs=20198 cs=3183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.903846 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58291 s=2 pgs=14453 cs=615 l=0).fault, initiating reconnect
2013-06-08 20:25:42.904287 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32880 s=2 pgs=24169 cs=7125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.904313 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60992 s=2 pgs=18331 cs=5325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.904479 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55878 s=2 pgs=23992 cs=5853 l=0).fault, initiating reconnect
2013-06-08 20:25:42.904603 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39837 s=2 pgs=17937 cs=4031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.904827 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39748 s=2 pgs=20199 cs=3185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.904900 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58297 s=2 pgs=14454 cs=617 l=0).fault, initiating reconnect
2013-06-08 20:25:42.905171 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32885 s=2 pgs=24170 cs=7127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.905245 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :60999 s=2 pgs=18332 cs=5327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.905298 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55884 s=2 pgs=23993 cs=5855 l=0).fault, initiating reconnect
2013-06-08 20:25:42.905538 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39843 s=2 pgs=17938 cs=4033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.905837 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39754 s=2 pgs=20200 cs=3187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.905848 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58303 s=2 pgs=14455 cs=619 l=0).fault, initiating reconnect
2013-06-08 20:25:42.905902 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32891 s=2 pgs=24171 cs=7129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.906128 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55890 s=2 pgs=23994 cs=5857 l=0).fault, initiating reconnect
2013-06-08 20:25:42.906208 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32772 s=2 pgs=18333 cs=5329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.906726 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39849 s=2 pgs=17939 cs=4035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.906743 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39760 s=2 pgs=20201 cs=3189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.906792 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58309 s=2 pgs=14456 cs=621 l=0).fault, initiating reconnect
2013-06-08 20:25:42.906806 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32897 s=2 pgs=24172 cs=7131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.906924 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55895 s=2 pgs=23995 cs=5859 l=0).fault, initiating reconnect
2013-06-08 20:25:42.907111 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32779 s=2 pgs=18334 cs=5331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.907667 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55901 s=2 pgs=23996 cs=5861 l=0).fault, initiating reconnect
2013-06-08 20:25:42.907774 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32903 s=2 pgs=24173 cs=7133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.907789 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39855 s=2 pgs=17940 cs=4037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.907814 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39766 s=2 pgs=20202 cs=3191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.908002 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32785 s=2 pgs=18335 cs=5333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.908539 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58315 s=2 pgs=14457 cs=623 l=0).fault, initiating reconnect
2013-06-08 20:25:42.908560 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32907 s=2 pgs=24174 cs=7135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.908611 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55903 s=2 pgs=23997 cs=5863 l=0).fault, initiating reconnect
2013-06-08 20:25:42.908741 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39774 s=2 pgs=20203 cs=3193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.908776 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39863 s=2 pgs=17941 cs=4039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.908779 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32790 s=2 pgs=18336 cs=5335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.909511 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55910 s=2 pgs=23998 cs=5865 l=0).fault, initiating reconnect
2013-06-08 20:25:42.909567 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39779 s=2 pgs=20204 cs=3195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.909599 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32912 s=2 pgs=24175 cs=7137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.909865 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32795 s=2 pgs=18337 cs=5337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.909868 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39871 s=2 pgs=17942 cs=4041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.910295 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55914 s=2 pgs=23999 cs=5867 l=0).fault, initiating reconnect
2013-06-08 20:25:42.910458 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39783 s=2 pgs=20205 cs=3197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.910489 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32919 s=2 pgs=24176 cs=7139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.910868 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39876 s=2 pgs=17943 cs=4043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.910908 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32800 s=2 pgs=18338 cs=5339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.911016 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58324 s=2 pgs=14458 cs=625 l=0).fault, initiating reconnect
2013-06-08 20:25:42.911172 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55919 s=2 pgs=24000 cs=5869 l=0).fault, initiating reconnect
2013-06-08 20:25:42.911389 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32924 s=2 pgs=24177 cs=7141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.911410 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39788 s=2 pgs=20206 cs=3199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.911842 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58340 s=2 pgs=14459 cs=627 l=0).fault, initiating reconnect
2013-06-08 20:25:42.911852 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32806 s=2 pgs=18339 cs=5341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.912110 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55925 s=2 pgs=24001 cs=5871 l=0).fault, initiating reconnect
2013-06-08 20:25:42.912050 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39880 s=2 pgs=17944 cs=4045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.912183 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32929 s=2 pgs=24178 cs=7143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.912301 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39795 s=2 pgs=20207 cs=3201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.912848 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32812 s=2 pgs=18340 cs=5343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.912899 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58344 s=2 pgs=14460 cs=629 l=0).fault, initiating reconnect
2013-06-08 20:25:42.912984 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55930 s=2 pgs=24002 cs=5873 l=0).fault, initiating reconnect
2013-06-08 20:25:42.913168 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32935 s=2 pgs=24179 cs=7145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.913311 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39801 s=2 pgs=20208 cs=3203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.913519 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39889 s=2 pgs=17945 cs=4047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.913778 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32817 s=2 pgs=18341 cs=5345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.913853 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :55936 s=2 pgs=24003 cs=5875 l=0).fault, initiating reconnect
2013-06-08 20:25:42.913810 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :58351 s=2 pgs=14461 cs=631 l=0).fault, initiating reconnect
2013-06-08 20:25:42.914046 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32940 s=2 pgs=24180 cs=7147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.914234 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39806 s=2 pgs=20209 cs=3205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.914621 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39897 s=2 pgs=17946 cs=4049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.914736 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55942 s=2 pgs=24004 cs=5877 l=0).fault, initiating reconnect
2013-06-08 20:25:42.914780 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58357 s=2 pgs=14462 cs=633 l=0).fault, initiating reconnect
2013-06-08 20:25:42.914827 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32823 s=2 pgs=18342 cs=5347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.914834 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32946 s=2 pgs=24181 cs=7149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.915169 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39812 s=2 pgs=20210 cs=3207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.915515 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55946 s=2 pgs=24005 cs=5879 l=0).fault, initiating reconnect
2013-06-08 20:25:42.915639 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39903 s=2 pgs=17947 cs=4051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.915705 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32952 s=2 pgs=24182 cs=7151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.915729 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32831 s=2 pgs=18343 cs=5349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.915820 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58363 s=2 pgs=14463 cs=635 l=0).fault, initiating reconnect
2013-06-08 20:25:42.916133 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39818 s=2 pgs=20211 cs=3209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.916320 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55951 s=2 pgs=24006 cs=5881 l=0).fault, initiating reconnect
2013-06-08 20:25:42.916536 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32837 s=2 pgs=18344 cs=5351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.916576 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32956 s=2 pgs=24183 cs=7153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.916639 7fddc9faa700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32956 s=1 pgs=24183 cs=7154 l=0).fault
2013-06-08 20:25:42.916780 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39910 s=2 pgs=17948 cs=4053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.916783 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58371 s=2 pgs=14464 cs=637 l=0).fault, initiating reconnect
2013-06-08 20:25:42.917023 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39824 s=2 pgs=20212 cs=3211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.917191 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55957 s=2 pgs=24007 cs=5883 l=0).fault, initiating reconnect
2013-06-08 20:25:42.917392 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32841 s=2 pgs=18345 cs=5353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.917628 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32962 s=2 pgs=24184 cs=7155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.917685 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58376 s=2 pgs=14465 cs=639 l=0).fault, initiating reconnect
2013-06-08 20:25:42.917884 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39830 s=2 pgs=20213 cs=3213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.917919 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39919 s=2 pgs=17949 cs=4055 l=0).fault, initiating reconnect
2013-06-08 20:25:42.918104 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55963 s=2 pgs=24008 cs=5885 l=0).fault, initiating reconnect
2013-06-08 20:25:42.918194 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32847 s=2 pgs=18346 cs=5355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.918384 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32968 s=2 pgs=24185 cs=7157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.918755 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58382 s=2 pgs=14466 cs=641 l=0).fault, initiating reconnect
2013-06-08 20:25:42.918941 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55969 s=2 pgs=24009 cs=5887 l=0).fault, initiating reconnect
2013-06-08 20:25:42.918986 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32853 s=2 pgs=18347 cs=5357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.919008 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39926 s=2 pgs=17950 cs=4057 l=0).fault, initiating reconnect
2013-06-08 20:25:42.919300 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32974 s=2 pgs=24186 cs=7159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.919671 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58388 s=2 pgs=14467 cs=643 l=0).fault, initiating reconnect
2013-06-08 20:25:42.919809 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32857 s=2 pgs=18348 cs=5359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.919883 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55973 s=2 pgs=24010 cs=5889 l=0).fault, initiating reconnect
2013-06-08 20:25:42.919887 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39835 s=2 pgs=20214 cs=3215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.920025 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39933 s=2 pgs=17951 cs=4059 l=0).fault, initiating reconnect
2013-06-08 20:25:42.920207 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32979 s=2 pgs=24187 cs=7161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.920510 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58393 s=2 pgs=14468 cs=645 l=0).fault, initiating reconnect
2013-06-08 20:25:42.920795 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32861 s=2 pgs=18349 cs=5361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.920807 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39848 s=2 pgs=20215 cs=3217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.921160 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :39939 s=2 pgs=17952 cs=4061 l=0).fault, initiating reconnect
2013-06-08 20:25:42.921161 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :32985 s=2 pgs=24188 cs=7163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.921454 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58399 s=2 pgs=14469 cs=647 l=0).fault, initiating reconnect
2013-06-08 20:25:42.921627 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32867 s=2 pgs=18350 cs=5363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.921805 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39853 s=2 pgs=20216 cs=3219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.921841 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55979 s=2 pgs=24011 cs=5891 l=0).fault, initiating reconnect
2013-06-08 20:25:42.921919 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :32990 s=2 pgs=24189 cs=7165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.922116 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39944 s=2 pgs=17953 cs=4063 l=0).fault, initiating reconnect
2013-06-08 20:25:42.922356 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58404 s=2 pgs=14470 cs=649 l=0).fault, initiating reconnect
2013-06-08 20:25:42.922537 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32872 s=2 pgs=18351 cs=5365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.922752 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39858 s=2 pgs=20217 cs=3221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.922801 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :32995 s=2 pgs=24190 cs=7167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.922810 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55991 s=2 pgs=24012 cs=5893 l=0).fault, initiating reconnect
2013-06-08 20:25:42.923187 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58410 s=2 pgs=14471 cs=651 l=0).fault, initiating reconnect
2013-06-08 20:25:42.923196 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39951 s=2 pgs=17954 cs=4065 l=0).fault, initiating reconnect
2013-06-08 20:25:42.923309 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32878 s=2 pgs=18352 cs=5367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.923582 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39864 s=2 pgs=20218 cs=3223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.923603 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :55998 s=2 pgs=24013 cs=5895 l=0).fault, initiating reconnect
2013-06-08 20:25:42.923675 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33000 s=2 pgs=24191 cs=7169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.924069 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32884 s=2 pgs=18353 cs=5369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.924202 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39958 s=2 pgs=17955 cs=4067 l=0).fault, initiating reconnect
2013-06-08 20:25:42.924240 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58415 s=2 pgs=14472 cs=653 l=0).fault, initiating reconnect
2013-06-08 20:25:42.924505 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33007 s=2 pgs=24192 cs=7171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.924613 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56003 s=2 pgs=24014 cs=5897 l=0).fault, initiating reconnect
2013-06-08 20:25:42.924665 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39870 s=2 pgs=20219 cs=3225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.924868 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32888 s=2 pgs=18354 cs=5371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.925181 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58423 s=2 pgs=14473 cs=655 l=0).fault, initiating reconnect
2013-06-08 20:25:42.925273 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39964 s=2 pgs=17956 cs=4069 l=0).fault, initiating reconnect
2013-06-08 20:25:42.925381 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33011 s=2 pgs=24193 cs=7173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.925462 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56009 s=2 pgs=24015 cs=5899 l=0).fault, initiating reconnect
2013-06-08 20:25:42.925598 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32894 s=2 pgs=18355 cs=5373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.925605 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39878 s=2 pgs=20220 cs=3227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.926196 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33017 s=2 pgs=24194 cs=7175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.926269 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32899 s=2 pgs=18356 cs=5375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.926397 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39885 s=2 pgs=20221 cs=3229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.926397 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39971 s=2 pgs=17957 cs=4071 l=0).fault, initiating reconnect
2013-06-08 20:25:42.926463 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56015 s=2 pgs=24016 cs=5901 l=0).fault, initiating reconnect
2013-06-08 20:25:42.926557 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58428 s=2 pgs=14474 cs=657 l=0).fault, initiating reconnect
2013-06-08 20:25:42.927241 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32902 s=2 pgs=18357 cs=5377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.927399 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39979 s=2 pgs=17958 cs=4073 l=0).fault, initiating reconnect
2013-06-08 20:25:42.927534 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56022 s=2 pgs=24017 cs=5903 l=0).fault, initiating reconnect
2013-06-08 20:25:42.927560 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39888 s=2 pgs=20222 cs=3231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.927796 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58439 s=2 pgs=14475 cs=659 l=0).fault, initiating reconnect
2013-06-08 20:25:42.927855 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33021 s=2 pgs=24195 cs=7177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.928172 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32907 s=2 pgs=18358 cs=5379 l=0).fault, initiating reconnect
2013-06-08 20:25:42.928399 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39895 s=2 pgs=20223 cs=3233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.928503 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39983 s=2 pgs=17959 cs=4075 l=0).fault, initiating reconnect
2013-06-08 20:25:42.928596 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33032 s=2 pgs=24196 cs=7179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.928990 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58444 s=2 pgs=14476 cs=661 l=0).fault, initiating reconnect
2013-06-08 20:25:42.929134 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39899 s=2 pgs=20224 cs=3235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.929136 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32913 s=2 pgs=18359 cs=5381 l=0).fault, initiating reconnect
2013-06-08 20:25:42.929576 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33036 s=2 pgs=24197 cs=7181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.929586 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56026 s=2 pgs=24018 cs=5905 l=0).fault, initiating reconnect
2013-06-08 20:25:42.929596 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39990 s=2 pgs=17960 cs=4077 l=0).fault, initiating reconnect
2013-06-08 20:25:42.929824 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58450 s=2 pgs=14477 cs=663 l=0).fault, initiating reconnect
2013-06-08 20:25:42.930013 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32919 s=2 pgs=18360 cs=5383 l=0).fault, initiating reconnect
2013-06-08 20:25:42.930084 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39903 s=2 pgs=20225 cs=3237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.930203 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33040 s=2 pgs=24198 cs=7183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.930558 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56038 s=2 pgs=24019 cs=5907 l=0).fault, initiating reconnect
2013-06-08 20:25:42.930776 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58456 s=2 pgs=14478 cs=665 l=0).fault, initiating reconnect
2013-06-08 20:25:42.930896 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39910 s=2 pgs=20226 cs=3239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.930898 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :39997 s=2 pgs=17961 cs=4079 l=0).fault, initiating reconnect
2013-06-08 20:25:42.931091 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32924 s=2 pgs=18361 cs=5385 l=0).fault, initiating reconnect
2013-06-08 20:25:42.931118 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33046 s=2 pgs=24199 cs=7185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.931394 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56044 s=2 pgs=24020 cs=5909 l=0).fault, initiating reconnect
2013-06-08 20:25:42.931733 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58461 s=2 pgs=14479 cs=667 l=0).fault, initiating reconnect
2013-06-08 20:25:42.931778 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39914 s=2 pgs=20227 cs=3241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.931847 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33052 s=2 pgs=24200 cs=7187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.931893 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32931 s=2 pgs=18362 cs=5387 l=0).fault, initiating reconnect
2013-06-08 20:25:42.932321 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56050 s=2 pgs=24021 cs=5911 l=0).fault, initiating reconnect
2013-06-08 20:25:42.932337 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40005 s=2 pgs=17962 cs=4081 l=0).fault, initiating reconnect
2013-06-08 20:25:42.932735 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58467 s=2 pgs=14480 cs=669 l=0).fault, initiating reconnect
2013-06-08 20:25:42.932808 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39920 s=2 pgs=20228 cs=3243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.932842 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32936 s=2 pgs=18363 cs=5389 l=0).fault, initiating reconnect
2013-06-08 20:25:42.932852 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33057 s=2 pgs=24201 cs=7189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.933280 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56055 s=2 pgs=24022 cs=5913 l=0).fault, initiating reconnect
2013-06-08 20:25:42.933591 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33062 s=2 pgs=24202 cs=7191 l=0).fault, initiating reconnect
2013-06-08 20:25:42.933666 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39926 s=2 pgs=20229 cs=3245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.933676 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40014 s=2 pgs=17963 cs=4083 l=0).fault, initiating reconnect
2013-06-08 20:25:42.933736 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32942 s=2 pgs=18364 cs=5391 l=0).fault, initiating reconnect
2013-06-08 20:25:42.934002 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58473 s=2 pgs=14481 cs=671 l=0).fault, initiating reconnect
2013-06-08 20:25:42.934275 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33065 s=2 pgs=24203 cs=7193 l=0).fault, initiating reconnect
2013-06-08 20:25:42.934499 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :39931 s=2 pgs=20230 cs=3247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.934547 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32948 s=2 pgs=18365 cs=5393 l=0).fault, initiating reconnect
2013-06-08 20:25:42.934579 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56061 s=2 pgs=24023 cs=5915 l=0).fault, initiating reconnect
2013-06-08 20:25:42.934745 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40022 s=2 pgs=17964 cs=4085 l=0).fault, initiating reconnect
2013-06-08 20:25:42.934952 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58482 s=2 pgs=14482 cs=673 l=0).fault, initiating reconnect
2013-06-08 20:25:42.935029 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33070 s=2 pgs=24204 cs=7195 l=0).fault, initiating reconnect
2013-06-08 20:25:42.935311 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39936 s=2 pgs=20231 cs=3249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.935364 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32952 s=2 pgs=18366 cs=5395 l=0).fault, initiating reconnect
2013-06-08 20:25:42.935404 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56070 s=2 pgs=24024 cs=5917 l=0).fault, initiating reconnect
2013-06-08 20:25:42.935761 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40029 s=2 pgs=17965 cs=4087 l=0).fault, initiating reconnect
2013-06-08 20:25:42.935949 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58488 s=2 pgs=14483 cs=675 l=0).fault, initiating reconnect
2013-06-08 20:25:42.935950 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33076 s=2 pgs=24205 cs=7197 l=0).fault, initiating reconnect
2013-06-08 20:25:42.936307 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39943 s=2 pgs=20232 cs=3251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.936315 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32957 s=2 pgs=18367 cs=5397 l=0).fault, initiating reconnect
2013-06-08 20:25:42.936506 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56076 s=2 pgs=24025 cs=5919 l=0).fault, initiating reconnect
2013-06-08 20:25:42.936806 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33082 s=2 pgs=24206 cs=7199 l=0).fault, initiating reconnect
2013-06-08 20:25:42.936926 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40035 s=2 pgs=17966 cs=4089 l=0).fault, initiating reconnect
2013-06-08 20:25:42.937146 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :39948 s=2 pgs=20233 cs=3253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.937156 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58494 s=2 pgs=14484 cs=677 l=0).fault, initiating reconnect
2013-06-08 20:25:42.937224 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32964 s=2 pgs=18368 cs=5399 l=0).fault, initiating reconnect
2013-06-08 20:25:42.937387 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56082 s=2 pgs=24026 cs=5921 l=0).fault, initiating reconnect
2013-06-08 20:25:42.937547 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33086 s=2 pgs=24207 cs=7201 l=0).fault, initiating reconnect
2013-06-08 20:25:42.938052 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :32970 s=2 pgs=18369 cs=5401 l=0).fault, initiating reconnect
2013-06-08 20:25:42.938055 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :58502 s=2 pgs=14485 cs=679 l=0).fault, initiating reconnect
2013-06-08 20:25:42.938225 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56088 s=2 pgs=24027 cs=5923 l=0).fault, initiating reconnect
2013-06-08 20:25:42.938267 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33092 s=2 pgs=24208 cs=7203 l=0).fault, initiating reconnect
2013-06-08 20:25:42.938379 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40042 s=2 pgs=17967 cs=4091 l=0).fault, initiating reconnect
2013-06-08 20:25:42.938945 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32973 s=2 pgs=18370 cs=5403 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939002 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33096 s=2 pgs=24209 cs=7205 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939104 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :39953 s=2 pgs=20234 cs=3255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939106 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :56092 s=2 pgs=24028 cs=5925 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939178 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58507 s=2 pgs=14486 cs=681 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939698 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40052 s=2 pgs=17968 cs=4093 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939750 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33099 s=2 pgs=24210 cs=7207 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939806 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32978 s=2 pgs=18371 cs=5405 l=0).fault, initiating reconnect
2013-06-08 20:25:42.939921 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56097 s=2 pgs=24029 cs=5927 l=0).fault, initiating reconnect
2013-06-08 20:25:42.940021 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :39966 s=2 pgs=20235 cs=3257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.940102 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58515 s=2 pgs=14487 cs=683 l=0).fault, initiating reconnect
2013-06-08 20:25:42.940459 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33104 s=2 pgs=24211 cs=7209 l=0).fault, initiating reconnect
2013-06-08 20:25:42.940579 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32985 s=2 pgs=18372 cs=5407 l=0).fault, initiating reconnect
2013-06-08 20:25:42.940842 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56103 s=2 pgs=24030 cs=5929 l=0).fault, initiating reconnect
2013-06-08 20:25:42.940906 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :39972 s=2 pgs=20236 cs=3259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.941058 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40058 s=2 pgs=17969 cs=4095 l=0).fault, initiating reconnect
2013-06-08 20:25:42.941207 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58521 s=2 pgs=14488 cs=685 l=0).fault, initiating reconnect
2013-06-08 20:25:42.941354 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33109 s=2 pgs=24212 cs=7211 l=0).fault, initiating reconnect
2013-06-08 20:25:42.941564 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32990 s=2 pgs=18373 cs=5409 l=0).fault, initiating reconnect
2013-06-08 20:25:42.941800 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56108 s=2 pgs=24031 cs=5931 l=0).fault, initiating reconnect
2013-06-08 20:25:42.941833 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :39977 s=2 pgs=20237 cs=3261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.942103 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33115 s=2 pgs=24213 cs=7213 l=0).fault, initiating reconnect
2013-06-08 20:25:42.942138 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58527 s=2 pgs=14489 cs=687 l=0).fault, initiating reconnect
2013-06-08 20:25:42.942271 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40068 s=2 pgs=17970 cs=4097 l=0).fault, initiating reconnect
2013-06-08 20:25:42.942376 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :32996 s=2 pgs=18374 cs=5411 l=0).fault, initiating reconnect
2013-06-08 20:25:42.942481 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56114 s=2 pgs=24032 cs=5933 l=0).fault, initiating reconnect
2013-06-08 20:25:42.942789 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :39983 s=2 pgs=20238 cs=3263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.942919 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58533 s=2 pgs=14490 cs=689 l=0).fault, initiating reconnect
2013-06-08 20:25:42.943065 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33119 s=2 pgs=24214 cs=7215 l=0).fault, initiating reconnect
2013-06-08 20:25:42.943246 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33002 s=2 pgs=18375 cs=5413 l=0).fault, initiating reconnect
2013-06-08 20:25:42.943367 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56120 s=2 pgs=24033 cs=5935 l=0).fault, initiating reconnect
2013-06-08 20:25:42.943648 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :39989 s=2 pgs=20239 cs=3265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.943742 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40076 s=2 pgs=17971 cs=4099 l=0).fault, initiating reconnect
2013-06-08 20:25:42.943887 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33126 s=2 pgs=24215 cs=7217 l=0).fault, initiating reconnect
2013-06-08 20:25:42.943945 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58538 s=2 pgs=14491 cs=691 l=0).fault, initiating reconnect
2013-06-08 20:25:42.944147 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33007 s=2 pgs=18376 cs=5415 l=0).fault, initiating reconnect
2013-06-08 20:25:42.944232 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56125 s=2 pgs=24034 cs=5937 l=0).fault, initiating reconnect
2013-06-08 20:25:42.944602 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :39994 s=2 pgs=20240 cs=3267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.944751 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33131 s=2 pgs=24216 cs=7219 l=0).fault, initiating reconnect
2013-06-08 20:25:42.944868 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58545 s=2 pgs=14492 cs=693 l=0).fault, initiating reconnect
2013-06-08 20:25:42.944867 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40085 s=2 pgs=17972 cs=4101 l=0).fault, initiating reconnect
2013-06-08 20:25:42.945178 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56131 s=2 pgs=24035 cs=5939 l=0).fault, initiating reconnect
2013-06-08 20:25:42.945195 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33013 s=2 pgs=18377 cs=5417 l=0).fault, initiating reconnect
2013-06-08 20:25:42.945483 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33136 s=2 pgs=24217 cs=7221 l=0).fault, initiating reconnect
2013-06-08 20:25:42.945828 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58551 s=2 pgs=14493 cs=695 l=0).fault, initiating reconnect
2013-06-08 20:25:42.946052 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33020 s=2 pgs=18378 cs=5419 l=0).fault, initiating reconnect
2013-06-08 20:25:42.946139 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56136 s=2 pgs=24036 cs=5941 l=0).fault, initiating reconnect
2013-06-08 20:25:42.946141 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40092 s=2 pgs=17973 cs=4103 l=0).fault, initiating reconnect
2013-06-08 20:25:42.946379 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33141 s=2 pgs=24218 cs=7223 l=0).fault, initiating reconnect
2013-06-08 20:25:42.946528 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40000 s=2 pgs=20241 cs=3269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.946918 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58555 s=2 pgs=14494 cs=697 l=0).fault, initiating reconnect
2013-06-08 20:25:42.946938 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33023 s=2 pgs=18379 cs=5421 l=0).fault, initiating reconnect
2013-06-08 20:25:42.947012 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56141 s=2 pgs=24037 cs=5943 l=0).fault, initiating reconnect
2013-06-08 20:25:42.947183 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33146 s=2 pgs=24219 cs=7225 l=0).fault, initiating reconnect
2013-06-08 20:25:42.947380 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40012 s=2 pgs=20242 cs=3271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.947501 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40100 s=2 pgs=17974 cs=4105 l=0).fault, initiating reconnect
2013-06-08 20:25:42.947768 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33029 s=2 pgs=18380 cs=5423 l=0).fault, initiating reconnect
2013-06-08 20:25:42.947912 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58561 s=2 pgs=14495 cs=699 l=0).fault, initiating reconnect
2013-06-08 20:25:42.948030 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33151 s=2 pgs=24220 cs=7227 l=0).fault, initiating reconnect
2013-06-08 20:25:42.948049 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56147 s=2 pgs=24038 cs=5945 l=0).fault, initiating reconnect
2013-06-08 20:25:42.948232 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40017 s=2 pgs=20243 cs=3273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.948734 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33034 s=2 pgs=18381 cs=5425 l=0).fault, initiating reconnect
2013-06-08 20:25:42.948738 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40108 s=2 pgs=17975 cs=4107 l=0).fault, initiating reconnect
2013-06-08 20:25:42.948792 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58568 s=2 pgs=14496 cs=701 l=0).fault, initiating reconnect
2013-06-08 20:25:42.948839 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33156 s=2 pgs=24221 cs=7229 l=0).fault, initiating reconnect
2013-06-08 20:25:42.949009 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56154 s=2 pgs=24039 cs=5947 l=0).fault, initiating reconnect
2013-06-08 20:25:42.949085 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40023 s=2 pgs=20244 cs=3275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.949561 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33039 s=2 pgs=18382 cs=5427 l=0).fault, initiating reconnect
2013-06-08 20:25:42.949760 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33162 s=2 pgs=24222 cs=7231 l=0).fault, initiating reconnect
2013-06-08 20:25:42.949924 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58574 s=2 pgs=14497 cs=703 l=0).fault, initiating reconnect
2013-06-08 20:25:42.949955 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40029 s=2 pgs=20245 cs=3277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.949961 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40115 s=2 pgs=17976 cs=4109 l=0).fault, initiating reconnect
2013-06-08 20:25:42.950561 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33166 s=2 pgs=24223 cs=7233 l=0).fault, initiating reconnect
2013-06-08 20:25:42.950567 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33045 s=2 pgs=18383 cs=5429 l=0).fault, initiating reconnect
2013-06-08 20:25:42.950853 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40033 s=2 pgs=20246 cs=3279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.950863 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58580 s=2 pgs=14498 cs=705 l=0).fault, initiating reconnect
2013-06-08 20:25:42.951000 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56160 s=2 pgs=24040 cs=5949 l=0).fault, initiating reconnect
2013-06-08 20:25:42.951063 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40124 s=2 pgs=17977 cs=4111 l=0).fault, initiating reconnect
2013-06-08 20:25:42.951306 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33170 s=2 pgs=24224 cs=7235 l=0).fault, initiating reconnect
2013-06-08 20:25:42.951481 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33051 s=2 pgs=18384 cs=5431 l=0).fault, initiating reconnect
2013-06-08 20:25:42.951753 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58586 s=2 pgs=14499 cs=707 l=0).fault, initiating reconnect
2013-06-08 20:25:42.951846 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40037 s=2 pgs=20247 cs=3281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.951954 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56171 s=2 pgs=24041 cs=5951 l=0).fault, initiating reconnect
2013-06-08 20:25:42.952022 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33176 s=2 pgs=24225 cs=7237 l=0).fault, initiating reconnect
2013-06-08 20:25:42.952020 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40130 s=2 pgs=17978 cs=4113 l=0).fault, initiating reconnect
2013-06-08 20:25:42.952309 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33057 s=2 pgs=18385 cs=5433 l=0).fault, initiating reconnect
2013-06-08 20:25:42.952693 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58591 s=2 pgs=14500 cs=709 l=0).fault, initiating reconnect
2013-06-08 20:25:42.952702 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33181 s=2 pgs=24226 cs=7239 l=0).fault, initiating reconnect
2013-06-08 20:25:42.952742 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40044 s=2 pgs=20248 cs=3283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.952893 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56177 s=2 pgs=24042 cs=5953 l=0).fault, initiating reconnect
2013-06-08 20:25:42.953228 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33063 s=2 pgs=18386 cs=5435 l=0).fault, initiating reconnect
2013-06-08 20:25:42.953372 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40137 s=2 pgs=17979 cs=4115 l=0).fault, initiating reconnect
2013-06-08 20:25:42.953505 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33184 s=2 pgs=24227 cs=7241 l=0).fault, initiating reconnect
2013-06-08 20:25:42.953554 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58598 s=2 pgs=14501 cs=711 l=0).fault, initiating reconnect
2013-06-08 20:25:42.953833 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40051 s=2 pgs=20249 cs=3285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.953898 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56184 s=2 pgs=24043 cs=5955 l=0).fault, initiating reconnect
2013-06-08 20:25:42.953999 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33068 s=2 pgs=18387 cs=5437 l=0).fault, initiating reconnect
2013-06-08 20:25:42.954632 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58604 s=2 pgs=14502 cs=713 l=0).fault, initiating reconnect
2013-06-08 20:25:42.954642 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56190 s=2 pgs=24044 cs=5957 l=0).fault, initiating reconnect
2013-06-08 20:25:42.954644 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40144 s=2 pgs=17980 cs=4117 l=0).fault, initiating reconnect
2013-06-08 20:25:42.954651 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33190 s=2 pgs=24228 cs=7243 l=0).fault, initiating reconnect
2013-06-08 20:25:42.954743 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40057 s=2 pgs=20250 cs=3287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.954799 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33074 s=2 pgs=18388 cs=5439 l=0).fault, initiating reconnect
2013-06-08 20:25:42.955374 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33197 s=2 pgs=24229 cs=7245 l=0).fault, initiating reconnect
2013-06-08 20:25:42.955648 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33080 s=2 pgs=18389 cs=5441 l=0).fault, initiating reconnect
2013-06-08 20:25:42.955652 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58608 s=2 pgs=14503 cs=715 l=0).fault, initiating reconnect
2013-06-08 20:25:42.955817 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40151 s=2 pgs=17981 cs=4119 l=0).fault, initiating reconnect
2013-06-08 20:25:42.956531 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33082 s=2 pgs=18390 cs=5443 l=0).fault, initiating reconnect
2013-06-08 20:25:42.956592 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58616 s=2 pgs=14504 cs=717 l=0).fault, initiating reconnect
2013-06-08 20:25:42.956601 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56195 s=2 pgs=24045 cs=5959 l=0).fault, initiating reconnect
2013-06-08 20:25:42.956740 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40064 s=2 pgs=20251 cs=3289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.957250 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33201 s=2 pgs=24230 cs=7247 l=0).fault, initiating reconnect
2013-06-08 20:25:42.957448 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33085 s=2 pgs=18391 cs=5445 l=0).fault, initiating reconnect
2013-06-08 20:25:42.957452 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40159 s=2 pgs=17982 cs=4121 l=0).fault, initiating reconnect
2013-06-08 20:25:42.957489 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56204 s=2 pgs=24046 cs=5961 l=0).fault, initiating reconnect
2013-06-08 20:25:42.957522 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58619 s=2 pgs=14505 cs=719 l=0).fault, initiating reconnect
2013-06-08 20:25:42.957764 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40073 s=2 pgs=20252 cs=3291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.958075 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33209 s=2 pgs=24231 cs=7249 l=0).fault, initiating reconnect
2013-06-08 20:25:42.958252 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33090 s=2 pgs=18392 cs=5447 l=0).fault, initiating reconnect
2013-06-08 20:25:42.958427 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58626 s=2 pgs=14506 cs=721 l=0).fault, initiating reconnect
2013-06-08 20:25:42.958592 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56209 s=2 pgs=24047 cs=5963 l=0).fault, initiating reconnect
2013-06-08 20:25:42.958634 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40079 s=2 pgs=20253 cs=3293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.958845 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33215 s=2 pgs=24232 cs=7251 l=0).fault, initiating reconnect
2013-06-08 20:25:42.958995 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40166 s=2 pgs=17983 cs=4123 l=0).fault, initiating reconnect
2013-06-08 20:25:42.959163 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33096 s=2 pgs=18393 cs=5449 l=0).fault, initiating reconnect
2013-06-08 20:25:42.959427 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58630 s=2 pgs=14507 cs=723 l=0).fault, initiating reconnect
2013-06-08 20:25:42.959448 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56215 s=2 pgs=24048 cs=5965 l=0).fault, initiating reconnect
2013-06-08 20:25:42.959459 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40084 s=2 pgs=20254 cs=3295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.959702 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33220 s=2 pgs=24233 cs=7253 l=0).fault, initiating reconnect
2013-06-08 20:25:42.960196 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33102 s=2 pgs=18394 cs=5451 l=0).fault, initiating reconnect
2013-06-08 20:25:42.960315 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56221 s=2 pgs=24049 cs=5967 l=0).fault, initiating reconnect
2013-06-08 20:25:42.960316 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40090 s=2 pgs=20255 cs=3297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.960384 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58636 s=2 pgs=14508 cs=725 l=0).fault, initiating reconnect
2013-06-08 20:25:42.960523 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40176 s=2 pgs=17984 cs=4125 l=0).fault, initiating reconnect
2013-06-08 20:25:42.960711 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33226 s=2 pgs=24234 cs=7255 l=0).fault, initiating reconnect
2013-06-08 20:25:42.961032 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33107 s=2 pgs=18395 cs=5453 l=0).fault, initiating reconnect
2013-06-08 20:25:42.961193 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40094 s=2 pgs=20256 cs=3299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.961209 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58643 s=2 pgs=14509 cs=727 l=0).fault, initiating reconnect
2013-06-08 20:25:42.961210 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56225 s=2 pgs=24050 cs=5969 l=0).fault, initiating reconnect
2013-06-08 20:25:42.961482 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33232 s=2 pgs=24235 cs=7257 l=0).fault, initiating reconnect
2013-06-08 20:25:42.961908 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56232 s=2 pgs=24051 cs=5971 l=0).fault, initiating reconnect
2013-06-08 20:25:42.961971 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40186 s=2 pgs=17985 cs=4127 l=0).fault, initiating reconnect
2013-06-08 20:25:42.962010 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33113 s=2 pgs=18396 cs=5455 l=0).fault, initiating reconnect
2013-06-08 20:25:42.962084 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40099 s=2 pgs=20257 cs=3301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.962093 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58649 s=2 pgs=14510 cs=729 l=0).fault, initiating reconnect
2013-06-08 20:25:42.962264 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33237 s=2 pgs=24236 cs=7259 l=0).fault, initiating reconnect
2013-06-08 20:25:42.962776 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56235 s=2 pgs=24052 cs=5973 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963010 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40106 s=2 pgs=20258 cs=3303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963081 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58655 s=2 pgs=14511 cs=731 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963084 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33120 s=2 pgs=18397 cs=5457 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963164 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33243 s=2 pgs=24237 cs=7261 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963314 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40194 s=2 pgs=17986 cs=4129 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963706 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56241 s=2 pgs=24053 cs=5975 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963917 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40110 s=2 pgs=20259 cs=3305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.963916 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33248 s=2 pgs=24238 cs=7263 l=0).fault, initiating reconnect
2013-06-08 20:25:42.964079 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33126 s=2 pgs=18398 cs=5459 l=0).fault, initiating reconnect
2013-06-08 20:25:42.964102 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58660 s=2 pgs=14512 cs=733 l=0).fault, initiating reconnect
2013-06-08 20:25:42.964445 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40204 s=2 pgs=17987 cs=4131 l=0).fault, initiating reconnect
2013-06-08 20:25:42.964666 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56247 s=2 pgs=24054 cs=5977 l=0).fault, initiating reconnect
2013-06-08 20:25:42.964689 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40116 s=2 pgs=20260 cs=3307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.964768 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33252 s=2 pgs=24239 cs=7265 l=0).fault, initiating reconnect
2013-06-08 20:25:42.964924 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58667 s=2 pgs=14513 cs=735 l=0).fault, initiating reconnect
2013-06-08 20:25:42.965068 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33133 s=2 pgs=18399 cs=5461 l=0).fault, initiating reconnect
2013-06-08 20:25:42.965542 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40210 s=2 pgs=17988 cs=4133 l=0).fault, initiating reconnect
2013-06-08 20:25:42.965540 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56253 s=2 pgs=24055 cs=5979 l=0).fault, initiating reconnect
2013-06-08 20:25:42.965601 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33258 s=2 pgs=24240 cs=7267 l=0).fault, initiating reconnect
2013-06-08 20:25:42.965614 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40122 s=2 pgs=20261 cs=3309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.965932 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58672 s=2 pgs=14514 cs=737 l=0).fault, initiating reconnect
2013-06-08 20:25:42.966120 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33140 s=2 pgs=18400 cs=5463 l=0).fault, initiating reconnect
2013-06-08 20:25:42.966438 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33263 s=2 pgs=24241 cs=7269 l=0).fault, initiating reconnect
2013-06-08 20:25:42.966541 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56259 s=2 pgs=24056 cs=5981 l=0).fault, initiating reconnect
2013-06-08 20:25:42.966546 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40216 s=2 pgs=17989 cs=4135 l=0).fault, initiating reconnect
2013-06-08 20:25:42.966617 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40129 s=2 pgs=20262 cs=3311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.966938 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58678 s=2 pgs=14515 cs=739 l=0).fault, initiating reconnect
2013-06-08 20:25:42.967100 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33146 s=2 pgs=18401 cs=5465 l=0).fault, initiating reconnect
2013-06-08 20:25:42.967249 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33267 s=2 pgs=24242 cs=7271 l=0).fault, initiating reconnect
2013-06-08 20:25:42.967363 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56265 s=2 pgs=24057 cs=5983 l=0).fault, initiating reconnect
2013-06-08 20:25:42.967526 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40135 s=2 pgs=20263 cs=3313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.967528 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40224 s=2 pgs=17990 cs=4137 l=0).fault, initiating reconnect
2013-06-08 20:25:42.967982 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33273 s=2 pgs=24243 cs=7273 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968038 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58684 s=2 pgs=14516 cs=741 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968086 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33152 s=2 pgs=18402 cs=5467 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968190 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56271 s=2 pgs=24058 cs=5985 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968528 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40140 s=2 pgs=20264 cs=3315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968660 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40231 s=2 pgs=17991 cs=4139 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968963 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33277 s=2 pgs=24244 cs=7275 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968983 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58691 s=2 pgs=14517 cs=743 l=0).fault, initiating reconnect
2013-06-08 20:25:42.968994 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33159 s=2 pgs=18403 cs=5469 l=0).fault, initiating reconnect
2013-06-08 20:25:42.969104 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56277 s=2 pgs=24059 cs=5987 l=0).fault, initiating reconnect
2013-06-08 20:25:42.969706 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40237 s=2 pgs=17992 cs=4141 l=0).fault, initiating reconnect
2013-06-08 20:25:42.969748 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33283 s=2 pgs=24245 cs=7277 l=0).fault, initiating reconnect
2013-06-08 20:25:42.969775 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33165 s=2 pgs=18404 cs=5471 l=0).fault, initiating reconnect
2013-06-08 20:25:42.969792 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58697 s=2 pgs=14518 cs=745 l=0).fault, initiating reconnect
2013-06-08 20:25:42.970090 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56283 s=2 pgs=24060 cs=5989 l=0).fault, initiating reconnect
2013-06-08 20:25:42.970399 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40146 s=2 pgs=20265 cs=3317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.970661 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33288 s=2 pgs=24246 cs=7279 l=0).fault, initiating reconnect
2013-06-08 20:25:42.970741 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33169 s=2 pgs=18405 cs=5473 l=0).fault, initiating reconnect
2013-06-08 20:25:42.970841 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :58703 s=2 pgs=14519 cs=747 l=0).fault, initiating reconnect
2013-06-08 20:25:42.970846 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :56288 s=2 pgs=24061 cs=5991 l=0).fault, initiating reconnect
2013-06-08 20:25:42.971027 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40242 s=2 pgs=17993 cs=4143 l=0).fault, initiating reconnect
2013-06-08 20:25:42.971278 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40157 s=2 pgs=20266 cs=3319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.971460 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33293 s=2 pgs=24247 cs=7281 l=0).fault, initiating reconnect
2013-06-08 20:25:42.971677 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33174 s=2 pgs=18406 cs=5475 l=0).fault, initiating reconnect
2013-06-08 20:25:42.971815 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56293 s=2 pgs=24062 cs=5993 l=0).fault, initiating reconnect
2013-06-08 20:25:42.971940 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40252 s=2 pgs=17994 cs=4145 l=0).fault, initiating reconnect
2013-06-08 20:25:42.971976 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58708 s=2 pgs=14520 cs=749 l=0).fault, initiating reconnect
2013-06-08 20:25:42.972243 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40163 s=2 pgs=20267 cs=3321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.972257 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33299 s=2 pgs=24248 cs=7283 l=0).fault, initiating reconnect
2013-06-08 20:25:42.972563 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33180 s=2 pgs=18407 cs=5477 l=0).fault, initiating reconnect
2013-06-08 20:25:42.972771 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56298 s=2 pgs=24063 cs=5995 l=0).fault, initiating reconnect
2013-06-08 20:25:42.972879 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58716 s=2 pgs=14521 cs=751 l=0).fault, initiating reconnect
2013-06-08 20:25:42.972983 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33305 s=2 pgs=24249 cs=7285 l=0).fault, initiating reconnect
2013-06-08 20:25:42.973139 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40169 s=2 pgs=20268 cs=3323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.973209 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40257 s=2 pgs=17995 cs=4147 l=0).fault, initiating reconnect
2013-06-08 20:25:42.973449 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33186 s=2 pgs=18408 cs=5479 l=0).fault, initiating reconnect
2013-06-08 20:25:42.973655 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56304 s=2 pgs=24064 cs=5997 l=0).fault, initiating reconnect
2013-06-08 20:25:42.973863 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58721 s=2 pgs=14522 cs=753 l=0).fault, initiating reconnect
2013-06-08 20:25:42.973963 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33309 s=2 pgs=24250 cs=7287 l=0).fault, initiating reconnect
2013-06-08 20:25:42.974181 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40175 s=2 pgs=20269 cs=3325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.974280 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40266 s=2 pgs=17996 cs=4149 l=0).fault, initiating reconnect
2013-06-08 20:25:42.974277 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :33192 s=2 pgs=18409 cs=5481 l=0).fault, initiating reconnect
2013-06-08 20:25:42.974506 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56310 s=2 pgs=24065 cs=5999 l=0).fault, initiating reconnect
2013-06-08 20:25:42.974776 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33315 s=2 pgs=24251 cs=7289 l=0).fault, initiating reconnect
2013-06-08 20:25:42.974856 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58727 s=2 pgs=14523 cs=755 l=0).fault, initiating reconnect
2013-06-08 20:25:42.975075 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40181 s=2 pgs=20270 cs=3327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.975133 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40273 s=2 pgs=17997 cs=4151 l=0).fault, initiating reconnect
2013-06-08 20:25:42.975298 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33197 s=2 pgs=18410 cs=5483 l=0).fault, initiating reconnect
2013-06-08 20:25:42.975339 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56316 s=2 pgs=24066 cs=6001 l=0).fault, initiating reconnect
2013-06-08 20:25:42.975624 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33320 s=2 pgs=24252 cs=7291 l=0).fault, initiating reconnect
2013-06-08 20:25:42.975870 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58734 s=2 pgs=14524 cs=757 l=0).fault, initiating reconnect
2013-06-08 20:25:42.976024 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40187 s=2 pgs=20271 cs=3329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.976201 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56322 s=2 pgs=24067 cs=6003 l=0).fault, initiating reconnect
2013-06-08 20:25:42.976235 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40278 s=2 pgs=17998 cs=4153 l=0).fault, initiating reconnect
2013-06-08 20:25:42.976249 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33204 s=2 pgs=18411 cs=5485 l=0).fault, initiating reconnect
2013-06-08 20:25:42.976517 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33326 s=2 pgs=24253 cs=7293 l=0).fault, initiating reconnect
2013-06-08 20:25:42.976854 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58740 s=2 pgs=14525 cs=759 l=0).fault, initiating reconnect
2013-06-08 20:25:42.976902 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40193 s=2 pgs=20272 cs=3331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.977198 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56326 s=2 pgs=24068 cs=6005 l=0).fault, initiating reconnect
2013-06-08 20:25:42.977270 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33211 s=2 pgs=18412 cs=5487 l=0).fault, initiating reconnect
2013-06-08 20:25:42.977410 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33332 s=2 pgs=24254 cs=7295 l=0).fault, initiating reconnect
2013-06-08 20:25:42.977440 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40285 s=2 pgs=17999 cs=4155 l=0).fault, initiating reconnect
2013-06-08 20:25:42.977846 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40199 s=2 pgs=20273 cs=3333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.977858 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58746 s=2 pgs=14526 cs=761 l=0).fault, initiating reconnect
2013-06-08 20:25:42.978168 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33216 s=2 pgs=18413 cs=5489 l=0).fault, initiating reconnect
2013-06-08 20:25:42.978186 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56332 s=2 pgs=24069 cs=6007 l=0).fault, initiating reconnect
2013-06-08 20:25:42.978255 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33337 s=2 pgs=24255 cs=7297 l=0).fault, initiating reconnect
2013-06-08 20:25:42.978811 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40204 s=2 pgs=20274 cs=3335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.978835 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58753 s=2 pgs=14527 cs=763 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979030 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33343 s=2 pgs=24256 cs=7299 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979075 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33221 s=2 pgs=18414 cs=5491 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979178 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40293 s=2 pgs=18000 cs=4157 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979213 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56339 s=2 pgs=24070 cs=6009 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979731 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40209 s=2 pgs=20275 cs=3337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979828 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58758 s=2 pgs=14528 cs=765 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979891 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33346 s=2 pgs=24257 cs=7301 l=0).fault, initiating reconnect
2013-06-08 20:25:42.979925 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33227 s=2 pgs=18415 cs=5493 l=0).fault, initiating reconnect
2013-06-08 20:25:42.980220 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40303 s=2 pgs=18001 cs=4159 l=0).fault, initiating reconnect
2013-06-08 20:25:42.980230 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56346 s=2 pgs=24071 cs=6011 l=0).fault, initiating reconnect
2013-06-08 20:25:42.980690 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40215 s=2 pgs=20276 cs=3339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.980722 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33352 s=2 pgs=24258 cs=7303 l=0).fault, initiating reconnect
2013-06-08 20:25:42.980750 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33233 s=2 pgs=18416 cs=5495 l=0).fault, initiating reconnect
2013-06-08 20:25:42.980846 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58764 s=2 pgs=14529 cs=767 l=0).fault, initiating reconnect
2013-06-08 20:25:42.981038 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56352 s=2 pgs=24072 cs=6013 l=0).fault, initiating reconnect
2013-06-08 20:25:42.981357 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40309 s=2 pgs=18002 cs=4161 l=0).fault, initiating reconnect
2013-06-08 20:25:42.981554 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33357 s=2 pgs=24259 cs=7305 l=0).fault, initiating reconnect
2013-06-08 20:25:42.981623 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33238 s=2 pgs=18417 cs=5497 l=0).fault, initiating reconnect
2013-06-08 20:25:42.981628 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40221 s=2 pgs=20277 cs=3341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.981784 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56357 s=2 pgs=24073 cs=6015 l=0).fault, initiating reconnect
2013-06-08 20:25:42.981957 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58772 s=2 pgs=14530 cs=769 l=0).fault, initiating reconnect
2013-06-08 20:25:42.982372 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33362 s=2 pgs=24260 cs=7307 l=0).fault, initiating reconnect
2013-06-08 20:25:42.982557 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33244 s=2 pgs=18418 cs=5499 l=0).fault, initiating reconnect
2013-06-08 20:25:42.982630 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56362 s=2 pgs=24074 cs=6017 l=0).fault, initiating reconnect
2013-06-08 20:25:42.982705 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40316 s=2 pgs=18003 cs=4163 l=0).fault, initiating reconnect
2013-06-08 20:25:42.982737 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40228 s=2 pgs=20278 cs=3343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.982828 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58779 s=2 pgs=14531 cs=771 l=0).fault, initiating reconnect
2013-06-08 20:25:42.983245 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56366 s=2 pgs=24075 cs=6019 l=0).fault, initiating reconnect
2013-06-08 20:25:42.983336 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33367 s=2 pgs=24261 cs=7309 l=0).fault, initiating reconnect
2013-06-08 20:25:42.983407 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33248 s=2 pgs=18419 cs=5501 l=0).fault, initiating reconnect
2013-06-08 20:25:42.983549 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40236 s=2 pgs=20279 cs=3345 l=0).fault, initiating reconnect
2013-06-08 20:25:42.983751 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40325 s=2 pgs=18004 cs=4165 l=0).fault, initiating reconnect
2013-06-08 20:25:42.983799 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58785 s=2 pgs=14532 cs=773 l=0).fault, initiating reconnect
2013-06-08 20:25:42.984011 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56370 s=2 pgs=24076 cs=6021 l=0).fault, initiating reconnect
2013-06-08 20:25:42.984095 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33374 s=2 pgs=24262 cs=7311 l=0).fault, initiating reconnect
2013-06-08 20:25:42.984276 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33255 s=2 pgs=18420 cs=5503 l=0).fault, initiating reconnect
2013-06-08 20:25:42.984483 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40241 s=2 pgs=20280 cs=3347 l=0).fault, initiating reconnect
2013-06-08 20:25:42.984872 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58791 s=2 pgs=14533 cs=775 l=0).fault, initiating reconnect
2013-06-08 20:25:42.984929 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33380 s=2 pgs=24263 cs=7313 l=0).fault, initiating reconnect
2013-06-08 20:25:42.984944 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40332 s=2 pgs=18005 cs=4167 l=0).fault, initiating reconnect
2013-06-08 20:25:42.985123 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56376 s=2 pgs=24077 cs=6023 l=0).fault, initiating reconnect
2013-06-08 20:25:42.985193 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33261 s=2 pgs=18421 cs=5505 l=0).fault, initiating reconnect
2013-06-08 20:25:42.985440 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40247 s=2 pgs=20281 cs=3349 l=0).fault, initiating reconnect
2013-06-08 20:25:42.985689 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33384 s=2 pgs=24264 cs=7315 l=0).fault, initiating reconnect
2013-06-08 20:25:42.985814 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58796 s=2 pgs=14534 cs=777 l=0).fault, initiating reconnect
2013-06-08 20:25:42.985935 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56383 s=2 pgs=24078 cs=6025 l=0).fault, initiating reconnect
2013-06-08 20:25:42.986006 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40340 s=2 pgs=18006 cs=4169 l=0).fault, initiating reconnect
2013-06-08 20:25:42.986112 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33267 s=2 pgs=18422 cs=5507 l=0).fault, initiating reconnect
2013-06-08 20:25:42.986281 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40253 s=2 pgs=20282 cs=3351 l=0).fault, initiating reconnect
2013-06-08 20:25:42.986461 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33389 s=2 pgs=24265 cs=7317 l=0).fault, initiating reconnect
2013-06-08 20:25:42.986944 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56388 s=2 pgs=24079 cs=6027 l=0).fault, initiating reconnect
2013-06-08 20:25:42.987016 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33273 s=2 pgs=18423 cs=5509 l=0).fault, initiating reconnect
2013-06-08 20:25:42.987235 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40259 s=2 pgs=20283 cs=3353 l=0).fault, initiating reconnect
2013-06-08 20:25:42.987237 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=32 :33395 s=2 pgs=24266 cs=7319 l=0).fault, initiating reconnect
2013-06-08 20:25:42.987414 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40347 s=2 pgs=18007 cs=4171 l=0).fault, initiating reconnect
2013-06-08 20:25:42.987626 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58803 s=2 pgs=14535 cs=779 l=0).fault, initiating reconnect
2013-06-08 20:25:42.987893 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33277 s=2 pgs=18424 cs=5511 l=0).fault, initiating reconnect
2013-06-08 20:25:42.988103 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33399 s=2 pgs=24267 cs=7321 l=0).fault, initiating reconnect
2013-06-08 20:25:42.988117 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40263 s=2 pgs=20284 cs=3355 l=0).fault, initiating reconnect
2013-06-08 20:25:42.988242 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56393 s=2 pgs=24080 cs=6029 l=0).fault, initiating reconnect
2013-06-08 20:25:42.988639 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40355 s=2 pgs=18008 cs=4173 l=0).fault, initiating reconnect
2013-06-08 20:25:42.988783 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33282 s=2 pgs=18425 cs=5513 l=0).fault, initiating reconnect
2013-06-08 20:25:42.988815 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58814 s=2 pgs=14536 cs=781 l=0).fault, initiating reconnect
2013-06-08 20:25:42.988884 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40269 s=2 pgs=20285 cs=3357 l=0).fault, initiating reconnect
2013-06-08 20:25:42.989055 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33403 s=2 pgs=24268 cs=7323 l=0).fault, initiating reconnect
2013-06-08 20:25:42.989065 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56402 s=2 pgs=24081 cs=6031 l=0).fault, initiating reconnect
2013-06-08 20:25:42.989718 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33287 s=2 pgs=18426 cs=5515 l=0).fault, initiating reconnect
2013-06-08 20:25:42.989792 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40274 s=2 pgs=20286 cs=3359 l=0).fault, initiating reconnect
2013-06-08 20:25:42.989972 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :56408 s=2 pgs=24082 cs=6033 l=0).fault, initiating reconnect
2013-06-08 20:25:42.989970 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :40361 s=2 pgs=18009 cs=4175 l=0).fault, initiating reconnect
2013-06-08 20:25:42.989990 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33410 s=2 pgs=24269 cs=7325 l=0).fault, initiating reconnect
2013-06-08 20:25:42.990059 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58821 s=2 pgs=14537 cs=783 l=0).fault, initiating reconnect
2013-06-08 20:25:42.990733 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33292 s=2 pgs=18427 cs=5517 l=0).fault, initiating reconnect
2013-06-08 20:25:42.990750 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40278 s=2 pgs=20287 cs=3361 l=0).fault, initiating reconnect
2013-06-08 20:25:42.990915 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56411 s=2 pgs=24083 cs=6035 l=0).fault, initiating reconnect
2013-06-08 20:25:42.990939 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33416 s=2 pgs=24270 cs=7327 l=0).fault, initiating reconnect
2013-06-08 20:25:42.991160 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58830 s=2 pgs=14538 cs=785 l=0).fault, initiating reconnect
2013-06-08 20:25:42.991285 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40370 s=2 pgs=18010 cs=4177 l=0).fault, initiating reconnect
2013-06-08 20:25:42.991492 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40284 s=2 pgs=20288 cs=3363 l=0).fault, initiating reconnect
2013-06-08 20:25:42.991520 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :33298 s=2 pgs=18428 cs=5519 l=0).fault, initiating reconnect
2013-06-08 20:25:42.991689 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33421 s=2 pgs=24271 cs=7329 l=0).fault, initiating reconnect
2013-06-08 20:25:42.991794 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56417 s=2 pgs=24084 cs=6037 l=0).fault, initiating reconnect
2013-06-08 20:25:42.992200 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58835 s=2 pgs=14539 cs=787 l=0).fault, initiating reconnect
2013-06-08 20:25:42.992510 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40290 s=2 pgs=20289 cs=3365 l=0).fault, initiating reconnect
2013-06-08 20:25:42.992622 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56424 s=2 pgs=24085 cs=6039 l=0).fault, initiating reconnect
2013-06-08 20:25:42.992649 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40378 s=2 pgs=18011 cs=4179 l=0).fault, initiating reconnect
2013-06-08 20:25:42.993150 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58841 s=2 pgs=14540 cs=789 l=0).fault, initiating reconnect
2013-06-08 20:25:42.993456 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33426 s=2 pgs=24272 cs=7331 l=0).fault, initiating reconnect
2013-06-08 20:25:42.993603 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33304 s=2 pgs=18429 cs=5521 l=0).fault, initiating reconnect
2013-06-08 20:25:42.993617 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56427 s=2 pgs=24086 cs=6041 l=0).fault, initiating reconnect
2013-06-08 20:25:42.993756 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40294 s=2 pgs=20290 cs=3367 l=0).fault, initiating reconnect
2013-06-08 20:25:42.993776 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40386 s=2 pgs=18012 cs=4181 l=0).fault, initiating reconnect
2013-06-08 20:25:42.994118 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58845 s=2 pgs=14541 cs=791 l=0).fault, initiating reconnect
2013-06-08 20:25:42.994564 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56432 s=2 pgs=24087 cs=6043 l=0).fault, initiating reconnect
2013-06-08 20:25:42.994769 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40301 s=2 pgs=20291 cs=3369 l=0).fault, initiating reconnect
2013-06-08 20:25:42.995139 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40392 s=2 pgs=18013 cs=4183 l=0).fault, initiating reconnect
2013-06-08 20:25:42.995173 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58851 s=2 pgs=14542 cs=793 l=0).fault, initiating reconnect
2013-06-08 20:25:42.995263 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33433 s=2 pgs=24273 cs=7333 l=0).fault, initiating reconnect
2013-06-08 20:25:42.995399 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56436 s=2 pgs=24088 cs=6045 l=0).fault, initiating reconnect
2013-06-08 20:25:42.995626 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33314 s=2 pgs=18430 cs=5523 l=0).fault, initiating reconnect
2013-06-08 20:25:42.995823 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40305 s=2 pgs=20292 cs=3371 l=0).fault, initiating reconnect
2013-06-08 20:25:42.996062 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58854 s=2 pgs=14543 cs=795 l=0).fault, initiating reconnect
2013-06-08 20:25:42.996083 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33443 s=2 pgs=24274 cs=7335 l=0).fault, initiating reconnect
2013-06-08 20:25:42.996327 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40397 s=2 pgs=18014 cs=4185 l=0).fault, initiating reconnect
2013-06-08 20:25:42.996442 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56441 s=2 pgs=24089 cs=6047 l=0).fault, initiating reconnect
2013-06-08 20:25:42.996508 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33325 s=2 pgs=18431 cs=5525 l=0).fault, initiating reconnect
2013-06-08 20:25:42.996775 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40311 s=2 pgs=20293 cs=3373 l=0).fault, initiating reconnect
2013-06-08 20:25:42.996919 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33448 s=2 pgs=24275 cs=7337 l=0).fault, initiating reconnect
2013-06-08 20:25:42.997089 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58860 s=2 pgs=14544 cs=797 l=0).fault, initiating reconnect
2013-06-08 20:25:42.997334 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56447 s=2 pgs=24090 cs=6049 l=0).fault, initiating reconnect
2013-06-08 20:25:42.997480 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40404 s=2 pgs=18015 cs=4187 l=0).fault, initiating reconnect
2013-06-08 20:25:42.997595 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33331 s=2 pgs=18432 cs=5527 l=0).fault, initiating reconnect
2013-06-08 20:25:42.997609 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40317 s=2 pgs=20294 cs=3375 l=0).fault, initiating reconnect
2013-06-08 20:25:42.997780 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33453 s=2 pgs=24276 cs=7339 l=0).fault, initiating reconnect
2013-06-08 20:25:42.998074 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58867 s=2 pgs=14545 cs=799 l=0).fault, initiating reconnect
2013-06-08 20:25:42.998199 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56452 s=2 pgs=24091 cs=6051 l=0).fault, initiating reconnect
2013-06-08 20:25:42.998497 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33337 s=2 pgs=18433 cs=5529 l=0).fault, initiating reconnect
2013-06-08 20:25:42.998566 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40323 s=2 pgs=20295 cs=3377 l=0).fault, initiating reconnect
2013-06-08 20:25:42.998599 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33459 s=2 pgs=24277 cs=7341 l=0).fault, initiating reconnect
2013-06-08 20:25:42.998735 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40411 s=2 pgs=18016 cs=4189 l=0).fault, initiating reconnect
2013-06-08 20:25:42.999137 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58873 s=2 pgs=14546 cs=801 l=0).fault, initiating reconnect
2013-06-08 20:25:42.999289 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56458 s=2 pgs=24092 cs=6053 l=0).fault, initiating reconnect
2013-06-08 20:25:42.999361 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33342 s=2 pgs=18434 cs=5531 l=0).fault, initiating reconnect
2013-06-08 20:25:42.999533 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33464 s=2 pgs=24278 cs=7343 l=0).fault, initiating reconnect
2013-06-08 20:25:42.999539 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40328 s=2 pgs=20296 cs=3379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.000125 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40420 s=2 pgs=18017 cs=4191 l=0).fault, initiating reconnect
2013-06-08 20:25:43.000185 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56464 s=2 pgs=24093 cs=6055 l=0).fault, initiating reconnect
2013-06-08 20:25:43.000242 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33348 s=2 pgs=18435 cs=5533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.000292 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58879 s=2 pgs=14547 cs=803 l=0).fault, initiating reconnect
2013-06-08 20:25:43.000479 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40335 s=2 pgs=20297 cs=3381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.000528 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33469 s=2 pgs=24279 cs=7345 l=0).fault, initiating reconnect
2013-06-08 20:25:43.001055 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56469 s=2 pgs=24094 cs=6057 l=0).fault, initiating reconnect
2013-06-08 20:25:43.001284 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40340 s=2 pgs=20298 cs=3383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.001294 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40426 s=2 pgs=18018 cs=4193 l=0).fault, initiating reconnect
2013-06-08 20:25:43.001296 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33353 s=2 pgs=18436 cs=5535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.001307 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :58887 s=2 pgs=14548 cs=805 l=0).fault, initiating reconnect
2013-06-08 20:25:43.001353 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33476 s=2 pgs=24280 cs=7347 l=0).fault, initiating reconnect
2013-06-08 20:25:43.002049 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56474 s=2 pgs=24095 cs=6059 l=0).fault, initiating reconnect
2013-06-08 20:25:43.002259 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40343 s=2 pgs=20299 cs=3385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.002288 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33359 s=2 pgs=18437 cs=5537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.002562 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58894 s=2 pgs=14549 cs=807 l=0).fault, initiating reconnect
2013-06-08 20:25:43.002622 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40435 s=2 pgs=18019 cs=4195 l=0).fault, initiating reconnect
2013-06-08 20:25:43.003049 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56480 s=2 pgs=24096 cs=6061 l=0).fault, initiating reconnect
2013-06-08 20:25:43.003186 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40349 s=2 pgs=20300 cs=3387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.003214 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33365 s=2 pgs=18438 cs=5539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.003449 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33482 s=2 pgs=24281 cs=7349 l=0).fault, initiating reconnect
2013-06-08 20:25:43.003615 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58899 s=2 pgs=14550 cs=809 l=0).fault, initiating reconnect
2013-06-08 20:25:43.003763 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40442 s=2 pgs=18020 cs=4197 l=0).fault, initiating reconnect
2013-06-08 20:25:43.003829 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56485 s=2 pgs=24097 cs=6063 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004167 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33491 s=2 pgs=24282 cs=7351 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004176 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40354 s=2 pgs=20301 cs=3389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004216 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33370 s=2 pgs=18439 cs=5541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004559 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58905 s=2 pgs=14551 cs=811 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004787 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40448 s=2 pgs=18021 cs=4199 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004875 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56491 s=2 pgs=24098 cs=6065 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004976 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40360 s=2 pgs=20302 cs=3391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.004985 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33496 s=2 pgs=24283 cs=7353 l=0).fault, initiating reconnect
2013-06-08 20:25:43.005114 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33377 s=2 pgs=18440 cs=5543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.005586 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58911 s=2 pgs=14552 cs=813 l=0).fault, initiating reconnect
2013-06-08 20:25:43.005678 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33502 s=2 pgs=24284 cs=7355 l=0).fault, initiating reconnect
2013-06-08 20:25:43.005757 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56497 s=2 pgs=24099 cs=6067 l=0).fault, initiating reconnect
2013-06-08 20:25:43.005866 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40366 s=2 pgs=20303 cs=3393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.005925 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40454 s=2 pgs=18022 cs=4201 l=0).fault, initiating reconnect
2013-06-08 20:25:43.006101 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33383 s=2 pgs=18441 cs=5545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.006506 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33505 s=2 pgs=24285 cs=7357 l=0).fault, initiating reconnect
2013-06-08 20:25:43.006622 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56503 s=2 pgs=24100 cs=6069 l=0).fault, initiating reconnect
2013-06-08 20:25:43.006633 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58917 s=2 pgs=14553 cs=815 l=0).fault, initiating reconnect
2013-06-08 20:25:43.006806 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40372 s=2 pgs=20304 cs=3395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.007030 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40463 s=2 pgs=18023 cs=4203 l=0).fault, initiating reconnect
2013-06-08 20:25:43.007061 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33389 s=2 pgs=18442 cs=5547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.007281 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33510 s=2 pgs=24286 cs=7359 l=0).fault, initiating reconnect
2013-06-08 20:25:43.007610 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56508 s=2 pgs=24101 cs=6071 l=0).fault, initiating reconnect
2013-06-08 20:25:43.007642 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58925 s=2 pgs=14554 cs=817 l=0).fault, initiating reconnect
2013-06-08 20:25:43.007775 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40378 s=2 pgs=20305 cs=3397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.008002 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33395 s=2 pgs=18443 cs=5549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.008221 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33516 s=2 pgs=24287 cs=7361 l=0).fault, initiating reconnect
2013-06-08 20:25:43.008252 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40469 s=2 pgs=18024 cs=4205 l=0).fault, initiating reconnect
2013-06-08 20:25:43.008452 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56514 s=2 pgs=24102 cs=6073 l=0).fault, initiating reconnect
2013-06-08 20:25:43.008653 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58931 s=2 pgs=14555 cs=819 l=0).fault, initiating reconnect
2013-06-08 20:25:43.008766 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40384 s=2 pgs=20306 cs=3399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.008832 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33400 s=2 pgs=18444 cs=5551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.009057 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33521 s=2 pgs=24288 cs=7363 l=0).fault, initiating reconnect
2013-06-08 20:25:43.009390 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56520 s=2 pgs=24103 cs=6075 l=0).fault, initiating reconnect
2013-06-08 20:25:43.009445 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40477 s=2 pgs=18025 cs=4207 l=0).fault, initiating reconnect
2013-06-08 20:25:43.009563 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58937 s=2 pgs=14556 cs=821 l=0).fault, initiating reconnect
2013-06-08 20:25:43.009589 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40390 s=2 pgs=20307 cs=3401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.009667 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33406 s=2 pgs=18445 cs=5553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.009865 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33527 s=2 pgs=24289 cs=7365 l=0).fault, initiating reconnect
2013-06-08 20:25:43.010305 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56525 s=2 pgs=24104 cs=6077 l=0).fault, initiating reconnect
2013-06-08 20:25:43.010403 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40484 s=2 pgs=18026 cs=4209 l=0).fault, initiating reconnect
2013-06-08 20:25:43.010465 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33412 s=2 pgs=18446 cs=5555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.010615 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58943 s=2 pgs=14557 cs=823 l=0).fault, initiating reconnect
2013-06-08 20:25:43.010678 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33533 s=2 pgs=24290 cs=7367 l=0).fault, initiating reconnect
2013-06-08 20:25:43.010692 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :40396 s=2 pgs=20308 cs=3403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.011292 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56531 s=2 pgs=24105 cs=6079 l=0).fault, initiating reconnect
2013-06-08 20:25:43.011402 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33416 s=2 pgs=18447 cs=5557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.011500 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40490 s=2 pgs=18027 cs=4211 l=0).fault, initiating reconnect
2013-06-08 20:25:43.011626 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40404 s=2 pgs=20309 cs=3405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.011679 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58950 s=2 pgs=14558 cs=825 l=0).fault, initiating reconnect
2013-06-08 20:25:43.012233 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56537 s=2 pgs=24106 cs=6081 l=0).fault, initiating reconnect
2013-06-08 20:25:43.012374 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33538 s=2 pgs=24291 cs=7369 l=0).fault, initiating reconnect
2013-06-08 20:25:43.012402 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33421 s=2 pgs=18448 cs=5559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.012583 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58957 s=2 pgs=14559 cs=827 l=0).fault, initiating reconnect
2013-06-08 20:25:43.012617 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40408 s=2 pgs=20310 cs=3407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.012650 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40497 s=2 pgs=18028 cs=4213 l=0).fault, initiating reconnect
2013-06-08 20:25:43.013146 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33545 s=2 pgs=24292 cs=7371 l=0).fault, initiating reconnect
2013-06-08 20:25:43.013359 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56544 s=2 pgs=24107 cs=6083 l=0).fault, initiating reconnect
2013-06-08 20:25:43.013503 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40414 s=2 pgs=20311 cs=3409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.013554 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33426 s=2 pgs=18449 cs=5561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.013579 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58961 s=2 pgs=14560 cs=829 l=0).fault, initiating reconnect
2013-06-08 20:25:43.013921 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40505 s=2 pgs=18029 cs=4215 l=0).fault, initiating reconnect
2013-06-08 20:25:43.013985 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33551 s=2 pgs=24293 cs=7373 l=0).fault, initiating reconnect
2013-06-08 20:25:43.014190 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56549 s=2 pgs=24108 cs=6085 l=0).fault, initiating reconnect
2013-06-08 20:25:43.014446 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33434 s=2 pgs=18450 cs=5563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.014498 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40418 s=2 pgs=20312 cs=3411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.014663 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58968 s=2 pgs=14561 cs=831 l=0).fault, initiating reconnect
2013-06-08 20:25:43.014791 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33557 s=2 pgs=24294 cs=7375 l=0).fault, initiating reconnect
2013-06-08 20:25:43.014992 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40511 s=2 pgs=18030 cs=4217 l=0).fault, initiating reconnect
2013-06-08 20:25:43.015168 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56555 s=2 pgs=24109 cs=6087 l=0).fault, initiating reconnect
2013-06-08 20:25:43.015298 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40425 s=2 pgs=20313 cs=3413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.015370 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33439 s=2 pgs=18451 cs=5565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.015643 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58974 s=2 pgs=14562 cs=833 l=0).fault, initiating reconnect
2013-06-08 20:25:43.015679 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33562 s=2 pgs=24295 cs=7377 l=0).fault, initiating reconnect
2013-06-08 20:25:43.015899 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40518 s=2 pgs=18031 cs=4219 l=0).fault, initiating reconnect
2013-06-08 20:25:43.016045 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56561 s=2 pgs=24110 cs=6089 l=0).fault, initiating reconnect
2013-06-08 20:25:43.016127 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40430 s=2 pgs=20314 cs=3415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.016351 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33446 s=2 pgs=18452 cs=5567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.016380 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33567 s=2 pgs=24296 cs=7379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.016651 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58981 s=2 pgs=14563 cs=835 l=0).fault, initiating reconnect
2013-06-08 20:25:43.016874 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56567 s=2 pgs=24111 cs=6091 l=0).fault, initiating reconnect
2013-06-08 20:25:43.017057 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40436 s=2 pgs=20315 cs=3417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.017079 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40524 s=2 pgs=18032 cs=4221 l=0).fault, initiating reconnect
2013-06-08 20:25:43.017251 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33573 s=2 pgs=24297 cs=7381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.017283 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33452 s=2 pgs=18453 cs=5569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.017703 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56572 s=2 pgs=24112 cs=6093 l=0).fault, initiating reconnect
2013-06-08 20:25:43.017726 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58987 s=2 pgs=14564 cs=837 l=0).fault, initiating reconnect
2013-06-08 20:25:43.018079 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33578 s=2 pgs=24298 cs=7383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.018154 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40441 s=2 pgs=20316 cs=3419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.018169 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33459 s=2 pgs=18454 cs=5571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.018166 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40532 s=2 pgs=18033 cs=4223 l=0).fault, initiating reconnect
2013-06-08 20:25:43.018588 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58993 s=2 pgs=14565 cs=839 l=0).fault, initiating reconnect
2013-06-08 20:25:43.018631 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56578 s=2 pgs=24113 cs=6095 l=0).fault, initiating reconnect
2013-06-08 20:25:43.018842 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33582 s=2 pgs=24299 cs=7385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.019121 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33465 s=2 pgs=18455 cs=5573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.019191 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40448 s=2 pgs=20317 cs=3421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.019303 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40539 s=2 pgs=18034 cs=4225 l=0).fault, initiating reconnect
2013-06-08 20:25:43.019529 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56584 s=2 pgs=24114 cs=6097 l=0).fault, initiating reconnect
2013-06-08 20:25:43.019751 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33588 s=2 pgs=24300 cs=7387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.019758 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :58999 s=2 pgs=14566 cs=841 l=0).fault, initiating reconnect
2013-06-08 20:25:43.020033 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40455 s=2 pgs=20318 cs=3423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.020154 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33469 s=2 pgs=18456 cs=5575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.020516 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56589 s=2 pgs=24115 cs=6099 l=0).fault, initiating reconnect
2013-06-08 20:25:43.020646 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59007 s=2 pgs=14567 cs=843 l=0).fault, initiating reconnect
2013-06-08 20:25:43.020708 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40546 s=2 pgs=18035 cs=4227 l=0).fault, initiating reconnect
2013-06-08 20:25:43.020935 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40460 s=2 pgs=20319 cs=3425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.020997 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33476 s=2 pgs=18457 cs=5577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.021508 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :33593 s=2 pgs=24301 cs=7389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.021531 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56594 s=2 pgs=24116 cs=6101 l=0).fault, initiating reconnect
2013-06-08 20:25:43.021719 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59011 s=2 pgs=14568 cs=845 l=0).fault, initiating reconnect
2013-06-08 20:25:43.021730 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40465 s=2 pgs=20320 cs=3427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.021746 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33481 s=2 pgs=18458 cs=5579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.022364 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :33602 s=2 pgs=24302 cs=7391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.022367 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40553 s=2 pgs=18036 cs=4229 l=0).fault, initiating reconnect
2013-06-08 20:25:43.022412 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33485 s=2 pgs=18459 cs=5581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.022433 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56600 s=2 pgs=24117 cs=6103 l=0).fault, initiating reconnect
2013-06-08 20:25:43.022501 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40471 s=2 pgs=20321 cs=3429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.022870 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59017 s=2 pgs=14569 cs=847 l=0).fault, initiating reconnect
2013-06-08 20:25:43.023254 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :33607 s=2 pgs=24303 cs=7393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.023285 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33489 s=2 pgs=18460 cs=5583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.023287 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40476 s=2 pgs=20322 cs=3431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.023523 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56607 s=2 pgs=24118 cs=6105 l=0).fault, initiating reconnect
2013-06-08 20:25:43.023629 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40563 s=2 pgs=18037 cs=4231 l=0).fault, initiating reconnect
2013-06-08 20:25:43.023886 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59025 s=2 pgs=14570 cs=849 l=0).fault, initiating reconnect
2013-06-08 20:25:43.024033 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40479 s=2 pgs=20323 cs=3433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.024161 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :33613 s=2 pgs=24304 cs=7395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.024163 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33495 s=2 pgs=18461 cs=5585 l=0).fault, initiating reconnect
2013-06-08 20:25:43.024485 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56613 s=2 pgs=24119 cs=6107 l=0).fault, initiating reconnect
2013-06-08 20:25:43.024723 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40484 s=2 pgs=20324 cs=3435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.024837 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59031 s=2 pgs=14571 cs=851 l=0).fault, initiating reconnect
2013-06-08 20:25:43.025027 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33620 s=2 pgs=24305 cs=7397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.025193 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40572 s=2 pgs=18038 cs=4233 l=0).fault, initiating reconnect
2013-06-08 20:25:43.025231 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33501 s=2 pgs=18462 cs=5587 l=0).fault, initiating reconnect
2013-06-08 20:25:43.025328 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56619 s=2 pgs=24120 cs=6109 l=0).fault, initiating reconnect
2013-06-08 20:25:43.025435 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40488 s=2 pgs=20325 cs=3437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.025793 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59037 s=2 pgs=14572 cs=853 l=0).fault, initiating reconnect
2013-06-08 20:25:43.025869 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33625 s=2 pgs=24306 cs=7399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.026037 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56625 s=2 pgs=24121 cs=6111 l=0).fault, initiating reconnect
2013-06-08 20:25:43.026259 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33507 s=2 pgs=18463 cs=5589 l=0).fault, initiating reconnect
2013-06-08 20:25:43.026397 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40494 s=2 pgs=20326 cs=3439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.026507 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40581 s=2 pgs=18039 cs=4235 l=0).fault, initiating reconnect
2013-06-08 20:25:43.026537 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59043 s=2 pgs=14573 cs=855 l=0).fault, initiating reconnect
2013-06-08 20:25:43.026859 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33631 s=2 pgs=24307 cs=7401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.026910 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56629 s=2 pgs=24122 cs=6113 l=0).fault, initiating reconnect
2013-06-08 20:25:43.027228 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40499 s=2 pgs=20327 cs=3441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.027309 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33513 s=2 pgs=18464 cs=5591 l=0).fault, initiating reconnect
2013-06-08 20:25:43.027411 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59049 s=2 pgs=14574 cs=857 l=0).fault, initiating reconnect
2013-06-08 20:25:43.027569 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40590 s=2 pgs=18040 cs=4237 l=0).fault, initiating reconnect
2013-06-08 20:25:43.027741 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33637 s=2 pgs=24308 cs=7403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.027875 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56635 s=2 pgs=24123 cs=6115 l=0).fault, initiating reconnect
2013-06-08 20:25:43.027983 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40504 s=2 pgs=20328 cs=3443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.028216 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33520 s=2 pgs=18465 cs=5593 l=0).fault, initiating reconnect
2013-06-08 20:25:43.028296 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59054 s=2 pgs=14575 cs=859 l=0).fault, initiating reconnect
2013-06-08 20:25:43.028557 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :33643 s=2 pgs=24309 cs=7405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.028568 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40597 s=2 pgs=18041 cs=4239 l=0).fault, initiating reconnect
2013-06-08 20:25:43.028894 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40510 s=2 pgs=20329 cs=3445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.028925 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56641 s=2 pgs=24124 cs=6117 l=0).fault, initiating reconnect
2013-06-08 20:25:43.029059 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33526 s=2 pgs=18466 cs=5595 l=0).fault, initiating reconnect
2013-06-08 20:25:43.029476 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59060 s=2 pgs=14576 cs=861 l=0).fault, initiating reconnect
2013-06-08 20:25:43.029490 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33648 s=2 pgs=24310 cs=7407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.029561 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40604 s=2 pgs=18042 cs=4241 l=0).fault, initiating reconnect
2013-06-08 20:25:43.029710 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40515 s=2 pgs=20330 cs=3447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.029850 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56648 s=2 pgs=24125 cs=6119 l=0).fault, initiating reconnect
2013-06-08 20:25:43.030077 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33532 s=2 pgs=18467 cs=5597 l=0).fault, initiating reconnect
2013-06-08 20:25:43.030414 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59066 s=2 pgs=14577 cs=863 l=0).fault, initiating reconnect
2013-06-08 20:25:43.030434 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33654 s=2 pgs=24311 cs=7409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.030525 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40521 s=2 pgs=20331 cs=3449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.030566 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40610 s=2 pgs=18043 cs=4243 l=0).fault, initiating reconnect
2013-06-08 20:25:43.030891 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :56654 s=2 pgs=24126 cs=6121 l=0).fault, initiating reconnect
2013-06-08 20:25:43.030900 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33538 s=2 pgs=18468 cs=5599 l=0).fault, initiating reconnect
2013-06-08 20:25:43.031243 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33660 s=2 pgs=24312 cs=7411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.031383 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40526 s=2 pgs=20332 cs=3451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.031526 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59072 s=2 pgs=14578 cs=865 l=0).fault, initiating reconnect
2013-06-08 20:25:43.031639 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40617 s=2 pgs=18044 cs=4245 l=0).fault, initiating reconnect
2013-06-08 20:25:43.031805 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33544 s=2 pgs=18469 cs=5601 l=0).fault, initiating reconnect
2013-06-08 20:25:43.031966 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56660 s=2 pgs=24127 cs=6123 l=0).fault, initiating reconnect
2013-06-08 20:25:43.032013 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33665 s=2 pgs=24313 cs=7413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.032199 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40531 s=2 pgs=20333 cs=3453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.032600 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33549 s=2 pgs=18470 cs=5603 l=0).fault, initiating reconnect
2013-06-08 20:25:43.032663 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59080 s=2 pgs=14579 cs=867 l=0).fault, initiating reconnect
2013-06-08 20:25:43.032772 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33671 s=2 pgs=24314 cs=7415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.032823 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56667 s=2 pgs=24128 cs=6125 l=0).fault, initiating reconnect
2013-06-08 20:25:43.032826 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40623 s=2 pgs=18045 cs=4247 l=0).fault, initiating reconnect
2013-06-08 20:25:43.033025 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40537 s=2 pgs=20334 cs=3455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.033327 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33553 s=2 pgs=18471 cs=5605 l=0).fault, initiating reconnect
2013-06-08 20:25:43.033575 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33675 s=2 pgs=24315 cs=7417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.033695 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56674 s=2 pgs=24129 cs=6127 l=0).fault, initiating reconnect
2013-06-08 20:25:43.033793 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59087 s=2 pgs=14580 cs=869 l=0).fault, initiating reconnect
2013-06-08 20:25:43.033921 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40543 s=2 pgs=20335 cs=3457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.033971 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :40631 s=2 pgs=18046 cs=4249 l=0).fault, initiating reconnect
2013-06-08 20:25:43.034027 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :33559 s=2 pgs=18472 cs=5607 l=0).fault, initiating reconnect
2013-06-08 20:25:43.034335 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33680 s=2 pgs=24316 cs=7419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.034701 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56678 s=2 pgs=24130 cs=6129 l=0).fault, initiating reconnect
2013-06-08 20:25:43.034721 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40548 s=2 pgs=20336 cs=3459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.034740 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59095 s=2 pgs=14581 cs=871 l=0).fault, initiating reconnect
2013-06-08 20:25:43.034873 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33564 s=2 pgs=18473 cs=5609 l=0).fault, initiating reconnect
2013-06-08 20:25:43.035195 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40640 s=2 pgs=18047 cs=4251 l=0).fault, initiating reconnect
2013-06-08 20:25:43.035216 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33686 s=2 pgs=24317 cs=7421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.035601 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59102 s=2 pgs=14582 cs=873 l=0).fault, initiating reconnect
2013-06-08 20:25:43.035646 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40553 s=2 pgs=20337 cs=3461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.035733 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33570 s=2 pgs=18474 cs=5611 l=0).fault, initiating reconnect
2013-06-08 20:25:43.036191 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56684 s=2 pgs=24131 cs=6131 l=0).fault, initiating reconnect
2013-06-08 20:25:43.036623 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40646 s=2 pgs=18048 cs=4253 l=0).fault, initiating reconnect
2013-06-08 20:25:43.036644 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59106 s=2 pgs=14583 cs=875 l=0).fault, initiating reconnect
2013-06-08 20:25:43.036709 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33692 s=2 pgs=24318 cs=7423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.036972 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40559 s=2 pgs=20338 cs=3463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.036993 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33575 s=2 pgs=18475 cs=5613 l=0).fault, initiating reconnect
2013-06-08 20:25:43.037063 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56693 s=2 pgs=24132 cs=6133 l=0).fault, initiating reconnect
2013-06-08 20:25:43.037670 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59111 s=2 pgs=14584 cs=877 l=0).fault, initiating reconnect
2013-06-08 20:25:43.037799 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40652 s=2 pgs=18049 cs=4255 l=0).fault, initiating reconnect
2013-06-08 20:25:43.037806 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40565 s=2 pgs=20339 cs=3465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.037902 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33581 s=2 pgs=18476 cs=5615 l=0).fault, initiating reconnect
2013-06-08 20:25:43.037896 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56699 s=2 pgs=24133 cs=6135 l=0).fault, initiating reconnect
2013-06-08 20:25:43.038476 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40570 s=2 pgs=20340 cs=3467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.038612 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33699 s=2 pgs=24319 cs=7425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.038640 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59116 s=2 pgs=14585 cs=879 l=0).fault, initiating reconnect
2013-06-08 20:25:43.038696 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33586 s=2 pgs=18477 cs=5617 l=0).fault, initiating reconnect
2013-06-08 20:25:43.038869 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40659 s=2 pgs=18050 cs=4257 l=0).fault, initiating reconnect
2013-06-08 20:25:43.038907 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56704 s=2 pgs=24134 cs=6137 l=0).fault, initiating reconnect
2013-06-08 20:25:43.039353 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33709 s=2 pgs=24320 cs=7427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.039411 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33591 s=2 pgs=18478 cs=5619 l=0).fault, initiating reconnect
2013-06-08 20:25:43.039448 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40573 s=2 pgs=20341 cs=3469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.039919 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40667 s=2 pgs=18051 cs=4259 l=0).fault, initiating reconnect
2013-06-08 20:25:43.039968 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56710 s=2 pgs=24135 cs=6139 l=0).fault, initiating reconnect
2013-06-08 20:25:43.040027 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59123 s=2 pgs=14586 cs=881 l=0).fault, initiating reconnect
2013-06-08 20:25:43.040149 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33714 s=2 pgs=24321 cs=7429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.040174 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33595 s=2 pgs=18479 cs=5621 l=0).fault, initiating reconnect
2013-06-08 20:25:43.040302 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40581 s=2 pgs=20342 cs=3471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.040900 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56715 s=2 pgs=24136 cs=6141 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041000 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40587 s=2 pgs=20343 cs=3473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041019 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33601 s=2 pgs=18480 cs=5623 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041037 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33720 s=2 pgs=24322 cs=7431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041123 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40672 s=2 pgs=18052 cs=4261 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041137 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59132 s=2 pgs=14587 cs=883 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041900 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33726 s=2 pgs=24323 cs=7433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041909 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56720 s=2 pgs=24137 cs=6143 l=0).fault, initiating reconnect
2013-06-08 20:25:43.041919 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40589 s=2 pgs=20344 cs=3475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.042102 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33605 s=2 pgs=18481 cs=5625 l=0).fault, initiating reconnect
2013-06-08 20:25:43.042288 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40682 s=2 pgs=18053 cs=4263 l=0).fault, initiating reconnect
2013-06-08 20:25:43.042294 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59141 s=2 pgs=14588 cs=885 l=0).fault, initiating reconnect
2013-06-08 20:25:43.042696 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56727 s=2 pgs=24138 cs=6145 l=0).fault, initiating reconnect
2013-06-08 20:25:43.042788 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40596 s=2 pgs=20345 cs=3477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.042821 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33729 s=2 pgs=24324 cs=7435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.043141 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33612 s=2 pgs=18482 cs=5627 l=0).fault, initiating reconnect
2013-06-08 20:25:43.043252 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59147 s=2 pgs=14589 cs=887 l=0).fault, initiating reconnect
2013-06-08 20:25:43.043388 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40688 s=2 pgs=18054 cs=4265 l=0).fault, initiating reconnect
2013-06-08 20:25:43.043532 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56732 s=2 pgs=24139 cs=6147 l=0).fault, initiating reconnect
2013-06-08 20:25:43.043542 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33737 s=2 pgs=24325 cs=7437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.043694 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40601 s=2 pgs=20346 cs=3479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.044023 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33618 s=2 pgs=18483 cs=5629 l=0).fault, initiating reconnect
2013-06-08 20:25:43.044320 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59152 s=2 pgs=14590 cs=889 l=0).fault, initiating reconnect
2013-06-08 20:25:43.044356 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56738 s=2 pgs=24140 cs=6149 l=0).fault, initiating reconnect
2013-06-08 20:25:43.044357 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33742 s=2 pgs=24326 cs=7439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.044540 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40608 s=2 pgs=20347 cs=3481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.044639 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40695 s=2 pgs=18055 cs=4267 l=0).fault, initiating reconnect
2013-06-08 20:25:43.044791 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33624 s=2 pgs=18484 cs=5631 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045084 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33747 s=2 pgs=24327 cs=7441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045136 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56743 s=2 pgs=24141 cs=6151 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045188 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59158 s=2 pgs=14591 cs=891 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045497 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40613 s=2 pgs=20348 cs=3483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045618 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33630 s=2 pgs=18485 cs=5633 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045771 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40704 s=2 pgs=18056 cs=4269 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045883 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33751 s=2 pgs=24328 cs=7443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.045975 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56749 s=2 pgs=24142 cs=6153 l=0).fault, initiating reconnect
2013-06-08 20:25:43.046096 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59166 s=2 pgs=14592 cs=893 l=0).fault, initiating reconnect
2013-06-08 20:25:43.046343 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40619 s=2 pgs=20349 cs=3485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.046513 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33635 s=2 pgs=18486 cs=5635 l=0).fault, initiating reconnect
2013-06-08 20:25:43.046810 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33757 s=2 pgs=24329 cs=7445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.046845 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56755 s=2 pgs=24143 cs=6155 l=0).fault, initiating reconnect
2013-06-08 20:25:43.046867 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40711 s=2 pgs=18057 cs=4271 l=0).fault, initiating reconnect
2013-06-08 20:25:43.047090 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59172 s=2 pgs=14593 cs=895 l=0).fault, initiating reconnect
2013-06-08 20:25:43.047151 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40625 s=2 pgs=20350 cs=3487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.047450 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33641 s=2 pgs=18487 cs=5637 l=0).fault, initiating reconnect
2013-06-08 20:25:43.047513 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33762 s=2 pgs=24330 cs=7447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.047852 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56760 s=2 pgs=24144 cs=6157 l=0).fault, initiating reconnect
2013-06-08 20:25:43.047976 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40719 s=2 pgs=18058 cs=4273 l=0).fault, initiating reconnect
2013-06-08 20:25:43.048153 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59178 s=2 pgs=14594 cs=897 l=0).fault, initiating reconnect
2013-06-08 20:25:43.048163 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40631 s=2 pgs=20351 cs=3489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.048347 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33647 s=2 pgs=18488 cs=5639 l=0).fault, initiating reconnect
2013-06-08 20:25:43.048372 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33768 s=2 pgs=24331 cs=7449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.048756 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56766 s=2 pgs=24145 cs=6159 l=0).fault, initiating reconnect
2013-06-08 20:25:43.048976 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40637 s=2 pgs=20352 cs=3491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.049155 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59184 s=2 pgs=14595 cs=899 l=0).fault, initiating reconnect
2013-06-08 20:25:43.049213 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40725 s=2 pgs=18059 cs=4275 l=0).fault, initiating reconnect
2013-06-08 20:25:43.049217 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33774 s=2 pgs=24332 cs=7451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.049258 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33653 s=2 pgs=18489 cs=5641 l=0).fault, initiating reconnect
2013-06-08 20:25:43.049651 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56772 s=2 pgs=24146 cs=6161 l=0).fault, initiating reconnect
2013-06-08 20:25:43.049819 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40641 s=2 pgs=20353 cs=3493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.050082 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59190 s=2 pgs=14596 cs=901 l=0).fault, initiating reconnect
2013-06-08 20:25:43.050207 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33659 s=2 pgs=18490 cs=5643 l=0).fault, initiating reconnect
2013-06-08 20:25:43.050227 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33780 s=2 pgs=24333 cs=7453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.050360 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56778 s=2 pgs=24147 cs=6163 l=0).fault, initiating reconnect
2013-06-08 20:25:43.050421 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40733 s=2 pgs=18060 cs=4277 l=0).fault, initiating reconnect
2013-06-08 20:25:43.050760 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40647 s=2 pgs=20354 cs=3495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.051027 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59196 s=2 pgs=14597 cs=903 l=0).fault, initiating reconnect
2013-06-08 20:25:43.051077 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33785 s=2 pgs=24334 cs=7455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.051112 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56783 s=2 pgs=24148 cs=6165 l=0).fault, initiating reconnect
2013-06-08 20:25:43.051211 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33664 s=2 pgs=18491 cs=5645 l=0).fault, initiating reconnect
2013-06-08 20:25:43.051612 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40742 s=2 pgs=18061 cs=4279 l=0).fault, initiating reconnect
2013-06-08 20:25:43.051631 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40653 s=2 pgs=20355 cs=3497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052002 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59202 s=2 pgs=14598 cs=905 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052023 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56788 s=2 pgs=24149 cs=6167 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052039 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33790 s=2 pgs=24335 cs=7457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052436 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33672 s=2 pgs=18492 cs=5647 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052611 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40659 s=2 pgs=20356 cs=3499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052763 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40748 s=2 pgs=18062 cs=4281 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052909 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56792 s=2 pgs=24150 cs=6169 l=0).fault, initiating reconnect
2013-06-08 20:25:43.052927 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59209 s=2 pgs=14599 cs=907 l=0).fault, initiating reconnect
2013-06-08 20:25:43.053104 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33796 s=2 pgs=24336 cs=7459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.053312 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33678 s=2 pgs=18493 cs=5649 l=0).fault, initiating reconnect
2013-06-08 20:25:43.053480 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40664 s=2 pgs=20357 cs=3501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.053687 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40755 s=2 pgs=18063 cs=4283 l=0).fault, initiating reconnect
2013-06-08 20:25:43.053705 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59215 s=2 pgs=14600 cs=909 l=0).fault, initiating reconnect
2013-06-08 20:25:43.053920 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33803 s=2 pgs=24337 cs=7461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.053942 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56798 s=2 pgs=24151 cs=6171 l=0).fault, initiating reconnect
2013-06-08 20:25:43.054145 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33684 s=2 pgs=18494 cs=5651 l=0).fault, initiating reconnect
2013-06-08 20:25:43.054451 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40670 s=2 pgs=20358 cs=3503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.054634 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59219 s=2 pgs=14601 cs=911 l=0).fault, initiating reconnect
2013-06-08 20:25:43.054823 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33808 s=2 pgs=24338 cs=7463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.054846 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56806 s=2 pgs=24152 cs=6173 l=0).fault, initiating reconnect
2013-06-08 20:25:43.054903 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40762 s=2 pgs=18064 cs=4285 l=0).fault, initiating reconnect
2013-06-08 20:25:43.055066 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33690 s=2 pgs=18495 cs=5653 l=0).fault, initiating reconnect
2013-06-08 20:25:43.055423 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40676 s=2 pgs=20359 cs=3505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.055525 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59225 s=2 pgs=14602 cs=913 l=0).fault, initiating reconnect
2013-06-08 20:25:43.055766 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56811 s=2 pgs=24153 cs=6175 l=0).fault, initiating reconnect
2013-06-08 20:25:43.055815 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40770 s=2 pgs=18065 cs=4287 l=0).fault, initiating reconnect
2013-06-08 20:25:43.055820 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33813 s=2 pgs=24339 cs=7465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.055871 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33696 s=2 pgs=18496 cs=5655 l=0).fault, initiating reconnect
2013-06-08 20:25:43.056390 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40682 s=2 pgs=20360 cs=3507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.056520 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56816 s=2 pgs=24154 cs=6177 l=0).fault, initiating reconnect
2013-06-08 20:25:43.056532 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59231 s=2 pgs=14603 cs=915 l=0).fault, initiating reconnect
2013-06-08 20:25:43.056749 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33702 s=2 pgs=18497 cs=5657 l=0).fault, initiating reconnect
2013-06-08 20:25:43.056819 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :33821 s=2 pgs=24340 cs=7467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.056822 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :40775 s=2 pgs=18066 cs=4289 l=0).fault, initiating reconnect
2013-06-08 20:25:43.057284 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56822 s=2 pgs=24155 cs=6179 l=0).fault, initiating reconnect
2013-06-08 20:25:43.057286 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40688 s=2 pgs=20361 cs=3509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.057566 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33706 s=2 pgs=18498 cs=5659 l=0).fault, initiating reconnect
2013-06-08 20:25:43.057666 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59237 s=2 pgs=14604 cs=917 l=0).fault, initiating reconnect
2013-06-08 20:25:43.057764 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33827 s=2 pgs=24341 cs=7469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.057893 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40783 s=2 pgs=18067 cs=4291 l=0).fault, initiating reconnect
2013-06-08 20:25:43.058235 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40695 s=2 pgs=20362 cs=3511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.058380 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56826 s=2 pgs=24156 cs=6181 l=0).fault, initiating reconnect
2013-06-08 20:25:43.058428 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33711 s=2 pgs=18499 cs=5661 l=0).fault, initiating reconnect
2013-06-08 20:25:43.058448 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33833 s=2 pgs=24342 cs=7471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.058625 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59245 s=2 pgs=14605 cs=919 l=0).fault, initiating reconnect
2013-06-08 20:25:43.059052 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40700 s=2 pgs=20363 cs=3513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.059171 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40789 s=2 pgs=18068 cs=4293 l=0).fault, initiating reconnect
2013-06-08 20:25:43.059221 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33838 s=2 pgs=24343 cs=7473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.059225 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33717 s=2 pgs=18500 cs=5663 l=0).fault, initiating reconnect
2013-06-08 20:25:43.059372 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56833 s=2 pgs=24157 cs=6183 l=0).fault, initiating reconnect
2013-06-08 20:25:43.059650 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59252 s=2 pgs=14606 cs=921 l=0).fault, initiating reconnect
2013-06-08 20:25:43.059865 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40705 s=2 pgs=20364 cs=3515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.060107 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33842 s=2 pgs=24344 cs=7475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.060155 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33722 s=2 pgs=18501 cs=5665 l=0).fault, initiating reconnect
2013-06-08 20:25:43.060230 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56841 s=2 pgs=24158 cs=6185 l=0).fault, initiating reconnect
2013-06-08 20:25:43.060481 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40796 s=2 pgs=18069 cs=4295 l=0).fault, initiating reconnect
2013-06-08 20:25:43.060611 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59258 s=2 pgs=14607 cs=923 l=0).fault, initiating reconnect
2013-06-08 20:25:43.060760 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40711 s=2 pgs=20365 cs=3517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.061052 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33847 s=2 pgs=24345 cs=7477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.061054 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33728 s=2 pgs=18502 cs=5667 l=0).fault, initiating reconnect
2013-06-08 20:25:43.061136 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56846 s=2 pgs=24159 cs=6187 l=0).fault, initiating reconnect
2013-06-08 20:25:43.061574 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40805 s=2 pgs=18070 cs=4297 l=0).fault, initiating reconnect
2013-06-08 20:25:43.061624 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59264 s=2 pgs=14608 cs=925 l=0).fault, initiating reconnect
2013-06-08 20:25:43.061894 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40717 s=2 pgs=20366 cs=3519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.062039 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33733 s=2 pgs=18503 cs=5669 l=0).fault, initiating reconnect
2013-06-08 20:25:43.062046 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56852 s=2 pgs=24160 cs=6189 l=0).fault, initiating reconnect
2013-06-08 20:25:43.062715 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40811 s=2 pgs=18071 cs=4299 l=0).fault, initiating reconnect
2013-06-08 20:25:43.062766 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59270 s=2 pgs=14609 cs=927 l=0).fault, initiating reconnect
2013-06-08 20:25:43.062787 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40723 s=2 pgs=20367 cs=3521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.062986 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33854 s=2 pgs=24346 cs=7479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.063002 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33739 s=2 pgs=18504 cs=5671 l=0).fault, initiating reconnect
2013-06-08 20:25:43.063793 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40728 s=2 pgs=20368 cs=3523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.063903 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33745 s=2 pgs=18505 cs=5673 l=0).fault, initiating reconnect
2013-06-08 20:25:43.063917 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :33864 s=2 pgs=24347 cs=7481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.063926 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59275 s=2 pgs=14610 cs=929 l=0).fault, initiating reconnect
2013-06-08 20:25:43.063928 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40816 s=2 pgs=18072 cs=4301 l=0).fault, initiating reconnect
2013-06-08 20:25:43.064046 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56857 s=2 pgs=24161 cs=6191 l=0).fault, initiating reconnect
2013-06-08 20:25:43.064655 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40731 s=2 pgs=20369 cs=3525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.064665 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33867 s=2 pgs=24348 cs=7483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.064829 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33750 s=2 pgs=18506 cs=5675 l=0).fault, initiating reconnect
2013-06-08 20:25:43.064864 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59281 s=2 pgs=14611 cs=931 l=0).fault, initiating reconnect
2013-06-08 20:25:43.064913 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40824 s=2 pgs=18073 cs=4303 l=0).fault, initiating reconnect
2013-06-08 20:25:43.065141 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56868 s=2 pgs=24162 cs=6193 l=0).fault, initiating reconnect
2013-06-08 20:25:43.065516 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40737 s=2 pgs=20370 cs=3527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.065518 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33873 s=2 pgs=24349 cs=7485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.065736 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33754 s=2 pgs=18507 cs=5677 l=0).fault, initiating reconnect
2013-06-08 20:25:43.065861 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59288 s=2 pgs=14612 cs=933 l=0).fault, initiating reconnect
2013-06-08 20:25:43.066028 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56874 s=2 pgs=24163 cs=6195 l=0).fault, initiating reconnect
2013-06-08 20:25:43.066083 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40831 s=2 pgs=18074 cs=4305 l=0).fault, initiating reconnect
2013-06-08 20:25:43.066424 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33878 s=2 pgs=24350 cs=7487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.066496 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40744 s=2 pgs=20371 cs=3529 l=0).fault, initiating reconnect
2013-06-08 20:25:43.066782 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33760 s=2 pgs=18508 cs=5679 l=0).fault, initiating reconnect
2013-06-08 20:25:43.066828 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56879 s=2 pgs=24164 cs=6197 l=0).fault, initiating reconnect
2013-06-08 20:25:43.066890 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59294 s=2 pgs=14613 cs=935 l=0).fault, initiating reconnect
2013-06-08 20:25:43.067139 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33884 s=2 pgs=24351 cs=7489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.067160 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40838 s=2 pgs=18075 cs=4307 l=0).fault, initiating reconnect
2013-06-08 20:25:43.067272 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40750 s=2 pgs=20372 cs=3531 l=0).fault, initiating reconnect
2013-06-08 20:25:43.067534 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56884 s=2 pgs=24165 cs=6199 l=0).fault, initiating reconnect
2013-06-08 20:25:43.067638 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33766 s=2 pgs=18509 cs=5681 l=0).fault, initiating reconnect
2013-06-08 20:25:43.067876 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59301 s=2 pgs=14614 cs=937 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068062 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33889 s=2 pgs=24352 cs=7491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068075 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40756 s=2 pgs=20373 cs=3533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068131 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40845 s=2 pgs=18076 cs=4309 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068300 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56889 s=2 pgs=24166 cs=6201 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068540 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33773 s=2 pgs=18510 cs=5683 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068817 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33895 s=2 pgs=24353 cs=7493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068823 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40761 s=2 pgs=20374 cs=3535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.068865 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59307 s=2 pgs=14615 cs=939 l=0).fault, initiating reconnect
2013-06-08 20:25:43.069183 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56895 s=2 pgs=24167 cs=6203 l=0).fault, initiating reconnect
2013-06-08 20:25:43.069236 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40852 s=2 pgs=18077 cs=4311 l=0).fault, initiating reconnect
2013-06-08 20:25:43.069503 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33779 s=2 pgs=18511 cs=5685 l=0).fault, initiating reconnect
2013-06-08 20:25:43.069631 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40766 s=2 pgs=20375 cs=3537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.069623 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33900 s=2 pgs=24354 cs=7495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.069883 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59315 s=2 pgs=14616 cs=941 l=0).fault, initiating reconnect
2013-06-08 20:25:43.070058 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56900 s=2 pgs=24168 cs=6205 l=0).fault, initiating reconnect
2013-06-08 20:25:43.070253 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40859 s=2 pgs=18078 cs=4313 l=0).fault, initiating reconnect
2013-06-08 20:25:43.070435 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33785 s=2 pgs=18512 cs=5687 l=0).fault, initiating reconnect
2013-06-08 20:25:43.070499 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33907 s=2 pgs=24355 cs=7497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.070533 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40771 s=2 pgs=20376 cs=3539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.070890 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56906 s=2 pgs=24169 cs=6207 l=0).fault, initiating reconnect
2013-06-08 20:25:43.070903 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59321 s=2 pgs=14617 cs=943 l=0).fault, initiating reconnect
2013-06-08 20:25:43.071245 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33791 s=2 pgs=18513 cs=5689 l=0).fault, initiating reconnect
2013-06-08 20:25:43.071289 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33912 s=2 pgs=24356 cs=7499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.071358 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :40865 s=2 pgs=18079 cs=4315 l=0).fault, initiating reconnect
2013-06-08 20:25:43.071364 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40778 s=2 pgs=20377 cs=3541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.071804 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56911 s=2 pgs=24170 cs=6209 l=0).fault, initiating reconnect
2013-06-08 20:25:43.071812 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59328 s=2 pgs=14618 cs=945 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072085 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33917 s=2 pgs=24357 cs=7501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072111 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :40784 s=2 pgs=20378 cs=3543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072113 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33796 s=2 pgs=18514 cs=5691 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072434 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40873 s=2 pgs=18080 cs=4317 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072693 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56918 s=2 pgs=24171 cs=6211 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072816 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :40788 s=2 pgs=20379 cs=3545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072841 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59333 s=2 pgs=14619 cs=947 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072920 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33922 s=2 pgs=24358 cs=7503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.072964 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33804 s=2 pgs=18515 cs=5693 l=0).fault, initiating reconnect
2013-06-08 20:25:43.073396 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56923 s=2 pgs=24172 cs=6213 l=0).fault, initiating reconnect
2013-06-08 20:25:43.073488 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40880 s=2 pgs=18081 cs=4319 l=0).fault, initiating reconnect
2013-06-08 20:25:43.073639 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33810 s=2 pgs=18516 cs=5695 l=0).fault, initiating reconnect
2013-06-08 20:25:43.073763 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :40792 s=2 pgs=20380 cs=3547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074000 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59341 s=2 pgs=14620 cs=949 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074031 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33929 s=2 pgs=24359 cs=7505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074424 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40887 s=2 pgs=18082 cs=4321 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074450 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56928 s=2 pgs=24173 cs=6215 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074504 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33813 s=2 pgs=18517 cs=5697 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074726 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :40799 s=2 pgs=20381 cs=3549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074818 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59348 s=2 pgs=14621 cs=951 l=0).fault, initiating reconnect
2013-06-08 20:25:43.074933 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33936 s=2 pgs=24360 cs=7507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.075200 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56935 s=2 pgs=24174 cs=6217 l=0).fault, initiating reconnect
2013-06-08 20:25:43.075306 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33819 s=2 pgs=18518 cs=5699 l=0).fault, initiating reconnect
2013-06-08 20:25:43.075342 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40892 s=2 pgs=18083 cs=4323 l=0).fault, initiating reconnect
2013-06-08 20:25:43.075696 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59354 s=2 pgs=14622 cs=953 l=0).fault, initiating reconnect
2013-06-08 20:25:43.075720 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33942 s=2 pgs=24361 cs=7509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.075744 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :40805 s=2 pgs=20382 cs=3551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.076273 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56940 s=2 pgs=24175 cs=6219 l=0).fault, initiating reconnect
2013-06-08 20:25:43.076278 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33824 s=2 pgs=18519 cs=5701 l=0).fault, initiating reconnect
2013-06-08 20:25:43.076459 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40900 s=2 pgs=18084 cs=4325 l=0).fault, initiating reconnect
2013-06-08 20:25:43.076567 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :40813 s=2 pgs=20383 cs=3553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.076576 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59359 s=2 pgs=14623 cs=955 l=0).fault, initiating reconnect
2013-06-08 20:25:43.076605 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33947 s=2 pgs=24362 cs=7511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.077226 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :56946 s=2 pgs=24176 cs=6221 l=0).fault, initiating reconnect
2013-06-08 20:25:43.077233 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33830 s=2 pgs=18520 cs=5703 l=0).fault, initiating reconnect
2013-06-08 20:25:43.077445 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33954 s=2 pgs=24363 cs=7513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.077452 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40906 s=2 pgs=18085 cs=4327 l=0).fault, initiating reconnect
2013-06-08 20:25:43.077576 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40817 s=2 pgs=20384 cs=3555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.077804 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59366 s=2 pgs=14624 cs=957 l=0).fault, initiating reconnect
2013-06-08 20:25:43.077985 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33836 s=2 pgs=18521 cs=5705 l=0).fault, initiating reconnect
2013-06-08 20:25:43.078126 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56952 s=2 pgs=24177 cs=6223 l=0).fault, initiating reconnect
2013-06-08 20:25:43.078365 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33957 s=2 pgs=24364 cs=7515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.078448 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40913 s=2 pgs=18086 cs=4329 l=0).fault, initiating reconnect
2013-06-08 20:25:43.078518 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40824 s=2 pgs=20385 cs=3557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.078688 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59373 s=2 pgs=14625 cs=959 l=0).fault, initiating reconnect
2013-06-08 20:25:43.079110 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33841 s=2 pgs=18522 cs=5707 l=0).fault, initiating reconnect
2013-06-08 20:25:43.079163 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33963 s=2 pgs=24365 cs=7517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.079304 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56959 s=2 pgs=24178 cs=6225 l=0).fault, initiating reconnect
2013-06-08 20:25:43.079514 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40919 s=2 pgs=18087 cs=4331 l=0).fault, initiating reconnect
2013-06-08 20:25:43.079539 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40830 s=2 pgs=20386 cs=3559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.079548 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59379 s=2 pgs=14626 cs=961 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080015 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33968 s=2 pgs=24366 cs=7519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080095 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33847 s=2 pgs=18523 cs=5709 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080297 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59385 s=2 pgs=14627 cs=963 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080411 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56966 s=2 pgs=24179 cs=6227 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080420 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40836 s=2 pgs=20387 cs=3561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080658 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40925 s=2 pgs=18088 cs=4333 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080872 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33973 s=2 pgs=24367 cs=7521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.080961 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33854 s=2 pgs=18524 cs=5711 l=0).fault, initiating reconnect
2013-06-08 20:25:43.081155 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59388 s=2 pgs=14628 cs=965 l=0).fault, initiating reconnect
2013-06-08 20:25:43.081292 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56973 s=2 pgs=24180 cs=6229 l=0).fault, initiating reconnect
2013-06-08 20:25:43.081368 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40842 s=2 pgs=20388 cs=3563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.081734 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33860 s=2 pgs=18525 cs=5713 l=0).fault, initiating reconnect
2013-06-08 20:25:43.081872 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33979 s=2 pgs=24368 cs=7523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.081924 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40933 s=2 pgs=18089 cs=4335 l=0).fault, initiating reconnect
2013-06-08 20:25:43.081968 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59394 s=2 pgs=14629 cs=967 l=0).fault, initiating reconnect
2013-06-08 20:25:43.082016 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56979 s=2 pgs=24181 cs=6231 l=0).fault, initiating reconnect
2013-06-08 20:25:43.082396 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40848 s=2 pgs=20389 cs=3565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.082661 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33985 s=2 pgs=24369 cs=7525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.082687 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33864 s=2 pgs=18526 cs=5715 l=0).fault, initiating reconnect
2013-06-08 20:25:43.082837 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56985 s=2 pgs=24182 cs=6233 l=0).fault, initiating reconnect
2013-06-08 20:25:43.082837 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59400 s=2 pgs=14630 cs=969 l=0).fault, initiating reconnect
2013-06-08 20:25:43.083064 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40941 s=2 pgs=18090 cs=4337 l=0).fault, initiating reconnect
2013-06-08 20:25:43.083284 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40854 s=2 pgs=20390 cs=3567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.083432 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33990 s=2 pgs=24370 cs=7527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.083583 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33871 s=2 pgs=18527 cs=5717 l=0).fault, initiating reconnect
2013-06-08 20:25:43.083697 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59406 s=2 pgs=14631 cs=971 l=0).fault, initiating reconnect
2013-06-08 20:25:43.083756 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56989 s=2 pgs=24183 cs=6235 l=0).fault, initiating reconnect
2013-06-08 20:25:43.084159 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40949 s=2 pgs=18091 cs=4339 l=0).fault, initiating reconnect
2013-06-08 20:25:43.084258 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40860 s=2 pgs=20391 cs=3569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.084264 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :33996 s=2 pgs=24371 cs=7529 l=0).fault, initiating reconnect
2013-06-08 20:25:43.084465 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33877 s=2 pgs=18528 cs=5719 l=0).fault, initiating reconnect
2013-06-08 20:25:43.084603 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :56996 s=2 pgs=24184 cs=6237 l=0).fault, initiating reconnect
2013-06-08 20:25:43.084648 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59411 s=2 pgs=14632 cs=973 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085118 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :40955 s=2 pgs=18092 cs=4341 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085130 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :40866 s=2 pgs=20392 cs=3571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085229 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34002 s=2 pgs=24372 cs=7531 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085313 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33883 s=2 pgs=18529 cs=5721 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085427 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59418 s=2 pgs=14633 cs=975 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085494 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57001 s=2 pgs=24185 cs=6239 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085993 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40872 s=2 pgs=20393 cs=3573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.085999 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34008 s=2 pgs=24373 cs=7533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.086202 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59423 s=2 pgs=14634 cs=977 l=0).fault, initiating reconnect
2013-06-08 20:25:43.086199 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40961 s=2 pgs=18093 cs=4343 l=0).fault, initiating reconnect
2013-06-08 20:25:43.086646 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :33889 s=2 pgs=18530 cs=5723 l=0).fault, initiating reconnect
2013-06-08 20:25:43.086649 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57008 s=2 pgs=24186 cs=6241 l=0).fault, initiating reconnect
2013-06-08 20:25:43.086861 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34012 s=2 pgs=24374 cs=7535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.087078 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59428 s=2 pgs=14635 cs=979 l=0).fault, initiating reconnect
2013-06-08 20:25:43.087358 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40969 s=2 pgs=18094 cs=4345 l=0).fault, initiating reconnect
2013-06-08 20:25:43.087525 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57014 s=2 pgs=24187 cs=6243 l=0).fault, initiating reconnect
2013-06-08 20:25:43.087623 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33896 s=2 pgs=18531 cs=5725 l=0).fault, initiating reconnect
2013-06-08 20:25:43.087628 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34018 s=2 pgs=24375 cs=7537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.087846 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59432 s=2 pgs=14636 cs=981 l=0).fault, initiating reconnect
2013-06-08 20:25:43.087881 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40878 s=2 pgs=20394 cs=3575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.088218 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57018 s=2 pgs=24188 cs=6245 l=0).fault, initiating reconnect
2013-06-08 20:25:43.088400 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40975 s=2 pgs=18095 cs=4347 l=0).fault, initiating reconnect
2013-06-08 20:25:43.088459 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34023 s=2 pgs=24376 cs=7539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.088536 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33902 s=2 pgs=18532 cs=5727 l=0).fault, initiating reconnect
2013-06-08 20:25:43.088709 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59437 s=2 pgs=14637 cs=983 l=0).fault, initiating reconnect
2013-06-08 20:25:43.088784 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40890 s=2 pgs=20395 cs=3577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.088972 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57023 s=2 pgs=24189 cs=6247 l=0).fault, initiating reconnect
2013-06-08 20:25:43.089263 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33909 s=2 pgs=18533 cs=5729 l=0).fault, initiating reconnect
2013-06-08 20:25:43.089326 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34028 s=2 pgs=24377 cs=7541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.089342 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40982 s=2 pgs=18096 cs=4349 l=0).fault, initiating reconnect
2013-06-08 20:25:43.089613 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40896 s=2 pgs=20396 cs=3579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.089634 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59443 s=2 pgs=14638 cs=985 l=0).fault, initiating reconnect
2013-06-08 20:25:43.090119 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33913 s=2 pgs=18534 cs=5731 l=0).fault, initiating reconnect
2013-06-08 20:25:43.090159 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57029 s=2 pgs=24190 cs=6249 l=0).fault, initiating reconnect
2013-06-08 20:25:43.090344 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34034 s=2 pgs=24378 cs=7543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.090530 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40901 s=2 pgs=20397 cs=3581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.090549 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40990 s=2 pgs=18097 cs=4351 l=0).fault, initiating reconnect
2013-06-08 20:25:43.090587 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59450 s=2 pgs=14639 cs=987 l=0).fault, initiating reconnect
2013-06-08 20:25:43.091041 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57036 s=2 pgs=24191 cs=6251 l=0).fault, initiating reconnect
2013-06-08 20:25:43.091064 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33918 s=2 pgs=18535 cs=5733 l=0).fault, initiating reconnect
2013-06-08 20:25:43.091253 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34040 s=2 pgs=24379 cs=7545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.091493 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59456 s=2 pgs=14640 cs=989 l=0).fault, initiating reconnect
2013-06-08 20:25:43.091845 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :40997 s=2 pgs=18098 cs=4353 l=0).fault, initiating reconnect
2013-06-08 20:25:43.091961 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33925 s=2 pgs=18536 cs=5735 l=0).fault, initiating reconnect
2013-06-08 20:25:43.091974 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57041 s=2 pgs=24192 cs=6253 l=0).fault, initiating reconnect
2013-06-08 20:25:43.092160 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34046 s=2 pgs=24380 cs=7547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.092559 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59460 s=2 pgs=14641 cs=991 l=0).fault, initiating reconnect
2013-06-08 20:25:43.092867 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57047 s=2 pgs=24193 cs=6255 l=0).fault, initiating reconnect
2013-06-08 20:25:43.092878 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41003 s=2 pgs=18099 cs=4355 l=0).fault, initiating reconnect
2013-06-08 20:25:43.092922 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34051 s=2 pgs=24381 cs=7549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.093057 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33929 s=2 pgs=18537 cs=5737 l=0).fault, initiating reconnect
2013-06-08 20:25:43.093106 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40906 s=2 pgs=20398 cs=3583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.093544 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59465 s=2 pgs=14642 cs=993 l=0).fault, initiating reconnect
2013-06-08 20:25:43.093725 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34055 s=2 pgs=24382 cs=7551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.093737 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57050 s=2 pgs=24194 cs=6257 l=0).fault, initiating reconnect
2013-06-08 20:25:43.093926 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41009 s=2 pgs=18100 cs=4357 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094033 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33936 s=2 pgs=18538 cs=5739 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094058 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40922 s=2 pgs=20399 cs=3585 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094606 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59471 s=2 pgs=14643 cs=995 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094632 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34059 s=2 pgs=24383 cs=7553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094783 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57057 s=2 pgs=24195 cs=6259 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094838 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33942 s=2 pgs=18539 cs=5741 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094934 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40928 s=2 pgs=20400 cs=3587 l=0).fault, initiating reconnect
2013-06-08 20:25:43.094983 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41016 s=2 pgs=18101 cs=4359 l=0).fault, initiating reconnect
2013-06-08 20:25:43.095550 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34065 s=2 pgs=24384 cs=7555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.095555 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59477 s=2 pgs=14644 cs=997 l=0).fault, initiating reconnect
2013-06-08 20:25:43.095582 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57063 s=2 pgs=24196 cs=6261 l=0).fault, initiating reconnect
2013-06-08 20:25:43.095630 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33947 s=2 pgs=18540 cs=5743 l=0).fault, initiating reconnect
2013-06-08 20:25:43.095941 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40933 s=2 pgs=20401 cs=3589 l=0).fault, initiating reconnect
2013-06-08 20:25:43.096133 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41024 s=2 pgs=18102 cs=4361 l=0).fault, initiating reconnect
2013-06-08 20:25:43.096373 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34070 s=2 pgs=24385 cs=7557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.096400 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33953 s=2 pgs=18541 cs=5745 l=0).fault, initiating reconnect
2013-06-08 20:25:43.096486 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57069 s=2 pgs=24197 cs=6263 l=0).fault, initiating reconnect
2013-06-08 20:25:43.096517 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59484 s=2 pgs=14645 cs=999 l=0).fault, initiating reconnect
2013-06-08 20:25:43.096972 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40939 s=2 pgs=20402 cs=3591 l=0).fault, initiating reconnect
2013-06-08 20:25:43.097093 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33957 s=2 pgs=18542 cs=5747 l=0).fault, initiating reconnect
2013-06-08 20:25:43.097259 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34076 s=2 pgs=24386 cs=7559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.097378 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57075 s=2 pgs=24198 cs=6265 l=0).fault, initiating reconnect
2013-06-08 20:25:43.097435 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41030 s=2 pgs=18103 cs=4363 l=0).fault, initiating reconnect
2013-06-08 20:25:43.097591 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59492 s=2 pgs=14646 cs=1001 l=0).fault, initiating reconnect
2013-06-08 20:25:43.098006 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40945 s=2 pgs=20403 cs=3593 l=0).fault, initiating reconnect
2013-06-08 20:25:43.098059 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33961 s=2 pgs=18543 cs=5749 l=0).fault, initiating reconnect
2013-06-08 20:25:43.098208 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34082 s=2 pgs=24387 cs=7561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.098338 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57080 s=2 pgs=24199 cs=6267 l=0).fault, initiating reconnect
2013-06-08 20:25:43.098553 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59498 s=2 pgs=14647 cs=1003 l=0).fault, initiating reconnect
2013-06-08 20:25:43.098695 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41039 s=2 pgs=18104 cs=4365 l=0).fault, initiating reconnect
2013-06-08 20:25:43.098742 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33967 s=2 pgs=18544 cs=5751 l=0).fault, initiating reconnect
2013-06-08 20:25:43.099003 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40951 s=2 pgs=20404 cs=3595 l=0).fault, initiating reconnect
2013-06-08 20:25:43.099013 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34088 s=2 pgs=24388 cs=7563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.099223 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57086 s=2 pgs=24200 cs=6269 l=0).fault, initiating reconnect
2013-06-08 20:25:43.099440 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59503 s=2 pgs=14648 cs=1005 l=0).fault, initiating reconnect
2013-06-08 20:25:43.099737 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33972 s=2 pgs=18545 cs=5753 l=0).fault, initiating reconnect
2013-06-08 20:25:43.099873 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40958 s=2 pgs=20405 cs=3597 l=0).fault, initiating reconnect
2013-06-08 20:25:43.099877 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34094 s=2 pgs=24389 cs=7565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.100042 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41046 s=2 pgs=18105 cs=4367 l=0).fault, initiating reconnect
2013-06-08 20:25:43.100196 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57092 s=2 pgs=24201 cs=6271 l=0).fault, initiating reconnect
2013-06-08 20:25:43.100491 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59509 s=2 pgs=14649 cs=1007 l=0).fault, initiating reconnect
2013-06-08 20:25:43.100713 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34099 s=2 pgs=24390 cs=7567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.100754 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33977 s=2 pgs=18546 cs=5755 l=0).fault, initiating reconnect
2013-06-08 20:25:43.100924 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40963 s=2 pgs=20406 cs=3599 l=0).fault, initiating reconnect
2013-06-08 20:25:43.101105 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57098 s=2 pgs=24202 cs=6273 l=0).fault, initiating reconnect
2013-06-08 20:25:43.101338 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41055 s=2 pgs=18106 cs=4369 l=0).fault, initiating reconnect
2013-06-08 20:25:43.101503 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59515 s=2 pgs=14650 cs=1009 l=0).fault, initiating reconnect
2013-06-08 20:25:43.101635 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33984 s=2 pgs=18547 cs=5757 l=0).fault, initiating reconnect
2013-06-08 20:25:43.101648 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34103 s=2 pgs=24391 cs=7569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.101771 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40970 s=2 pgs=20407 cs=3601 l=0).fault, initiating reconnect
2013-06-08 20:25:43.101936 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57103 s=2 pgs=24203 cs=6275 l=0).fault, initiating reconnect
2013-06-08 20:25:43.102258 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59521 s=2 pgs=14651 cs=1011 l=0).fault, initiating reconnect
2013-06-08 20:25:43.102388 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41062 s=2 pgs=18107 cs=4371 l=0).fault, initiating reconnect
2013-06-08 20:25:43.102528 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34110 s=2 pgs=24392 cs=7571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.102543 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33989 s=2 pgs=18548 cs=5759 l=0).fault, initiating reconnect
2013-06-08 20:25:43.102843 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57109 s=2 pgs=24204 cs=6277 l=0).fault, initiating reconnect
2013-06-08 20:25:43.102847 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40976 s=2 pgs=20408 cs=3603 l=0).fault, initiating reconnect
2013-06-08 20:25:43.103202 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59526 s=2 pgs=14652 cs=1013 l=0).fault, initiating reconnect
2013-06-08 20:25:43.103419 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41069 s=2 pgs=18108 cs=4373 l=0).fault, initiating reconnect
2013-06-08 20:25:43.103483 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34115 s=2 pgs=24393 cs=7573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.103497 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :33996 s=2 pgs=18549 cs=5761 l=0).fault, initiating reconnect
2013-06-08 20:25:43.103723 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57114 s=2 pgs=24205 cs=6279 l=0).fault, initiating reconnect
2013-06-08 20:25:43.103839 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40983 s=2 pgs=20409 cs=3605 l=0).fault, initiating reconnect
2013-06-08 20:25:43.104103 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59532 s=2 pgs=14653 cs=1015 l=0).fault, initiating reconnect
2013-06-08 20:25:43.104297 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34002 s=2 pgs=18550 cs=5763 l=0).fault, initiating reconnect
2013-06-08 20:25:43.104432 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34121 s=2 pgs=24394 cs=7575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.104597 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41075 s=2 pgs=18109 cs=4375 l=0).fault, initiating reconnect
2013-06-08 20:25:43.104596 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57120 s=2 pgs=24206 cs=6281 l=0).fault, initiating reconnect
2013-06-08 20:25:43.105060 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :40989 s=2 pgs=20410 cs=3607 l=0).fault, initiating reconnect
2013-06-08 20:25:43.105062 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59538 s=2 pgs=14654 cs=1017 l=0).fault, initiating reconnect
2013-06-08 20:25:43.105206 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34006 s=2 pgs=18551 cs=5765 l=0).fault, initiating reconnect
2013-06-08 20:25:43.105304 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34127 s=2 pgs=24395 cs=7577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.105615 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57126 s=2 pgs=24207 cs=6283 l=0).fault, initiating reconnect
2013-06-08 20:25:43.105889 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59544 s=2 pgs=14655 cs=1019 l=0).fault, initiating reconnect
2013-06-08 20:25:43.106099 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :40995 s=2 pgs=20411 cs=3609 l=0).fault, initiating reconnect
2013-06-08 20:25:43.106117 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34133 s=2 pgs=24396 cs=7579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.106121 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34012 s=2 pgs=18552 cs=5767 l=0).fault, initiating reconnect
2013-06-08 20:25:43.106572 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57131 s=2 pgs=24208 cs=6285 l=0).fault, initiating reconnect
2013-06-08 20:25:43.106732 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41083 s=2 pgs=18110 cs=4377 l=0).fault, initiating reconnect
2013-06-08 20:25:43.106864 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59548 s=2 pgs=14656 cs=1021 l=0).fault, initiating reconnect
2013-06-08 20:25:43.107011 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34018 s=2 pgs=18553 cs=5769 l=0).fault, initiating reconnect
2013-06-08 20:25:43.107023 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34137 s=2 pgs=24397 cs=7581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.107034 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41001 s=2 pgs=20412 cs=3611 l=0).fault, initiating reconnect
2013-06-08 20:25:43.107565 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57136 s=2 pgs=24209 cs=6287 l=0).fault, initiating reconnect
2013-06-08 20:25:43.107844 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34143 s=2 pgs=24398 cs=7583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.107889 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34022 s=2 pgs=18554 cs=5771 l=0).fault, initiating reconnect
2013-06-08 20:25:43.108043 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59554 s=2 pgs=14657 cs=1023 l=0).fault, initiating reconnect
2013-06-08 20:25:43.108092 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41009 s=2 pgs=20413 cs=3613 l=0).fault, initiating reconnect
2013-06-08 20:25:43.108180 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41095 s=2 pgs=18111 cs=4379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.108417 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57142 s=2 pgs=24210 cs=6289 l=0).fault, initiating reconnect
2013-06-08 20:25:43.108723 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34146 s=2 pgs=24399 cs=7585 l=0).fault, initiating reconnect
2013-06-08 20:25:43.108865 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41014 s=2 pgs=20414 cs=3615 l=0).fault, initiating reconnect
2013-06-08 20:25:43.108892 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34027 s=2 pgs=18555 cs=5773 l=0).fault, initiating reconnect
2013-06-08 20:25:43.109077 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59561 s=2 pgs=14658 cs=1025 l=0).fault, initiating reconnect
2013-06-08 20:25:43.109189 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41105 s=2 pgs=18112 cs=4381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.109272 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57148 s=2 pgs=24211 cs=6291 l=0).fault, initiating reconnect
2013-06-08 20:25:43.109615 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34152 s=2 pgs=24400 cs=7587 l=0).fault, initiating reconnect
2013-06-08 20:25:43.109740 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34034 s=2 pgs=18556 cs=5775 l=0).fault, initiating reconnect
2013-06-08 20:25:43.109775 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41018 s=2 pgs=20415 cs=3617 l=0).fault, initiating reconnect
2013-06-08 20:25:43.110125 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59568 s=2 pgs=14659 cs=1027 l=0).fault, initiating reconnect
2013-06-08 20:25:43.110149 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57154 s=2 pgs=24212 cs=6293 l=0).fault, initiating reconnect
2013-06-08 20:25:43.110487 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41111 s=2 pgs=18113 cs=4383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.110699 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41025 s=2 pgs=20416 cs=3619 l=0).fault, initiating reconnect
2013-06-08 20:25:43.110713 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34039 s=2 pgs=18557 cs=5777 l=0).fault, initiating reconnect
2013-06-08 20:25:43.111105 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59574 s=2 pgs=14660 cs=1029 l=0).fault, initiating reconnect
2013-06-08 20:25:43.111154 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57159 s=2 pgs=24213 cs=6295 l=0).fault, initiating reconnect
2013-06-08 20:25:43.111440 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34158 s=2 pgs=24401 cs=7589 l=0).fault, initiating reconnect
2013-06-08 20:25:43.111578 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41118 s=2 pgs=18114 cs=4385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.111634 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34045 s=2 pgs=18558 cs=5779 l=0).fault, initiating reconnect
2013-06-08 20:25:43.111654 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41029 s=2 pgs=20417 cs=3621 l=0).fault, initiating reconnect
2013-06-08 20:25:43.112164 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57163 s=2 pgs=24214 cs=6297 l=0).fault, initiating reconnect
2013-06-08 20:25:43.112220 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59580 s=2 pgs=14661 cs=1031 l=0).fault, initiating reconnect
2013-06-08 20:25:43.112339 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34168 s=2 pgs=24402 cs=7591 l=0).fault, initiating reconnect
2013-06-08 20:25:43.112515 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41035 s=2 pgs=20418 cs=3623 l=0).fault, initiating reconnect
2013-06-08 20:25:43.112523 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41124 s=2 pgs=18115 cs=4387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.112542 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34051 s=2 pgs=18559 cs=5781 l=0).fault, initiating reconnect
2013-06-08 20:25:43.112961 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57169 s=2 pgs=24215 cs=6299 l=0).fault, initiating reconnect
2013-06-08 20:25:43.113187 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34174 s=2 pgs=24403 cs=7593 l=0).fault, initiating reconnect
2013-06-08 20:25:43.113262 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59586 s=2 pgs=14662 cs=1033 l=0).fault, initiating reconnect
2013-06-08 20:25:43.113524 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41040 s=2 pgs=20419 cs=3625 l=0).fault, initiating reconnect
2013-06-08 20:25:43.113525 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41130 s=2 pgs=18116 cs=4389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.113555 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34057 s=2 pgs=18560 cs=5783 l=0).fault, initiating reconnect
2013-06-08 20:25:43.114033 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34179 s=2 pgs=24404 cs=7595 l=0).fault, initiating reconnect
2013-06-08 20:25:43.114068 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57175 s=2 pgs=24216 cs=6301 l=0).fault, initiating reconnect
2013-06-08 20:25:43.114498 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59593 s=2 pgs=14663 cs=1035 l=0).fault, initiating reconnect
2013-06-08 20:25:43.114500 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34063 s=2 pgs=18561 cs=5785 l=0).fault, initiating reconnect
2013-06-08 20:25:43.114502 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41046 s=2 pgs=20420 cs=3627 l=0).fault, initiating reconnect
2013-06-08 20:25:43.114671 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41137 s=2 pgs=18117 cs=4391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.114888 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34184 s=2 pgs=24405 cs=7597 l=0).fault, initiating reconnect
2013-06-08 20:25:43.115127 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57182 s=2 pgs=24217 cs=6303 l=0).fault, initiating reconnect
2013-06-08 20:25:43.115363 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34068 s=2 pgs=18562 cs=5787 l=0).fault, initiating reconnect
2013-06-08 20:25:43.115408 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59599 s=2 pgs=14664 cs=1037 l=0).fault, initiating reconnect
2013-06-08 20:25:43.115472 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41052 s=2 pgs=20421 cs=3629 l=0).fault, initiating reconnect
2013-06-08 20:25:43.115732 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41144 s=2 pgs=18118 cs=4393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.115819 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34190 s=2 pgs=24406 cs=7599 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116014 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57188 s=2 pgs=24218 cs=6305 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116040 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34072 s=2 pgs=18563 cs=5789 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116574 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41059 s=2 pgs=20422 cs=3631 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116574 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59606 s=2 pgs=14665 cs=1039 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116663 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34196 s=2 pgs=24407 cs=7601 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116760 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57194 s=2 pgs=24219 cs=6307 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116879 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34078 s=2 pgs=18564 cs=5791 l=0).fault, initiating reconnect
2013-06-08 20:25:43.116939 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41150 s=2 pgs=18119 cs=4395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.117496 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41064 s=2 pgs=20423 cs=3633 l=0).fault, initiating reconnect
2013-06-08 20:25:43.117625 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57199 s=2 pgs=24220 cs=6309 l=0).fault, initiating reconnect
2013-06-08 20:25:43.117639 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59613 s=2 pgs=14666 cs=1041 l=0).fault, initiating reconnect
2013-06-08 20:25:43.117645 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34083 s=2 pgs=18565 cs=5793 l=0).fault, initiating reconnect
2013-06-08 20:25:43.117804 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34201 s=2 pgs=24408 cs=7603 l=0).fault, initiating reconnect
2013-06-08 20:25:43.118314 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41159 s=2 pgs=18120 cs=4397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.118329 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41070 s=2 pgs=20424 cs=3635 l=0).fault, initiating reconnect
2013-06-08 20:25:43.118689 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57203 s=2 pgs=24221 cs=6311 l=0).fault, initiating reconnect
2013-06-08 20:25:43.118699 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34209 s=2 pgs=24409 cs=7605 l=0).fault, initiating reconnect
2013-06-08 20:25:43.118709 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59620 s=2 pgs=14667 cs=1043 l=0).fault, initiating reconnect
2013-06-08 20:25:43.119304 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41076 s=2 pgs=20425 cs=3637 l=0).fault, initiating reconnect
2013-06-08 20:25:43.119363 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34088 s=2 pgs=18566 cs=5795 l=0).fault, initiating reconnect
2013-06-08 20:25:43.119585 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59627 s=2 pgs=14668 cs=1045 l=0).fault, initiating reconnect
2013-06-08 20:25:43.119590 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41165 s=2 pgs=18121 cs=4399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.119603 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57209 s=2 pgs=24222 cs=6313 l=0).fault, initiating reconnect
2013-06-08 20:25:43.119607 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34213 s=2 pgs=24410 cs=7607 l=0).fault, initiating reconnect
2013-06-08 20:25:43.120131 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41080 s=2 pgs=20426 cs=3639 l=0).fault, initiating reconnect
2013-06-08 20:25:43.120455 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34220 s=2 pgs=24411 cs=7609 l=0).fault, initiating reconnect
2013-06-08 20:25:43.120457 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34096 s=2 pgs=18567 cs=5797 l=0).fault, initiating reconnect
2013-06-08 20:25:43.120487 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57216 s=2 pgs=24223 cs=6315 l=0).fault, initiating reconnect
2013-06-08 20:25:43.120538 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59630 s=2 pgs=14669 cs=1047 l=0).fault, initiating reconnect
2013-06-08 20:25:43.120853 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41173 s=2 pgs=18122 cs=4401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.121047 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41086 s=2 pgs=20427 cs=3641 l=0).fault, initiating reconnect
2013-06-08 20:25:43.121202 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34223 s=2 pgs=24412 cs=7611 l=0).fault, initiating reconnect
2013-06-08 20:25:43.121270 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34102 s=2 pgs=18568 cs=5799 l=0).fault, initiating reconnect
2013-06-08 20:25:43.121544 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57221 s=2 pgs=24224 cs=6317 l=0).fault, initiating reconnect
2013-06-08 20:25:43.121592 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59638 s=2 pgs=14670 cs=1049 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122031 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34228 s=2 pgs=24413 cs=7613 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122052 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41092 s=2 pgs=20428 cs=3643 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122214 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34109 s=2 pgs=18569 cs=5801 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122525 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41181 s=2 pgs=18123 cs=4403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122531 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59644 s=2 pgs=14671 cs=1051 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122608 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57227 s=2 pgs=24225 cs=6319 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122882 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41098 s=2 pgs=20429 cs=3645 l=0).fault, initiating reconnect
2013-06-08 20:25:43.122917 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34232 s=2 pgs=24414 cs=7615 l=0).fault, initiating reconnect
2013-06-08 20:25:43.123073 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34114 s=2 pgs=18570 cs=5803 l=0).fault, initiating reconnect
2013-06-08 20:25:43.123537 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57234 s=2 pgs=24226 cs=6321 l=0).fault, initiating reconnect
2013-06-08 20:25:43.123609 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59648 s=2 pgs=14672 cs=1053 l=0).fault, initiating reconnect
2013-06-08 20:25:43.123613 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41191 s=2 pgs=18124 cs=4405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.123776 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34239 s=2 pgs=24415 cs=7617 l=0).fault, initiating reconnect
2013-06-08 20:25:43.123906 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41103 s=2 pgs=20430 cs=3647 l=0).fault, initiating reconnect
2013-06-08 20:25:43.124162 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34120 s=2 pgs=18571 cs=5805 l=0).fault, initiating reconnect
2013-06-08 20:25:43.124563 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :57238 s=2 pgs=24227 cs=6323 l=0).fault, initiating reconnect
2013-06-08 20:25:43.124577 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :59655 s=2 pgs=14673 cs=1055 l=0).fault, initiating reconnect
2013-06-08 20:25:43.124772 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41110 s=2 pgs=20431 cs=3649 l=0).fault, initiating reconnect
2013-06-08 20:25:43.124779 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41198 s=2 pgs=18125 cs=4407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.124874 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34244 s=2 pgs=24416 cs=7619 l=0).fault, initiating reconnect
2013-06-08 20:25:43.125078 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34126 s=2 pgs=18572 cs=5807 l=0).fault, initiating reconnect
2013-06-08 20:25:43.125427 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57244 s=2 pgs=24228 cs=6325 l=0).fault, initiating reconnect
2013-06-08 20:25:43.125654 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59661 s=2 pgs=14674 cs=1057 l=0).fault, initiating reconnect
2013-06-08 20:25:43.125751 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34251 s=2 pgs=24417 cs=7621 l=0).fault, initiating reconnect
2013-06-08 20:25:43.125755 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41114 s=2 pgs=20432 cs=3651 l=0).fault, initiating reconnect
2013-06-08 20:25:43.125976 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34132 s=2 pgs=18573 cs=5809 l=0).fault, initiating reconnect
2013-06-08 20:25:43.126321 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57250 s=2 pgs=24229 cs=6327 l=0).fault, initiating reconnect
2013-06-08 20:25:43.126606 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34255 s=2 pgs=24418 cs=7623 l=0).fault, initiating reconnect
2013-06-08 20:25:43.126618 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59667 s=2 pgs=14675 cs=1059 l=0).fault, initiating reconnect
2013-06-08 20:25:43.126695 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41121 s=2 pgs=20433 cs=3653 l=0).fault, initiating reconnect
2013-06-08 20:25:43.126806 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41205 s=2 pgs=18126 cs=4409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.127028 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34137 s=2 pgs=18574 cs=5811 l=0).fault, initiating reconnect
2013-06-08 20:25:43.127199 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57255 s=2 pgs=24230 cs=6329 l=0).fault, initiating reconnect
2013-06-08 20:25:43.127366 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34259 s=2 pgs=24419 cs=7625 l=0).fault, initiating reconnect
2013-06-08 20:25:43.127642 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59673 s=2 pgs=14676 cs=1061 l=0).fault, initiating reconnect
2013-06-08 20:25:43.127677 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41126 s=2 pgs=20434 cs=3655 l=0).fault, initiating reconnect
2013-06-08 20:25:43.127912 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41217 s=2 pgs=18127 cs=4411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.127915 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34143 s=2 pgs=18575 cs=5813 l=0).fault, initiating reconnect
2013-06-08 20:25:43.128236 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34265 s=2 pgs=24420 cs=7627 l=0).fault, initiating reconnect
2013-06-08 20:25:43.128287 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57261 s=2 pgs=24231 cs=6331 l=0).fault, initiating reconnect
2013-06-08 20:25:43.128621 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41132 s=2 pgs=20435 cs=3657 l=0).fault, initiating reconnect
2013-06-08 20:25:43.128658 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59679 s=2 pgs=14677 cs=1063 l=0).fault, initiating reconnect
2013-06-08 20:25:43.128800 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34149 s=2 pgs=18576 cs=5815 l=0).fault, initiating reconnect
2013-06-08 20:25:43.129159 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41223 s=2 pgs=18128 cs=4413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.129186 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57268 s=2 pgs=24232 cs=6333 l=0).fault, initiating reconnect
2013-06-08 20:25:43.129191 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34270 s=2 pgs=24421 cs=7629 l=0).fault, initiating reconnect
2013-06-08 20:25:43.129337 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41137 s=2 pgs=20436 cs=3659 l=0).fault, initiating reconnect
2013-06-08 20:25:43.129555 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59686 s=2 pgs=14678 cs=1065 l=0).fault, initiating reconnect
2013-06-08 20:25:43.129660 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34154 s=2 pgs=18577 cs=5817 l=0).fault, initiating reconnect
2013-06-08 20:25:43.130004 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34277 s=2 pgs=24422 cs=7631 l=0).fault, initiating reconnect
2013-06-08 20:25:43.130117 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41143 s=2 pgs=20437 cs=3661 l=0).fault, initiating reconnect
2013-06-08 20:25:43.130205 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57273 s=2 pgs=24233 cs=6335 l=0).fault, initiating reconnect
2013-06-08 20:25:43.130304 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41230 s=2 pgs=18129 cs=4415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.130516 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59692 s=2 pgs=14679 cs=1067 l=0).fault, initiating reconnect
2013-06-08 20:25:43.130694 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34160 s=2 pgs=18578 cs=5819 l=0).fault, initiating reconnect
2013-06-08 20:25:43.130754 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34281 s=2 pgs=24423 cs=7633 l=0).fault, initiating reconnect
2013-06-08 20:25:43.131131 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41147 s=2 pgs=20438 cs=3663 l=0).fault, initiating reconnect
2013-06-08 20:25:43.131430 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34166 s=2 pgs=18579 cs=5821 l=0).fault, initiating reconnect
2013-06-08 20:25:43.131537 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59698 s=2 pgs=14680 cs=1069 l=0).fault, initiating reconnect
2013-06-08 20:25:43.131572 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41239 s=2 pgs=18130 cs=4417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.131648 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34287 s=2 pgs=24424 cs=7635 l=0).fault, initiating reconnect
2013-06-08 20:25:43.131922 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57280 s=2 pgs=24234 cs=6337 l=0).fault, initiating reconnect
2013-06-08 20:25:43.132209 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34169 s=2 pgs=18580 cs=5823 l=0).fault, initiating reconnect
2013-06-08 20:25:43.132362 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59703 s=2 pgs=14681 cs=1071 l=0).fault, initiating reconnect
2013-06-08 20:25:43.132442 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34292 s=2 pgs=24425 cs=7637 l=0).fault, initiating reconnect
2013-06-08 20:25:43.132570 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41153 s=2 pgs=20439 cs=3665 l=0).fault, initiating reconnect
2013-06-08 20:25:43.132748 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41246 s=2 pgs=18131 cs=4419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.132816 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57290 s=2 pgs=24235 cs=6339 l=0).fault, initiating reconnect
2013-06-08 20:25:43.133107 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34174 s=2 pgs=18581 cs=5825 l=0).fault, initiating reconnect
2013-06-08 20:25:43.133495 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41162 s=2 pgs=20440 cs=3667 l=0).fault, initiating reconnect
2013-06-08 20:25:43.133539 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59708 s=2 pgs=14682 cs=1073 l=0).fault, initiating reconnect
2013-06-08 20:25:43.133551 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34296 s=2 pgs=24426 cs=7639 l=0).fault, initiating reconnect
2013-06-08 20:25:43.133558 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59708 s=1 pgs=14682 cs=1074 l=0).fault
2013-06-08 20:25:43.133884 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41253 s=2 pgs=18132 cs=4421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.134482 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41166 s=2 pgs=20441 cs=3669 l=0).fault, initiating reconnect
2013-06-08 20:25:43.134493 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34303 s=2 pgs=24427 cs=7641 l=0).fault, initiating reconnect
2013-06-08 20:25:43.134550 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59715 s=2 pgs=14683 cs=1075 l=0).fault, initiating reconnect
2013-06-08 20:25:43.134654 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57296 s=2 pgs=24236 cs=6341 l=0).fault, initiating reconnect
2013-06-08 20:25:43.135143 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34180 s=2 pgs=18582 cs=5827 l=0).fault, initiating reconnect
2013-06-08 20:25:43.135156 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41259 s=2 pgs=18133 cs=4423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.135297 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41170 s=2 pgs=20442 cs=3671 l=0).fault, initiating reconnect
2013-06-08 20:25:43.135395 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59720 s=2 pgs=14684 cs=1077 l=0).fault, initiating reconnect
2013-06-08 20:25:43.135435 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34306 s=2 pgs=24428 cs=7643 l=0).fault, initiating reconnect
2013-06-08 20:25:43.135600 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57305 s=2 pgs=24237 cs=6343 l=0).fault, initiating reconnect
2013-06-08 20:25:43.136100 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41176 s=2 pgs=20443 cs=3673 l=0).fault, initiating reconnect
2013-06-08 20:25:43.136126 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34189 s=2 pgs=18583 cs=5829 l=0).fault, initiating reconnect
2013-06-08 20:25:43.136181 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59725 s=2 pgs=14685 cs=1079 l=0).fault, initiating reconnect
2013-06-08 20:25:43.136248 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34313 s=2 pgs=24429 cs=7645 l=0).fault, initiating reconnect
2013-06-08 20:25:43.136308 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41265 s=2 pgs=18134 cs=4425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.136373 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57311 s=2 pgs=24238 cs=6345 l=0).fault, initiating reconnect
2013-06-08 20:25:43.136929 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34196 s=2 pgs=18584 cs=5831 l=0).fault, initiating reconnect
2013-06-08 20:25:43.137013 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41180 s=2 pgs=20444 cs=3675 l=0).fault, initiating reconnect
2013-06-08 20:25:43.137118 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59730 s=2 pgs=14686 cs=1081 l=0).fault, initiating reconnect
2013-06-08 20:25:43.137301 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57317 s=2 pgs=24239 cs=6347 l=0).fault, initiating reconnect
2013-06-08 20:25:43.137826 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34201 s=2 pgs=18585 cs=5833 l=0).fault, initiating reconnect
2013-06-08 20:25:43.137879 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41187 s=2 pgs=20445 cs=3677 l=0).fault, initiating reconnect
2013-06-08 20:25:43.138200 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59736 s=2 pgs=14687 cs=1083 l=0).fault, initiating reconnect
2013-06-08 20:25:43.138225 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57321 s=2 pgs=24240 cs=6349 l=0).fault, initiating reconnect
2013-06-08 20:25:43.138229 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34318 s=2 pgs=24430 cs=7647 l=0).fault, initiating reconnect
2013-06-08 20:25:43.138666 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34205 s=2 pgs=18586 cs=5835 l=0).fault, initiating reconnect
2013-06-08 20:25:43.138730 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41274 s=2 pgs=18135 cs=4427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.138751 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41191 s=2 pgs=20446 cs=3679 l=0).fault, initiating reconnect
2013-06-08 20:25:43.139109 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34328 s=2 pgs=24431 cs=7649 l=0).fault, initiating reconnect
2013-06-08 20:25:43.139136 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57324 s=2 pgs=24241 cs=6351 l=0).fault, initiating reconnect
2013-06-08 20:25:43.139244 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59742 s=2 pgs=14688 cs=1085 l=0).fault, initiating reconnect
2013-06-08 20:25:43.139565 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41197 s=2 pgs=20447 cs=3681 l=0).fault, initiating reconnect
2013-06-08 20:25:43.139801 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34333 s=2 pgs=24432 cs=7651 l=0).fault, initiating reconnect
2013-06-08 20:25:43.139819 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41286 s=2 pgs=18136 cs=4429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.139874 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34210 s=2 pgs=18587 cs=5837 l=0).fault, initiating reconnect
2013-06-08 20:25:43.140102 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57331 s=2 pgs=24242 cs=6353 l=0).fault, initiating reconnect
2013-06-08 20:25:43.140594 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41201 s=2 pgs=20448 cs=3683 l=0).fault, initiating reconnect
2013-06-08 20:25:43.140604 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34337 s=2 pgs=24433 cs=7653 l=0).fault, initiating reconnect
2013-06-08 20:25:43.140793 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34219 s=2 pgs=18588 cs=5839 l=0).fault, initiating reconnect
2013-06-08 20:25:43.141025 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41293 s=2 pgs=18137 cs=4431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.141091 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57337 s=2 pgs=24243 cs=6355 l=0).fault, initiating reconnect
2013-06-08 20:25:43.141384 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59748 s=2 pgs=14689 cs=1087 l=0).fault, initiating reconnect
2013-06-08 20:25:43.141487 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41206 s=2 pgs=20449 cs=3685 l=0).fault, initiating reconnect
2013-06-08 20:25:43.141563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34342 s=2 pgs=24434 cs=7655 l=0).fault, initiating reconnect
2013-06-08 20:25:43.141832 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34223 s=2 pgs=18589 cs=5841 l=0).fault, initiating reconnect
2013-06-08 20:25:43.141986 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41299 s=2 pgs=18138 cs=4433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.142044 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57342 s=2 pgs=24244 cs=6357 l=0).fault, initiating reconnect
2013-06-08 20:25:43.142427 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41212 s=2 pgs=20450 cs=3687 l=0).fault, initiating reconnect
2013-06-08 20:25:43.142450 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34348 s=2 pgs=24435 cs=7657 l=0).fault, initiating reconnect
2013-06-08 20:25:43.142615 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59759 s=2 pgs=14690 cs=1089 l=0).fault, initiating reconnect
2013-06-08 20:25:43.142784 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34229 s=2 pgs=18590 cs=5843 l=0).fault, initiating reconnect
2013-06-08 20:25:43.142907 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57348 s=2 pgs=24245 cs=6359 l=0).fault, initiating reconnect
2013-06-08 20:25:43.143190 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41305 s=2 pgs=18139 cs=4435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.143256 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34353 s=2 pgs=24436 cs=7659 l=0).fault, initiating reconnect
2013-06-08 20:25:43.143316 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41217 s=2 pgs=20451 cs=3689 l=0).fault, initiating reconnect
2013-06-08 20:25:43.143590 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59767 s=2 pgs=14691 cs=1091 l=0).fault, initiating reconnect
2013-06-08 20:25:43.143735 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57353 s=2 pgs=24246 cs=6361 l=0).fault, initiating reconnect
2013-06-08 20:25:43.143738 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34235 s=2 pgs=18591 cs=5845 l=0).fault, initiating reconnect
2013-06-08 20:25:43.144086 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34358 s=2 pgs=24437 cs=7661 l=0).fault, initiating reconnect
2013-06-08 20:25:43.144140 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41224 s=2 pgs=20452 cs=3691 l=0).fault, initiating reconnect
2013-06-08 20:25:43.144195 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41312 s=2 pgs=18140 cs=4437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.144600 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59773 s=2 pgs=14692 cs=1093 l=0).fault, initiating reconnect
2013-06-08 20:25:43.144729 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57359 s=2 pgs=24247 cs=6363 l=0).fault, initiating reconnect
2013-06-08 20:25:43.144768 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34241 s=2 pgs=18592 cs=5847 l=0).fault, initiating reconnect
2013-06-08 20:25:43.144933 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34363 s=2 pgs=24438 cs=7663 l=0).fault, initiating reconnect
2013-06-08 20:25:43.145122 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41229 s=2 pgs=20453 cs=3693 l=0).fault, initiating reconnect
2013-06-08 20:25:43.145270 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41320 s=2 pgs=18141 cs=4439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.145575 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59779 s=2 pgs=14693 cs=1095 l=0).fault, initiating reconnect
2013-06-08 20:25:43.145631 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34248 s=2 pgs=18593 cs=5849 l=0).fault, initiating reconnect
2013-06-08 20:25:43.145637 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57364 s=2 pgs=24248 cs=6365 l=0).fault, initiating reconnect
2013-06-08 20:25:43.145840 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34369 s=2 pgs=24439 cs=7665 l=0).fault, initiating reconnect
2013-06-08 20:25:43.146062 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41235 s=2 pgs=20454 cs=3695 l=0).fault, initiating reconnect
2013-06-08 20:25:43.146476 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41326 s=2 pgs=18142 cs=4441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.146494 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59785 s=2 pgs=14694 cs=1097 l=0).fault, initiating reconnect
2013-06-08 20:25:43.146568 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34253 s=2 pgs=18594 cs=5851 l=0).fault, initiating reconnect
2013-06-08 20:25:43.146750 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34375 s=2 pgs=24440 cs=7667 l=0).fault, initiating reconnect
2013-06-08 20:25:43.147090 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41241 s=2 pgs=20455 cs=3697 l=0).fault, initiating reconnect
2013-06-08 20:25:43.147453 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57371 s=2 pgs=24249 cs=6367 l=0).fault, initiating reconnect
2013-06-08 20:25:43.147474 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34259 s=2 pgs=18595 cs=5853 l=0).fault, initiating reconnect
2013-06-08 20:25:43.147583 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41332 s=2 pgs=18143 cs=4443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.147593 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34380 s=2 pgs=24441 cs=7669 l=0).fault, initiating reconnect
2013-06-08 20:25:43.147644 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59791 s=2 pgs=14695 cs=1099 l=0).fault, initiating reconnect
2013-06-08 20:25:43.147907 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41246 s=2 pgs=20456 cs=3699 l=0).fault, initiating reconnect
2013-06-08 20:25:43.148256 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57379 s=2 pgs=24250 cs=6369 l=0).fault, initiating reconnect
2013-06-08 20:25:43.148347 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34263 s=2 pgs=18596 cs=5855 l=0).fault, initiating reconnect
2013-06-08 20:25:43.148409 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34385 s=2 pgs=24442 cs=7671 l=0).fault, initiating reconnect
2013-06-08 20:25:43.148499 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59799 s=2 pgs=14696 cs=1101 l=0).fault, initiating reconnect
2013-06-08 20:25:43.148655 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41339 s=2 pgs=18144 cs=4445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.148754 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41252 s=2 pgs=20457 cs=3701 l=0).fault, initiating reconnect
2013-06-08 20:25:43.149044 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34269 s=2 pgs=18597 cs=5857 l=0).fault, initiating reconnect
2013-06-08 20:25:43.149230 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57385 s=2 pgs=24251 cs=6371 l=0).fault, initiating reconnect
2013-06-08 20:25:43.149376 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34390 s=2 pgs=24443 cs=7673 l=0).fault, initiating reconnect
2013-06-08 20:25:43.149506 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41258 s=2 pgs=20458 cs=3703 l=0).fault, initiating reconnect
2013-06-08 20:25:43.149710 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41347 s=2 pgs=18145 cs=4447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.149963 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57392 s=2 pgs=24252 cs=6373 l=0).fault, initiating reconnect
2013-06-08 20:25:43.150116 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34396 s=2 pgs=24444 cs=7675 l=0).fault, initiating reconnect
2013-06-08 20:25:43.150137 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59804 s=2 pgs=14697 cs=1103 l=0).fault, initiating reconnect
2013-06-08 20:25:43.150527 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41262 s=2 pgs=20459 cs=3705 l=0).fault, initiating reconnect
2013-06-08 20:25:43.150784 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41353 s=2 pgs=18146 cs=4449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.150794 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57396 s=2 pgs=24253 cs=6375 l=0).fault, initiating reconnect
2013-06-08 20:25:43.150902 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34400 s=2 pgs=24445 cs=7677 l=0).fault, initiating reconnect
2013-06-08 20:25:43.151069 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34274 s=2 pgs=18598 cs=5859 l=0).fault, initiating reconnect
2013-06-08 20:25:43.151173 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59814 s=2 pgs=14698 cs=1105 l=0).fault, initiating reconnect
2013-06-08 20:25:43.151474 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41267 s=2 pgs=20460 cs=3707 l=0).fault, initiating reconnect
2013-06-08 20:25:43.151530 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57401 s=2 pgs=24254 cs=6377 l=0).fault, initiating reconnect
2013-06-08 20:25:43.151636 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34405 s=2 pgs=24446 cs=7679 l=0).fault, initiating reconnect
2013-06-08 20:25:43.151776 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41358 s=2 pgs=18147 cs=4451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.151921 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34286 s=2 pgs=18599 cs=5861 l=0).fault, initiating reconnect
2013-06-08 20:25:43.152053 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59820 s=2 pgs=14699 cs=1107 l=0).fault, initiating reconnect
2013-06-08 20:25:43.152335 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41273 s=2 pgs=20461 cs=3709 l=0).fault, initiating reconnect
2013-06-08 20:25:43.152407 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34410 s=2 pgs=24447 cs=7681 l=0).fault, initiating reconnect
2013-06-08 20:25:43.152583 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57406 s=2 pgs=24255 cs=6379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.152586 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34292 s=2 pgs=18600 cs=5863 l=0).fault, initiating reconnect
2013-06-08 20:25:43.152763 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41366 s=2 pgs=18148 cs=4453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.153057 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59826 s=2 pgs=14700 cs=1109 l=0).fault, initiating reconnect
2013-06-08 20:25:43.153216 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34415 s=2 pgs=24448 cs=7683 l=0).fault, initiating reconnect
2013-06-08 20:25:43.153349 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41279 s=2 pgs=20462 cs=3711 l=0).fault, initiating reconnect
2013-06-08 20:25:43.153547 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57413 s=2 pgs=24256 cs=6381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.153576 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34297 s=2 pgs=18601 cs=5865 l=0).fault, initiating reconnect
2013-06-08 20:25:43.153796 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41373 s=2 pgs=18149 cs=4455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.153918 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59832 s=2 pgs=14701 cs=1111 l=0).fault, initiating reconnect
2013-06-08 20:25:43.154062 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34420 s=2 pgs=24449 cs=7685 l=0).fault, initiating reconnect
2013-06-08 20:25:43.154243 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41286 s=2 pgs=20463 cs=3713 l=0).fault, initiating reconnect
2013-06-08 20:25:43.154442 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34303 s=2 pgs=18602 cs=5867 l=0).fault, initiating reconnect
2013-06-08 20:25:43.154585 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57419 s=2 pgs=24257 cs=6383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.154752 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41379 s=2 pgs=18150 cs=4457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.154959 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34426 s=2 pgs=24450 cs=7687 l=0).fault, initiating reconnect
2013-06-08 20:25:43.154996 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59838 s=2 pgs=14702 cs=1113 l=0).fault, initiating reconnect
2013-06-08 20:25:43.155118 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41292 s=2 pgs=20464 cs=3715 l=0).fault, initiating reconnect
2013-06-08 20:25:43.155230 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34308 s=2 pgs=18603 cs=5869 l=0).fault, initiating reconnect
2013-06-08 20:25:43.155428 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57426 s=2 pgs=24258 cs=6385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.155744 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41385 s=2 pgs=18151 cs=4459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.155799 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34431 s=2 pgs=24451 cs=7689 l=0).fault, initiating reconnect
2013-06-08 20:25:43.156000 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41298 s=2 pgs=20465 cs=3717 l=0).fault, initiating reconnect
2013-06-08 20:25:43.156004 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59845 s=2 pgs=14703 cs=1115 l=0).fault, initiating reconnect
2013-06-08 20:25:43.156307 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57432 s=2 pgs=24259 cs=6387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.156321 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34314 s=2 pgs=18604 cs=5871 l=0).fault, initiating reconnect
2013-06-08 20:25:43.156695 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34437 s=2 pgs=24452 cs=7691 l=0).fault, initiating reconnect
2013-06-08 20:25:43.156813 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41391 s=2 pgs=18152 cs=4461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.157026 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59852 s=2 pgs=14704 cs=1117 l=0).fault, initiating reconnect
2013-06-08 20:25:43.157088 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41303 s=2 pgs=20466 cs=3719 l=0).fault, initiating reconnect
2013-06-08 20:25:43.157251 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57437 s=2 pgs=24260 cs=6389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.157282 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34321 s=2 pgs=18605 cs=5873 l=0).fault, initiating reconnect
2013-06-08 20:25:43.157444 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34442 s=2 pgs=24453 cs=7693 l=0).fault, initiating reconnect
2013-06-08 20:25:43.158091 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57443 s=2 pgs=24261 cs=6391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.158097 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41310 s=2 pgs=20467 cs=3721 l=0).fault, initiating reconnect
2013-06-08 20:25:43.158109 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59857 s=2 pgs=14705 cs=1119 l=0).fault, initiating reconnect
2013-06-08 20:25:43.158178 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34327 s=2 pgs=18606 cs=5875 l=0).fault, initiating reconnect
2013-06-08 20:25:43.158179 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34448 s=2 pgs=24454 cs=7695 l=0).fault, initiating reconnect
2013-06-08 20:25:43.159020 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34453 s=2 pgs=24455 cs=7697 l=0).fault, initiating reconnect
2013-06-08 20:25:43.159098 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59864 s=2 pgs=14706 cs=1121 l=0).fault, initiating reconnect
2013-06-08 20:25:43.159102 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34332 s=2 pgs=18607 cs=5877 l=0).fault, initiating reconnect
2013-06-08 20:25:43.159101 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57446 s=2 pgs=24262 cs=6393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.159149 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :41315 s=2 pgs=20468 cs=3723 l=0).fault, initiating reconnect
2013-06-08 20:25:43.159850 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41398 s=2 pgs=18153 cs=4463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.160019 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34454 s=2 pgs=24456 cs=7699 l=0).fault, initiating reconnect
2013-06-08 20:25:43.160089 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :41323 s=2 pgs=20469 cs=3725 l=0).fault, initiating reconnect
2013-06-08 20:25:43.160097 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57454 s=2 pgs=24263 cs=6395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.160112 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59868 s=2 pgs=14707 cs=1123 l=0).fault, initiating reconnect
2013-06-08 20:25:43.160838 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41414 s=2 pgs=18154 cs=4465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.160843 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34460 s=2 pgs=24457 cs=7701 l=0).fault, initiating reconnect
2013-06-08 20:25:43.161042 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57459 s=2 pgs=24264 cs=6397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.161051 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59876 s=2 pgs=14708 cs=1125 l=0).fault, initiating reconnect
2013-06-08 20:25:43.161065 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41326 s=2 pgs=20470 cs=3727 l=0).fault, initiating reconnect
2013-06-08 20:25:43.161128 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34336 s=2 pgs=18608 cs=5879 l=0).fault, initiating reconnect
2013-06-08 20:25:43.161717 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34465 s=2 pgs=24458 cs=7703 l=0).fault, initiating reconnect
2013-06-08 20:25:43.161847 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41419 s=2 pgs=18155 cs=4467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162006 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41333 s=2 pgs=20471 cs=3729 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162018 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59880 s=2 pgs=14709 cs=1127 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162093 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34349 s=2 pgs=18609 cs=5881 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162100 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57463 s=2 pgs=24265 cs=6399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162481 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34470 s=2 pgs=24459 cs=7705 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162845 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41426 s=2 pgs=18156 cs=4469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162854 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41337 s=2 pgs=20472 cs=3731 l=0).fault, initiating reconnect
2013-06-08 20:25:43.162873 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :59886 s=2 pgs=14710 cs=1129 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163050 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34354 s=2 pgs=18610 cs=5883 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163051 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57472 s=2 pgs=24266 cs=6401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163405 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34476 s=2 pgs=24460 cs=7707 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163813 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :41434 s=2 pgs=18157 cs=4471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163902 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :57478 s=2 pgs=24267 cs=6403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163906 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41342 s=2 pgs=20473 cs=3733 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163918 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :59891 s=2 pgs=14711 cs=1131 l=0).fault, initiating reconnect
2013-06-08 20:25:43.163969 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34360 s=2 pgs=18611 cs=5885 l=0).fault, initiating reconnect
2013-06-08 20:25:43.164283 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34482 s=2 pgs=24461 cs=7709 l=0).fault, initiating reconnect
2013-06-08 20:25:43.164791 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59899 s=2 pgs=14712 cs=1133 l=0).fault, initiating reconnect
2013-06-08 20:25:43.164856 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34367 s=2 pgs=18612 cs=5887 l=0).fault, initiating reconnect
2013-06-08 20:25:43.164918 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41350 s=2 pgs=20474 cs=3735 l=0).fault, initiating reconnect
2013-06-08 20:25:43.164934 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :41438 s=2 pgs=18158 cs=4473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.164933 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57481 s=2 pgs=24268 cs=6405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.165307 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34488 s=2 pgs=24462 cs=7711 l=0).fault, initiating reconnect
2013-06-08 20:25:43.165806 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57489 s=2 pgs=24269 cs=6407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.165820 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34370 s=2 pgs=18613 cs=5889 l=0).fault, initiating reconnect
2013-06-08 20:25:43.165823 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59902 s=2 pgs=14713 cs=1135 l=0).fault, initiating reconnect
2013-06-08 20:25:43.166045 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :41448 s=2 pgs=18159 cs=4475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.166056 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34494 s=2 pgs=24463 cs=7713 l=0).fault, initiating reconnect
2013-06-08 20:25:43.166586 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41356 s=2 pgs=20475 cs=3737 l=0).fault, initiating reconnect
2013-06-08 20:25:43.166753 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34375 s=2 pgs=18614 cs=5891 l=0).fault, initiating reconnect
2013-06-08 20:25:43.166795 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59909 s=2 pgs=14714 cs=1137 l=0).fault, initiating reconnect
2013-06-08 20:25:43.166851 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34499 s=2 pgs=24464 cs=7715 l=0).fault, initiating reconnect
2013-06-08 20:25:43.166885 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57494 s=2 pgs=24270 cs=6409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.167105 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :41453 s=2 pgs=18160 cs=4477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.167525 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41365 s=2 pgs=20476 cs=3739 l=0).fault, initiating reconnect
2013-06-08 20:25:43.167791 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :59915 s=2 pgs=14715 cs=1139 l=0).fault, initiating reconnect
2013-06-08 20:25:43.167803 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34503 s=2 pgs=24465 cs=7717 l=0).fault, initiating reconnect
2013-06-08 20:25:43.167847 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34381 s=2 pgs=18615 cs=5893 l=0).fault, initiating reconnect
2013-06-08 20:25:43.168168 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57501 s=2 pgs=24271 cs=6411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.168592 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41371 s=2 pgs=20477 cs=3741 l=0).fault, initiating reconnect
2013-06-08 20:25:43.168695 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34508 s=2 pgs=24466 cs=7719 l=0).fault, initiating reconnect
2013-06-08 20:25:43.168720 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34389 s=2 pgs=18616 cs=5895 l=0).fault, initiating reconnect
2013-06-08 20:25:43.168841 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :41460 s=2 pgs=18161 cs=4479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.169156 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59920 s=2 pgs=14716 cs=1141 l=0).fault, initiating reconnect
2013-06-08 20:25:43.169213 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57507 s=2 pgs=24272 cs=6413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.169488 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41376 s=2 pgs=20478 cs=3743 l=0).fault, initiating reconnect
2013-06-08 20:25:43.169506 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34512 s=2 pgs=24467 cs=7721 l=0).fault, initiating reconnect
2013-06-08 20:25:43.169695 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34393 s=2 pgs=18617 cs=5897 l=0).fault, initiating reconnect
2013-06-08 20:25:43.169986 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :41469 s=2 pgs=18162 cs=4481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.170165 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59928 s=2 pgs=14717 cs=1143 l=0).fault, initiating reconnect
2013-06-08 20:25:43.170233 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57513 s=2 pgs=24273 cs=6415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.170369 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34518 s=2 pgs=24468 cs=7723 l=0).fault, initiating reconnect
2013-06-08 20:25:43.170475 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34399 s=2 pgs=18618 cs=5899 l=0).fault, initiating reconnect
2013-06-08 20:25:43.171062 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41382 s=2 pgs=20479 cs=3745 l=0).fault, initiating reconnect
2013-06-08 20:25:43.171074 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59934 s=2 pgs=14718 cs=1145 l=0).fault, initiating reconnect
2013-06-08 20:25:43.171082 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :41475 s=2 pgs=18163 cs=4483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.171081 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57519 s=2 pgs=24274 cs=6417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.171201 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34523 s=2 pgs=24469 cs=7725 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172028 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57524 s=2 pgs=24275 cs=6419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172030 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41393 s=2 pgs=20480 cs=3747 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172048 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41481 s=2 pgs=18164 cs=4485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172067 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34529 s=2 pgs=24470 cs=7727 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172111 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34404 s=2 pgs=18619 cs=5901 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172227 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59938 s=2 pgs=14719 cs=1147 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172821 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41396 s=2 pgs=20481 cs=3749 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172907 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57527 s=2 pgs=24276 cs=6421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.172910 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34533 s=2 pgs=24471 cs=7729 l=0).fault, initiating reconnect
2013-06-08 20:25:43.173120 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41487 s=2 pgs=18165 cs=4487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.173140 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :59948 s=2 pgs=14720 cs=1149 l=0).fault, initiating reconnect
2013-06-08 20:25:43.173138 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34414 s=2 pgs=18620 cs=5903 l=0).fault, initiating reconnect
2013-06-08 20:25:43.173780 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41401 s=2 pgs=20482 cs=3751 l=0).fault, initiating reconnect
2013-06-08 20:25:43.173803 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57534 s=2 pgs=24277 cs=6423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.173824 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34538 s=2 pgs=24472 cs=7731 l=0).fault, initiating reconnect
2013-06-08 20:25:43.173989 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34421 s=2 pgs=18621 cs=5905 l=0).fault, initiating reconnect
2013-06-08 20:25:43.174171 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41494 s=2 pgs=18166 cs=4489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.174173 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :59953 s=2 pgs=14721 cs=1151 l=0).fault, initiating reconnect
2013-06-08 20:25:43.174738 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34544 s=2 pgs=24473 cs=7733 l=0).fault, initiating reconnect
2013-06-08 20:25:43.174755 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57540 s=2 pgs=24278 cs=6425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.174902 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34425 s=2 pgs=18622 cs=5907 l=0).fault, initiating reconnect
2013-06-08 20:25:43.175275 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41502 s=2 pgs=18167 cs=4491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.175443 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59959 s=2 pgs=14722 cs=1153 l=0).fault, initiating reconnect
2013-06-08 20:25:43.175483 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34548 s=2 pgs=24474 cs=7735 l=0).fault, initiating reconnect
2013-06-08 20:25:43.175631 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57546 s=2 pgs=24279 cs=6427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.175669 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34430 s=2 pgs=18623 cs=5909 l=0).fault, initiating reconnect
2013-06-08 20:25:43.175779 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41407 s=2 pgs=20483 cs=3753 l=0).fault, initiating reconnect
2013-06-08 20:25:43.176244 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34553 s=2 pgs=24475 cs=7737 l=0).fault, initiating reconnect
2013-06-08 20:25:43.176263 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59965 s=2 pgs=14723 cs=1155 l=0).fault, initiating reconnect
2013-06-08 20:25:43.176363 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41506 s=2 pgs=18168 cs=4493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.176605 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57551 s=2 pgs=24280 cs=6429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.176622 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41421 s=2 pgs=20484 cs=3755 l=0).fault, initiating reconnect
2013-06-08 20:25:43.176639 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34435 s=2 pgs=18624 cs=5911 l=0).fault, initiating reconnect
2013-06-08 20:25:43.177064 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34557 s=2 pgs=24476 cs=7739 l=0).fault, initiating reconnect
2013-06-08 20:25:43.177260 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59971 s=2 pgs=14724 cs=1157 l=0).fault, initiating reconnect
2013-06-08 20:25:43.177405 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41514 s=2 pgs=18169 cs=4495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.177558 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34442 s=2 pgs=18625 cs=5913 l=0).fault, initiating reconnect
2013-06-08 20:25:43.177559 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57557 s=2 pgs=24281 cs=6431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.177629 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41426 s=2 pgs=20485 cs=3757 l=0).fault, initiating reconnect
2013-06-08 20:25:43.177962 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34563 s=2 pgs=24477 cs=7741 l=0).fault, initiating reconnect
2013-06-08 20:25:43.178291 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59977 s=2 pgs=14725 cs=1159 l=0).fault, initiating reconnect
2013-06-08 20:25:43.178412 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41433 s=2 pgs=20486 cs=3759 l=0).fault, initiating reconnect
2013-06-08 20:25:43.178448 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34446 s=2 pgs=18626 cs=5915 l=0).fault, initiating reconnect
2013-06-08 20:25:43.178494 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57564 s=2 pgs=24282 cs=6433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.178680 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41520 s=2 pgs=18170 cs=4497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.178685 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34569 s=2 pgs=24478 cs=7743 l=0).fault, initiating reconnect
2013-06-08 20:25:43.179306 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59983 s=2 pgs=14726 cs=1161 l=0).fault, initiating reconnect
2013-06-08 20:25:43.179337 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34452 s=2 pgs=18627 cs=5917 l=0).fault, initiating reconnect
2013-06-08 20:25:43.179443 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41436 s=2 pgs=20487 cs=3761 l=0).fault, initiating reconnect
2013-06-08 20:25:43.179507 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57570 s=2 pgs=24283 cs=6435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.179516 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34575 s=2 pgs=24479 cs=7745 l=0).fault, initiating reconnect
2013-06-08 20:25:43.179859 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41529 s=2 pgs=18171 cs=4499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.180215 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34457 s=2 pgs=18628 cs=5919 l=0).fault, initiating reconnect
2013-06-08 20:25:43.180234 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59989 s=2 pgs=14727 cs=1163 l=0).fault, initiating reconnect
2013-06-08 20:25:43.180364 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41443 s=2 pgs=20488 cs=3763 l=0).fault, initiating reconnect
2013-06-08 20:25:43.180381 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57576 s=2 pgs=24284 cs=6437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.180440 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34580 s=2 pgs=24480 cs=7747 l=0).fault, initiating reconnect
2013-06-08 20:25:43.181164 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34462 s=2 pgs=18629 cs=5921 l=0).fault, initiating reconnect
2013-06-08 20:25:43.181273 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34586 s=2 pgs=24481 cs=7749 l=0).fault, initiating reconnect
2013-06-08 20:25:43.181289 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41536 s=2 pgs=18172 cs=4501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.181291 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :59996 s=2 pgs=14728 cs=1165 l=0).fault, initiating reconnect
2013-06-08 20:25:43.181286 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41449 s=2 pgs=20489 cs=3765 l=0).fault, initiating reconnect
2013-06-08 20:25:43.181396 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57582 s=2 pgs=24285 cs=6439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.182027 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34467 s=2 pgs=18630 cs=5923 l=0).fault, initiating reconnect
2013-06-08 20:25:43.182078 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60002 s=2 pgs=14729 cs=1167 l=0).fault, initiating reconnect
2013-06-08 20:25:43.182089 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41456 s=2 pgs=20490 cs=3767 l=0).fault, initiating reconnect
2013-06-08 20:25:43.182200 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34588 s=2 pgs=24482 cs=7751 l=0).fault, initiating reconnect
2013-06-08 20:25:43.182493 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41545 s=2 pgs=18173 cs=4503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.182902 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34473 s=2 pgs=18631 cs=5925 l=0).fault, initiating reconnect
2013-06-08 20:25:43.182982 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34596 s=2 pgs=24483 cs=7753 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183020 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60007 s=2 pgs=14730 cs=1169 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183041 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41460 s=2 pgs=20491 cs=3769 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183178 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57589 s=2 pgs=24286 cs=6441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183572 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41552 s=2 pgs=18174 cs=4505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183806 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34601 s=2 pgs=24484 cs=7755 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183902 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34478 s=2 pgs=18632 cs=5927 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183930 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60012 s=2 pgs=14731 cs=1171 l=0).fault, initiating reconnect
2013-06-08 20:25:43.183998 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41465 s=2 pgs=20492 cs=3771 l=0).fault, initiating reconnect
2013-06-08 20:25:43.184057 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57599 s=2 pgs=24287 cs=6443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.184550 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34604 s=2 pgs=24485 cs=7757 l=0).fault, initiating reconnect
2013-06-08 20:25:43.184742 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41558 s=2 pgs=18175 cs=4507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.184784 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60019 s=2 pgs=14732 cs=1173 l=0).fault, initiating reconnect
2013-06-08 20:25:43.184813 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34485 s=2 pgs=18633 cs=5929 l=0).fault, initiating reconnect
2013-06-08 20:25:43.184956 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57605 s=2 pgs=24288 cs=6445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.184995 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41472 s=2 pgs=20493 cs=3773 l=0).fault, initiating reconnect
2013-06-08 20:25:43.185382 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34609 s=2 pgs=24486 cs=7759 l=0).fault, initiating reconnect
2013-06-08 20:25:43.185639 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34492 s=2 pgs=18634 cs=5931 l=0).fault, initiating reconnect
2013-06-08 20:25:43.185714 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60024 s=2 pgs=14733 cs=1175 l=0).fault, initiating reconnect
2013-06-08 20:25:43.185897 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41565 s=2 pgs=18176 cs=4509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.185951 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41479 s=2 pgs=20494 cs=3775 l=0).fault, initiating reconnect
2013-06-08 20:25:43.185980 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57610 s=2 pgs=24289 cs=6447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.186210 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34615 s=2 pgs=24487 cs=7761 l=0).fault, initiating reconnect
2013-06-08 20:25:43.186452 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34496 s=2 pgs=18635 cs=5933 l=0).fault, initiating reconnect
2013-06-08 20:25:43.186757 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60030 s=2 pgs=14734 cs=1177 l=0).fault, initiating reconnect
2013-06-08 20:25:43.186940 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41484 s=2 pgs=20495 cs=3777 l=0).fault, initiating reconnect
2013-06-08 20:25:43.186944 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57617 s=2 pgs=24290 cs=6449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.187127 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41573 s=2 pgs=18177 cs=4511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.187220 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34621 s=2 pgs=24488 cs=7763 l=0).fault, initiating reconnect
2013-06-08 20:25:43.187580 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34502 s=2 pgs=18636 cs=5935 l=0).fault, initiating reconnect
2013-06-08 20:25:43.187773 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41489 s=2 pgs=20496 cs=3779 l=0).fault, initiating reconnect
2013-06-08 20:25:43.187818 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60036 s=2 pgs=14735 cs=1179 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188008 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57622 s=2 pgs=24291 cs=6451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188056 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34627 s=2 pgs=24489 cs=7765 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188206 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41581 s=2 pgs=18178 cs=4513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188495 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34508 s=2 pgs=18637 cs=5937 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188665 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41494 s=2 pgs=20497 cs=3781 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188780 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34632 s=2 pgs=24490 cs=7767 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188886 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :57628 s=2 pgs=24292 cs=6453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.188894 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60043 s=2 pgs=14736 cs=1181 l=0).fault, initiating reconnect
2013-06-08 20:25:43.189243 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41588 s=2 pgs=18179 cs=4515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.189375 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41500 s=2 pgs=20498 cs=3783 l=0).fault, initiating reconnect
2013-06-08 20:25:43.189432 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34514 s=2 pgs=18638 cs=5939 l=0).fault, initiating reconnect
2013-06-08 20:25:43.189595 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34636 s=2 pgs=24491 cs=7769 l=0).fault, initiating reconnect
2013-06-08 20:25:43.189967 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60051 s=2 pgs=14737 cs=1183 l=0).fault, initiating reconnect
2013-06-08 20:25:43.189972 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57634 s=2 pgs=24293 cs=6455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.190239 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34521 s=2 pgs=18639 cs=5941 l=0).fault, initiating reconnect
2013-06-08 20:25:43.190314 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41505 s=2 pgs=20499 cs=3785 l=0).fault, initiating reconnect
2013-06-08 20:25:43.190338 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41594 s=2 pgs=18180 cs=4517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.190381 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34642 s=2 pgs=24492 cs=7771 l=0).fault, initiating reconnect
2013-06-08 20:25:43.190884 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57641 s=2 pgs=24294 cs=6457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.190965 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60056 s=2 pgs=14738 cs=1185 l=0).fault, initiating reconnect
2013-06-08 20:25:43.191074 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34525 s=2 pgs=18640 cs=5943 l=0).fault, initiating reconnect
2013-06-08 20:25:43.191134 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41511 s=2 pgs=20500 cs=3787 l=0).fault, initiating reconnect
2013-06-08 20:25:43.191258 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34648 s=2 pgs=24493 cs=7773 l=0).fault, initiating reconnect
2013-06-08 20:25:43.191451 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41602 s=2 pgs=18181 cs=4519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.191788 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60063 s=2 pgs=14739 cs=1187 l=0).fault, initiating reconnect
2013-06-08 20:25:43.191872 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57646 s=2 pgs=24295 cs=6459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192000 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34653 s=2 pgs=24494 cs=7775 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192022 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41517 s=2 pgs=20501 cs=3789 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192203 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34531 s=2 pgs=18641 cs=5945 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192605 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41609 s=2 pgs=18182 cs=4521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192750 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57653 s=2 pgs=24296 cs=6461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192759 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34657 s=2 pgs=24495 cs=7777 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192878 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41523 s=2 pgs=20502 cs=3791 l=0).fault, initiating reconnect
2013-06-08 20:25:43.192910 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60068 s=2 pgs=14740 cs=1189 l=0).fault, initiating reconnect
2013-06-08 20:25:43.193086 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34539 s=2 pgs=18642 cs=5947 l=0).fault, initiating reconnect
2013-06-08 20:25:43.193443 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57658 s=2 pgs=24297 cs=6463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.193519 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34662 s=2 pgs=24496 cs=7779 l=0).fault, initiating reconnect
2013-06-08 20:25:43.193781 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41615 s=2 pgs=18183 cs=4523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.193806 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60077 s=2 pgs=14741 cs=1191 l=0).fault, initiating reconnect
2013-06-08 20:25:43.193987 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34545 s=2 pgs=18643 cs=5949 l=0).fault, initiating reconnect
2013-06-08 20:25:43.194279 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34667 s=2 pgs=24497 cs=7781 l=0).fault, initiating reconnect
2013-06-08 20:25:43.194459 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57663 s=2 pgs=24298 cs=6465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.194563 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41528 s=2 pgs=20503 cs=3793 l=0).fault, initiating reconnect
2013-06-08 20:25:43.194767 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60082 s=2 pgs=14742 cs=1193 l=0).fault, initiating reconnect
2013-06-08 20:25:43.194776 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=29 :34550 s=2 pgs=18644 cs=5951 l=0).fault, initiating reconnect
2013-06-08 20:25:43.194971 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34671 s=2 pgs=24498 cs=7783 l=0).fault, initiating reconnect
2013-06-08 20:25:43.195639 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41623 s=2 pgs=18184 cs=4525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.195649 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34555 s=2 pgs=18645 cs=5953 l=0).fault, initiating reconnect
2013-06-08 20:25:43.195653 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :41538 s=2 pgs=20504 cs=3795 l=0).fault, initiating reconnect
2013-06-08 20:25:43.195805 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60087 s=2 pgs=14743 cs=1195 l=0).fault, initiating reconnect
2013-06-08 20:25:43.195843 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34676 s=2 pgs=24499 cs=7785 l=0).fault, initiating reconnect
2013-06-08 20:25:43.196410 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34558 s=2 pgs=18646 cs=5955 l=0).fault, initiating reconnect
2013-06-08 20:25:43.196561 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57669 s=2 pgs=24299 cs=6467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.196567 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41544 s=2 pgs=20505 cs=3797 l=0).fault, initiating reconnect
2013-06-08 20:25:43.196763 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60093 s=2 pgs=14744 cs=1197 l=0).fault, initiating reconnect
2013-06-08 20:25:43.196759 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34681 s=2 pgs=24500 cs=7787 l=0).fault, initiating reconnect
2013-06-08 20:25:43.196881 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41632 s=2 pgs=18185 cs=4527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.197192 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34562 s=2 pgs=18647 cs=5957 l=0).fault, initiating reconnect
2013-06-08 20:25:43.197413 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41549 s=2 pgs=20506 cs=3799 l=0).fault, initiating reconnect
2013-06-08 20:25:43.197519 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57680 s=2 pgs=24300 cs=6469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.197547 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60099 s=2 pgs=14745 cs=1199 l=0).fault, initiating reconnect
2013-06-08 20:25:43.197578 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34685 s=2 pgs=24501 cs=7789 l=0).fault, initiating reconnect
2013-06-08 20:25:43.197939 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41642 s=2 pgs=18186 cs=4529 l=0).fault, initiating reconnect
2013-06-08 20:25:43.198068 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34568 s=2 pgs=18648 cs=5959 l=0).fault, initiating reconnect
2013-06-08 20:25:43.198380 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34692 s=2 pgs=24502 cs=7791 l=0).fault, initiating reconnect
2013-06-08 20:25:43.198386 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41554 s=2 pgs=20507 cs=3801 l=0).fault, initiating reconnect
2013-06-08 20:25:43.198395 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57687 s=2 pgs=24301 cs=6471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.198545 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60104 s=2 pgs=14746 cs=1201 l=0).fault, initiating reconnect
2013-06-08 20:25:43.199033 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41648 s=2 pgs=18187 cs=4531 l=0).fault, initiating reconnect
2013-06-08 20:25:43.199111 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34574 s=2 pgs=18649 cs=5961 l=0).fault, initiating reconnect
2013-06-08 20:25:43.199298 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34695 s=2 pgs=24503 cs=7793 l=0).fault, initiating reconnect
2013-06-08 20:25:43.199299 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41561 s=2 pgs=20508 cs=3803 l=0).fault, initiating reconnect
2013-06-08 20:25:43.199394 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57694 s=2 pgs=24302 cs=6473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.199559 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60111 s=2 pgs=14747 cs=1203 l=0).fault, initiating reconnect
2013-06-08 20:25:43.199846 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34580 s=2 pgs=18650 cs=5963 l=0).fault, initiating reconnect
2013-06-08 20:25:43.200252 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41654 s=2 pgs=18188 cs=4533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.200268 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41566 s=2 pgs=20509 cs=3805 l=0).fault, initiating reconnect
2013-06-08 20:25:43.200385 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57700 s=2 pgs=24303 cs=6475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.200649 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60117 s=2 pgs=14748 cs=1205 l=0).fault, initiating reconnect
2013-06-08 20:25:43.200693 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34585 s=2 pgs=18651 cs=5965 l=0).fault, initiating reconnect
2013-06-08 20:25:43.201151 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41572 s=2 pgs=20510 cs=3807 l=0).fault, initiating reconnect
2013-06-08 20:25:43.201162 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34701 s=2 pgs=24504 cs=7795 l=0).fault, initiating reconnect
2013-06-08 20:25:43.201486 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57705 s=2 pgs=24304 cs=6477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.201542 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60122 s=2 pgs=14749 cs=1207 l=0).fault, initiating reconnect
2013-06-08 20:25:43.201554 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41661 s=2 pgs=18189 cs=4535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.201748 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34590 s=2 pgs=18652 cs=5967 l=0).fault, initiating reconnect
2013-06-08 20:25:43.202045 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34712 s=2 pgs=24505 cs=7797 l=0).fault, initiating reconnect
2013-06-08 20:25:43.202188 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41576 s=2 pgs=20511 cs=3809 l=0).fault, initiating reconnect
2013-06-08 20:25:43.202566 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41670 s=2 pgs=18190 cs=4537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.202611 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60127 s=2 pgs=14750 cs=1209 l=0).fault, initiating reconnect
2013-06-08 20:25:43.202622 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34596 s=2 pgs=18653 cs=5969 l=0).fault, initiating reconnect
2013-06-08 20:25:43.202625 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57710 s=2 pgs=24305 cs=6479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.202852 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34717 s=2 pgs=24506 cs=7799 l=0).fault, initiating reconnect
2013-06-08 20:25:43.203150 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41583 s=2 pgs=20512 cs=3811 l=0).fault, initiating reconnect
2013-06-08 20:25:43.203477 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34601 s=2 pgs=18654 cs=5971 l=0).fault, initiating reconnect
2013-06-08 20:25:43.203639 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57717 s=2 pgs=24306 cs=6481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.203660 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :41677 s=2 pgs=18191 cs=4539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.203672 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :60132 s=2 pgs=14751 cs=1211 l=0).fault, initiating reconnect
2013-06-08 20:25:43.203699 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34723 s=2 pgs=24507 cs=7801 l=0).fault, initiating reconnect
2013-06-08 20:25:43.204315 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34605 s=2 pgs=18655 cs=5973 l=0).fault, initiating reconnect
2013-06-08 20:25:43.204533 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34729 s=2 pgs=24508 cs=7803 l=0).fault, initiating reconnect
2013-06-08 20:25:43.204602 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60141 s=2 pgs=14752 cs=1213 l=0).fault, initiating reconnect
2013-06-08 20:25:43.204655 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57723 s=2 pgs=24307 cs=6483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.204666 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41682 s=2 pgs=18192 cs=4541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.204971 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41589 s=2 pgs=20513 cs=3813 l=0).fault, initiating reconnect
2013-06-08 20:25:43.205156 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34610 s=2 pgs=18656 cs=5975 l=0).fault, initiating reconnect
2013-06-08 20:25:43.205403 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34731 s=2 pgs=24509 cs=7805 l=0).fault, initiating reconnect
2013-06-08 20:25:43.205650 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60145 s=2 pgs=14753 cs=1215 l=0).fault, initiating reconnect
2013-06-08 20:25:43.205674 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57730 s=2 pgs=24308 cs=6485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.205677 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41689 s=2 pgs=18193 cs=4543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.205878 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41600 s=2 pgs=20514 cs=3815 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206143 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34737 s=2 pgs=24510 cs=7807 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206157 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34616 s=2 pgs=18657 cs=5977 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206601 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :57736 s=2 pgs=24309 cs=6487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206611 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60151 s=2 pgs=14754 cs=1217 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206774 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41606 s=2 pgs=20515 cs=3817 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206919 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41695 s=2 pgs=18194 cs=4545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206940 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34623 s=2 pgs=18658 cs=5979 l=0).fault, initiating reconnect
2013-06-08 20:25:43.206988 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34742 s=2 pgs=24511 cs=7809 l=0).fault, initiating reconnect
2013-06-08 20:25:43.207529 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :57741 s=2 pgs=24310 cs=6489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.207579 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60158 s=2 pgs=14755 cs=1219 l=0).fault, initiating reconnect
2013-06-08 20:25:43.207625 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41611 s=2 pgs=20516 cs=3819 l=0).fault, initiating reconnect
2013-06-08 20:25:43.207799 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34749 s=2 pgs=24512 cs=7811 l=0).fault, initiating reconnect
2013-06-08 20:25:43.207797 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34628 s=2 pgs=18659 cs=5981 l=0).fault, initiating reconnect
2013-06-08 20:25:43.208208 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41702 s=2 pgs=18195 cs=4547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.208364 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :57747 s=2 pgs=24311 cs=6491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.208524 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :34753 s=2 pgs=24513 cs=7813 l=0).fault, initiating reconnect
2013-06-08 20:25:43.208542 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41617 s=2 pgs=20517 cs=3821 l=0).fault, initiating reconnect
2013-06-08 20:25:43.208590 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60164 s=2 pgs=14756 cs=1221 l=0).fault, initiating reconnect
2013-06-08 20:25:43.208724 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34634 s=2 pgs=18660 cs=5983 l=0).fault, initiating reconnect
2013-06-08 20:25:43.209124 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41710 s=2 pgs=18196 cs=4549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.209240 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41623 s=2 pgs=20518 cs=3823 l=0).fault, initiating reconnect
2013-06-08 20:25:43.209254 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :57753 s=2 pgs=24312 cs=6493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.209323 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :34757 s=2 pgs=24514 cs=7815 l=0).fault, initiating reconnect
2013-06-08 20:25:43.209657 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34640 s=2 pgs=18661 cs=5985 l=0).fault, initiating reconnect
2013-06-08 20:25:43.210175 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41627 s=2 pgs=20519 cs=3825 l=0).fault, initiating reconnect
2013-06-08 20:25:43.210190 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :34764 s=2 pgs=24515 cs=7817 l=0).fault, initiating reconnect
2013-06-08 20:25:43.210651 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34645 s=2 pgs=18662 cs=5987 l=0).fault, initiating reconnect
2013-06-08 20:25:43.210674 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60172 s=2 pgs=14757 cs=1223 l=0).fault, initiating reconnect
2013-06-08 20:25:43.210994 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41716 s=2 pgs=18197 cs=4551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.210994 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :34767 s=2 pgs=24516 cs=7819 l=0).fault, initiating reconnect
2013-06-08 20:25:43.210999 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :57760 s=2 pgs=24313 cs=6495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.211254 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41631 s=2 pgs=20520 cs=3827 l=0).fault, initiating reconnect
2013-06-08 20:25:43.211484 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34648 s=2 pgs=18663 cs=5989 l=0).fault, initiating reconnect
2013-06-08 20:25:43.211724 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60182 s=2 pgs=14758 cs=1225 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212013 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34772 s=2 pgs=24517 cs=7821 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212110 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41725 s=2 pgs=18198 cs=4553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212115 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41638 s=2 pgs=20521 cs=3829 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212164 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57768 s=2 pgs=24314 cs=6497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212446 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34654 s=2 pgs=18664 cs=5991 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212537 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60188 s=2 pgs=14759 cs=1227 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212773 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34776 s=2 pgs=24518 cs=7823 l=0).fault, initiating reconnect
2013-06-08 20:25:43.212992 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41643 s=2 pgs=20522 cs=3831 l=0).fault, initiating reconnect
2013-06-08 20:25:43.213134 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57776 s=2 pgs=24315 cs=6499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.213161 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41732 s=2 pgs=18199 cs=4555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.213393 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34660 s=2 pgs=18665 cs=5993 l=0).fault, initiating reconnect
2013-06-08 20:25:43.213516 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60194 s=2 pgs=14760 cs=1229 l=0).fault, initiating reconnect
2013-06-08 20:25:43.213596 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34782 s=2 pgs=24519 cs=7825 l=0).fault, initiating reconnect
2013-06-08 20:25:43.213865 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41648 s=2 pgs=20523 cs=3833 l=0).fault, initiating reconnect
2013-06-08 20:25:43.213879 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57781 s=2 pgs=24316 cs=6501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.214289 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34666 s=2 pgs=18666 cs=5995 l=0).fault, initiating reconnect
2013-06-08 20:25:43.214475 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41740 s=2 pgs=18200 cs=4557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.214673 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57787 s=2 pgs=24317 cs=6503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.214823 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41654 s=2 pgs=20524 cs=3835 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215111 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34788 s=2 pgs=24520 cs=7827 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215117 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=30 :34671 s=2 pgs=18667 cs=5997 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215455 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41747 s=2 pgs=18201 cs=4559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215635 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57790 s=2 pgs=24318 cs=6505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215656 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60200 s=2 pgs=14761 cs=1231 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215832 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41659 s=2 pgs=20525 cs=3837 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215880 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34795 s=2 pgs=24521 cs=7829 l=0).fault, initiating reconnect
2013-06-08 20:25:43.215925 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34676 s=2 pgs=18668 cs=5999 l=0).fault, initiating reconnect
2013-06-08 20:25:43.216606 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57795 s=2 pgs=24319 cs=6507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.216609 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41752 s=2 pgs=18202 cs=4561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.216724 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34801 s=2 pgs=24522 cs=7831 l=0).fault, initiating reconnect
2013-06-08 20:25:43.216767 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60212 s=2 pgs=14762 cs=1233 l=0).fault, initiating reconnect
2013-06-08 20:25:43.216792 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34682 s=2 pgs=18669 cs=6001 l=0).fault, initiating reconnect
2013-06-08 20:25:43.216888 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41665 s=2 pgs=20526 cs=3839 l=0).fault, initiating reconnect
2013-06-08 20:25:43.217411 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57800 s=2 pgs=24320 cs=6509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.217510 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34805 s=2 pgs=24523 cs=7833 l=0).fault, initiating reconnect
2013-06-08 20:25:43.217708 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41759 s=2 pgs=18203 cs=4563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.217711 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34687 s=2 pgs=18670 cs=6003 l=0).fault, initiating reconnect
2013-06-08 20:25:43.217785 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60219 s=2 pgs=14763 cs=1235 l=0).fault, initiating reconnect
2013-06-08 20:25:43.217918 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41673 s=2 pgs=20527 cs=3841 l=0).fault, initiating reconnect
2013-06-08 20:25:43.218335 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57806 s=2 pgs=24321 cs=6511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.218305 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34810 s=2 pgs=24524 cs=7835 l=0).fault, initiating reconnect
2013-06-08 20:25:43.218713 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41767 s=2 pgs=18204 cs=4565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.218728 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60226 s=2 pgs=14764 cs=1237 l=0).fault, initiating reconnect
2013-06-08 20:25:43.218731 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34691 s=2 pgs=18671 cs=6005 l=0).fault, initiating reconnect
2013-06-08 20:25:43.218910 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41679 s=2 pgs=20528 cs=3843 l=0).fault, initiating reconnect
2013-06-08 20:25:43.219119 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34816 s=2 pgs=24525 cs=7837 l=0).fault, initiating reconnect
2013-06-08 20:25:43.219195 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57812 s=2 pgs=24322 cs=6513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.219672 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34699 s=2 pgs=18672 cs=6007 l=0).fault, initiating reconnect
2013-06-08 20:25:43.219802 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41685 s=2 pgs=20529 cs=3845 l=0).fault, initiating reconnect
2013-06-08 20:25:43.219811 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41772 s=2 pgs=18205 cs=4567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.220020 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34821 s=2 pgs=24526 cs=7839 l=0).fault, initiating reconnect
2013-06-08 20:25:43.220033 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60231 s=2 pgs=14765 cs=1239 l=0).fault, initiating reconnect
2013-06-08 20:25:43.220166 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57819 s=2 pgs=24323 cs=6515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.220569 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34703 s=2 pgs=18673 cs=6009 l=0).fault, initiating reconnect
2013-06-08 20:25:43.220729 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34826 s=2 pgs=24527 cs=7841 l=0).fault, initiating reconnect
2013-06-08 20:25:43.220894 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41689 s=2 pgs=20530 cs=3847 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221009 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57825 s=2 pgs=24324 cs=6517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221122 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41780 s=2 pgs=18206 cs=4569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221136 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60240 s=2 pgs=14766 cs=1241 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221409 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34709 s=2 pgs=18674 cs=6011 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221500 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34830 s=2 pgs=24528 cs=7843 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221880 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41696 s=2 pgs=20531 cs=3849 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221898 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57829 s=2 pgs=24325 cs=6519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.221991 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60247 s=2 pgs=14767 cs=1243 l=0).fault, initiating reconnect
2013-06-08 20:25:43.222254 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34836 s=2 pgs=24529 cs=7845 l=0).fault, initiating reconnect
2013-06-08 20:25:43.222264 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34715 s=2 pgs=18675 cs=6013 l=0).fault, initiating reconnect
2013-06-08 20:25:43.222404 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41788 s=2 pgs=18207 cs=4571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.222805 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41702 s=2 pgs=20532 cs=3851 l=0).fault, initiating reconnect
2013-06-08 20:25:43.222878 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57835 s=2 pgs=24326 cs=6521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.223080 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34721 s=2 pgs=18676 cs=6015 l=0).fault, initiating reconnect
2013-06-08 20:25:43.223128 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34840 s=2 pgs=24530 cs=7847 l=0).fault, initiating reconnect
2013-06-08 20:25:43.223133 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60252 s=2 pgs=14768 cs=1245 l=0).fault, initiating reconnect
2013-06-08 20:25:43.223744 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57841 s=2 pgs=24327 cs=6523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.223817 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41708 s=2 pgs=20533 cs=3853 l=0).fault, initiating reconnect
2013-06-08 20:25:43.223999 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34846 s=2 pgs=24531 cs=7849 l=0).fault, initiating reconnect
2013-06-08 20:25:43.224028 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34725 s=2 pgs=18677 cs=6017 l=0).fault, initiating reconnect
2013-06-08 20:25:43.224179 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60260 s=2 pgs=14769 cs=1247 l=0).fault, initiating reconnect
2013-06-08 20:25:43.224624 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57845 s=2 pgs=24328 cs=6525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.224868 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :34731 s=2 pgs=18678 cs=6019 l=0).fault, initiating reconnect
2013-06-08 20:25:43.224884 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :41797 s=2 pgs=18208 cs=4573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.224930 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34850 s=2 pgs=24532 cs=7851 l=0).fault, initiating reconnect
2013-06-08 20:25:43.225000 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41714 s=2 pgs=20534 cs=3855 l=0).fault, initiating reconnect
2013-06-08 20:25:43.225327 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60265 s=2 pgs=14770 cs=1249 l=0).fault, initiating reconnect
2013-06-08 20:25:43.225523 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57850 s=2 pgs=24329 cs=6527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.225758 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34856 s=2 pgs=24533 cs=7853 l=0).fault, initiating reconnect
2013-06-08 20:25:43.225793 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34734 s=2 pgs=18679 cs=6021 l=0).fault, initiating reconnect
2013-06-08 20:25:43.226017 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :41810 s=2 pgs=18209 cs=4575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.226358 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57856 s=2 pgs=24330 cs=6529 l=0).fault, initiating reconnect
2013-06-08 20:25:43.226414 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60271 s=2 pgs=14771 cs=1251 l=0).fault, initiating reconnect
2013-06-08 20:25:43.226433 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41722 s=2 pgs=20535 cs=3857 l=0).fault, initiating reconnect
2013-06-08 20:25:43.226667 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34860 s=2 pgs=24534 cs=7855 l=0).fault, initiating reconnect
2013-06-08 20:25:43.226699 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34741 s=2 pgs=18680 cs=6023 l=0).fault, initiating reconnect
2013-06-08 20:25:43.227142 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :41817 s=2 pgs=18210 cs=4577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.227363 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57860 s=2 pgs=24331 cs=6531 l=0).fault, initiating reconnect
2013-06-08 20:25:43.227368 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34867 s=2 pgs=24535 cs=7857 l=0).fault, initiating reconnect
2013-06-08 20:25:43.227370 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41730 s=2 pgs=20536 cs=3859 l=0).fault, initiating reconnect
2013-06-08 20:25:43.227448 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60277 s=2 pgs=14772 cs=1253 l=0).fault, initiating reconnect
2013-06-08 20:25:43.227804 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34746 s=2 pgs=18681 cs=6025 l=0).fault, initiating reconnect
2013-06-08 20:25:43.228374 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :41823 s=2 pgs=18211 cs=4579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.228497 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57866 s=2 pgs=24332 cs=6533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.228498 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41736 s=2 pgs=20537 cs=3861 l=0).fault, initiating reconnect
2013-06-08 20:25:43.228535 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34870 s=2 pgs=24536 cs=7859 l=0).fault, initiating reconnect
2013-06-08 20:25:43.228887 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34753 s=2 pgs=18682 cs=6027 l=0).fault, initiating reconnect
2013-06-08 20:25:43.229296 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60285 s=2 pgs=14773 cs=1255 l=0).fault, initiating reconnect
2013-06-08 20:25:43.229416 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41741 s=2 pgs=20538 cs=3863 l=0).fault, initiating reconnect
2013-06-08 20:25:43.229429 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57872 s=2 pgs=24333 cs=6535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.229432 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :34877 s=2 pgs=24537 cs=7861 l=0).fault, initiating reconnect
2013-06-08 20:25:43.229441 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :41829 s=2 pgs=18212 cs=4581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.229867 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34758 s=2 pgs=18683 cs=6029 l=0).fault, initiating reconnect
2013-06-08 20:25:43.230309 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :41745 s=2 pgs=20539 cs=3865 l=0).fault, initiating reconnect
2013-06-08 20:25:43.230310 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :34883 s=2 pgs=24538 cs=7863 l=0).fault, initiating reconnect
2013-06-08 20:25:43.230325 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57878 s=2 pgs=24334 cs=6537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.230459 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60292 s=2 pgs=14774 cs=1257 l=0).fault, initiating reconnect
2013-06-08 20:25:43.230574 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41837 s=2 pgs=18213 cs=4583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.230795 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34764 s=2 pgs=18684 cs=6031 l=0).fault, initiating reconnect
2013-06-08 20:25:43.231052 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57884 s=2 pgs=24335 cs=6539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.231182 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34885 s=2 pgs=24539 cs=7865 l=0).fault, initiating reconnect
2013-06-08 20:25:43.231349 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41751 s=2 pgs=20540 cs=3867 l=0).fault, initiating reconnect
2013-06-08 20:25:43.231392 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60301 s=2 pgs=14775 cs=1259 l=0).fault, initiating reconnect
2013-06-08 20:25:43.231717 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34770 s=2 pgs=18685 cs=6033 l=0).fault, initiating reconnect
2013-06-08 20:25:43.231767 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :41844 s=2 pgs=18214 cs=4585 l=0).fault, initiating reconnect
2013-06-08 20:25:43.231771 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :57888 s=2 pgs=24336 cs=6541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.232027 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34892 s=2 pgs=24540 cs=7867 l=0).fault, initiating reconnect
2013-06-08 20:25:43.232314 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41758 s=2 pgs=20541 cs=3869 l=0).fault, initiating reconnect
2013-06-08 20:25:43.232348 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60307 s=2 pgs=14776 cs=1261 l=0).fault, initiating reconnect
2013-06-08 20:25:43.232695 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34775 s=2 pgs=18686 cs=6035 l=0).fault, initiating reconnect
2013-06-08 20:25:43.232759 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57894 s=2 pgs=24337 cs=6543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.232776 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34898 s=2 pgs=24541 cs=7869 l=0).fault, initiating reconnect
2013-06-08 20:25:43.233121 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60313 s=2 pgs=14777 cs=1263 l=0).fault, initiating reconnect
2013-06-08 20:25:43.233313 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41764 s=2 pgs=20542 cs=3871 l=0).fault, initiating reconnect
2013-06-08 20:25:43.233618 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34903 s=2 pgs=24542 cs=7871 l=0).fault, initiating reconnect
2013-06-08 20:25:43.233689 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :57899 s=2 pgs=24338 cs=6545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.233631 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :34781 s=2 pgs=18687 cs=6037 l=0).fault, initiating reconnect
2013-06-08 20:25:43.233862 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41851 s=2 pgs=18215 cs=4587 l=0).fault, initiating reconnect
2013-06-08 20:25:43.234243 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41770 s=2 pgs=20543 cs=3873 l=0).fault, initiating reconnect
2013-06-08 20:25:43.234249 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60317 s=2 pgs=14778 cs=1265 l=0).fault, initiating reconnect
2013-06-08 20:25:43.234473 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34906 s=2 pgs=24543 cs=7873 l=0).fault, initiating reconnect
2013-06-08 20:25:43.234586 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57904 s=2 pgs=24339 cs=6547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.234717 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34788 s=2 pgs=18688 cs=6039 l=0).fault, initiating reconnect
2013-06-08 20:25:43.235158 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60324 s=2 pgs=14779 cs=1267 l=0).fault, initiating reconnect
2013-06-08 20:25:43.235163 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41775 s=2 pgs=20544 cs=3875 l=0).fault, initiating reconnect
2013-06-08 20:25:43.235248 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41864 s=2 pgs=18216 cs=4589 l=0).fault, initiating reconnect
2013-06-08 20:25:43.235273 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34912 s=2 pgs=24544 cs=7875 l=0).fault, initiating reconnect
2013-06-08 20:25:43.235315 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57910 s=2 pgs=24340 cs=6549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.235666 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34794 s=2 pgs=18689 cs=6041 l=0).fault, initiating reconnect
2013-06-08 20:25:43.236078 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60328 s=2 pgs=14780 cs=1269 l=0).fault, initiating reconnect
2013-06-08 20:25:43.236093 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :34919 s=2 pgs=24545 cs=7877 l=0).fault, initiating reconnect
2013-06-08 20:25:43.236100 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41781 s=2 pgs=20545 cs=3877 l=0).fault, initiating reconnect
2013-06-08 20:25:43.236325 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57915 s=2 pgs=24341 cs=6551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.236508 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41872 s=2 pgs=18217 cs=4591 l=0).fault, initiating reconnect
2013-06-08 20:25:43.236573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34800 s=2 pgs=18690 cs=6043 l=0).fault, initiating reconnect
2013-06-08 20:25:43.236799 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34922 s=2 pgs=24546 cs=7879 l=0).fault, initiating reconnect
2013-06-08 20:25:43.237062 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41788 s=2 pgs=20546 cs=3879 l=0).fault, initiating reconnect
2013-06-08 20:25:43.237214 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60334 s=2 pgs=14781 cs=1271 l=0).fault, initiating reconnect
2013-06-08 20:25:43.237221 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57921 s=2 pgs=24342 cs=6553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.237433 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41880 s=2 pgs=18218 cs=4593 l=0).fault, initiating reconnect
2013-06-08 20:25:43.237469 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34806 s=2 pgs=18691 cs=6045 l=0).fault, initiating reconnect
2013-06-08 20:25:43.237520 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34927 s=2 pgs=24547 cs=7881 l=0).fault, initiating reconnect
2013-06-08 20:25:43.237936 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41793 s=2 pgs=20547 cs=3881 l=0).fault, initiating reconnect
2013-06-08 20:25:43.238148 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57926 s=2 pgs=24343 cs=6555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.238339 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60342 s=2 pgs=14782 cs=1273 l=0).fault, initiating reconnect
2013-06-08 20:25:43.238347 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34933 s=2 pgs=24548 cs=7883 l=0).fault, initiating reconnect
2013-06-08 20:25:43.238363 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34812 s=2 pgs=18692 cs=6047 l=0).fault, initiating reconnect
2013-06-08 20:25:43.238497 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41886 s=2 pgs=18219 cs=4595 l=0).fault, initiating reconnect
2013-06-08 20:25:43.238845 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41799 s=2 pgs=20548 cs=3883 l=0).fault, initiating reconnect
2013-06-08 20:25:43.239026 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57932 s=2 pgs=24344 cs=6557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.239196 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34937 s=2 pgs=24549 cs=7885 l=0).fault, initiating reconnect
2013-06-08 20:25:43.239235 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60349 s=2 pgs=14783 cs=1275 l=0).fault, initiating reconnect
2013-06-08 20:25:43.239365 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41894 s=2 pgs=18220 cs=4597 l=0).fault, initiating reconnect
2013-06-08 20:25:43.239780 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41805 s=2 pgs=20549 cs=3885 l=0).fault, initiating reconnect
2013-06-08 20:25:43.239941 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57938 s=2 pgs=24345 cs=6559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.240108 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60355 s=2 pgs=14784 cs=1277 l=0).fault, initiating reconnect
2013-06-08 20:25:43.240245 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34943 s=2 pgs=24550 cs=7887 l=0).fault, initiating reconnect
2013-06-08 20:25:43.240276 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34818 s=2 pgs=18693 cs=6049 l=0).fault, initiating reconnect
2013-06-08 20:25:43.240330 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41899 s=2 pgs=18221 cs=4599 l=0).fault, initiating reconnect
2013-06-08 20:25:43.240610 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41810 s=2 pgs=20550 cs=3887 l=0).fault, initiating reconnect
2013-06-08 20:25:43.240967 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57943 s=2 pgs=24346 cs=6561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.241049 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34948 s=2 pgs=24551 cs=7889 l=0).fault, initiating reconnect
2013-06-08 20:25:43.241180 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60360 s=2 pgs=14785 cs=1279 l=0).fault, initiating reconnect
2013-06-08 20:25:43.241269 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41905 s=2 pgs=18222 cs=4601 l=0).fault, initiating reconnect
2013-06-08 20:25:43.241424 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34829 s=2 pgs=18694 cs=6051 l=0).fault, initiating reconnect
2013-06-08 20:25:43.241458 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41816 s=2 pgs=20551 cs=3889 l=0).fault, initiating reconnect
2013-06-08 20:25:43.241904 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57949 s=2 pgs=24347 cs=6563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.241917 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34953 s=2 pgs=24552 cs=7891 l=0).fault, initiating reconnect
2013-06-08 20:25:43.242061 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60367 s=2 pgs=14786 cs=1281 l=0).fault, initiating reconnect
2013-06-08 20:25:43.242229 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34836 s=2 pgs=18695 cs=6053 l=0).fault, initiating reconnect
2013-06-08 20:25:43.242413 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41910 s=2 pgs=18223 cs=4603 l=0).fault, initiating reconnect
2013-06-08 20:25:43.242489 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41822 s=2 pgs=20552 cs=3891 l=0).fault, initiating reconnect
2013-06-08 20:25:43.242678 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34959 s=2 pgs=24553 cs=7893 l=0).fault, initiating reconnect
2013-06-08 20:25:43.242822 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57955 s=2 pgs=24348 cs=6565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.243104 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60373 s=2 pgs=14787 cs=1283 l=0).fault, initiating reconnect
2013-06-08 20:25:43.243153 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34841 s=2 pgs=18696 cs=6055 l=0).fault, initiating reconnect
2013-06-08 20:25:43.243376 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41828 s=2 pgs=20553 cs=3893 l=0).fault, initiating reconnect
2013-06-08 20:25:43.243415 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34964 s=2 pgs=24554 cs=7895 l=0).fault, initiating reconnect
2013-06-08 20:25:43.243461 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41917 s=2 pgs=18224 cs=4605 l=0).fault, initiating reconnect
2013-06-08 20:25:43.243771 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57962 s=2 pgs=24349 cs=6567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.244084 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60379 s=2 pgs=14788 cs=1285 l=0).fault, initiating reconnect
2013-06-08 20:25:43.244128 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34847 s=2 pgs=18697 cs=6057 l=0).fault, initiating reconnect
2013-06-08 20:25:43.244323 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34969 s=2 pgs=24555 cs=7897 l=0).fault, initiating reconnect
2013-06-08 20:25:43.244330 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41833 s=2 pgs=20554 cs=3895 l=0).fault, initiating reconnect
2013-06-08 20:25:43.244414 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41925 s=2 pgs=18225 cs=4607 l=0).fault, initiating reconnect
2013-06-08 20:25:43.244579 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57968 s=2 pgs=24350 cs=6569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.245046 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34974 s=2 pgs=24556 cs=7899 l=0).fault, initiating reconnect
2013-06-08 20:25:43.245070 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34853 s=2 pgs=18698 cs=6059 l=0).fault, initiating reconnect
2013-06-08 20:25:43.245075 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60385 s=2 pgs=14789 cs=1287 l=0).fault, initiating reconnect
2013-06-08 20:25:43.245244 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41840 s=2 pgs=20555 cs=3897 l=0).fault, initiating reconnect
2013-06-08 20:25:43.245419 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41931 s=2 pgs=18226 cs=4609 l=0).fault, initiating reconnect
2013-06-08 20:25:43.245573 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57974 s=2 pgs=24351 cs=6571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.245866 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34980 s=2 pgs=24557 cs=7901 l=0).fault, initiating reconnect
2013-06-08 20:25:43.246030 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60392 s=2 pgs=14790 cs=1289 l=0).fault, initiating reconnect
2013-06-08 20:25:43.246161 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41846 s=2 pgs=20556 cs=3899 l=0).fault, initiating reconnect
2013-06-08 20:25:43.246187 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34858 s=2 pgs=18699 cs=6061 l=0).fault, initiating reconnect
2013-06-08 20:25:43.246380 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41937 s=2 pgs=18227 cs=4611 l=0).fault, initiating reconnect
2013-06-08 20:25:43.246625 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34984 s=2 pgs=24558 cs=7903 l=0).fault, initiating reconnect
2013-06-08 20:25:43.246640 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57980 s=2 pgs=24352 cs=6573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.247030 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60398 s=2 pgs=14791 cs=1291 l=0).fault, initiating reconnect
2013-06-08 20:25:43.247157 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41851 s=2 pgs=20557 cs=3901 l=0).fault, initiating reconnect
2013-06-08 20:25:43.247203 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34867 s=2 pgs=18700 cs=6063 l=0).fault, initiating reconnect
2013-06-08 20:25:43.247493 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41943 s=2 pgs=18228 cs=4613 l=0).fault, initiating reconnect
2013-06-08 20:25:43.247509 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34989 s=2 pgs=24559 cs=7905 l=0).fault, initiating reconnect
2013-06-08 20:25:43.247595 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57987 s=2 pgs=24353 cs=6575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.247918 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60404 s=2 pgs=14792 cs=1293 l=0).fault, initiating reconnect
2013-06-08 20:25:43.248227 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34873 s=2 pgs=18701 cs=6065 l=0).fault, initiating reconnect
2013-06-08 20:25:43.248284 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34995 s=2 pgs=24560 cs=7907 l=0).fault, initiating reconnect
2013-06-08 20:25:43.248294 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41857 s=2 pgs=20558 cs=3903 l=0).fault, initiating reconnect
2013-06-08 20:25:43.248462 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41949 s=2 pgs=18229 cs=4615 l=0).fault, initiating reconnect
2013-06-08 20:25:43.248574 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57993 s=2 pgs=24354 cs=6577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.248848 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60410 s=2 pgs=14793 cs=1295 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249002 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41865 s=2 pgs=20559 cs=3905 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249083 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :34999 s=2 pgs=24561 cs=7909 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249179 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34878 s=2 pgs=18702 cs=6067 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249562 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41956 s=2 pgs=18230 cs=4617 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249600 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :57999 s=2 pgs=24355 cs=6579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249749 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60416 s=2 pgs=14794 cs=1297 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249898 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41869 s=2 pgs=20560 cs=3907 l=0).fault, initiating reconnect
2013-06-08 20:25:43.249912 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35005 s=2 pgs=24562 cs=7911 l=0).fault, initiating reconnect
2013-06-08 20:25:43.250124 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34886 s=2 pgs=18703 cs=6069 l=0).fault, initiating reconnect
2013-06-08 20:25:43.250423 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58005 s=2 pgs=24356 cs=6581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.250665 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41962 s=2 pgs=18231 cs=4619 l=0).fault, initiating reconnect
2013-06-08 20:25:43.250821 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60422 s=2 pgs=14795 cs=1299 l=0).fault, initiating reconnect
2013-06-08 20:25:43.250824 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35011 s=2 pgs=24563 cs=7913 l=0).fault, initiating reconnect
2013-06-08 20:25:43.250999 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41875 s=2 pgs=20561 cs=3909 l=0).fault, initiating reconnect
2013-06-08 20:25:43.251177 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34892 s=2 pgs=18704 cs=6071 l=0).fault, initiating reconnect
2013-06-08 20:25:43.251321 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58010 s=2 pgs=24357 cs=6583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.251659 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35016 s=2 pgs=24564 cs=7915 l=0).fault, initiating reconnect
2013-06-08 20:25:43.251713 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41969 s=2 pgs=18232 cs=4621 l=0).fault, initiating reconnect
2013-06-08 20:25:43.251770 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60428 s=2 pgs=14796 cs=1301 l=0).fault, initiating reconnect
2013-06-08 20:25:43.251913 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41882 s=2 pgs=20562 cs=3911 l=0).fault, initiating reconnect
2013-06-08 20:25:43.252032 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34898 s=2 pgs=18705 cs=6073 l=0).fault, initiating reconnect
2013-06-08 20:25:43.252149 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58016 s=2 pgs=24358 cs=6585 l=0).fault, initiating reconnect
2013-06-08 20:25:43.252582 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35020 s=2 pgs=24565 cs=7917 l=0).fault, initiating reconnect
2013-06-08 20:25:43.252697 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41976 s=2 pgs=18233 cs=4623 l=0).fault, initiating reconnect
2013-06-08 20:25:43.252746 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60435 s=2 pgs=14797 cs=1303 l=0).fault, initiating reconnect
2013-06-08 20:25:43.252919 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41888 s=2 pgs=20563 cs=3913 l=0).fault, initiating reconnect
2013-06-08 20:25:43.252939 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34904 s=2 pgs=18706 cs=6075 l=0).fault, initiating reconnect
2013-06-08 20:25:43.253065 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58022 s=2 pgs=24359 cs=6587 l=0).fault, initiating reconnect
2013-06-08 20:25:43.253408 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35026 s=2 pgs=24566 cs=7919 l=0).fault, initiating reconnect
2013-06-08 20:25:43.253568 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60441 s=2 pgs=14798 cs=1305 l=0).fault, initiating reconnect
2013-06-08 20:25:43.253745 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41982 s=2 pgs=18234 cs=4625 l=0).fault, initiating reconnect
2013-06-08 20:25:43.253794 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41894 s=2 pgs=20564 cs=3915 l=0).fault, initiating reconnect
2013-06-08 20:25:43.253975 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34910 s=2 pgs=18707 cs=6077 l=0).fault, initiating reconnect
2013-06-08 20:25:43.254157 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58028 s=2 pgs=24360 cs=6589 l=0).fault, initiating reconnect
2013-06-08 20:25:43.254183 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35032 s=2 pgs=24567 cs=7921 l=0).fault, initiating reconnect
2013-06-08 20:25:43.254640 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60446 s=2 pgs=14799 cs=1307 l=0).fault, initiating reconnect
2013-06-08 20:25:43.254866 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41900 s=2 pgs=20565 cs=3917 l=0).fault, initiating reconnect
2013-06-08 20:25:43.254870 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :41989 s=2 pgs=18235 cs=4627 l=0).fault, initiating reconnect
2013-06-08 20:25:43.254957 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35038 s=2 pgs=24568 cs=7923 l=0).fault, initiating reconnect
2013-06-08 20:25:43.254970 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34916 s=2 pgs=18708 cs=6079 l=0).fault, initiating reconnect
2013-06-08 20:25:43.255012 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58034 s=2 pgs=24361 cs=6591 l=0).fault, initiating reconnect
2013-06-08 20:25:43.255586 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60452 s=2 pgs=14800 cs=1309 l=0).fault, initiating reconnect
2013-06-08 20:25:43.255787 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35042 s=2 pgs=24569 cs=7925 l=0).fault, initiating reconnect
2013-06-08 20:25:43.255787 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41905 s=2 pgs=20566 cs=3919 l=0).fault, initiating reconnect
2013-06-08 20:25:43.255794 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :41996 s=2 pgs=18236 cs=4629 l=0).fault, initiating reconnect
2013-06-08 20:25:43.255805 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58041 s=2 pgs=24362 cs=6593 l=0).fault, initiating reconnect
2013-06-08 20:25:43.255890 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34923 s=2 pgs=18709 cs=6081 l=0).fault, initiating reconnect
2013-06-08 20:25:43.256543 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58045 s=2 pgs=24363 cs=6595 l=0).fault, initiating reconnect
2013-06-08 20:25:43.256550 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60458 s=2 pgs=14801 cs=1311 l=0).fault, initiating reconnect
2013-06-08 20:25:43.256586 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35046 s=2 pgs=24570 cs=7927 l=0).fault, initiating reconnect
2013-06-08 20:25:43.256725 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34930 s=2 pgs=18710 cs=6083 l=0).fault, initiating reconnect
2013-06-08 20:25:43.256790 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41913 s=2 pgs=20567 cs=3921 l=0).fault, initiating reconnect
2013-06-08 20:25:43.256837 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42002 s=2 pgs=18237 cs=4631 l=0).fault, initiating reconnect
2013-06-08 20:25:43.257381 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35053 s=2 pgs=24571 cs=7929 l=0).fault, initiating reconnect
2013-06-08 20:25:43.257489 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34934 s=2 pgs=18711 cs=6085 l=0).fault, initiating reconnect
2013-06-08 20:25:43.257562 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58048 s=2 pgs=24364 cs=6597 l=0).fault, initiating reconnect
2013-06-08 20:25:43.257708 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60464 s=2 pgs=14802 cs=1313 l=0).fault, initiating reconnect
2013-06-08 20:25:43.257713 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42010 s=2 pgs=18238 cs=4633 l=0).fault, initiating reconnect
2013-06-08 20:25:43.257840 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41921 s=2 pgs=20568 cs=3923 l=0).fault, initiating reconnect
2013-06-08 20:25:43.258276 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35057 s=2 pgs=24572 cs=7931 l=0).fault, initiating reconnect
2013-06-08 20:25:43.258519 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60474 s=2 pgs=14803 cs=1315 l=0).fault, initiating reconnect
2013-06-08 20:25:43.258536 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34938 s=2 pgs=18712 cs=6087 l=0).fault, initiating reconnect
2013-06-08 20:25:43.258663 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58056 s=2 pgs=24365 cs=6599 l=0).fault, initiating reconnect
2013-06-08 20:25:43.258711 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42015 s=2 pgs=18239 cs=4635 l=0).fault, initiating reconnect
2013-06-08 20:25:43.258717 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :41927 s=2 pgs=20569 cs=3925 l=0).fault, initiating reconnect
2013-06-08 20:25:43.259066 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35063 s=2 pgs=24573 cs=7933 l=0).fault, initiating reconnect
2013-06-08 20:25:43.259395 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34945 s=2 pgs=18713 cs=6089 l=0).fault, initiating reconnect
2013-06-08 20:25:43.259398 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60477 s=2 pgs=14804 cs=1317 l=0).fault, initiating reconnect
2013-06-08 20:25:43.259664 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58063 s=2 pgs=24366 cs=6601 l=0).fault, initiating reconnect
2013-06-08 20:25:43.259663 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :41933 s=2 pgs=20570 cs=3927 l=0).fault, initiating reconnect
2013-06-08 20:25:43.259898 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35069 s=2 pgs=24574 cs=7935 l=0).fault, initiating reconnect
2013-06-08 20:25:43.260076 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42022 s=2 pgs=18240 cs=4637 l=0).fault, initiating reconnect
2013-06-08 20:25:43.260320 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34950 s=2 pgs=18714 cs=6091 l=0).fault, initiating reconnect
2013-06-08 20:25:43.260348 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60484 s=2 pgs=14805 cs=1319 l=0).fault, initiating reconnect
2013-06-08 20:25:43.260480 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58070 s=2 pgs=24367 cs=6603 l=0).fault, initiating reconnect
2013-06-08 20:25:43.260529 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :41937 s=2 pgs=20571 cs=3929 l=0).fault, initiating reconnect
2013-06-08 20:25:43.260760 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35074 s=2 pgs=24575 cs=7937 l=0).fault, initiating reconnect
2013-06-08 20:25:43.261076 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42030 s=2 pgs=18241 cs=4639 l=0).fault, initiating reconnect
2013-06-08 20:25:43.261185 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34956 s=2 pgs=18715 cs=6093 l=0).fault, initiating reconnect
2013-06-08 20:25:43.261199 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60490 s=2 pgs=14806 cs=1321 l=0).fault, initiating reconnect
2013-06-08 20:25:43.261329 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58075 s=2 pgs=24368 cs=6605 l=0).fault, initiating reconnect
2013-06-08 20:25:43.261561 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :41944 s=2 pgs=20572 cs=3931 l=0).fault, initiating reconnect
2013-06-08 20:25:43.261576 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35080 s=2 pgs=24576 cs=7939 l=0).fault, initiating reconnect
2013-06-08 20:25:43.261932 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34962 s=2 pgs=18716 cs=6095 l=0).fault, initiating reconnect
2013-06-08 20:25:43.262227 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60496 s=2 pgs=14807 cs=1323 l=0).fault, initiating reconnect
2013-06-08 20:25:43.262288 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42036 s=2 pgs=18242 cs=4641 l=0).fault, initiating reconnect
2013-06-08 20:25:43.262291 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58081 s=2 pgs=24369 cs=6607 l=0).fault, initiating reconnect
2013-06-08 20:25:43.262480 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35086 s=2 pgs=24577 cs=7941 l=0).fault, initiating reconnect
2013-06-08 20:25:43.262502 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :41950 s=2 pgs=20573 cs=3933 l=0).fault, initiating reconnect
2013-06-08 20:25:43.262785 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34967 s=2 pgs=18717 cs=6097 l=0).fault, initiating reconnect
2013-06-08 20:25:43.263143 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60501 s=2 pgs=14808 cs=1325 l=0).fault, initiating reconnect
2013-06-08 20:25:43.263262 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58087 s=2 pgs=24370 cs=6609 l=0).fault, initiating reconnect
2013-06-08 20:25:43.263346 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35091 s=2 pgs=24578 cs=7943 l=0).fault, initiating reconnect
2013-06-08 20:25:43.263469 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42044 s=2 pgs=18243 cs=4643 l=0).fault, initiating reconnect
2013-06-08 20:25:43.263640 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41957 s=2 pgs=20574 cs=3935 l=0).fault, initiating reconnect
2013-06-08 20:25:43.263879 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34973 s=2 pgs=18718 cs=6099 l=0).fault, initiating reconnect
2013-06-08 20:25:43.264101 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60507 s=2 pgs=14809 cs=1327 l=0).fault, initiating reconnect
2013-06-08 20:25:43.264155 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58092 s=2 pgs=24371 cs=6611 l=0).fault, initiating reconnect
2013-06-08 20:25:43.264164 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35096 s=2 pgs=24579 cs=7945 l=0).fault, initiating reconnect
2013-06-08 20:25:43.264665 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41963 s=2 pgs=20575 cs=3937 l=0).fault, initiating reconnect
2013-06-08 20:25:43.264668 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42052 s=2 pgs=18244 cs=4645 l=0).fault, initiating reconnect
2013-06-08 20:25:43.264898 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34979 s=2 pgs=18719 cs=6101 l=0).fault, initiating reconnect
2013-06-08 20:25:43.264974 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35102 s=2 pgs=24580 cs=7947 l=0).fault, initiating reconnect
2013-06-08 20:25:43.265147 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60513 s=2 pgs=14810 cs=1329 l=0).fault, initiating reconnect
2013-06-08 20:25:43.265158 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58098 s=2 pgs=24372 cs=6613 l=0).fault, initiating reconnect
2013-06-08 20:25:43.265695 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42058 s=2 pgs=18245 cs=4647 l=0).fault, initiating reconnect
2013-06-08 20:25:43.265837 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35106 s=2 pgs=24581 cs=7949 l=0).fault, initiating reconnect
2013-06-08 20:25:43.265852 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41970 s=2 pgs=20576 cs=3939 l=0).fault, initiating reconnect
2013-06-08 20:25:43.265961 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34984 s=2 pgs=18720 cs=6103 l=0).fault, initiating reconnect
2013-06-08 20:25:43.266198 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58105 s=2 pgs=24373 cs=6615 l=0).fault, initiating reconnect
2013-06-08 20:25:43.266234 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60520 s=2 pgs=14811 cs=1331 l=0).fault, initiating reconnect
2013-06-08 20:25:43.266567 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42064 s=2 pgs=18246 cs=4649 l=0).fault, initiating reconnect
2013-06-08 20:25:43.266656 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41975 s=2 pgs=20577 cs=3941 l=0).fault, initiating reconnect
2013-06-08 20:25:43.266927 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35111 s=2 pgs=24582 cs=7951 l=0).fault, initiating reconnect
2013-06-08 20:25:43.267085 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34992 s=2 pgs=18721 cs=6105 l=0).fault, initiating reconnect
2013-06-08 20:25:43.267229 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60527 s=2 pgs=14812 cs=1333 l=0).fault, initiating reconnect
2013-06-08 20:25:43.267248 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58110 s=2 pgs=24374 cs=6617 l=0).fault, initiating reconnect
2013-06-08 20:25:43.267632 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41981 s=2 pgs=20578 cs=3943 l=0).fault, initiating reconnect
2013-06-08 20:25:43.267680 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42070 s=2 pgs=18247 cs=4651 l=0).fault, initiating reconnect
2013-06-08 20:25:43.267768 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35117 s=2 pgs=24583 cs=7953 l=0).fault, initiating reconnect
2013-06-08 20:25:43.267990 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60532 s=2 pgs=14813 cs=1335 l=0).fault, initiating reconnect
2013-06-08 20:25:43.268081 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :34998 s=2 pgs=18722 cs=6107 l=0).fault, initiating reconnect
2013-06-08 20:25:43.268327 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58117 s=2 pgs=24375 cs=6619 l=0).fault, initiating reconnect
2013-06-08 20:25:43.268477 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41986 s=2 pgs=20579 cs=3945 l=0).fault, initiating reconnect
2013-06-08 20:25:43.268570 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35123 s=2 pgs=24584 cs=7955 l=0).fault, initiating reconnect
2013-06-08 20:25:43.268635 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42077 s=2 pgs=18248 cs=4653 l=0).fault, initiating reconnect
2013-06-08 20:25:43.268914 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60537 s=2 pgs=14814 cs=1337 l=0).fault, initiating reconnect
2013-06-08 20:25:43.268936 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35005 s=2 pgs=18723 cs=6109 l=0).fault, initiating reconnect
2013-06-08 20:25:43.269322 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58123 s=2 pgs=24376 cs=6621 l=0).fault, initiating reconnect
2013-06-08 20:25:43.269351 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41992 s=2 pgs=20580 cs=3947 l=0).fault, initiating reconnect
2013-06-08 20:25:43.269596 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35128 s=2 pgs=24585 cs=7957 l=0).fault, initiating reconnect
2013-06-08 20:25:43.269601 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42084 s=2 pgs=18249 cs=4655 l=0).fault, initiating reconnect
2013-06-08 20:25:43.270217 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60543 s=2 pgs=14815 cs=1339 l=0).fault, initiating reconnect
2013-06-08 20:25:43.270248 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :41998 s=2 pgs=20581 cs=3949 l=0).fault, initiating reconnect
2013-06-08 20:25:43.270270 7fddc938f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60543 s=1 pgs=14815 cs=1340 l=0).fault
2013-06-08 20:25:43.270304 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35011 s=2 pgs=18724 cs=6111 l=0).fault, initiating reconnect
2013-06-08 20:25:43.270371 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58129 s=2 pgs=24377 cs=6623 l=0).fault, initiating reconnect
2013-06-08 20:25:43.271106 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35134 s=2 pgs=24586 cs=7959 l=0).fault, initiating reconnect
2013-06-08 20:25:43.271253 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42001 s=2 pgs=20582 cs=3951 l=0).fault, initiating reconnect
2013-06-08 20:25:43.271252 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42090 s=2 pgs=18250 cs=4657 l=0).fault, initiating reconnect
2013-06-08 20:25:43.271374 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58136 s=2 pgs=24378 cs=6625 l=0).fault, initiating reconnect
2013-06-08 20:25:43.271405 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35018 s=2 pgs=18725 cs=6113 l=0).fault, initiating reconnect
2013-06-08 20:25:43.271815 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60550 s=2 pgs=14816 cs=1341 l=0).fault, initiating reconnect
2013-06-08 20:25:43.272281 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35140 s=2 pgs=24587 cs=7961 l=0).fault, initiating reconnect
2013-06-08 20:25:43.272423 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42096 s=2 pgs=18251 cs=4659 l=0).fault, initiating reconnect
2013-06-08 20:25:43.272595 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42006 s=2 pgs=20583 cs=3953 l=0).fault, initiating reconnect
2013-06-08 20:25:43.272656 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35023 s=2 pgs=18726 cs=6115 l=0).fault, initiating reconnect
2013-06-08 20:25:43.272793 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58141 s=2 pgs=24379 cs=6627 l=0).fault, initiating reconnect
2013-06-08 20:25:43.273288 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60558 s=2 pgs=14817 cs=1343 l=0).fault, initiating reconnect
2013-06-08 20:25:43.273599 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42102 s=2 pgs=18252 cs=4661 l=0).fault, initiating reconnect
2013-06-08 20:25:43.273606 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35029 s=2 pgs=18727 cs=6117 l=0).fault, initiating reconnect
2013-06-08 20:25:43.273726 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42013 s=2 pgs=20584 cs=3955 l=0).fault, initiating reconnect
2013-06-08 20:25:43.273794 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35146 s=2 pgs=24588 cs=7963 l=0).fault, initiating reconnect
2013-06-08 20:25:43.274255 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58147 s=2 pgs=24380 cs=6629 l=0).fault, initiating reconnect
2013-06-08 20:25:43.274719 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60564 s=2 pgs=14818 cs=1345 l=0).fault, initiating reconnect
2013-06-08 20:25:43.274721 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42019 s=2 pgs=20585 cs=3957 l=0).fault, initiating reconnect
2013-06-08 20:25:43.274782 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35155 s=2 pgs=24589 cs=7965 l=0).fault, initiating reconnect
2013-06-08 20:25:43.274833 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35033 s=2 pgs=18728 cs=6119 l=0).fault, initiating reconnect
2013-06-08 20:25:43.274858 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42107 s=2 pgs=18253 cs=4663 l=0).fault, initiating reconnect
2013-06-08 20:25:43.275381 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58153 s=2 pgs=24381 cs=6631 l=0).fault, initiating reconnect
2013-06-08 20:25:43.275755 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42023 s=2 pgs=20586 cs=3959 l=0).fault, initiating reconnect
2013-06-08 20:25:43.275798 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60570 s=2 pgs=14819 cs=1347 l=0).fault, initiating reconnect
2013-06-08 20:25:43.275876 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35040 s=2 pgs=18729 cs=6121 l=0).fault, initiating reconnect
2013-06-08 20:25:43.276687 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42116 s=2 pgs=18254 cs=4665 l=0).fault, initiating reconnect
2013-06-08 20:25:43.276771 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35045 s=2 pgs=18730 cs=6123 l=0).fault, initiating reconnect
2013-06-08 20:25:43.277597 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35047 s=2 pgs=18731 cs=6125 l=0).fault, initiating reconnect
2013-06-08 20:25:43.277645 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42121 s=2 pgs=18255 cs=4667 l=0).fault, initiating reconnect
2013-06-08 20:25:43.278613 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35048 s=2 pgs=18732 cs=6127 l=0).fault, initiating reconnect
2013-06-08 20:25:43.278651 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42124 s=2 pgs=18256 cs=4669 l=0).fault, initiating reconnect
2013-06-08 20:25:43.279502 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35050 s=2 pgs=18733 cs=6129 l=0).fault, initiating reconnect
2013-06-08 20:25:43.279667 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42126 s=2 pgs=18257 cs=4671 l=0).fault, initiating reconnect
2013-06-08 20:25:43.280467 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35052 s=2 pgs=18734 cs=6131 l=0).fault, initiating reconnect
2013-06-08 20:25:43.280848 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42128 s=2 pgs=18258 cs=4673 l=0).fault, initiating reconnect
2013-06-08 20:25:43.281273 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35054 s=2 pgs=18735 cs=6133 l=0).fault, initiating reconnect
2013-06-08 20:25:43.281901 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42130 s=2 pgs=18259 cs=4675 l=0).fault, initiating reconnect
2013-06-08 20:25:43.282157 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35056 s=2 pgs=18736 cs=6135 l=0).fault, initiating reconnect
2013-06-08 20:25:43.282953 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42132 s=2 pgs=18260 cs=4677 l=0).fault, initiating reconnect
2013-06-08 20:25:43.283031 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35058 s=2 pgs=18737 cs=6137 l=0).fault, initiating reconnect
2013-06-08 20:25:43.283878 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35060 s=2 pgs=18738 cs=6139 l=0).fault, initiating reconnect
2013-06-08 20:25:43.284055 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42134 s=2 pgs=18261 cs=4679 l=0).fault, initiating reconnect
2013-06-08 20:25:43.284577 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42028 s=2 pgs=20587 cs=3961 l=0).fault, initiating reconnect
2013-06-08 20:25:43.284689 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58159 s=2 pgs=24382 cs=6633 l=0).fault, initiating reconnect
2013-06-08 20:25:43.284743 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35061 s=2 pgs=18739 cs=6141 l=0).fault, initiating reconnect
2013-06-08 20:25:43.284845 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60577 s=2 pgs=14820 cs=1349 l=0).fault, initiating reconnect
2013-06-08 20:25:43.285056 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35159 s=2 pgs=24590 cs=7967 l=0).fault, initiating reconnect
2013-06-08 20:25:43.285107 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42137 s=2 pgs=18262 cs=4681 l=0).fault, initiating reconnect
2013-06-08 20:25:43.285506 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58181 s=2 pgs=24383 cs=6635 l=0).fault, initiating reconnect
2013-06-08 20:25:43.285573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35065 s=2 pgs=18740 cs=6143 l=0).fault, initiating reconnect
2013-06-08 20:25:43.285655 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42048 s=2 pgs=20588 cs=3963 l=0).fault, initiating reconnect
2013-06-08 20:25:43.285811 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35187 s=2 pgs=24591 cs=7969 l=0).fault, initiating reconnect
2013-06-08 20:25:43.285937 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60599 s=2 pgs=14821 cs=1351 l=0).fault, initiating reconnect
2013-06-08 20:25:43.286103 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42143 s=2 pgs=18263 cs=4683 l=0).fault, initiating reconnect
2013-06-08 20:25:43.286401 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58186 s=2 pgs=24384 cs=6637 l=0).fault, initiating reconnect
2013-06-08 20:25:43.286600 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42056 s=2 pgs=20589 cs=3965 l=0).fault, initiating reconnect
2013-06-08 20:25:43.286602 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35192 s=2 pgs=24592 cs=7971 l=0).fault, initiating reconnect
2013-06-08 20:25:43.286921 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60606 s=2 pgs=14822 cs=1353 l=0).fault, initiating reconnect
2013-06-08 20:25:43.287112 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42149 s=2 pgs=18264 cs=4685 l=0).fault, initiating reconnect
2013-06-08 20:25:43.287295 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58192 s=2 pgs=24385 cs=6639 l=0).fault, initiating reconnect
2013-06-08 20:25:43.287351 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35197 s=2 pgs=24593 cs=7973 l=0).fault, initiating reconnect
2013-06-08 20:25:43.287426 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42061 s=2 pgs=20590 cs=3967 l=0).fault, initiating reconnect
2013-06-08 20:25:43.287834 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60611 s=2 pgs=14823 cs=1355 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288103 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35201 s=2 pgs=24594 cs=7975 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288108 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42154 s=2 pgs=18265 cs=4687 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288194 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42067 s=2 pgs=20591 cs=3969 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288268 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58197 s=2 pgs=24386 cs=6641 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288506 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35070 s=2 pgs=18741 cs=6145 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288897 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35204 s=2 pgs=24595 cs=7977 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288945 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60616 s=2 pgs=14824 cs=1357 l=0).fault, initiating reconnect
2013-06-08 20:25:43.288979 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42071 s=2 pgs=20592 cs=3971 l=0).fault, initiating reconnect
2013-06-08 20:25:43.289089 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58204 s=2 pgs=24387 cs=6643 l=0).fault, initiating reconnect
2013-06-08 20:25:43.289098 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42160 s=2 pgs=18266 cs=4689 l=0).fault, initiating reconnect
2013-06-08 20:25:43.289302 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35088 s=2 pgs=18742 cs=6147 l=0).fault, initiating reconnect
2013-06-08 20:25:43.289648 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35209 s=2 pgs=24596 cs=7979 l=0).fault, initiating reconnect
2013-06-08 20:25:43.289868 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42076 s=2 pgs=20593 cs=3973 l=0).fault, initiating reconnect
2013-06-08 20:25:43.289898 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60623 s=2 pgs=14825 cs=1359 l=0).fault, initiating reconnect
2013-06-08 20:25:43.290025 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58209 s=2 pgs=24388 cs=6645 l=0).fault, initiating reconnect
2013-06-08 20:25:43.290086 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42168 s=2 pgs=18267 cs=4691 l=0).fault, initiating reconnect
2013-06-08 20:25:43.290228 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35094 s=2 pgs=18743 cs=6149 l=0).fault, initiating reconnect
2013-06-08 20:25:43.290345 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35215 s=2 pgs=24597 cs=7981 l=0).fault, initiating reconnect
2013-06-08 20:25:43.290734 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42081 s=2 pgs=20594 cs=3975 l=0).fault, initiating reconnect
2013-06-08 20:25:43.290864 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58215 s=2 pgs=24389 cs=6647 l=0).fault, initiating reconnect
2013-06-08 20:25:43.290992 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60630 s=2 pgs=14826 cs=1361 l=0).fault, initiating reconnect
2013-06-08 20:25:43.291054 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35221 s=2 pgs=24598 cs=7983 l=0).fault, initiating reconnect
2013-06-08 20:25:43.291078 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35100 s=2 pgs=18744 cs=6151 l=0).fault, initiating reconnect
2013-06-08 20:25:43.291232 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42174 s=2 pgs=18268 cs=4693 l=0).fault, initiating reconnect
2013-06-08 20:25:43.291563 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42087 s=2 pgs=20595 cs=3977 l=0).fault, initiating reconnect
2013-06-08 20:25:43.291712 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58220 s=2 pgs=24390 cs=6649 l=0).fault, initiating reconnect
2013-06-08 20:25:43.291873 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35225 s=2 pgs=24599 cs=7985 l=0).fault, initiating reconnect
2013-06-08 20:25:43.291901 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60637 s=2 pgs=14827 cs=1363 l=0).fault, initiating reconnect
2013-06-08 20:25:43.292422 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42093 s=2 pgs=20596 cs=3979 l=0).fault, initiating reconnect
2013-06-08 20:25:43.292573 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58226 s=2 pgs=24391 cs=6651 l=0).fault, initiating reconnect
2013-06-08 20:25:43.292725 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35230 s=2 pgs=24600 cs=7987 l=0).fault, initiating reconnect
2013-06-08 20:25:43.292927 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60644 s=2 pgs=14828 cs=1365 l=0).fault, initiating reconnect
2013-06-08 20:25:43.293432 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58230 s=2 pgs=24392 cs=6653 l=0).fault, initiating reconnect
2013-06-08 20:25:43.293444 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42182 s=2 pgs=18269 cs=4695 l=0).fault, initiating reconnect
2013-06-08 20:25:43.293446 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42097 s=2 pgs=20597 cs=3981 l=0).fault, initiating reconnect
2013-06-08 20:25:43.293568 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35234 s=2 pgs=24601 cs=7989 l=0).fault, initiating reconnect
2013-06-08 20:25:43.293954 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60648 s=2 pgs=14829 cs=1367 l=0).fault, initiating reconnect
2013-06-08 20:25:43.294230 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42103 s=2 pgs=20598 cs=3983 l=0).fault, initiating reconnect
2013-06-08 20:25:43.294236 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58233 s=2 pgs=24393 cs=6655 l=0).fault, initiating reconnect
2013-06-08 20:25:43.294394 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35239 s=2 pgs=24602 cs=7991 l=0).fault, initiating reconnect
2013-06-08 20:25:43.294404 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :42192 s=2 pgs=18270 cs=4697 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295036 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35106 s=2 pgs=18745 cs=6153 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295038 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60653 s=2 pgs=14830 cs=1369 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295113 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42106 s=2 pgs=20599 cs=3985 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295139 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35243 s=2 pgs=24603 cs=7993 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295419 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :42199 s=2 pgs=18271 cs=4699 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295727 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58239 s=2 pgs=24394 cs=6657 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295942 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35125 s=2 pgs=18746 cs=6155 l=0).fault, initiating reconnect
2013-06-08 20:25:43.295961 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35248 s=2 pgs=24604 cs=7995 l=0).fault, initiating reconnect
2013-06-08 20:25:43.296142 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60659 s=2 pgs=14831 cs=1371 l=0).fault, initiating reconnect
2013-06-08 20:25:43.296317 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :42204 s=2 pgs=18272 cs=4701 l=0).fault, initiating reconnect
2013-06-08 20:25:43.296596 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58247 s=2 pgs=24395 cs=6659 l=0).fault, initiating reconnect
2013-06-08 20:25:43.296782 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35131 s=2 pgs=18747 cs=6157 l=0).fault, initiating reconnect
2013-06-08 20:25:43.297003 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35252 s=2 pgs=24605 cs=7997 l=0).fault, initiating reconnect
2013-06-08 20:25:43.297154 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60666 s=2 pgs=14832 cs=1373 l=0).fault, initiating reconnect
2013-06-08 20:25:43.297310 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :42209 s=2 pgs=18273 cs=4703 l=0).fault, initiating reconnect
2013-06-08 20:25:43.297493 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58252 s=2 pgs=24396 cs=6661 l=0).fault, initiating reconnect
2013-06-08 20:25:43.297696 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35136 s=2 pgs=18748 cs=6159 l=0).fault, initiating reconnect
2013-06-08 20:25:43.297788 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35257 s=2 pgs=24606 cs=7999 l=0).fault, initiating reconnect
2013-06-08 20:25:43.297827 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42112 s=2 pgs=20600 cs=3987 l=0).fault, initiating reconnect
2013-06-08 20:25:43.298347 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :58257 s=2 pgs=24397 cs=6663 l=0).fault, initiating reconnect
2013-06-08 20:25:43.298351 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :42214 s=2 pgs=18274 cs=4705 l=0).fault, initiating reconnect
2013-06-08 20:25:43.298441 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35141 s=2 pgs=18749 cs=6161 l=0).fault, initiating reconnect
2013-06-08 20:25:43.298506 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60671 s=2 pgs=14833 cs=1375 l=0).fault, initiating reconnect
2013-06-08 20:25:43.298550 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35262 s=2 pgs=24607 cs=8001 l=0).fault, initiating reconnect
2013-06-08 20:25:43.298733 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42128 s=2 pgs=20601 cs=3989 l=0).fault, initiating reconnect
2013-06-08 20:25:43.299162 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58261 s=2 pgs=24398 cs=6665 l=0).fault, initiating reconnect
2013-06-08 20:25:43.299298 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35146 s=2 pgs=18750 cs=6163 l=0).fault, initiating reconnect
2013-06-08 20:25:43.299381 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35268 s=2 pgs=24608 cs=8003 l=0).fault, initiating reconnect
2013-06-08 20:25:43.299446 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42220 s=2 pgs=18275 cs=4707 l=0).fault, initiating reconnect
2013-06-08 20:25:43.299591 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60680 s=2 pgs=14834 cs=1377 l=0).fault, initiating reconnect
2013-06-08 20:25:43.299724 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42134 s=2 pgs=20602 cs=3991 l=0).fault, initiating reconnect
2013-06-08 20:25:43.300075 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58267 s=2 pgs=24399 cs=6667 l=0).fault, initiating reconnect
2013-06-08 20:25:43.300095 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35151 s=2 pgs=18751 cs=6165 l=0).fault, initiating reconnect
2013-06-08 20:25:43.300210 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35272 s=2 pgs=24609 cs=8005 l=0).fault, initiating reconnect
2013-06-08 20:25:43.300417 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60687 s=2 pgs=14835 cs=1379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.300550 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42140 s=2 pgs=20603 cs=3993 l=0).fault, initiating reconnect
2013-06-08 20:25:43.300918 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58273 s=2 pgs=24400 cs=6669 l=0).fault, initiating reconnect
2013-06-08 20:25:43.301004 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35278 s=2 pgs=24610 cs=8007 l=0).fault, initiating reconnect
2013-06-08 20:25:43.301089 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35157 s=2 pgs=18752 cs=6167 l=0).fault, initiating reconnect
2013-06-08 20:25:43.301374 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42145 s=2 pgs=20604 cs=3995 l=0).fault, initiating reconnect
2013-06-08 20:25:43.301439 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60692 s=2 pgs=14836 cs=1381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.301771 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35282 s=2 pgs=24611 cs=8009 l=0).fault, initiating reconnect
2013-06-08 20:25:43.301841 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58278 s=2 pgs=24401 cs=6671 l=0).fault, initiating reconnect
2013-06-08 20:25:43.302065 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35163 s=2 pgs=18753 cs=6169 l=0).fault, initiating reconnect
2013-06-08 20:25:43.302244 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42149 s=2 pgs=20605 cs=3997 l=0).fault, initiating reconnect
2013-06-08 20:25:43.302334 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60698 s=2 pgs=14837 cs=1383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.302487 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42228 s=2 pgs=18276 cs=4709 l=0).fault, initiating reconnect
2013-06-08 20:25:43.302493 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=24 :35286 s=2 pgs=24612 cs=8011 l=0).fault, initiating reconnect
2013-06-08 20:25:43.302628 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58284 s=2 pgs=24402 cs=6673 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303004 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35168 s=2 pgs=18754 cs=6171 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303062 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42154 s=2 pgs=20606 cs=3999 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303226 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35292 s=2 pgs=24613 cs=8013 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303259 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60703 s=2 pgs=14838 cs=1385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303330 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58290 s=2 pgs=24403 cs=6675 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303458 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42246 s=2 pgs=18277 cs=4711 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303749 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35174 s=2 pgs=18755 cs=6173 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303890 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42160 s=2 pgs=20607 cs=4001 l=0).fault, initiating reconnect
2013-06-08 20:25:43.303974 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35296 s=2 pgs=24614 cs=8015 l=0).fault, initiating reconnect
2013-06-08 20:25:43.304109 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60710 s=2 pgs=14839 cs=1387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.304157 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58295 s=2 pgs=24404 cs=6677 l=0).fault, initiating reconnect
2013-06-08 20:25:43.304478 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42254 s=2 pgs=18278 cs=4713 l=0).fault, initiating reconnect
2013-06-08 20:25:43.304489 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35180 s=2 pgs=18756 cs=6175 l=0).fault, initiating reconnect
2013-06-08 20:25:43.304707 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42166 s=2 pgs=20608 cs=4003 l=0).fault, initiating reconnect
2013-06-08 20:25:43.304798 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35302 s=2 pgs=24615 cs=8017 l=0).fault, initiating reconnect
2013-06-08 20:25:43.304975 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58301 s=2 pgs=24405 cs=6679 l=0).fault, initiating reconnect
2013-06-08 20:25:43.305165 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60716 s=2 pgs=14840 cs=1389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.305373 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35186 s=2 pgs=18757 cs=6177 l=0).fault, initiating reconnect
2013-06-08 20:25:43.305543 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42172 s=2 pgs=20609 cs=4005 l=0).fault, initiating reconnect
2013-06-08 20:25:43.305546 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42260 s=2 pgs=18279 cs=4715 l=0).fault, initiating reconnect
2013-06-08 20:25:43.305627 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35308 s=2 pgs=24616 cs=8019 l=0).fault, initiating reconnect
2013-06-08 20:25:43.305711 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58306 s=2 pgs=24406 cs=6681 l=0).fault, initiating reconnect
2013-06-08 20:25:43.306152 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60723 s=2 pgs=14841 cs=1391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.306207 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35191 s=2 pgs=18758 cs=6179 l=0).fault, initiating reconnect
2013-06-08 20:25:43.306415 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42177 s=2 pgs=20610 cs=4007 l=0).fault, initiating reconnect
2013-06-08 20:25:43.306479 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58312 s=2 pgs=24407 cs=6683 l=0).fault, initiating reconnect
2013-06-08 20:25:43.306524 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35314 s=2 pgs=24617 cs=8021 l=0).fault, initiating reconnect
2013-06-08 20:25:43.306704 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42268 s=2 pgs=18280 cs=4717 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307075 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60729 s=2 pgs=14842 cs=1393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307123 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35197 s=2 pgs=18759 cs=6181 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307202 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35320 s=2 pgs=24618 cs=8023 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307265 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58316 s=2 pgs=24408 cs=6685 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307334 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42183 s=2 pgs=20611 cs=4009 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307662 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42276 s=2 pgs=18281 cs=4719 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307921 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35324 s=2 pgs=24619 cs=8025 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307976 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35203 s=2 pgs=18760 cs=6183 l=0).fault, initiating reconnect
2013-06-08 20:25:43.307984 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58322 s=2 pgs=24409 cs=6687 l=0).fault, initiating reconnect
2013-06-08 20:25:43.308295 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42191 s=2 pgs=20612 cs=4011 l=0).fault, initiating reconnect
2013-06-08 20:25:43.308545 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42282 s=2 pgs=18282 cs=4721 l=0).fault, initiating reconnect
2013-06-08 20:25:43.308609 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35328 s=2 pgs=24620 cs=8027 l=0).fault, initiating reconnect
2013-06-08 20:25:43.308653 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60735 s=2 pgs=14843 cs=1395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.308674 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58327 s=2 pgs=24410 cs=6689 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309055 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42196 s=2 pgs=20613 cs=4013 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309315 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58332 s=2 pgs=24411 cs=6691 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309442 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42287 s=2 pgs=18283 cs=4723 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309443 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35333 s=2 pgs=24621 cs=8029 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309656 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60747 s=2 pgs=14844 cs=1397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309674 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35209 s=2 pgs=18761 cs=6185 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309917 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42201 s=2 pgs=20614 cs=4015 l=0).fault, initiating reconnect
2013-06-08 20:25:43.309984 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58334 s=2 pgs=24412 cs=6693 l=0).fault, initiating reconnect
2013-06-08 20:25:43.310247 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35339 s=2 pgs=24622 cs=8031 l=0).fault, initiating reconnect
2013-06-08 20:25:43.310368 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42293 s=2 pgs=18284 cs=4725 l=0).fault, initiating reconnect
2013-06-08 20:25:43.310523 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35220 s=2 pgs=18762 cs=6187 l=0).fault, initiating reconnect
2013-06-08 20:25:43.310634 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60754 s=2 pgs=14845 cs=1399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.310659 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42207 s=2 pgs=20615 cs=4017 l=0).fault, initiating reconnect
2013-06-08 20:25:43.310817 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58340 s=2 pgs=24413 cs=6695 l=0).fault, initiating reconnect
2013-06-08 20:25:43.310984 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35344 s=2 pgs=24623 cs=8033 l=0).fault, initiating reconnect
2013-06-08 20:25:43.311259 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42300 s=2 pgs=18285 cs=4727 l=0).fault, initiating reconnect
2013-06-08 20:25:43.311274 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35226 s=2 pgs=18763 cs=6189 l=0).fault, initiating reconnect
2013-06-08 20:25:43.311567 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42213 s=2 pgs=20616 cs=4019 l=0).fault, initiating reconnect
2013-06-08 20:25:43.311603 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60760 s=2 pgs=14846 cs=1401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.311744 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58346 s=2 pgs=24414 cs=6697 l=0).fault, initiating reconnect
2013-06-08 20:25:43.311789 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35350 s=2 pgs=24624 cs=8035 l=0).fault, initiating reconnect
2013-06-08 20:25:43.312231 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35232 s=2 pgs=18764 cs=6191 l=0).fault, initiating reconnect
2013-06-08 20:25:43.312423 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42219 s=2 pgs=20617 cs=4021 l=0).fault, initiating reconnect
2013-06-08 20:25:43.312600 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35356 s=2 pgs=24625 cs=8037 l=0).fault, initiating reconnect
2013-06-08 20:25:43.312625 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :58352 s=2 pgs=24415 cs=6699 l=0).fault, initiating reconnect
2013-06-08 20:25:43.312634 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :60766 s=2 pgs=14847 cs=1403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.313063 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42306 s=2 pgs=18286 cs=4729 l=0).fault, initiating reconnect
2013-06-08 20:25:43.313077 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35237 s=2 pgs=18765 cs=6193 l=0).fault, initiating reconnect
2013-06-08 20:25:43.313340 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42223 s=2 pgs=20618 cs=4023 l=0).fault, initiating reconnect
2013-06-08 20:25:43.313383 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35359 s=2 pgs=24626 cs=8039 l=0).fault, initiating reconnect
2013-06-08 20:25:43.313515 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58357 s=2 pgs=24416 cs=6701 l=0).fault, initiating reconnect
2013-06-08 20:25:43.313550 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60774 s=2 pgs=14848 cs=1405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.313893 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35243 s=2 pgs=18766 cs=6195 l=0).fault, initiating reconnect
2013-06-08 20:25:43.314132 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35365 s=2 pgs=24627 cs=8041 l=0).fault, initiating reconnect
2013-06-08 20:25:43.314256 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42229 s=2 pgs=20619 cs=4025 l=0).fault, initiating reconnect
2013-06-08 20:25:43.314426 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58364 s=2 pgs=24417 cs=6703 l=0).fault, initiating reconnect
2013-06-08 20:25:43.314746 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35248 s=2 pgs=18767 cs=6197 l=0).fault, initiating reconnect
2013-06-08 20:25:43.314816 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35369 s=2 pgs=24628 cs=8043 l=0).fault, initiating reconnect
2013-06-08 20:25:43.315119 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42235 s=2 pgs=20620 cs=4027 l=0).fault, initiating reconnect
2013-06-08 20:25:43.315298 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58368 s=2 pgs=24418 cs=6705 l=0).fault, initiating reconnect
2013-06-08 20:25:43.315520 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60779 s=2 pgs=14849 cs=1407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.315580 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35373 s=2 pgs=24629 cs=8045 l=0).fault, initiating reconnect
2013-06-08 20:25:43.315597 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35252 s=2 pgs=18768 cs=6199 l=0).fault, initiating reconnect
2013-06-08 20:25:43.316002 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42239 s=2 pgs=20621 cs=4029 l=0).fault, initiating reconnect
2013-06-08 20:25:43.316180 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42317 s=2 pgs=18287 cs=4731 l=0).fault, initiating reconnect
2013-06-08 20:25:43.316234 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58372 s=2 pgs=24419 cs=6707 l=0).fault, initiating reconnect
2013-06-08 20:25:43.316304 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35377 s=2 pgs=24630 cs=8047 l=0).fault, initiating reconnect
2013-06-08 20:25:43.316417 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35258 s=2 pgs=18769 cs=6201 l=0).fault, initiating reconnect
2013-06-08 20:25:43.316463 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60789 s=2 pgs=14850 cs=1409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.316860 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42244 s=2 pgs=20622 cs=4031 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317111 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58378 s=2 pgs=24420 cs=6709 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317114 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35382 s=2 pgs=24631 cs=8049 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317260 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35263 s=2 pgs=18770 cs=6203 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317296 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42335 s=2 pgs=18288 cs=4733 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317474 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60797 s=2 pgs=14851 cs=1411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317757 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42250 s=2 pgs=20623 cs=4033 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317810 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35387 s=2 pgs=24632 cs=8051 l=0).fault, initiating reconnect
2013-06-08 20:25:43.317934 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58383 s=2 pgs=24421 cs=6711 l=0).fault, initiating reconnect
2013-06-08 20:25:43.318124 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35268 s=2 pgs=18771 cs=6205 l=0).fault, initiating reconnect
2013-06-08 20:25:43.318249 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60803 s=2 pgs=14852 cs=1413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.318382 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42344 s=2 pgs=18289 cs=4735 l=0).fault, initiating reconnect
2013-06-08 20:25:43.318569 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35392 s=2 pgs=24633 cs=8053 l=0).fault, initiating reconnect
2013-06-08 20:25:43.318634 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42256 s=2 pgs=20624 cs=4035 l=0).fault, initiating reconnect
2013-06-08 20:25:43.318758 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58390 s=2 pgs=24422 cs=6713 l=0).fault, initiating reconnect
2013-06-08 20:25:43.318960 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35274 s=2 pgs=18772 cs=6207 l=0).fault, initiating reconnect
2013-06-08 20:25:43.319228 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60808 s=2 pgs=14853 cs=1415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.319376 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35397 s=2 pgs=24634 cs=8055 l=0).fault, initiating reconnect
2013-06-08 20:25:43.319557 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58396 s=2 pgs=24423 cs=6715 l=0).fault, initiating reconnect
2013-06-08 20:25:43.319627 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42263 s=2 pgs=20625 cs=4037 l=0).fault, initiating reconnect
2013-06-08 20:25:43.319637 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42351 s=2 pgs=18290 cs=4737 l=0).fault, initiating reconnect
2013-06-08 20:25:43.319802 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35280 s=2 pgs=18773 cs=6209 l=0).fault, initiating reconnect
2013-06-08 20:25:43.320140 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35402 s=2 pgs=24635 cs=8057 l=0).fault, initiating reconnect
2013-06-08 20:25:43.320219 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60814 s=2 pgs=14854 cs=1417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.320321 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58400 s=2 pgs=24424 cs=6717 l=0).fault, initiating reconnect
2013-06-08 20:25:43.320529 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42269 s=2 pgs=20626 cs=4039 l=0).fault, initiating reconnect
2013-06-08 20:25:43.320774 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35286 s=2 pgs=18774 cs=6211 l=0).fault, initiating reconnect
2013-06-08 20:25:43.320874 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42360 s=2 pgs=18291 cs=4739 l=0).fault, initiating reconnect
2013-06-08 20:25:43.321102 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60821 s=2 pgs=14855 cs=1419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.321141 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58406 s=2 pgs=24425 cs=6719 l=0).fault, initiating reconnect
2013-06-08 20:25:43.321655 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35291 s=2 pgs=18775 cs=6213 l=0).fault, initiating reconnect
2013-06-08 20:25:43.322029 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58411 s=2 pgs=24426 cs=6721 l=0).fault, initiating reconnect
2013-06-08 20:25:43.322073 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60826 s=2 pgs=14856 cs=1421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.322167 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42367 s=2 pgs=18292 cs=4741 l=0).fault, initiating reconnect
2013-06-08 20:25:43.322483 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42275 s=2 pgs=20627 cs=4041 l=0).fault, initiating reconnect
2013-06-08 20:25:43.322548 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35295 s=2 pgs=18776 cs=6215 l=0).fault, initiating reconnect
2013-06-08 20:25:43.322731 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35407 s=2 pgs=24636 cs=8059 l=0).fault, initiating reconnect
2013-06-08 20:25:43.322917 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58413 s=2 pgs=24427 cs=6723 l=0).fault, initiating reconnect
2013-06-08 20:25:43.323174 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42373 s=2 pgs=18293 cs=4743 l=0).fault, initiating reconnect
2013-06-08 20:25:43.323215 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60830 s=2 pgs=14857 cs=1423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.323375 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35300 s=2 pgs=18777 cs=6217 l=0).fault, initiating reconnect
2013-06-08 20:25:43.323394 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42284 s=2 pgs=20628 cs=4043 l=0).fault, initiating reconnect
2013-06-08 20:25:43.323600 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35421 s=2 pgs=24637 cs=8061 l=0).fault, initiating reconnect
2013-06-08 20:25:43.323768 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58419 s=2 pgs=24428 cs=6725 l=0).fault, initiating reconnect
2013-06-08 20:25:43.324245 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42378 s=2 pgs=18294 cs=4745 l=0).fault, initiating reconnect
2013-06-08 20:25:43.324254 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35305 s=2 pgs=18778 cs=6219 l=0).fault, initiating reconnect
2013-06-08 20:25:43.324330 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42291 s=2 pgs=20629 cs=4045 l=0).fault, initiating reconnect
2013-06-08 20:25:43.324352 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60837 s=2 pgs=14858 cs=1425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.324388 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35427 s=2 pgs=24638 cs=8063 l=0).fault, initiating reconnect
2013-06-08 20:25:43.324577 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58425 s=2 pgs=24429 cs=6727 l=0).fault, initiating reconnect
2013-06-08 20:25:43.325052 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35310 s=2 pgs=18779 cs=6221 l=0).fault, initiating reconnect
2013-06-08 20:25:43.325089 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35433 s=2 pgs=24639 cs=8065 l=0).fault, initiating reconnect
2013-06-08 20:25:43.325149 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42296 s=2 pgs=20630 cs=4047 l=0).fault, initiating reconnect
2013-06-08 20:25:43.325202 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60845 s=2 pgs=14859 cs=1427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.325547 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58431 s=2 pgs=24430 cs=6729 l=0).fault, initiating reconnect
2013-06-08 20:25:43.325753 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35436 s=2 pgs=24640 cs=8067 l=0).fault, initiating reconnect
2013-06-08 20:25:43.325871 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35315 s=2 pgs=18780 cs=6223 l=0).fault, initiating reconnect
2013-06-08 20:25:43.326044 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42302 s=2 pgs=20631 cs=4049 l=0).fault, initiating reconnect
2013-06-08 20:25:43.326217 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60851 s=2 pgs=14860 cs=1429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.326267 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42384 s=2 pgs=18295 cs=4747 l=0).fault, initiating reconnect
2013-06-08 20:25:43.326459 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58436 s=2 pgs=24431 cs=6731 l=0).fault, initiating reconnect
2013-06-08 20:25:43.326546 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35440 s=2 pgs=24641 cs=8069 l=0).fault, initiating reconnect
2013-06-08 20:25:43.326816 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35321 s=2 pgs=18781 cs=6225 l=0).fault, initiating reconnect
2013-06-08 20:25:43.327174 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60856 s=2 pgs=14861 cs=1431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.327386 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35446 s=2 pgs=24642 cs=8071 l=0).fault, initiating reconnect
2013-06-08 20:25:43.327462 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58442 s=2 pgs=24432 cs=6733 l=0).fault, initiating reconnect
2013-06-08 20:25:43.327761 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35327 s=2 pgs=18782 cs=6227 l=0).fault, initiating reconnect
2013-06-08 20:25:43.328006 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60861 s=2 pgs=14862 cs=1433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.328209 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35449 s=2 pgs=24643 cs=8073 l=0).fault, initiating reconnect
2013-06-08 20:25:43.328331 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58447 s=2 pgs=24433 cs=6735 l=0).fault, initiating reconnect
2013-06-08 20:25:43.328602 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35331 s=2 pgs=18783 cs=6229 l=0).fault, initiating reconnect
2013-06-08 20:25:43.328876 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60865 s=2 pgs=14863 cs=1435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.329216 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58451 s=2 pgs=24434 cs=6737 l=0).fault, initiating reconnect
2013-06-08 20:25:43.329421 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35335 s=2 pgs=18784 cs=6231 l=0).fault, initiating reconnect
2013-06-08 20:25:43.329458 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42399 s=2 pgs=18296 cs=4749 l=0).fault, initiating reconnect
2013-06-08 20:25:43.329716 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60869 s=2 pgs=14864 cs=1437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.330107 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42307 s=2 pgs=20632 cs=4051 l=0).fault, initiating reconnect
2013-06-08 20:25:43.330117 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58454 s=2 pgs=24435 cs=6739 l=0).fault, initiating reconnect
2013-06-08 20:25:43.330190 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35338 s=2 pgs=18785 cs=6233 l=0).fault, initiating reconnect
2013-06-08 20:25:43.330525 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42414 s=2 pgs=18297 cs=4751 l=0).fault, initiating reconnect
2013-06-08 20:25:43.331033 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35453 s=2 pgs=24644 cs=8075 l=0).fault, initiating reconnect
2013-06-08 20:25:43.331088 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58459 s=2 pgs=24436 cs=6741 l=0).fault, initiating reconnect
2013-06-08 20:25:43.331102 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42326 s=2 pgs=20633 cs=4053 l=0).fault, initiating reconnect
2013-06-08 20:25:43.331504 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42419 s=2 pgs=18298 cs=4753 l=0).fault, initiating reconnect
2013-06-08 20:25:43.331888 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35465 s=2 pgs=24645 cs=8077 l=0).fault, initiating reconnect
2013-06-08 20:25:43.332013 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58463 s=2 pgs=24437 cs=6743 l=0).fault, initiating reconnect
2013-06-08 20:25:43.332060 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35343 s=2 pgs=18786 cs=6235 l=0).fault, initiating reconnect
2013-06-08 20:25:43.332080 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42332 s=2 pgs=20634 cs=4055 l=0).fault, initiating reconnect
2013-06-08 20:25:43.332693 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35469 s=2 pgs=24646 cs=8079 l=0).fault, initiating reconnect
2013-06-08 20:25:43.332837 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35351 s=2 pgs=18787 cs=6237 l=0).fault, initiating reconnect
2013-06-08 20:25:43.332896 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58467 s=2 pgs=24438 cs=6745 l=0).fault, initiating reconnect
2013-06-08 20:25:43.332957 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42337 s=2 pgs=20635 cs=4057 l=0).fault, initiating reconnect
2013-06-08 20:25:43.333445 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35473 s=2 pgs=24647 cs=8081 l=0).fault, initiating reconnect
2013-06-08 20:25:43.333492 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42423 s=2 pgs=18299 cs=4755 l=0).fault, initiating reconnect
2013-06-08 20:25:43.333640 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35354 s=2 pgs=18788 cs=6239 l=0).fault, initiating reconnect
2013-06-08 20:25:43.333732 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60873 s=2 pgs=14865 cs=1439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.333847 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58472 s=2 pgs=24439 cs=6747 l=0).fault, initiating reconnect
2013-06-08 20:25:43.333889 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42341 s=2 pgs=20636 cs=4059 l=0).fault, initiating reconnect
2013-06-08 20:25:43.334136 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35477 s=2 pgs=24648 cs=8083 l=0).fault, initiating reconnect
2013-06-08 20:25:43.334485 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :42433 s=2 pgs=18300 cs=4757 l=0).fault, initiating reconnect
2013-06-08 20:25:43.334521 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=28 :35359 s=2 pgs=18789 cs=6241 l=0).fault, initiating reconnect
2013-06-08 20:25:43.334588 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58478 s=2 pgs=24440 cs=6749 l=0).fault, initiating reconnect
2013-06-08 20:25:43.334860 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35483 s=2 pgs=24649 cs=8085 l=0).fault, initiating reconnect
2013-06-08 20:25:43.334864 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42347 s=2 pgs=20637 cs=4061 l=0).fault, initiating reconnect
2013-06-08 20:25:43.335038 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60893 s=2 pgs=14866 cs=1441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.335313 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58483 s=2 pgs=24441 cs=6751 l=0).fault, initiating reconnect
2013-06-08 20:25:43.335549 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :42440 s=2 pgs=18301 cs=4759 l=0).fault, initiating reconnect
2013-06-08 20:25:43.335660 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35487 s=2 pgs=24650 cs=8087 l=0).fault, initiating reconnect
2013-06-08 20:25:43.336044 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :60902 s=2 pgs=14867 cs=1443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.336047 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42353 s=2 pgs=20638 cs=4063 l=0).fault, initiating reconnect
2013-06-08 20:25:43.336163 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58487 s=2 pgs=24442 cs=6753 l=0).fault, initiating reconnect
2013-06-08 20:25:43.336403 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :35492 s=2 pgs=24651 cs=8089 l=0).fault, initiating reconnect
2013-06-08 20:25:43.336415 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :42446 s=2 pgs=18302 cs=4761 l=0).fault, initiating reconnect
2013-06-08 20:25:43.336910 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60906 s=2 pgs=14868 cs=1445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337030 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42358 s=2 pgs=20639 cs=4065 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337028 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58492 s=2 pgs=24443 cs=6755 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337207 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :35497 s=2 pgs=24652 cs=8091 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337391 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42451 s=2 pgs=18303 cs=4763 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337796 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60911 s=2 pgs=14869 cs=1447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337923 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58497 s=2 pgs=24444 cs=6757 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337944 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42364 s=2 pgs=20640 cs=4067 l=0).fault, initiating reconnect
2013-06-08 20:25:43.337964 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :35501 s=2 pgs=24653 cs=8093 l=0).fault, initiating reconnect
2013-06-08 20:25:43.338294 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42457 s=2 pgs=18304 cs=4765 l=0).fault, initiating reconnect
2013-06-08 20:25:43.338808 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :35506 s=2 pgs=24654 cs=8095 l=0).fault, initiating reconnect
2013-06-08 20:25:43.338814 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58501 s=2 pgs=24445 cs=6759 l=0).fault, initiating reconnect
2013-06-08 20:25:43.338825 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60916 s=2 pgs=14870 cs=1449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.338889 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35364 s=2 pgs=18790 cs=6243 l=0).fault, initiating reconnect
2013-06-08 20:25:43.339251 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42462 s=2 pgs=18305 cs=4767 l=0).fault, initiating reconnect
2013-06-08 20:25:43.339586 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58506 s=2 pgs=24446 cs=6761 l=0).fault, initiating reconnect
2013-06-08 20:25:43.339592 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :35508 s=2 pgs=24655 cs=8097 l=0).fault, initiating reconnect
2013-06-08 20:25:43.339680 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35391 s=2 pgs=18791 cs=6245 l=0).fault, initiating reconnect
2013-06-08 20:25:43.339747 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60923 s=2 pgs=14871 cs=1451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.339968 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42370 s=2 pgs=20641 cs=4069 l=0).fault, initiating reconnect
2013-06-08 20:25:43.340247 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42467 s=2 pgs=18306 cs=4769 l=0).fault, initiating reconnect
2013-06-08 20:25:43.340364 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58510 s=2 pgs=24447 cs=6763 l=0).fault, initiating reconnect
2013-06-08 20:25:43.340454 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :35514 s=2 pgs=24656 cs=8099 l=0).fault, initiating reconnect
2013-06-08 20:25:43.340522 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35395 s=2 pgs=18792 cs=6247 l=0).fault, initiating reconnect
2013-06-08 20:25:43.340593 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60929 s=2 pgs=14872 cs=1453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.340842 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42382 s=2 pgs=20642 cs=4071 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341138 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58516 s=2 pgs=24448 cs=6765 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341246 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :35520 s=2 pgs=24657 cs=8101 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341329 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35401 s=2 pgs=18793 cs=6249 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341326 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42473 s=2 pgs=18307 cs=4771 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341702 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42388 s=2 pgs=20643 cs=4073 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341769 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60935 s=2 pgs=14873 cs=1455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341963 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58521 s=2 pgs=24449 cs=6767 l=0).fault, initiating reconnect
2013-06-08 20:25:43.341969 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :35525 s=2 pgs=24658 cs=8103 l=0).fault, initiating reconnect
2013-06-08 20:25:43.342376 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42482 s=2 pgs=18308 cs=4773 l=0).fault, initiating reconnect
2013-06-08 20:25:43.342506 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42393 s=2 pgs=20644 cs=4075 l=0).fault, initiating reconnect
2013-06-08 20:25:43.342627 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60942 s=2 pgs=14874 cs=1457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.342688 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :35531 s=2 pgs=24659 cs=8105 l=0).fault, initiating reconnect
2013-06-08 20:25:43.342701 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58527 s=2 pgs=24450 cs=6769 l=0).fault, initiating reconnect
2013-06-08 20:25:43.343336 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42398 s=2 pgs=20645 cs=4077 l=0).fault, initiating reconnect
2013-06-08 20:25:43.343350 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35406 s=2 pgs=18794 cs=6251 l=0).fault, initiating reconnect
2013-06-08 20:25:43.343433 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :60947 s=2 pgs=14875 cs=1459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.343438 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :35535 s=2 pgs=24660 cs=8107 l=0).fault, initiating reconnect
2013-06-08 20:25:43.343518 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58533 s=2 pgs=24451 cs=6771 l=0).fault, initiating reconnect
2013-06-08 20:25:43.344226 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=31 :35540 s=2 pgs=24661 cs=8109 l=0).fault, initiating reconnect
2013-06-08 20:25:43.344239 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42402 s=2 pgs=20646 cs=4079 l=0).fault, initiating reconnect
2013-06-08 20:25:43.344251 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35418 s=2 pgs=18795 cs=6253 l=0).fault, initiating reconnect
2013-06-08 20:25:43.344343 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58538 s=2 pgs=24452 cs=6773 l=0).fault, initiating reconnect
2013-06-08 20:25:43.344405 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42487 s=2 pgs=18309 cs=4775 l=0).fault, initiating reconnect
2013-06-08 20:25:43.344466 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60952 s=2 pgs=14876 cs=1461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.344951 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35542 s=2 pgs=24662 cs=8111 l=0).fault, initiating reconnect
2013-06-08 20:25:43.345078 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35424 s=2 pgs=18796 cs=6255 l=0).fault, initiating reconnect
2013-06-08 20:25:43.345104 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42408 s=2 pgs=20647 cs=4081 l=0).fault, initiating reconnect
2013-06-08 20:25:43.345190 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58542 s=2 pgs=24453 cs=6775 l=0).fault, initiating reconnect
2013-06-08 20:25:43.345343 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60960 s=2 pgs=14877 cs=1463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.345375 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42501 s=2 pgs=18310 cs=4777 l=0).fault, initiating reconnect
2013-06-08 20:25:43.345760 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35548 s=2 pgs=24663 cs=8113 l=0).fault, initiating reconnect
2013-06-08 20:25:43.345950 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35429 s=2 pgs=18797 cs=6257 l=0).fault, initiating reconnect
2013-06-08 20:25:43.346043 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42415 s=2 pgs=20648 cs=4083 l=0).fault, initiating reconnect
2013-06-08 20:25:43.346107 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58548 s=2 pgs=24454 cs=6777 l=0).fault, initiating reconnect
2013-06-08 20:25:43.346367 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60965 s=2 pgs=14878 cs=1465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.346403 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42508 s=2 pgs=18311 cs=4779 l=0).fault, initiating reconnect
2013-06-08 20:25:43.346523 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35554 s=2 pgs=24664 cs=8115 l=0).fault, initiating reconnect
2013-06-08 20:25:43.346920 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42421 s=2 pgs=20649 cs=4085 l=0).fault, initiating reconnect
2013-06-08 20:25:43.346971 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58554 s=2 pgs=24455 cs=6779 l=0).fault, initiating reconnect
2013-06-08 20:25:43.347189 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60971 s=2 pgs=14879 cs=1467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.347263 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35435 s=2 pgs=18798 cs=6259 l=0).fault, initiating reconnect
2013-06-08 20:25:43.347284 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35560 s=2 pgs=24665 cs=8117 l=0).fault, initiating reconnect
2013-06-08 20:25:43.347439 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42514 s=2 pgs=18312 cs=4781 l=0).fault, initiating reconnect
2013-06-08 20:25:43.347751 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42426 s=2 pgs=20650 cs=4087 l=0).fault, initiating reconnect
2013-06-08 20:25:43.347788 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58559 s=2 pgs=24456 cs=6781 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348039 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35565 s=2 pgs=24666 cs=8119 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348089 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35444 s=2 pgs=18799 cs=6261 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348106 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60976 s=2 pgs=14880 cs=1469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348529 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42521 s=2 pgs=18313 cs=4783 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348589 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42432 s=2 pgs=20651 cs=4089 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348615 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58565 s=2 pgs=24457 cs=6783 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348772 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35569 s=2 pgs=24667 cs=8121 l=0).fault, initiating reconnect
2013-06-08 20:25:43.348910 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35450 s=2 pgs=18800 cs=6263 l=0).fault, initiating reconnect
2013-06-08 20:25:43.349224 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60984 s=2 pgs=14881 cs=1471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.349309 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42438 s=2 pgs=20652 cs=4091 l=0).fault, initiating reconnect
2013-06-08 20:25:43.349500 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58571 s=2 pgs=24458 cs=6785 l=0).fault, initiating reconnect
2013-06-08 20:25:43.349547 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35575 s=2 pgs=24668 cs=8123 l=0).fault, initiating reconnect
2013-06-08 20:25:43.349554 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42527 s=2 pgs=18314 cs=4785 l=0).fault, initiating reconnect
2013-06-08 20:25:43.349625 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35456 s=2 pgs=18801 cs=6265 l=0).fault, initiating reconnect
2013-06-08 20:25:43.350078 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60990 s=2 pgs=14882 cs=1473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.350223 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42443 s=2 pgs=20653 cs=4093 l=0).fault, initiating reconnect
2013-06-08 20:25:43.350313 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35580 s=2 pgs=24669 cs=8125 l=0).fault, initiating reconnect
2013-06-08 20:25:43.350325 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58576 s=2 pgs=24459 cs=6787 l=0).fault, initiating reconnect
2013-06-08 20:25:43.350404 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35462 s=2 pgs=18802 cs=6267 l=0).fault, initiating reconnect
2013-06-08 20:25:43.350613 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42536 s=2 pgs=18315 cs=4787 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351066 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35585 s=2 pgs=24670 cs=8127 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351078 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42449 s=2 pgs=20654 cs=4095 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351090 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :60996 s=2 pgs=14883 cs=1475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351162 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35467 s=2 pgs=18803 cs=6269 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351192 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58583 s=2 pgs=24460 cs=6789 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351778 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35589 s=2 pgs=24671 cs=8129 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351896 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35472 s=2 pgs=18804 cs=6271 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351965 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42455 s=2 pgs=20655 cs=4097 l=0).fault, initiating reconnect
2013-06-08 20:25:43.351981 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32771 s=2 pgs=14884 cs=1477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.352068 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58590 s=2 pgs=24461 cs=6791 l=0).fault, initiating reconnect
2013-06-08 20:25:43.352607 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35594 s=2 pgs=24672 cs=8131 l=0).fault, initiating reconnect
2013-06-08 20:25:43.352662 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35475 s=2 pgs=18805 cs=6273 l=0).fault, initiating reconnect
2013-06-08 20:25:43.352785 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42461 s=2 pgs=20656 cs=4099 l=0).fault, initiating reconnect
2013-06-08 20:25:43.352990 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58595 s=2 pgs=24462 cs=6793 l=0).fault, initiating reconnect
2013-06-08 20:25:43.353056 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32777 s=2 pgs=14885 cs=1479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.353421 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35599 s=2 pgs=24673 cs=8133 l=0).fault, initiating reconnect
2013-06-08 20:25:43.353477 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35480 s=2 pgs=18806 cs=6275 l=0).fault, initiating reconnect
2013-06-08 20:25:43.353564 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42466 s=2 pgs=20657 cs=4101 l=0).fault, initiating reconnect
2013-06-08 20:25:43.353823 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58599 s=2 pgs=24463 cs=6795 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354081 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32783 s=2 pgs=14886 cs=1481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354142 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35604 s=2 pgs=24674 cs=8135 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354207 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35485 s=2 pgs=18807 cs=6277 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354379 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42471 s=2 pgs=20658 cs=4103 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354711 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58604 s=2 pgs=24464 cs=6797 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354853 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42543 s=2 pgs=18316 cs=4789 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354915 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32788 s=2 pgs=14887 cs=1483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.354967 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35609 s=2 pgs=24675 cs=8137 l=0).fault, initiating reconnect
2013-06-08 20:25:43.355048 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35490 s=2 pgs=18808 cs=6279 l=0).fault, initiating reconnect
2013-06-08 20:25:43.355305 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42476 s=2 pgs=20659 cs=4105 l=0).fault, initiating reconnect
2013-06-08 20:25:43.355565 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58609 s=2 pgs=24465 cs=6799 l=0).fault, initiating reconnect
2013-06-08 20:25:43.355735 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35615 s=2 pgs=24676 cs=8139 l=0).fault, initiating reconnect
2013-06-08 20:25:43.355887 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32794 s=2 pgs=14888 cs=1485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.355995 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42568 s=2 pgs=18317 cs=4791 l=0).fault, initiating reconnect
2013-06-08 20:25:43.356173 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42482 s=2 pgs=20660 cs=4107 l=0).fault, initiating reconnect
2013-06-08 20:25:43.356443 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58615 s=2 pgs=24466 cs=6801 l=0).fault, initiating reconnect
2013-06-08 20:25:43.356502 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35619 s=2 pgs=24677 cs=8141 l=0).fault, initiating reconnect
2013-06-08 20:25:43.357071 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42487 s=2 pgs=20661 cs=4109 l=0).fault, initiating reconnect
2013-06-08 20:25:43.357241 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42576 s=2 pgs=18318 cs=4793 l=0).fault, initiating reconnect
2013-06-08 20:25:43.357257 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35624 s=2 pgs=24678 cs=8143 l=0).fault, initiating reconnect
2013-06-08 20:25:43.357329 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58620 s=2 pgs=24467 cs=6803 l=0).fault, initiating reconnect
2013-06-08 20:25:43.358005 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42490 s=2 pgs=20662 cs=4111 l=0).fault, initiating reconnect
2013-06-08 20:25:43.358052 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35627 s=2 pgs=24679 cs=8145 l=0).fault, initiating reconnect
2013-06-08 20:25:43.358148 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58625 s=2 pgs=24468 cs=6805 l=0).fault, initiating reconnect
2013-06-08 20:25:43.358497 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42581 s=2 pgs=18319 cs=4795 l=0).fault, initiating reconnect
2013-06-08 20:25:43.358858 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35630 s=2 pgs=24680 cs=8147 l=0).fault, initiating reconnect
2013-06-08 20:25:43.358905 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42494 s=2 pgs=20663 cs=4113 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359045 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58628 s=2 pgs=24469 cs=6807 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359085 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35496 s=2 pgs=18809 cs=6281 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359301 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32800 s=2 pgs=14889 cs=1487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359532 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42587 s=2 pgs=18320 cs=4797 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359668 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35633 s=2 pgs=24681 cs=8149 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359847 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42499 s=2 pgs=20664 cs=4115 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359856 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35516 s=2 pgs=18810 cs=6283 l=0).fault, initiating reconnect
2013-06-08 20:25:43.359900 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58632 s=2 pgs=24470 cs=6809 l=0).fault, initiating reconnect
2013-06-08 20:25:43.360358 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42593 s=2 pgs=18321 cs=4799 l=0).fault, initiating reconnect
2013-06-08 20:25:43.360482 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35639 s=2 pgs=24682 cs=8151 l=0).fault, initiating reconnect
2013-06-08 20:25:43.360545 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35521 s=2 pgs=18811 cs=6285 l=0).fault, initiating reconnect
2013-06-08 20:25:43.360660 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58639 s=2 pgs=24471 cs=6811 l=0).fault, initiating reconnect
2013-06-08 20:25:43.360782 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42505 s=2 pgs=20665 cs=4117 l=0).fault, initiating reconnect
2013-06-08 20:25:43.361234 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35644 s=2 pgs=24683 cs=8153 l=0).fault, initiating reconnect
2013-06-08 20:25:43.361253 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42598 s=2 pgs=18322 cs=4801 l=0).fault, initiating reconnect
2013-06-08 20:25:43.361303 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35525 s=2 pgs=18812 cs=6287 l=0).fault, initiating reconnect
2013-06-08 20:25:43.361344 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58643 s=2 pgs=24472 cs=6813 l=0).fault, initiating reconnect
2013-06-08 20:25:43.361526 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42512 s=2 pgs=20666 cs=4119 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362002 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35648 s=2 pgs=24684 cs=8155 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362054 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35530 s=2 pgs=18813 cs=6289 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362127 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58648 s=2 pgs=24473 cs=6815 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362297 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42604 s=2 pgs=18323 cs=4803 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362419 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42517 s=2 pgs=20667 cs=4121 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362715 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35653 s=2 pgs=24685 cs=8157 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362760 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35534 s=2 pgs=18814 cs=6291 l=0).fault, initiating reconnect
2013-06-08 20:25:43.362899 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58652 s=2 pgs=24474 cs=6817 l=0).fault, initiating reconnect
2013-06-08 20:25:43.363330 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42522 s=2 pgs=20668 cs=4123 l=0).fault, initiating reconnect
2013-06-08 20:25:43.363340 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42611 s=2 pgs=18324 cs=4805 l=0).fault, initiating reconnect
2013-06-08 20:25:43.363464 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35658 s=2 pgs=24686 cs=8159 l=0).fault, initiating reconnect
2013-06-08 20:25:43.363615 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35539 s=2 pgs=18815 cs=6293 l=0).fault, initiating reconnect
2013-06-08 20:25:43.363717 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58657 s=2 pgs=24475 cs=6819 l=0).fault, initiating reconnect
2013-06-08 20:25:43.364204 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35663 s=2 pgs=24687 cs=8161 l=0).fault, initiating reconnect
2013-06-08 20:25:43.364219 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42526 s=2 pgs=20669 cs=4125 l=0).fault, initiating reconnect
2013-06-08 20:25:43.364335 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42617 s=2 pgs=18325 cs=4807 l=0).fault, initiating reconnect
2013-06-08 20:25:43.364439 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32817 s=2 pgs=14890 cs=1489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.364561 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58662 s=2 pgs=24476 cs=6821 l=0).fault, initiating reconnect
2013-06-08 20:25:43.364975 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35667 s=2 pgs=24688 cs=8163 l=0).fault, initiating reconnect
2013-06-08 20:25:43.365040 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42531 s=2 pgs=20670 cs=4127 l=0).fault, initiating reconnect
2013-06-08 20:25:43.365188 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42623 s=2 pgs=18326 cs=4809 l=0).fault, initiating reconnect
2013-06-08 20:25:43.365449 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58667 s=2 pgs=24477 cs=6823 l=0).fault, initiating reconnect
2013-06-08 20:25:43.365521 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32849 s=2 pgs=14891 cs=1491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.365598 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35544 s=2 pgs=18816 cs=6295 l=0).fault, initiating reconnect
2013-06-08 20:25:43.365867 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35671 s=2 pgs=24689 cs=8165 l=0).fault, initiating reconnect
2013-06-08 20:25:43.366287 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42628 s=2 pgs=18327 cs=4811 l=0).fault, initiating reconnect
2013-06-08 20:25:43.366289 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42537 s=2 pgs=20671 cs=4129 l=0).fault, initiating reconnect
2013-06-08 20:25:43.366400 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58671 s=2 pgs=24478 cs=6825 l=0).fault, initiating reconnect
2013-06-08 20:25:43.366444 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35556 s=2 pgs=18817 cs=6297 l=0).fault, initiating reconnect
2013-06-08 20:25:43.366624 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32855 s=2 pgs=14892 cs=1493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.366644 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35677 s=2 pgs=24690 cs=8167 l=0).fault, initiating reconnect
2013-06-08 20:25:43.367110 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42633 s=2 pgs=18328 cs=4813 l=0).fault, initiating reconnect
2013-06-08 20:25:43.367148 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42544 s=2 pgs=20672 cs=4131 l=0).fault, initiating reconnect
2013-06-08 20:25:43.367216 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58677 s=2 pgs=24479 cs=6827 l=0).fault, initiating reconnect
2013-06-08 20:25:43.367232 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35561 s=2 pgs=18818 cs=6299 l=0).fault, initiating reconnect
2013-06-08 20:25:43.367328 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35683 s=2 pgs=24691 cs=8169 l=0).fault, initiating reconnect
2013-06-08 20:25:43.367410 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32862 s=2 pgs=14893 cs=1495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368047 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58683 s=2 pgs=24480 cs=6829 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368051 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35688 s=2 pgs=24692 cs=8171 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368105 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42550 s=2 pgs=20673 cs=4133 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368182 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35567 s=2 pgs=18819 cs=6301 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368456 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32869 s=2 pgs=14894 cs=1497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368828 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35691 s=2 pgs=24693 cs=8173 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368927 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42557 s=2 pgs=20674 cs=4135 l=0).fault, initiating reconnect
2013-06-08 20:25:43.368942 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58687 s=2 pgs=24481 cs=6831 l=0).fault, initiating reconnect
2013-06-08 20:25:43.369122 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35573 s=2 pgs=18820 cs=6303 l=0).fault, initiating reconnect
2013-06-08 20:25:43.369368 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32874 s=2 pgs=14895 cs=1499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.369787 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35695 s=2 pgs=24694 cs=8175 l=0).fault, initiating reconnect
2013-06-08 20:25:43.369834 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42562 s=2 pgs=20675 cs=4137 l=0).fault, initiating reconnect
2013-06-08 20:25:43.369873 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58693 s=2 pgs=24482 cs=6833 l=0).fault, initiating reconnect
2013-06-08 20:25:43.369940 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35578 s=2 pgs=18821 cs=6305 l=0).fault, initiating reconnect
2013-06-08 20:25:43.370327 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32879 s=2 pgs=14896 cs=1501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.370536 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35700 s=2 pgs=24695 cs=8177 l=0).fault, initiating reconnect
2013-06-08 20:25:43.370732 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42566 s=2 pgs=20676 cs=4139 l=0).fault, initiating reconnect
2013-06-08 20:25:43.370797 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58699 s=2 pgs=24483 cs=6835 l=0).fault, initiating reconnect
2013-06-08 20:25:43.370841 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35583 s=2 pgs=18822 cs=6307 l=0).fault, initiating reconnect
2013-06-08 20:25:43.371260 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32884 s=2 pgs=14897 cs=1503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.371382 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35705 s=2 pgs=24696 cs=8179 l=0).fault, initiating reconnect
2013-06-08 20:25:43.371747 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58704 s=2 pgs=24484 cs=6837 l=0).fault, initiating reconnect
2013-06-08 20:25:43.371765 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42571 s=2 pgs=20677 cs=4141 l=0).fault, initiating reconnect
2013-06-08 20:25:43.371783 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35588 s=2 pgs=18823 cs=6309 l=0).fault, initiating reconnect
2013-06-08 20:25:43.372174 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42639 s=2 pgs=18329 cs=4815 l=0).fault, initiating reconnect
2013-06-08 20:25:43.372178 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35710 s=2 pgs=24697 cs=8181 l=0).fault, initiating reconnect
2013-06-08 20:25:43.372298 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32889 s=2 pgs=14898 cs=1505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.372535 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35592 s=2 pgs=18824 cs=6311 l=0).fault, initiating reconnect
2013-06-08 20:25:43.372647 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58710 s=2 pgs=24485 cs=6839 l=0).fault, initiating reconnect
2013-06-08 20:25:43.372717 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42576 s=2 pgs=20678 cs=4143 l=0).fault, initiating reconnect
2013-06-08 20:25:43.372991 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35715 s=2 pgs=24698 cs=8183 l=0).fault, initiating reconnect
2013-06-08 20:25:43.373168 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32896 s=2 pgs=14899 cs=1507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.373334 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35597 s=2 pgs=18825 cs=6313 l=0).fault, initiating reconnect
2013-06-08 20:25:43.373392 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42669 s=2 pgs=18330 cs=4817 l=0).fault, initiating reconnect
2013-06-08 20:25:43.373673 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58715 s=2 pgs=24486 cs=6841 l=0).fault, initiating reconnect
2013-06-08 20:25:43.373838 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35720 s=2 pgs=24699 cs=8185 l=0).fault, initiating reconnect
2013-06-08 20:25:43.374092 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32901 s=2 pgs=14900 cs=1509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.374208 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35602 s=2 pgs=18826 cs=6315 l=0).fault, initiating reconnect
2013-06-08 20:25:43.374307 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42678 s=2 pgs=18331 cs=4819 l=0).fault, initiating reconnect
2013-06-08 20:25:43.374570 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58721 s=2 pgs=24487 cs=6843 l=0).fault, initiating reconnect
2013-06-08 20:25:43.374729 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35725 s=2 pgs=24700 cs=8187 l=0).fault, initiating reconnect
2013-06-08 20:25:43.375074 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32906 s=2 pgs=14901 cs=1511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.375131 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35607 s=2 pgs=18827 cs=6317 l=0).fault, initiating reconnect
2013-06-08 20:25:43.375312 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42683 s=2 pgs=18332 cs=4821 l=0).fault, initiating reconnect
2013-06-08 20:25:43.375494 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58726 s=2 pgs=24488 cs=6845 l=0).fault, initiating reconnect
2013-06-08 20:25:43.375581 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35730 s=2 pgs=24701 cs=8189 l=0).fault, initiating reconnect
2013-06-08 20:25:43.376038 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35612 s=2 pgs=18828 cs=6319 l=0).fault, initiating reconnect
2013-06-08 20:25:43.376098 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32911 s=2 pgs=14902 cs=1513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.376305 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42584 s=2 pgs=20679 cs=4145 l=0).fault, initiating reconnect
2013-06-08 20:25:43.376380 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42688 s=2 pgs=18333 cs=4823 l=0).fault, initiating reconnect
2013-06-08 20:25:43.376381 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35735 s=2 pgs=24702 cs=8191 l=0).fault, initiating reconnect
2013-06-08 20:25:43.376513 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58731 s=2 pgs=24489 cs=6847 l=0).fault, initiating reconnect
2013-06-08 20:25:43.376852 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35616 s=2 pgs=18829 cs=6321 l=0).fault, initiating reconnect
2013-06-08 20:25:43.377045 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32917 s=2 pgs=14903 cs=1515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.377231 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35739 s=2 pgs=24703 cs=8193 l=0).fault, initiating reconnect
2013-06-08 20:25:43.377266 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42695 s=2 pgs=18334 cs=4825 l=0).fault, initiating reconnect
2013-06-08 20:25:43.377370 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42603 s=2 pgs=20680 cs=4147 l=0).fault, initiating reconnect
2013-06-08 20:25:43.377407 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58738 s=2 pgs=24490 cs=6849 l=0).fault, initiating reconnect
2013-06-08 20:25:43.377639 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35622 s=2 pgs=18830 cs=6323 l=0).fault, initiating reconnect
2013-06-08 20:25:43.377835 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32923 s=2 pgs=14904 cs=1517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.378056 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35744 s=2 pgs=24704 cs=8195 l=0).fault, initiating reconnect
2013-06-08 20:25:43.378304 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58743 s=2 pgs=24491 cs=6851 l=0).fault, initiating reconnect
2013-06-08 20:25:43.378357 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42700 s=2 pgs=18335 cs=4827 l=0).fault, initiating reconnect
2013-06-08 20:25:43.378413 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42612 s=2 pgs=20681 cs=4149 l=0).fault, initiating reconnect
2013-06-08 20:25:43.378877 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35750 s=2 pgs=24705 cs=8197 l=0).fault, initiating reconnect
2013-06-08 20:25:43.379192 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35628 s=2 pgs=18831 cs=6325 l=0).fault, initiating reconnect
2013-06-08 20:25:43.379239 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58748 s=2 pgs=24492 cs=6853 l=0).fault, initiating reconnect
2013-06-08 20:25:43.379357 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42707 s=2 pgs=18336 cs=4829 l=0).fault, initiating reconnect
2013-06-08 20:25:43.379363 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32929 s=2 pgs=14905 cs=1519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.379492 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42618 s=2 pgs=20682 cs=4151 l=0).fault, initiating reconnect
2013-06-08 20:25:43.379628 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35754 s=2 pgs=24706 cs=8199 l=0).fault, initiating reconnect
2013-06-08 20:25:43.380037 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35635 s=2 pgs=18832 cs=6327 l=0).fault, initiating reconnect
2013-06-08 20:25:43.380088 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58753 s=2 pgs=24493 cs=6855 l=0).fault, initiating reconnect
2013-06-08 20:25:43.380360 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42713 s=2 pgs=18337 cs=4831 l=0).fault, initiating reconnect
2013-06-08 20:25:43.380459 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35760 s=2 pgs=24707 cs=8201 l=0).fault, initiating reconnect
2013-06-08 20:25:43.380467 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42624 s=2 pgs=20683 cs=4153 l=0).fault, initiating reconnect
2013-06-08 20:25:43.381026 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58759 s=2 pgs=24494 cs=6857 l=0).fault, initiating reconnect
2013-06-08 20:25:43.381149 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32937 s=2 pgs=14906 cs=1521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.381184 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35764 s=2 pgs=24708 cs=8203 l=0).fault, initiating reconnect
2013-06-08 20:25:43.381382 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :42630 s=2 pgs=20684 cs=4155 l=0).fault, initiating reconnect
2013-06-08 20:25:43.381390 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :42718 s=2 pgs=18338 cs=4833 l=0).fault, initiating reconnect
2013-06-08 20:25:43.381806 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58763 s=2 pgs=24495 cs=6859 l=0).fault, initiating reconnect
2013-06-08 20:25:43.382018 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35768 s=2 pgs=24709 cs=8205 l=0).fault, initiating reconnect
2013-06-08 20:25:43.382222 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32947 s=2 pgs=14907 cs=1523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.382366 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42634 s=2 pgs=20685 cs=4157 l=0).fault, initiating reconnect
2013-06-08 20:25:43.382529 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58768 s=2 pgs=24496 cs=6861 l=0).fault, initiating reconnect
2013-06-08 20:25:43.382623 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42725 s=2 pgs=18339 cs=4835 l=0).fault, initiating reconnect
2013-06-08 20:25:43.382725 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35772 s=2 pgs=24710 cs=8207 l=0).fault, initiating reconnect
2013-06-08 20:25:43.383224 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32953 s=2 pgs=14908 cs=1525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.383291 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58772 s=2 pgs=24497 cs=6863 l=0).fault, initiating reconnect
2013-06-08 20:25:43.383322 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42639 s=2 pgs=20686 cs=4159 l=0).fault, initiating reconnect
2013-06-08 20:25:43.383451 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35777 s=2 pgs=24711 cs=8209 l=0).fault, initiating reconnect
2013-06-08 20:25:43.383661 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42731 s=2 pgs=18340 cs=4837 l=0).fault, initiating reconnect
2013-06-08 20:25:43.384051 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32958 s=2 pgs=14909 cs=1527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.384220 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58777 s=2 pgs=24498 cs=6865 l=0).fault, initiating reconnect
2013-06-08 20:25:43.384249 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42644 s=2 pgs=20687 cs=4161 l=0).fault, initiating reconnect
2013-06-08 20:25:43.384276 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35781 s=2 pgs=24712 cs=8211 l=0).fault, initiating reconnect
2013-06-08 20:25:43.384648 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42737 s=2 pgs=18341 cs=4839 l=0).fault, initiating reconnect
2013-06-08 20:25:43.385068 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35786 s=2 pgs=24713 cs=8213 l=0).fault, initiating reconnect
2013-06-08 20:25:43.385105 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32963 s=2 pgs=14910 cs=1529 l=0).fault, initiating reconnect
2013-06-08 20:25:43.385181 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42650 s=2 pgs=20688 cs=4163 l=0).fault, initiating reconnect
2013-06-08 20:25:43.385185 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58781 s=2 pgs=24499 cs=6867 l=0).fault, initiating reconnect
2013-06-08 20:25:43.385758 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42742 s=2 pgs=18342 cs=4841 l=0).fault, initiating reconnect
2013-06-08 20:25:43.385852 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35788 s=2 pgs=24714 cs=8215 l=0).fault, initiating reconnect
2013-06-08 20:25:43.386021 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32969 s=2 pgs=14911 cs=1531 l=0).fault, initiating reconnect
2013-06-08 20:25:43.386113 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42655 s=2 pgs=20689 cs=4165 l=0).fault, initiating reconnect
2013-06-08 20:25:43.386179 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58788 s=2 pgs=24500 cs=6869 l=0).fault, initiating reconnect
2013-06-08 20:25:43.386572 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35793 s=2 pgs=24715 cs=8217 l=0).fault, initiating reconnect
2013-06-08 20:25:43.386826 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42747 s=2 pgs=18343 cs=4843 l=0).fault, initiating reconnect
2013-06-08 20:25:43.387009 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42660 s=2 pgs=20690 cs=4167 l=0).fault, initiating reconnect
2013-06-08 20:25:43.387091 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32974 s=2 pgs=14912 cs=1533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.387105 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58793 s=2 pgs=24501 cs=6871 l=0).fault, initiating reconnect
2013-06-08 20:25:43.387345 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35797 s=2 pgs=24716 cs=8219 l=0).fault, initiating reconnect
2013-06-08 20:25:43.387789 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42753 s=2 pgs=18344 cs=4845 l=0).fault, initiating reconnect
2013-06-08 20:25:43.387952 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42664 s=2 pgs=20691 cs=4169 l=0).fault, initiating reconnect
2013-06-08 20:25:43.388086 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35802 s=2 pgs=24717 cs=8221 l=0).fault, initiating reconnect
2013-06-08 20:25:43.388087 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58798 s=2 pgs=24502 cs=6873 l=0).fault, initiating reconnect
2013-06-08 20:25:43.388117 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32980 s=2 pgs=14913 cs=1535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.388690 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42669 s=2 pgs=20692 cs=4171 l=0).fault, initiating reconnect
2013-06-08 20:25:43.388749 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42758 s=2 pgs=18345 cs=4847 l=0).fault, initiating reconnect
2013-06-08 20:25:43.388927 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58802 s=2 pgs=24503 cs=6875 l=0).fault, initiating reconnect
2013-06-08 20:25:43.389008 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35807 s=2 pgs=24718 cs=8223 l=0).fault, initiating reconnect
2013-06-08 20:25:43.389036 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32986 s=2 pgs=14914 cs=1537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.389449 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42673 s=2 pgs=20693 cs=4173 l=0).fault, initiating reconnect
2013-06-08 20:25:43.389775 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35811 s=2 pgs=24719 cs=8225 l=0).fault, initiating reconnect
2013-06-08 20:25:43.389804 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42764 s=2 pgs=18346 cs=4849 l=0).fault, initiating reconnect
2013-06-08 20:25:43.389843 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :58807 s=2 pgs=24504 cs=6877 l=0).fault, initiating reconnect
2013-06-08 20:25:43.389872 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :32992 s=2 pgs=14915 cs=1539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.390297 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42678 s=2 pgs=20694 cs=4175 l=0).fault, initiating reconnect
2013-06-08 20:25:43.390477 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35814 s=2 pgs=24720 cs=8227 l=0).fault, initiating reconnect
2013-06-08 20:25:43.390647 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58813 s=2 pgs=24505 cs=6879 l=0).fault, initiating reconnect
2013-06-08 20:25:43.390840 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :32997 s=2 pgs=14916 cs=1541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.390869 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42770 s=2 pgs=18347 cs=4851 l=0).fault, initiating reconnect
2013-06-08 20:25:43.391208 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42683 s=2 pgs=20695 cs=4177 l=0).fault, initiating reconnect
2013-06-08 20:25:43.391354 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35819 s=2 pgs=24721 cs=8229 l=0).fault, initiating reconnect
2013-06-08 20:25:43.391492 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58817 s=2 pgs=24506 cs=6881 l=0).fault, initiating reconnect
2013-06-08 20:25:43.391802 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33001 s=2 pgs=14917 cs=1543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.391929 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42777 s=2 pgs=18348 cs=4853 l=0).fault, initiating reconnect
2013-06-08 20:25:43.392225 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42688 s=2 pgs=20696 cs=4179 l=0).fault, initiating reconnect
2013-06-08 20:25:43.392265 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35824 s=2 pgs=24722 cs=8231 l=0).fault, initiating reconnect
2013-06-08 20:25:43.392344 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58822 s=2 pgs=24507 cs=6883 l=0).fault, initiating reconnect
2013-06-08 20:25:43.392714 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33006 s=2 pgs=14918 cs=1545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.392971 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35829 s=2 pgs=24723 cs=8233 l=0).fault, initiating reconnect
2013-06-08 20:25:43.393106 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42782 s=2 pgs=18349 cs=4855 l=0).fault, initiating reconnect
2013-06-08 20:25:43.393111 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42693 s=2 pgs=20697 cs=4181 l=0).fault, initiating reconnect
2013-06-08 20:25:43.393301 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58827 s=2 pgs=24508 cs=6885 l=0).fault, initiating reconnect
2013-06-08 20:25:43.393607 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33011 s=2 pgs=14919 cs=1547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.393678 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35832 s=2 pgs=24724 cs=8235 l=0).fault, initiating reconnect
2013-06-08 20:25:43.393935 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42788 s=2 pgs=18350 cs=4857 l=0).fault, initiating reconnect
2013-06-08 20:25:43.394079 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42699 s=2 pgs=20698 cs=4183 l=0).fault, initiating reconnect
2013-06-08 20:25:43.394266 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58832 s=2 pgs=24509 cs=6887 l=0).fault, initiating reconnect
2013-06-08 20:25:43.394493 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35837 s=2 pgs=24725 cs=8237 l=0).fault, initiating reconnect
2013-06-08 20:25:43.394569 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33016 s=2 pgs=14920 cs=1549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.395047 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42704 s=2 pgs=20699 cs=4185 l=0).fault, initiating reconnect
2013-06-08 20:25:43.395122 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42793 s=2 pgs=18351 cs=4859 l=0).fault, initiating reconnect
2013-06-08 20:25:43.395123 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58837 s=2 pgs=24510 cs=6889 l=0).fault, initiating reconnect
2013-06-08 20:25:43.395324 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35841 s=2 pgs=24726 cs=8239 l=0).fault, initiating reconnect
2013-06-08 20:25:43.395419 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33022 s=2 pgs=14921 cs=1551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.395922 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42708 s=2 pgs=20700 cs=4187 l=0).fault, initiating reconnect
2013-06-08 20:25:43.396007 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58841 s=2 pgs=24511 cs=6891 l=0).fault, initiating reconnect
2013-06-08 20:25:43.396094 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35846 s=2 pgs=24727 cs=8241 l=0).fault, initiating reconnect
2013-06-08 20:25:43.396305 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33027 s=2 pgs=14922 cs=1553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.396381 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42800 s=2 pgs=18352 cs=4861 l=0).fault, initiating reconnect
2013-06-08 20:25:43.396853 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42713 s=2 pgs=20701 cs=4189 l=0).fault, initiating reconnect
2013-06-08 20:25:43.396856 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35850 s=2 pgs=24728 cs=8243 l=0).fault, initiating reconnect
2013-06-08 20:25:43.396905 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58846 s=2 pgs=24512 cs=6893 l=0).fault, initiating reconnect
2013-06-08 20:25:43.397272 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33031 s=2 pgs=14923 cs=1555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.397555 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35854 s=2 pgs=24729 cs=8245 l=0).fault, initiating reconnect
2013-06-08 20:25:43.397565 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42807 s=2 pgs=18353 cs=4863 l=0).fault, initiating reconnect
2013-06-08 20:25:43.397696 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42718 s=2 pgs=20702 cs=4191 l=0).fault, initiating reconnect
2013-06-08 20:25:43.397776 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58852 s=2 pgs=24513 cs=6895 l=0).fault, initiating reconnect
2013-06-08 20:25:43.398229 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33036 s=2 pgs=14924 cs=1557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.398305 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35857 s=2 pgs=24730 cs=8247 l=0).fault, initiating reconnect
2013-06-08 20:25:43.398482 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42724 s=2 pgs=20703 cs=4193 l=0).fault, initiating reconnect
2013-06-08 20:25:43.398632 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58857 s=2 pgs=24514 cs=6897 l=0).fault, initiating reconnect
2013-06-08 20:25:43.398670 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42813 s=2 pgs=18354 cs=4865 l=0).fault, initiating reconnect
2013-06-08 20:25:43.399041 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35862 s=2 pgs=24731 cs=8249 l=0).fault, initiating reconnect
2013-06-08 20:25:43.399108 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33041 s=2 pgs=14925 cs=1559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.399312 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42728 s=2 pgs=20704 cs=4195 l=0).fault, initiating reconnect
2013-06-08 20:25:43.399633 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58861 s=2 pgs=24515 cs=6899 l=0).fault, initiating reconnect
2013-06-08 20:25:43.399711 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42820 s=2 pgs=18355 cs=4867 l=0).fault, initiating reconnect
2013-06-08 20:25:43.399847 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35866 s=2 pgs=24732 cs=8251 l=0).fault, initiating reconnect
2013-06-08 20:25:43.400222 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33047 s=2 pgs=14926 cs=1561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.400277 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42733 s=2 pgs=20705 cs=4197 l=0).fault, initiating reconnect
2013-06-08 20:25:43.400455 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58866 s=2 pgs=24516 cs=6901 l=0).fault, initiating reconnect
2013-06-08 20:25:43.400611 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35871 s=2 pgs=24733 cs=8253 l=0).fault, initiating reconnect
2013-06-08 20:25:43.400790 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42825 s=2 pgs=18356 cs=4869 l=0).fault, initiating reconnect
2013-06-08 20:25:43.401049 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42738 s=2 pgs=20706 cs=4199 l=0).fault, initiating reconnect
2013-06-08 20:25:43.401149 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33052 s=2 pgs=14927 cs=1563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.401279 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58871 s=2 pgs=24517 cs=6903 l=0).fault, initiating reconnect
2013-06-08 20:25:43.401371 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35875 s=2 pgs=24734 cs=8255 l=0).fault, initiating reconnect
2013-06-08 20:25:43.401920 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42742 s=2 pgs=20707 cs=4201 l=0).fault, initiating reconnect
2013-06-08 20:25:43.402023 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35880 s=2 pgs=24735 cs=8257 l=0).fault, initiating reconnect
2013-06-08 20:25:43.402099 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33058 s=2 pgs=14928 cs=1565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.402148 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42831 s=2 pgs=18357 cs=4871 l=0).fault, initiating reconnect
2013-06-08 20:25:43.402815 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35882 s=2 pgs=24736 cs=8259 l=0).fault, initiating reconnect
2013-06-08 20:25:43.402866 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42746 s=2 pgs=20708 cs=4203 l=0).fault, initiating reconnect
2013-06-08 20:25:43.403025 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33063 s=2 pgs=14929 cs=1567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.403157 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42839 s=2 pgs=18358 cs=4873 l=0).fault, initiating reconnect
2013-06-08 20:25:43.403575 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35885 s=2 pgs=24737 cs=8261 l=0).fault, initiating reconnect
2013-06-08 20:25:43.403841 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35641 s=2 pgs=18833 cs=6329 l=0).fault, initiating reconnect
2013-06-08 20:25:43.403847 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42751 s=2 pgs=20709 cs=4205 l=0).fault, initiating reconnect
2013-06-08 20:25:43.403943 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58876 s=2 pgs=24518 cs=6905 l=0).fault, initiating reconnect
2013-06-08 20:25:43.404190 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33067 s=2 pgs=14930 cs=1569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.404290 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42843 s=2 pgs=18359 cs=4875 l=0).fault, initiating reconnect
2013-06-08 20:25:43.404359 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35889 s=2 pgs=24738 cs=8263 l=0).fault, initiating reconnect
2013-06-08 20:25:43.404659 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35770 s=2 pgs=18834 cs=6331 l=0).fault, initiating reconnect
2013-06-08 20:25:43.404803 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58889 s=2 pgs=24519 cs=6907 l=0).fault, initiating reconnect
2013-06-08 20:25:43.404826 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42756 s=2 pgs=20710 cs=4207 l=0).fault, initiating reconnect
2013-06-08 20:25:43.405149 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35895 s=2 pgs=24739 cs=8265 l=0).fault, initiating reconnect
2013-06-08 20:25:43.405301 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33073 s=2 pgs=14931 cs=1571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.405418 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42849 s=2 pgs=18360 cs=4877 l=0).fault, initiating reconnect
2013-06-08 20:25:43.405566 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35776 s=2 pgs=18835 cs=6333 l=0).fault, initiating reconnect
2013-06-08 20:25:43.405659 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42763 s=2 pgs=20711 cs=4209 l=0).fault, initiating reconnect
2013-06-08 20:25:43.405719 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58894 s=2 pgs=24520 cs=6909 l=0).fault, initiating reconnect
2013-06-08 20:25:43.405998 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35899 s=2 pgs=24740 cs=8267 l=0).fault, initiating reconnect
2013-06-08 20:25:43.406422 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42856 s=2 pgs=18361 cs=4879 l=0).fault, initiating reconnect
2013-06-08 20:25:43.406486 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35782 s=2 pgs=18836 cs=6335 l=0).fault, initiating reconnect
2013-06-08 20:25:43.406575 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42768 s=2 pgs=20712 cs=4211 l=0).fault, initiating reconnect
2013-06-08 20:25:43.406602 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33080 s=2 pgs=14932 cs=1573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.406749 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35905 s=2 pgs=24741 cs=8269 l=0).fault, initiating reconnect
2013-06-08 20:25:43.407361 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35787 s=2 pgs=18837 cs=6337 l=0).fault, initiating reconnect
2013-06-08 20:25:43.407446 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42773 s=2 pgs=20713 cs=4213 l=0).fault, initiating reconnect
2013-06-08 20:25:43.407500 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42861 s=2 pgs=18362 cs=4881 l=0).fault, initiating reconnect
2013-06-08 20:25:43.407593 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33089 s=2 pgs=14933 cs=1575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.408030 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35910 s=2 pgs=24742 cs=8271 l=0).fault, initiating reconnect
2013-06-08 20:25:43.408211 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35791 s=2 pgs=18838 cs=6339 l=0).fault, initiating reconnect
2013-06-08 20:25:43.408314 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42777 s=2 pgs=20714 cs=4215 l=0).fault, initiating reconnect
2013-06-08 20:25:43.408399 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58901 s=2 pgs=24521 cs=6911 l=0).fault, initiating reconnect
2013-06-08 20:25:43.408405 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42868 s=2 pgs=18363 cs=4883 l=0).fault, initiating reconnect
2013-06-08 20:25:43.408559 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33094 s=2 pgs=14934 cs=1577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.408775 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35915 s=2 pgs=24743 cs=8273 l=0).fault, initiating reconnect
2013-06-08 20:25:43.409047 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35796 s=2 pgs=18839 cs=6341 l=0).fault, initiating reconnect
2013-06-08 20:25:43.409132 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42782 s=2 pgs=20715 cs=4217 l=0).fault, initiating reconnect
2013-06-08 20:25:43.409244 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58916 s=2 pgs=24522 cs=6913 l=0).fault, initiating reconnect
2013-06-08 20:25:43.409419 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42873 s=2 pgs=18364 cs=4885 l=0).fault, initiating reconnect
2013-06-08 20:25:43.409816 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35921 s=2 pgs=24744 cs=8275 l=0).fault, initiating reconnect
2013-06-08 20:25:43.409867 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35802 s=2 pgs=18840 cs=6343 l=0).fault, initiating reconnect
2013-06-08 20:25:43.410003 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42788 s=2 pgs=20716 cs=4219 l=0).fault, initiating reconnect
2013-06-08 20:25:43.410087 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58921 s=2 pgs=24523 cs=6915 l=0).fault, initiating reconnect
2013-06-08 20:25:43.410527 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42880 s=2 pgs=18365 cs=4887 l=0).fault, initiating reconnect
2013-06-08 20:25:43.410584 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35926 s=2 pgs=24745 cs=8277 l=0).fault, initiating reconnect
2013-06-08 20:25:43.410669 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35807 s=2 pgs=18841 cs=6345 l=0).fault, initiating reconnect
2013-06-08 20:25:43.410775 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42793 s=2 pgs=20717 cs=4221 l=0).fault, initiating reconnect
2013-06-08 20:25:43.410866 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58926 s=2 pgs=24524 cs=6917 l=0).fault, initiating reconnect
2013-06-08 20:25:43.411294 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35930 s=2 pgs=24746 cs=8279 l=0).fault, initiating reconnect
2013-06-08 20:25:43.411540 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35812 s=2 pgs=18842 cs=6347 l=0).fault, initiating reconnect
2013-06-08 20:25:43.411611 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42798 s=2 pgs=20718 cs=4223 l=0).fault, initiating reconnect
2013-06-08 20:25:43.411739 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58931 s=2 pgs=24525 cs=6919 l=0).fault, initiating reconnect
2013-06-08 20:25:43.411773 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42886 s=2 pgs=18366 cs=4889 l=0).fault, initiating reconnect
2013-06-08 20:25:43.412119 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35935 s=2 pgs=24747 cs=8281 l=0).fault, initiating reconnect
2013-06-08 20:25:43.412275 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35816 s=2 pgs=18843 cs=6349 l=0).fault, initiating reconnect
2013-06-08 20:25:43.412668 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42802 s=2 pgs=20719 cs=4225 l=0).fault, initiating reconnect
2013-06-08 20:25:43.412786 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42894 s=2 pgs=18367 cs=4891 l=0).fault, initiating reconnect
2013-06-08 20:25:43.412942 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35940 s=2 pgs=24748 cs=8283 l=0).fault, initiating reconnect
2013-06-08 20:25:43.413116 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35821 s=2 pgs=18844 cs=6351 l=0).fault, initiating reconnect
2013-06-08 20:25:43.413624 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :58935 s=2 pgs=24526 cs=6921 l=0).fault, initiating reconnect
2013-06-08 20:25:43.413628 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :42807 s=2 pgs=20720 cs=4227 l=0).fault, initiating reconnect
2013-06-08 20:25:43.413688 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42898 s=2 pgs=18368 cs=4893 l=0).fault, initiating reconnect
2013-06-08 20:25:43.413753 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35944 s=2 pgs=24749 cs=8285 l=0).fault, initiating reconnect
2013-06-08 20:25:43.414225 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33100 s=2 pgs=14935 cs=1579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.414493 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58943 s=2 pgs=24527 cs=6923 l=0).fault, initiating reconnect
2013-06-08 20:25:43.414502 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :42812 s=2 pgs=20721 cs=4229 l=0).fault, initiating reconnect
2013-06-08 20:25:43.414544 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35949 s=2 pgs=24750 cs=8287 l=0).fault, initiating reconnect
2013-06-08 20:25:43.414770 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42903 s=2 pgs=18369 cs=4895 l=0).fault, initiating reconnect
2013-06-08 20:25:43.415074 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35825 s=2 pgs=18845 cs=6353 l=0).fault, initiating reconnect
2013-06-08 20:25:43.415133 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33130 s=2 pgs=14936 cs=1581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.415293 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35953 s=2 pgs=24751 cs=8289 l=0).fault, initiating reconnect
2013-06-08 20:25:43.415316 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58948 s=2 pgs=24528 cs=6925 l=0).fault, initiating reconnect
2013-06-08 20:25:43.415478 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :42817 s=2 pgs=20722 cs=4231 l=0).fault, initiating reconnect
2013-06-08 20:25:43.415780 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42909 s=2 pgs=18370 cs=4897 l=0).fault, initiating reconnect
2013-06-08 20:25:43.416089 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35835 s=2 pgs=18846 cs=6355 l=0).fault, initiating reconnect
2013-06-08 20:25:43.416160 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58955 s=2 pgs=24529 cs=6927 l=0).fault, initiating reconnect
2013-06-08 20:25:43.416309 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33136 s=2 pgs=14937 cs=1583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.416313 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :42824 s=2 pgs=20723 cs=4233 l=0).fault, initiating reconnect
2013-06-08 20:25:43.416910 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35841 s=2 pgs=18847 cs=6357 l=0).fault, initiating reconnect
2013-06-08 20:25:43.416982 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58959 s=2 pgs=24530 cs=6929 l=0).fault, initiating reconnect
2013-06-08 20:25:43.417044 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42915 s=2 pgs=18371 cs=4899 l=0).fault, initiating reconnect
2013-06-08 20:25:43.417125 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35957 s=2 pgs=24752 cs=8291 l=0).fault, initiating reconnect
2013-06-08 20:25:43.417161 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42829 s=2 pgs=20724 cs=4235 l=0).fault, initiating reconnect
2013-06-08 20:25:43.417231 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33143 s=2 pgs=14938 cs=1585 l=0).fault, initiating reconnect
2013-06-08 20:25:43.417667 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35845 s=2 pgs=18848 cs=6359 l=0).fault, initiating reconnect
2013-06-08 20:25:43.417805 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58963 s=2 pgs=24531 cs=6931 l=0).fault, initiating reconnect
2013-06-08 20:25:43.417897 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35968 s=2 pgs=24753 cs=8293 l=0).fault, initiating reconnect
2013-06-08 20:25:43.418044 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42834 s=2 pgs=20725 cs=4237 l=0).fault, initiating reconnect
2013-06-08 20:25:43.418131 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42922 s=2 pgs=18372 cs=4901 l=0).fault, initiating reconnect
2013-06-08 20:25:43.418188 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33150 s=2 pgs=14939 cs=1587 l=0).fault, initiating reconnect
2013-06-08 20:25:43.418550 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58969 s=2 pgs=24532 cs=6933 l=0).fault, initiating reconnect
2013-06-08 20:25:43.418580 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35851 s=2 pgs=18849 cs=6361 l=0).fault, initiating reconnect
2013-06-08 20:25:43.418653 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35973 s=2 pgs=24754 cs=8295 l=0).fault, initiating reconnect
2013-06-08 20:25:43.418955 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42839 s=2 pgs=20726 cs=4239 l=0).fault, initiating reconnect
2013-06-08 20:25:43.419190 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42930 s=2 pgs=18373 cs=4903 l=0).fault, initiating reconnect
2013-06-08 20:25:43.419521 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35979 s=2 pgs=24755 cs=8297 l=0).fault, initiating reconnect
2013-06-08 20:25:43.419536 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58974 s=2 pgs=24533 cs=6935 l=0).fault, initiating reconnect
2013-06-08 20:25:43.419865 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42845 s=2 pgs=20727 cs=4241 l=0).fault, initiating reconnect
2013-06-08 20:25:43.420209 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42936 s=2 pgs=18374 cs=4905 l=0).fault, initiating reconnect
2013-06-08 20:25:43.420256 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35982 s=2 pgs=24756 cs=8299 l=0).fault, initiating reconnect
2013-06-08 20:25:43.420391 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58980 s=2 pgs=24534 cs=6937 l=0).fault, initiating reconnect
2013-06-08 20:25:43.420451 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35858 s=2 pgs=18850 cs=6363 l=0).fault, initiating reconnect
2013-06-08 20:25:43.420685 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42849 s=2 pgs=20728 cs=4243 l=0).fault, initiating reconnect
2013-06-08 20:25:43.421042 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35986 s=2 pgs=24757 cs=8301 l=0).fault, initiating reconnect
2013-06-08 20:25:43.421191 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35868 s=2 pgs=18851 cs=6365 l=0).fault, initiating reconnect
2013-06-08 20:25:43.421223 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42940 s=2 pgs=18375 cs=4907 l=0).fault, initiating reconnect
2013-06-08 20:25:43.421230 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58984 s=2 pgs=24535 cs=6939 l=0).fault, initiating reconnect
2013-06-08 20:25:43.421641 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42854 s=2 pgs=20729 cs=4245 l=0).fault, initiating reconnect
2013-06-08 20:25:43.421821 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35990 s=2 pgs=24758 cs=8303 l=0).fault, initiating reconnect
2013-06-08 20:25:43.421962 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35871 s=2 pgs=18852 cs=6367 l=0).fault, initiating reconnect
2013-06-08 20:25:43.422029 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58989 s=2 pgs=24536 cs=6941 l=0).fault, initiating reconnect
2013-06-08 20:25:43.422207 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42948 s=2 pgs=18376 cs=4909 l=0).fault, initiating reconnect
2013-06-08 20:25:43.422504 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33156 s=2 pgs=14940 cs=1589 l=0).fault, initiating reconnect
2013-06-08 20:25:43.422572 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42859 s=2 pgs=20730 cs=4247 l=0).fault, initiating reconnect
2013-06-08 20:25:43.422628 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :35995 s=2 pgs=24759 cs=8305 l=0).fault, initiating reconnect
2013-06-08 20:25:43.422673 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35876 s=2 pgs=18853 cs=6369 l=0).fault, initiating reconnect
2013-06-08 20:25:43.422899 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :58994 s=2 pgs=24537 cs=6943 l=0).fault, initiating reconnect
2013-06-08 20:25:43.423378 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36001 s=2 pgs=24760 cs=8307 l=0).fault, initiating reconnect
2013-06-08 20:25:43.423428 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42953 s=2 pgs=18377 cs=4911 l=0).fault, initiating reconnect
2013-06-08 20:25:43.423443 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42865 s=2 pgs=20731 cs=4249 l=0).fault, initiating reconnect
2013-06-08 20:25:43.423455 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35882 s=2 pgs=18854 cs=6371 l=0).fault, initiating reconnect
2013-06-08 20:25:43.423604 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33179 s=2 pgs=14941 cs=1591 l=0).fault, initiating reconnect
2013-06-08 20:25:43.423800 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59000 s=2 pgs=24538 cs=6945 l=0).fault, initiating reconnect
2013-06-08 20:25:43.424237 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42871 s=2 pgs=20732 cs=4251 l=0).fault, initiating reconnect
2013-06-08 20:25:43.424305 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35887 s=2 pgs=18855 cs=6373 l=0).fault, initiating reconnect
2013-06-08 20:25:43.424524 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42960 s=2 pgs=18378 cs=4913 l=0).fault, initiating reconnect
2013-06-08 20:25:43.424587 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33188 s=2 pgs=14942 cs=1593 l=0).fault, initiating reconnect
2013-06-08 20:25:43.424604 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36004 s=2 pgs=24761 cs=8309 l=0).fault, initiating reconnect
2013-06-08 20:25:43.424615 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59006 s=2 pgs=24539 cs=6947 l=0).fault, initiating reconnect
2013-06-08 20:25:43.424982 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42875 s=2 pgs=20733 cs=4253 l=0).fault, initiating reconnect
2013-06-08 20:25:43.425227 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35891 s=2 pgs=18856 cs=6375 l=0).fault, initiating reconnect
2013-06-08 20:25:43.425333 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59012 s=2 pgs=24540 cs=6949 l=0).fault, initiating reconnect
2013-06-08 20:25:43.425342 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36014 s=2 pgs=24762 cs=8311 l=0).fault, initiating reconnect
2013-06-08 20:25:43.425490 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42967 s=2 pgs=18379 cs=4915 l=0).fault, initiating reconnect
2013-06-08 20:25:43.425691 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33193 s=2 pgs=14943 cs=1595 l=0).fault, initiating reconnect
2013-06-08 20:25:43.425909 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42881 s=2 pgs=20734 cs=4255 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426055 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36019 s=2 pgs=24763 cs=8313 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426081 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59015 s=2 pgs=24541 cs=6951 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426105 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35897 s=2 pgs=18857 cs=6377 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426368 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42975 s=2 pgs=18380 cs=4917 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426773 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36023 s=2 pgs=24764 cs=8315 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426821 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33201 s=2 pgs=14944 cs=1597 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426855 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35905 s=2 pgs=18858 cs=6379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.426868 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42887 s=2 pgs=20735 cs=4257 l=0).fault, initiating reconnect
2013-06-08 20:25:43.427082 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59021 s=2 pgs=24542 cs=6953 l=0).fault, initiating reconnect
2013-06-08 20:25:43.427273 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42981 s=2 pgs=18381 cs=4919 l=0).fault, initiating reconnect
2013-06-08 20:25:43.427588 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36027 s=2 pgs=24765 cs=8317 l=0).fault, initiating reconnect
2013-06-08 20:25:43.427673 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35909 s=2 pgs=18859 cs=6381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.427773 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42895 s=2 pgs=20736 cs=4259 l=0).fault, initiating reconnect
2013-06-08 20:25:43.427790 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33208 s=2 pgs=14945 cs=1599 l=0).fault, initiating reconnect
2013-06-08 20:25:43.427945 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59028 s=2 pgs=24543 cs=6955 l=0).fault, initiating reconnect
2013-06-08 20:25:43.428312 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36033 s=2 pgs=24766 cs=8319 l=0).fault, initiating reconnect
2013-06-08 20:25:43.428397 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42987 s=2 pgs=18382 cs=4921 l=0).fault, initiating reconnect
2013-06-08 20:25:43.428475 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35914 s=2 pgs=18860 cs=6383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.428626 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42900 s=2 pgs=20737 cs=4261 l=0).fault, initiating reconnect
2013-06-08 20:25:43.428663 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33216 s=2 pgs=14946 cs=1601 l=0).fault, initiating reconnect
2013-06-08 20:25:43.428755 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59034 s=2 pgs=24544 cs=6957 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429054 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36038 s=2 pgs=24767 cs=8321 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429257 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35920 s=2 pgs=18861 cs=6385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429390 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :42994 s=2 pgs=18383 cs=4923 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429432 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42906 s=2 pgs=20738 cs=4263 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429544 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33222 s=2 pgs=14947 cs=1603 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429585 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59040 s=2 pgs=24545 cs=6959 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429818 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36044 s=2 pgs=24768 cs=8323 l=0).fault, initiating reconnect
2013-06-08 20:25:43.429991 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35925 s=2 pgs=18862 cs=6387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.430279 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42912 s=2 pgs=20739 cs=4265 l=0).fault, initiating reconnect
2013-06-08 20:25:43.430355 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33228 s=2 pgs=14948 cs=1605 l=0).fault, initiating reconnect
2013-06-08 20:25:43.430398 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59046 s=2 pgs=24546 cs=6961 l=0).fault, initiating reconnect
2013-06-08 20:25:43.430406 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43001 s=2 pgs=18384 cs=4925 l=0).fault, initiating reconnect
2013-06-08 20:25:43.430619 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36050 s=2 pgs=24769 cs=8325 l=0).fault, initiating reconnect
2013-06-08 20:25:43.431014 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35931 s=2 pgs=18863 cs=6389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.431132 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42917 s=2 pgs=20740 cs=4267 l=0).fault, initiating reconnect
2013-06-08 20:25:43.431142 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59051 s=2 pgs=24547 cs=6963 l=0).fault, initiating reconnect
2013-06-08 20:25:43.431203 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33233 s=2 pgs=14949 cs=1607 l=0).fault, initiating reconnect
2013-06-08 20:25:43.431389 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43010 s=2 pgs=18385 cs=4927 l=0).fault, initiating reconnect
2013-06-08 20:25:43.431497 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36056 s=2 pgs=24770 cs=8327 l=0).fault, initiating reconnect
2013-06-08 20:25:43.431789 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35937 s=2 pgs=18864 cs=6391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.432030 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59056 s=2 pgs=24548 cs=6965 l=0).fault, initiating reconnect
2013-06-08 20:25:43.432115 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42923 s=2 pgs=20741 cs=4269 l=0).fault, initiating reconnect
2013-06-08 20:25:43.432212 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36062 s=2 pgs=24771 cs=8329 l=0).fault, initiating reconnect
2013-06-08 20:25:43.432372 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43016 s=2 pgs=18386 cs=4929 l=0).fault, initiating reconnect
2013-06-08 20:25:43.432573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35943 s=2 pgs=18865 cs=6393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.432912 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59061 s=2 pgs=24549 cs=6967 l=0).fault, initiating reconnect
2013-06-08 20:25:43.433008 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36066 s=2 pgs=24772 cs=8331 l=0).fault, initiating reconnect
2013-06-08 20:25:43.433069 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42930 s=2 pgs=20742 cs=4271 l=0).fault, initiating reconnect
2013-06-08 20:25:43.433420 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35948 s=2 pgs=18866 cs=6395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.433502 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43022 s=2 pgs=18387 cs=4931 l=0).fault, initiating reconnect
2013-06-08 20:25:43.433615 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33240 s=2 pgs=14950 cs=1609 l=0).fault, initiating reconnect
2013-06-08 20:25:43.433695 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59066 s=2 pgs=24550 cs=6969 l=0).fault, initiating reconnect
2013-06-08 20:25:43.433787 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36070 s=2 pgs=24773 cs=8333 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434023 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42936 s=2 pgs=20743 cs=4273 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434218 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35952 s=2 pgs=18867 cs=6397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434389 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59072 s=2 pgs=24551 cs=6971 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434494 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43028 s=2 pgs=18388 cs=4933 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434608 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36076 s=2 pgs=24774 cs=8335 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434782 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33254 s=2 pgs=14951 cs=1611 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434891 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42942 s=2 pgs=20744 cs=4275 l=0).fault, initiating reconnect
2013-06-08 20:25:43.434953 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35958 s=2 pgs=18868 cs=6399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.435218 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59076 s=2 pgs=24552 cs=6973 l=0).fault, initiating reconnect
2013-06-08 20:25:43.435337 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43035 s=2 pgs=18389 cs=4935 l=0).fault, initiating reconnect
2013-06-08 20:25:43.435396 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36081 s=2 pgs=24775 cs=8337 l=0).fault, initiating reconnect
2013-06-08 20:25:43.435763 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35964 s=2 pgs=18869 cs=6401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.435850 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42948 s=2 pgs=20745 cs=4277 l=0).fault, initiating reconnect
2013-06-08 20:25:43.435983 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33262 s=2 pgs=14952 cs=1613 l=0).fault, initiating reconnect
2013-06-08 20:25:43.436099 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59082 s=2 pgs=24553 cs=6975 l=0).fault, initiating reconnect
2013-06-08 20:25:43.436175 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36087 s=2 pgs=24776 cs=8339 l=0).fault, initiating reconnect
2013-06-08 20:25:43.436289 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43041 s=2 pgs=18390 cs=4937 l=0).fault, initiating reconnect
2013-06-08 20:25:43.436685 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35968 s=2 pgs=18870 cs=6403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.436762 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42954 s=2 pgs=20746 cs=4279 l=0).fault, initiating reconnect
2013-06-08 20:25:43.436865 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33270 s=2 pgs=14953 cs=1615 l=0).fault, initiating reconnect
2013-06-08 20:25:43.436907 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36092 s=2 pgs=24777 cs=8341 l=0).fault, initiating reconnect
2013-06-08 20:25:43.437019 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59088 s=2 pgs=24554 cs=6977 l=0).fault, initiating reconnect
2013-06-08 20:25:43.437483 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35974 s=2 pgs=18871 cs=6405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.437482 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43048 s=2 pgs=18391 cs=4939 l=0).fault, initiating reconnect
2013-06-08 20:25:43.437727 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36097 s=2 pgs=24778 cs=8343 l=0).fault, initiating reconnect
2013-06-08 20:25:43.437730 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42960 s=2 pgs=20747 cs=4281 l=0).fault, initiating reconnect
2013-06-08 20:25:43.437838 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33276 s=2 pgs=14954 cs=1617 l=0).fault, initiating reconnect
2013-06-08 20:25:43.437862 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59095 s=2 pgs=24555 cs=6979 l=0).fault, initiating reconnect
2013-06-08 20:25:43.438322 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35980 s=2 pgs=18872 cs=6407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.438559 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36101 s=2 pgs=24779 cs=8345 l=0).fault, initiating reconnect
2013-06-08 20:25:43.438692 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=31 :43054 s=2 pgs=18392 cs=4941 l=0).fault, initiating reconnect
2013-06-08 20:25:43.438703 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59101 s=2 pgs=24556 cs=6981 l=0).fault, initiating reconnect
2013-06-08 20:25:43.438778 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33283 s=2 pgs=14955 cs=1619 l=0).fault, initiating reconnect
2013-06-08 20:25:43.438814 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42967 s=2 pgs=20748 cs=4283 l=0).fault, initiating reconnect
2013-06-08 20:25:43.439149 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35985 s=2 pgs=18873 cs=6409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.439369 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36106 s=2 pgs=24780 cs=8347 l=0).fault, initiating reconnect
2013-06-08 20:25:43.439482 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59105 s=2 pgs=24557 cs=6983 l=0).fault, initiating reconnect
2013-06-08 20:25:43.439713 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42975 s=2 pgs=20749 cs=4285 l=0).fault, initiating reconnect
2013-06-08 20:25:43.439760 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33289 s=2 pgs=14956 cs=1621 l=0).fault, initiating reconnect
2013-06-08 20:25:43.439835 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43062 s=2 pgs=18393 cs=4943 l=0).fault, initiating reconnect
2013-06-08 20:25:43.439997 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35991 s=2 pgs=18874 cs=6411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.440171 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36112 s=2 pgs=24781 cs=8349 l=0).fault, initiating reconnect
2013-06-08 20:25:43.440281 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59110 s=2 pgs=24558 cs=6985 l=0).fault, initiating reconnect
2013-06-08 20:25:43.440544 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42979 s=2 pgs=20750 cs=4287 l=0).fault, initiating reconnect
2013-06-08 20:25:43.440719 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33295 s=2 pgs=14957 cs=1623 l=0).fault, initiating reconnect
2013-06-08 20:25:43.440780 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :35997 s=2 pgs=18875 cs=6413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.440915 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43071 s=2 pgs=18394 cs=4945 l=0).fault, initiating reconnect
2013-06-08 20:25:43.440923 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36118 s=2 pgs=24782 cs=8351 l=0).fault, initiating reconnect
2013-06-08 20:25:43.441117 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59116 s=2 pgs=24559 cs=6987 l=0).fault, initiating reconnect
2013-06-08 20:25:43.441484 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42985 s=2 pgs=20751 cs=4289 l=0).fault, initiating reconnect
2013-06-08 20:25:43.441665 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36002 s=2 pgs=18876 cs=6415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.441736 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36124 s=2 pgs=24783 cs=8353 l=0).fault, initiating reconnect
2013-06-08 20:25:43.441774 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33301 s=2 pgs=14958 cs=1625 l=0).fault, initiating reconnect
2013-06-08 20:25:43.442397 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42991 s=2 pgs=20752 cs=4291 l=0).fault, initiating reconnect
2013-06-08 20:25:43.442550 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36128 s=2 pgs=24784 cs=8355 l=0).fault, initiating reconnect
2013-06-08 20:25:43.442581 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36007 s=2 pgs=18877 cs=6417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.442718 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33309 s=2 pgs=14959 cs=1627 l=0).fault, initiating reconnect
2013-06-08 20:25:43.443276 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36131 s=2 pgs=24785 cs=8357 l=0).fault, initiating reconnect
2013-06-08 20:25:43.443278 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :42995 s=2 pgs=20753 cs=4293 l=0).fault, initiating reconnect
2013-06-08 20:25:43.443384 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36012 s=2 pgs=18878 cs=6419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.443482 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43078 s=2 pgs=18395 cs=4947 l=0).fault, initiating reconnect
2013-06-08 20:25:43.443751 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33313 s=2 pgs=14960 cs=1629 l=0).fault, initiating reconnect
2013-06-08 20:25:43.443769 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59122 s=2 pgs=24560 cs=6989 l=0).fault, initiating reconnect
2013-06-08 20:25:43.444093 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36135 s=2 pgs=24786 cs=8359 l=0).fault, initiating reconnect
2013-06-08 20:25:43.444118 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :42999 s=2 pgs=20754 cs=4295 l=0).fault, initiating reconnect
2013-06-08 20:25:43.444202 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36016 s=2 pgs=18879 cs=6421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.444462 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43092 s=2 pgs=18396 cs=4949 l=0).fault, initiating reconnect
2013-06-08 20:25:43.444534 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59136 s=2 pgs=24561 cs=6991 l=0).fault, initiating reconnect
2013-06-08 20:25:43.444809 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36140 s=2 pgs=24787 cs=8361 l=0).fault, initiating reconnect
2013-06-08 20:25:43.444842 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33318 s=2 pgs=14961 cs=1631 l=0).fault, initiating reconnect
2013-06-08 20:25:43.445091 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43006 s=2 pgs=20755 cs=4297 l=0).fault, initiating reconnect
2013-06-08 20:25:43.445141 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36022 s=2 pgs=18880 cs=6423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.445159 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59141 s=2 pgs=24562 cs=6993 l=0).fault, initiating reconnect
2013-06-08 20:25:43.445475 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43098 s=2 pgs=18397 cs=4951 l=0).fault, initiating reconnect
2013-06-08 20:25:43.445544 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36145 s=2 pgs=24788 cs=8363 l=0).fault, initiating reconnect
2013-06-08 20:25:43.445958 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43012 s=2 pgs=20756 cs=4299 l=0).fault, initiating reconnect
2013-06-08 20:25:43.445984 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33326 s=2 pgs=14962 cs=1633 l=0).fault, initiating reconnect
2013-06-08 20:25:43.446053 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36028 s=2 pgs=18881 cs=6425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.446088 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59146 s=2 pgs=24563 cs=6995 l=0).fault, initiating reconnect
2013-06-08 20:25:43.446311 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36151 s=2 pgs=24789 cs=8365 l=0).fault, initiating reconnect
2013-06-08 20:25:43.446662 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43105 s=2 pgs=18398 cs=4953 l=0).fault, initiating reconnect
2013-06-08 20:25:43.446789 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43017 s=2 pgs=20757 cs=4301 l=0).fault, initiating reconnect
2013-06-08 20:25:43.446836 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36034 s=2 pgs=18882 cs=6427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.446871 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33333 s=2 pgs=14963 cs=1635 l=0).fault, initiating reconnect
2013-06-08 20:25:43.447010 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36156 s=2 pgs=24790 cs=8367 l=0).fault, initiating reconnect
2013-06-08 20:25:43.447596 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36039 s=2 pgs=18883 cs=6429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.447598 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43023 s=2 pgs=20758 cs=4303 l=0).fault, initiating reconnect
2013-06-08 20:25:43.447709 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36161 s=2 pgs=24791 cs=8369 l=0).fault, initiating reconnect
2013-06-08 20:25:43.447830 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33340 s=2 pgs=14964 cs=1637 l=0).fault, initiating reconnect
2013-06-08 20:25:43.448311 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36042 s=2 pgs=18884 cs=6431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.448350 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43028 s=2 pgs=20759 cs=4305 l=0).fault, initiating reconnect
2013-06-08 20:25:43.448427 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36164 s=2 pgs=24792 cs=8371 l=0).fault, initiating reconnect
2013-06-08 20:25:43.448738 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43112 s=2 pgs=18399 cs=4955 l=0).fault, initiating reconnect
2013-06-08 20:25:43.448799 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33345 s=2 pgs=14965 cs=1639 l=0).fault, initiating reconnect
2013-06-08 20:25:43.448974 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36046 s=2 pgs=18885 cs=6433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449093 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43032 s=2 pgs=20760 cs=4307 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449185 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36168 s=2 pgs=24793 cs=8373 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449576 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59152 s=2 pgs=24564 cs=6997 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449634 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36051 s=2 pgs=18886 cs=6435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449642 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33350 s=2 pgs=14966 cs=1641 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449760 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43124 s=2 pgs=18400 cs=4957 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449763 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43037 s=2 pgs=20761 cs=4309 l=0).fault, initiating reconnect
2013-06-08 20:25:43.449913 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36173 s=2 pgs=24794 cs=8375 l=0).fault, initiating reconnect
2013-06-08 20:25:43.450280 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59171 s=2 pgs=24565 cs=6999 l=0).fault, initiating reconnect
2013-06-08 20:25:43.450315 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36055 s=2 pgs=18887 cs=6437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.450417 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43043 s=2 pgs=20762 cs=4311 l=0).fault, initiating reconnect
2013-06-08 20:25:43.450441 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33356 s=2 pgs=14967 cs=1643 l=0).fault, initiating reconnect
2013-06-08 20:25:43.450693 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36179 s=2 pgs=24795 cs=8377 l=0).fault, initiating reconnect
2013-06-08 20:25:43.450694 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43132 s=2 pgs=18401 cs=4959 l=0).fault, initiating reconnect
2013-06-08 20:25:43.450979 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59177 s=2 pgs=24566 cs=7001 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451155 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43047 s=2 pgs=20763 cs=4313 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451208 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36061 s=2 pgs=18888 cs=6439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451447 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33363 s=2 pgs=14968 cs=1645 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451508 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36184 s=2 pgs=24796 cs=8379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451777 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59183 s=2 pgs=24567 cs=7003 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451807 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43140 s=2 pgs=18402 cs=4961 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451850 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36068 s=2 pgs=18889 cs=6441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.451856 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43052 s=2 pgs=20764 cs=4315 l=0).fault, initiating reconnect
2013-06-08 20:25:43.452369 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33369 s=2 pgs=14969 cs=1647 l=0).fault, initiating reconnect
2013-06-08 20:25:43.452472 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59188 s=2 pgs=24568 cs=7005 l=0).fault, initiating reconnect
2013-06-08 20:25:43.452527 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43059 s=2 pgs=20765 cs=4317 l=0).fault, initiating reconnect
2013-06-08 20:25:43.452565 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36073 s=2 pgs=18890 cs=6443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.452757 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43147 s=2 pgs=18403 cs=4963 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453105 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59193 s=2 pgs=24569 cs=7007 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453171 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36078 s=2 pgs=18891 cs=6445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453225 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43062 s=2 pgs=20766 cs=4319 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453374 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36190 s=2 pgs=24797 cs=8381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453712 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43154 s=2 pgs=18404 cs=4965 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453781 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59197 s=2 pgs=24570 cs=7009 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453962 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43067 s=2 pgs=20767 cs=4321 l=0).fault, initiating reconnect
2013-06-08 20:25:43.453984 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36081 s=2 pgs=18892 cs=6447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.454194 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36203 s=2 pgs=24798 cs=8383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.454323 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33375 s=2 pgs=14970 cs=1649 l=0).fault, initiating reconnect
2013-06-08 20:25:43.454477 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59202 s=2 pgs=24571 cs=7011 l=0).fault, initiating reconnect
2013-06-08 20:25:43.454603 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36087 s=2 pgs=18893 cs=6449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.454756 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43159 s=2 pgs=18405 cs=4967 l=0).fault, initiating reconnect
2013-06-08 20:25:43.454781 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43071 s=2 pgs=20768 cs=4323 l=0).fault, initiating reconnect
2013-06-08 20:25:43.454950 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36208 s=2 pgs=24799 cs=8385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.455179 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59207 s=2 pgs=24572 cs=7013 l=0).fault, initiating reconnect
2013-06-08 20:25:43.455213 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33389 s=2 pgs=14971 cs=1651 l=0).fault, initiating reconnect
2013-06-08 20:25:43.455335 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36091 s=2 pgs=18894 cs=6451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.455753 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36214 s=2 pgs=24800 cs=8387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.455757 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43167 s=2 pgs=18406 cs=4969 l=0).fault, initiating reconnect
2013-06-08 20:25:43.455858 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59212 s=2 pgs=24573 cs=7015 l=0).fault, initiating reconnect
2013-06-08 20:25:43.456005 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36097 s=2 pgs=18895 cs=6453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.456210 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33396 s=2 pgs=14972 cs=1653 l=0).fault, initiating reconnect
2013-06-08 20:25:43.456518 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :36218 s=2 pgs=24801 cs=8389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.456527 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59217 s=2 pgs=24574 cs=7017 l=0).fault, initiating reconnect
2013-06-08 20:25:43.456721 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43174 s=2 pgs=18407 cs=4971 l=0).fault, initiating reconnect
2013-06-08 20:25:43.456805 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36101 s=2 pgs=18896 cs=6455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.457078 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33402 s=2 pgs=14973 cs=1655 l=0).fault, initiating reconnect
2013-06-08 20:25:43.457204 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59220 s=2 pgs=24575 cs=7019 l=0).fault, initiating reconnect
2013-06-08 20:25:43.457221 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43078 s=2 pgs=20769 cs=4325 l=0).fault, initiating reconnect
2013-06-08 20:25:43.457284 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :36224 s=2 pgs=24802 cs=8391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.457573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36106 s=2 pgs=18897 cs=6457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.457751 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43180 s=2 pgs=18408 cs=4973 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458008 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59225 s=2 pgs=24576 cs=7021 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458022 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43094 s=2 pgs=20770 cs=4327 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458021 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=27 :36230 s=2 pgs=24803 cs=8393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458307 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36111 s=2 pgs=18898 cs=6459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458712 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36233 s=2 pgs=24804 cs=8395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458719 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43098 s=2 pgs=20771 cs=4329 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458729 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43187 s=2 pgs=18409 cs=4975 l=0).fault, initiating reconnect
2013-06-08 20:25:43.458831 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59232 s=2 pgs=24577 cs=7023 l=0).fault, initiating reconnect
2013-06-08 20:25:43.459066 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36116 s=2 pgs=18899 cs=6461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.459393 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36237 s=2 pgs=24805 cs=8397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.459464 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43104 s=2 pgs=20772 cs=4331 l=0).fault, initiating reconnect
2013-06-08 20:25:43.459473 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59237 s=2 pgs=24578 cs=7025 l=0).fault, initiating reconnect
2013-06-08 20:25:43.459697 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43193 s=2 pgs=18410 cs=4977 l=0).fault, initiating reconnect
2013-06-08 20:25:43.459843 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36121 s=2 pgs=18900 cs=6463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460080 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33407 s=2 pgs=14974 cs=1657 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460098 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43108 s=2 pgs=20773 cs=4333 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460166 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36242 s=2 pgs=24806 cs=8399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460177 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59241 s=2 pgs=24579 cs=7027 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460523 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36126 s=2 pgs=18901 cs=6465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460757 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43200 s=2 pgs=18411 cs=4979 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460855 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43113 s=2 pgs=20774 cs=4335 l=0).fault, initiating reconnect
2013-06-08 20:25:43.460922 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59247 s=2 pgs=24580 cs=7029 l=0).fault, initiating reconnect
2013-06-08 20:25:43.461016 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36249 s=2 pgs=24807 cs=8401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.461043 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33427 s=2 pgs=14975 cs=1659 l=0).fault, initiating reconnect
2013-06-08 20:25:43.461278 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36131 s=2 pgs=18902 cs=6467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.461584 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43118 s=2 pgs=20775 cs=4337 l=0).fault, initiating reconnect
2013-06-08 20:25:43.461589 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59251 s=2 pgs=24581 cs=7031 l=0).fault, initiating reconnect
2013-06-08 20:25:43.461733 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43207 s=2 pgs=18412 cs=4981 l=0).fault, initiating reconnect
2013-06-08 20:25:43.461835 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36255 s=2 pgs=24808 cs=8403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.462004 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36137 s=2 pgs=18903 cs=6469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.462342 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59256 s=2 pgs=24582 cs=7033 l=0).fault, initiating reconnect
2013-06-08 20:25:43.462348 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43123 s=2 pgs=20776 cs=4339 l=0).fault, initiating reconnect
2013-06-08 20:25:43.462594 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36261 s=2 pgs=24809 cs=8405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.462736 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36142 s=2 pgs=18904 cs=6471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.462796 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43215 s=2 pgs=18413 cs=4983 l=0).fault, initiating reconnect
2013-06-08 20:25:43.463008 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59260 s=2 pgs=24583 cs=7035 l=0).fault, initiating reconnect
2013-06-08 20:25:43.463057 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33436 s=2 pgs=14976 cs=1661 l=0).fault, initiating reconnect
2013-06-08 20:25:43.463379 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36265 s=2 pgs=24810 cs=8407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.463485 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36146 s=2 pgs=18905 cs=6473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.463699 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43222 s=2 pgs=18414 cs=4985 l=0).fault, initiating reconnect
2013-06-08 20:25:43.463746 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59265 s=2 pgs=24584 cs=7037 l=0).fault, initiating reconnect
2013-06-08 20:25:43.463987 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33449 s=2 pgs=14977 cs=1663 l=0).fault, initiating reconnect
2013-06-08 20:25:43.464109 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36270 s=2 pgs=24811 cs=8409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.464161 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36151 s=2 pgs=18906 cs=6475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.464432 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59270 s=2 pgs=24585 cs=7039 l=0).fault, initiating reconnect
2013-06-08 20:25:43.464717 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43227 s=2 pgs=18415 cs=4987 l=0).fault, initiating reconnect
2013-06-08 20:25:43.464822 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36156 s=2 pgs=18907 cs=6477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.464861 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36275 s=2 pgs=24812 cs=8411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.464986 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33454 s=2 pgs=14978 cs=1665 l=0).fault, initiating reconnect
2013-06-08 20:25:43.465114 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43129 s=2 pgs=20777 cs=4341 l=0).fault, initiating reconnect
2013-06-08 20:25:43.465128 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59274 s=2 pgs=24586 cs=7041 l=0).fault, initiating reconnect
2013-06-08 20:25:43.465614 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36159 s=2 pgs=18908 cs=6479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.465627 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36280 s=2 pgs=24813 cs=8413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.465817 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43233 s=2 pgs=18416 cs=4989 l=0).fault, initiating reconnect
2013-06-08 20:25:43.465870 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33461 s=2 pgs=14979 cs=1667 l=0).fault, initiating reconnect
2013-06-08 20:25:43.465905 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43147 s=2 pgs=20778 cs=4343 l=0).fault, initiating reconnect
2013-06-08 20:25:43.466275 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36164 s=2 pgs=18909 cs=6481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.466303 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36285 s=2 pgs=24814 cs=8415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.466618 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43153 s=2 pgs=20779 cs=4345 l=0).fault, initiating reconnect
2013-06-08 20:25:43.466912 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43241 s=2 pgs=18417 cs=4991 l=0).fault, initiating reconnect
2013-06-08 20:25:43.466915 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=27 :33467 s=2 pgs=14980 cs=1669 l=0).fault, initiating reconnect
2013-06-08 20:25:43.466973 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36169 s=2 pgs=18910 cs=6483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.467027 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36290 s=2 pgs=24815 cs=8417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.467275 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43156 s=2 pgs=20780 cs=4347 l=0).fault, initiating reconnect
2013-06-08 20:25:43.467377 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59280 s=2 pgs=24587 cs=7043 l=0).fault, initiating reconnect
2013-06-08 20:25:43.467726 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36174 s=2 pgs=18911 cs=6485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.467830 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36295 s=2 pgs=24816 cs=8419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.467856 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33473 s=2 pgs=14981 cs=1671 l=0).fault, initiating reconnect
2013-06-08 20:25:43.467913 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43247 s=2 pgs=18418 cs=4993 l=0).fault, initiating reconnect
2013-06-08 20:25:43.468155 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59294 s=2 pgs=24588 cs=7045 l=0).fault, initiating reconnect
2013-06-08 20:25:43.468433 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36178 s=2 pgs=18912 cs=6487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.468562 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36299 s=2 pgs=24817 cs=8421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.468679 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33480 s=2 pgs=14982 cs=1673 l=0).fault, initiating reconnect
2013-06-08 20:25:43.468836 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59299 s=2 pgs=24589 cs=7047 l=0).fault, initiating reconnect
2013-06-08 20:25:43.468905 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43256 s=2 pgs=18419 cs=4995 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469100 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36183 s=2 pgs=18913 cs=6489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469246 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43161 s=2 pgs=20781 cs=4349 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469338 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36304 s=2 pgs=24818 cs=8423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469590 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33485 s=2 pgs=14983 cs=1675 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469642 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59303 s=2 pgs=24590 cs=7049 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469768 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36188 s=2 pgs=18914 cs=6491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469818 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43262 s=2 pgs=18420 cs=4997 l=0).fault, initiating reconnect
2013-06-08 20:25:43.469958 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43174 s=2 pgs=20782 cs=4351 l=0).fault, initiating reconnect
2013-06-08 20:25:43.470080 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36310 s=2 pgs=24819 cs=8425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.470303 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59309 s=2 pgs=24591 cs=7051 l=0).fault, initiating reconnect
2013-06-08 20:25:43.470402 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33491 s=2 pgs=14984 cs=1677 l=0).fault, initiating reconnect
2013-06-08 20:25:43.470540 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36193 s=2 pgs=18915 cs=6493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.470671 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43180 s=2 pgs=20783 cs=4353 l=0).fault, initiating reconnect
2013-06-08 20:25:43.470765 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43269 s=2 pgs=18421 cs=4999 l=0).fault, initiating reconnect
2013-06-08 20:25:43.470857 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36316 s=2 pgs=24820 cs=8427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.471040 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59314 s=2 pgs=24592 cs=7053 l=0).fault, initiating reconnect
2013-06-08 20:25:43.471248 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33498 s=2 pgs=14985 cs=1679 l=0).fault, initiating reconnect
2013-06-08 20:25:43.471330 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36199 s=2 pgs=18916 cs=6495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.471378 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43185 s=2 pgs=20784 cs=4355 l=0).fault, initiating reconnect
2013-06-08 20:25:43.471610 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36322 s=2 pgs=24821 cs=8429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.471761 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43276 s=2 pgs=18422 cs=5001 l=0).fault, initiating reconnect
2013-06-08 20:25:43.471766 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59320 s=2 pgs=24593 cs=7055 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472020 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43191 s=2 pgs=20785 cs=4357 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472105 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36205 s=2 pgs=18917 cs=6497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472122 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33504 s=2 pgs=14986 cs=1681 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472329 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36327 s=2 pgs=24822 cs=8431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472447 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59326 s=2 pgs=24594 cs=7057 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472612 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43283 s=2 pgs=18423 cs=5003 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472736 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43195 s=2 pgs=20786 cs=4359 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472830 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36211 s=2 pgs=18918 cs=6499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.472966 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33512 s=2 pgs=14987 cs=1683 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473130 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59331 s=2 pgs=24595 cs=7059 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473139 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36333 s=2 pgs=24823 cs=8433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473479 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43201 s=2 pgs=20787 cs=4361 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473495 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36217 s=2 pgs=18919 cs=6501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473554 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43290 s=2 pgs=18424 cs=5005 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473878 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59337 s=2 pgs=24596 cs=7061 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473898 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36339 s=2 pgs=24824 cs=8435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.473909 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33518 s=2 pgs=14988 cs=1685 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474157 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43206 s=2 pgs=20788 cs=4363 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474192 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36222 s=2 pgs=18920 cs=6503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474525 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43298 s=2 pgs=18425 cs=5007 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474527 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59341 s=2 pgs=24597 cs=7063 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474591 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36345 s=2 pgs=24825 cs=8437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474703 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33526 s=2 pgs=14989 cs=1687 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474913 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43212 s=2 pgs=20789 cs=4365 l=0).fault, initiating reconnect
2013-06-08 20:25:43.474940 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36228 s=2 pgs=18921 cs=6505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.475207 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59347 s=2 pgs=24598 cs=7065 l=0).fault, initiating reconnect
2013-06-08 20:25:43.475382 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36351 s=2 pgs=24826 cs=8439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.475461 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43304 s=2 pgs=18426 cs=5009 l=0).fault, initiating reconnect
2013-06-08 20:25:43.475569 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33532 s=2 pgs=14990 cs=1689 l=0).fault, initiating reconnect
2013-06-08 20:25:43.475629 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43218 s=2 pgs=20790 cs=4367 l=0).fault, initiating reconnect
2013-06-08 20:25:43.475693 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36234 s=2 pgs=18922 cs=6507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.475924 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59352 s=2 pgs=24599 cs=7067 l=0).fault, initiating reconnect
2013-06-08 20:25:43.476274 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43224 s=2 pgs=20791 cs=4369 l=0).fault, initiating reconnect
2013-06-08 20:25:43.476357 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36240 s=2 pgs=18923 cs=6509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.476418 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43312 s=2 pgs=18427 cs=5011 l=0).fault, initiating reconnect
2013-06-08 20:25:43.476631 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33538 s=2 pgs=14991 cs=1691 l=0).fault, initiating reconnect
2013-06-08 20:25:43.476689 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59358 s=2 pgs=24600 cs=7069 l=0).fault, initiating reconnect
2013-06-08 20:25:43.477002 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43227 s=2 pgs=20792 cs=4371 l=0).fault, initiating reconnect
2013-06-08 20:25:43.477072 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36243 s=2 pgs=18924 cs=6511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.477380 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59363 s=2 pgs=24601 cs=7071 l=0).fault, initiating reconnect
2013-06-08 20:25:43.477434 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43319 s=2 pgs=18428 cs=5013 l=0).fault, initiating reconnect
2013-06-08 20:25:43.477451 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33545 s=2 pgs=14992 cs=1693 l=0).fault, initiating reconnect
2013-06-08 20:25:43.477701 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43232 s=2 pgs=20793 cs=4373 l=0).fault, initiating reconnect
2013-06-08 20:25:43.477740 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36248 s=2 pgs=18925 cs=6513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.478033 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59366 s=2 pgs=24602 cs=7073 l=0).fault, initiating reconnect
2013-06-08 20:25:43.478322 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43325 s=2 pgs=18429 cs=5015 l=0).fault, initiating reconnect
2013-06-08 20:25:43.478349 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33551 s=2 pgs=14993 cs=1695 l=0).fault, initiating reconnect
2013-06-08 20:25:43.478364 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43237 s=2 pgs=20794 cs=4375 l=0).fault, initiating reconnect
2013-06-08 20:25:43.478573 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36253 s=2 pgs=18926 cs=6515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.478738 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59371 s=2 pgs=24603 cs=7075 l=0).fault, initiating reconnect
2013-06-08 20:25:43.479061 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43242 s=2 pgs=20795 cs=4377 l=0).fault, initiating reconnect
2013-06-08 20:25:43.479248 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43330 s=2 pgs=18430 cs=5017 l=0).fault, initiating reconnect
2013-06-08 20:25:43.479256 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33556 s=2 pgs=14994 cs=1697 l=0).fault, initiating reconnect
2013-06-08 20:25:43.479367 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36258 s=2 pgs=18927 cs=6517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.479431 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59376 s=2 pgs=24604 cs=7077 l=0).fault, initiating reconnect
2013-06-08 20:25:43.479812 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43245 s=2 pgs=20796 cs=4379 l=0).fault, initiating reconnect
2013-06-08 20:25:43.479972 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36263 s=2 pgs=18928 cs=6519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.480083 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59381 s=2 pgs=24605 cs=7079 l=0).fault, initiating reconnect
2013-06-08 20:25:43.480186 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43337 s=2 pgs=18431 cs=5019 l=0).fault, initiating reconnect
2013-06-08 20:25:43.480204 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33561 s=2 pgs=14995 cs=1699 l=0).fault, initiating reconnect
2013-06-08 20:25:43.480585 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43250 s=2 pgs=20797 cs=4381 l=0).fault, initiating reconnect
2013-06-08 20:25:43.480838 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59384 s=2 pgs=24606 cs=7081 l=0).fault, initiating reconnect
2013-06-08 20:25:43.480852 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36266 s=2 pgs=18929 cs=6521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.481158 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43343 s=2 pgs=18432 cs=5021 l=0).fault, initiating reconnect
2013-06-08 20:25:43.481161 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33569 s=2 pgs=14996 cs=1701 l=0).fault, initiating reconnect
2013-06-08 20:25:43.481310 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43255 s=2 pgs=20798 cs=4383 l=0).fault, initiating reconnect
2013-06-08 20:25:43.481552 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59388 s=2 pgs=24607 cs=7083 l=0).fault, initiating reconnect
2013-06-08 20:25:43.481599 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36272 s=2 pgs=18930 cs=6523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.481619 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36356 s=2 pgs=24827 cs=8441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482008 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43348 s=2 pgs=18433 cs=5023 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482026 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43260 s=2 pgs=20799 cs=4385 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482053 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33574 s=2 pgs=14997 cs=1703 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482288 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59393 s=2 pgs=24608 cs=7085 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482353 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36398 s=2 pgs=24828 cs=8443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482701 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43265 s=2 pgs=20800 cs=4387 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482877 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33581 s=2 pgs=14998 cs=1705 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482934 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43354 s=2 pgs=18434 cs=5025 l=0).fault, initiating reconnect
2013-06-08 20:25:43.482985 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59399 s=2 pgs=24609 cs=7087 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483018 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36277 s=2 pgs=18931 cs=6525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483070 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36403 s=2 pgs=24829 cs=8445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483399 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43269 s=2 pgs=20801 cs=4389 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483668 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33585 s=2 pgs=14999 cs=1707 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483681 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59404 s=2 pgs=24610 cs=7089 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483730 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36288 s=2 pgs=18932 cs=6527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483766 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36409 s=2 pgs=24830 cs=8447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.483915 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43361 s=2 pgs=18435 cs=5027 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484094 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43275 s=2 pgs=20802 cs=4391 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484327 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59409 s=2 pgs=24611 cs=7091 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484482 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36414 s=2 pgs=24831 cs=8449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484490 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36293 s=2 pgs=18933 cs=6529 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484592 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33591 s=2 pgs=15000 cs=1709 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484843 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43370 s=2 pgs=18436 cs=5029 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484852 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43281 s=2 pgs=20803 cs=4393 l=0).fault, initiating reconnect
2013-06-08 20:25:43.484946 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59414 s=2 pgs=24612 cs=7093 l=0).fault, initiating reconnect
2013-06-08 20:25:43.485221 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36298 s=2 pgs=18934 cs=6531 l=0).fault, initiating reconnect
2013-06-08 20:25:43.485253 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36419 s=2 pgs=24832 cs=8451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.485446 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33600 s=2 pgs=15001 cs=1711 l=0).fault, initiating reconnect
2013-06-08 20:25:43.485494 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43287 s=2 pgs=20804 cs=4395 l=0).fault, initiating reconnect
2013-06-08 20:25:43.485652 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43376 s=2 pgs=18437 cs=5031 l=0).fault, initiating reconnect
2013-06-08 20:25:43.485726 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59420 s=2 pgs=24613 cs=7095 l=0).fault, initiating reconnect
2013-06-08 20:25:43.485865 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36425 s=2 pgs=24833 cs=8453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.486152 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43292 s=2 pgs=20805 cs=4397 l=0).fault, initiating reconnect
2013-06-08 20:25:43.486433 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59426 s=2 pgs=24614 cs=7097 l=0).fault, initiating reconnect
2013-06-08 20:25:43.486597 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=28 :33606 s=2 pgs=15002 cs=1713 l=0).fault, initiating reconnect
2013-06-08 20:25:43.486599 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36430 s=2 pgs=24834 cs=8455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.486710 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43383 s=2 pgs=18438 cs=5033 l=0).fault, initiating reconnect
2013-06-08 20:25:43.486851 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43296 s=2 pgs=20806 cs=4399 l=0).fault, initiating reconnect
2013-06-08 20:25:43.487029 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59429 s=2 pgs=24615 cs=7099 l=0).fault, initiating reconnect
2013-06-08 20:25:43.487376 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36433 s=2 pgs=24835 cs=8457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.487555 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43301 s=2 pgs=20807 cs=4401 l=0).fault, initiating reconnect
2013-06-08 20:25:43.487575 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33614 s=2 pgs=15003 cs=1715 l=0).fault, initiating reconnect
2013-06-08 20:25:43.487605 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43390 s=2 pgs=18439 cs=5035 l=0).fault, initiating reconnect
2013-06-08 20:25:43.487749 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59434 s=2 pgs=24616 cs=7101 l=0).fault, initiating reconnect
2013-06-08 20:25:43.488124 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36438 s=2 pgs=24836 cs=8459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.488395 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59439 s=2 pgs=24617 cs=7103 l=0).fault, initiating reconnect
2013-06-08 20:25:43.488393 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=30 :43304 s=2 pgs=20808 cs=4403 l=0).fault, initiating reconnect
2013-06-08 20:25:43.488463 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43396 s=2 pgs=18440 cs=5037 l=0).fault, initiating reconnect
2013-06-08 20:25:43.488599 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33620 s=2 pgs=15004 cs=1717 l=0).fault, initiating reconnect
2013-06-08 20:25:43.488912 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36443 s=2 pgs=24837 cs=8461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489010 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43310 s=2 pgs=20809 cs=4405 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489079 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :59441 s=2 pgs=24618 cs=7105 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489201 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36304 s=2 pgs=18935 cs=6533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489488 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33627 s=2 pgs=15005 cs=1719 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489553 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43401 s=2 pgs=18441 cs=5039 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489658 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43314 s=2 pgs=20810 cs=4407 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489731 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36448 s=2 pgs=24838 cs=8463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.489847 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :59447 s=2 pgs=24619 cs=7107 l=0).fault, initiating reconnect
2013-06-08 20:25:43.490053 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36331 s=2 pgs=18936 cs=6535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.490315 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43319 s=2 pgs=20811 cs=4409 l=0).fault, initiating reconnect
2013-06-08 20:25:43.490329 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=29 :33632 s=2 pgs=15006 cs=1721 l=0).fault, initiating reconnect
2013-06-08 20:25:43.490459 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :59453 s=2 pgs=24620 cs=7109 l=0).fault, initiating reconnect
2013-06-08 20:25:43.490461 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36455 s=2 pgs=24839 cs=8465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.490508 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43408 s=2 pgs=18442 cs=5041 l=0).fault, initiating reconnect
2013-06-08 20:25:43.490841 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36337 s=2 pgs=18937 cs=6537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491041 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43323 s=2 pgs=20812 cs=4411 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491156 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=30 :59457 s=2 pgs=24621 cs=7111 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491159 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36461 s=2 pgs=24840 cs=8467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491242 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :33639 s=2 pgs=15007 cs=1723 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491289 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43417 s=2 pgs=18443 cs=5043 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491527 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36343 s=2 pgs=18938 cs=6539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491644 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43329 s=2 pgs=20813 cs=4413 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491873 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59463 s=2 pgs=24622 cs=7113 l=0).fault, initiating reconnect
2013-06-08 20:25:43.491900 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36465 s=2 pgs=24841 cs=8469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.492094 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :33647 s=2 pgs=15008 cs=1725 l=0).fault, initiating reconnect
2013-06-08 20:25:43.492214 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43423 s=2 pgs=18444 cs=5045 l=0).fault, initiating reconnect
2013-06-08 20:25:43.492477 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43335 s=2 pgs=20814 cs=4415 l=0).fault, initiating reconnect
2013-06-08 20:25:43.492545 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36472 s=2 pgs=24842 cs=8471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.492555 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59468 s=2 pgs=24623 cs=7115 l=0).fault, initiating reconnect
2013-06-08 20:25:43.492956 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :33653 s=2 pgs=15009 cs=1727 l=0).fault, initiating reconnect
2013-06-08 20:25:43.493116 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43340 s=2 pgs=20815 cs=4417 l=0).fault, initiating reconnect
2013-06-08 20:25:43.493179 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43429 s=2 pgs=18445 cs=5047 l=0).fault, initiating reconnect
2013-06-08 20:25:43.493231 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59473 s=2 pgs=24624 cs=7117 l=0).fault, initiating reconnect
2013-06-08 20:25:43.493288 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36477 s=2 pgs=24843 cs=8473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.493816 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :33658 s=2 pgs=15010 cs=1729 l=0).fault, initiating reconnect
2013-06-08 20:25:43.493860 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43344 s=2 pgs=20816 cs=4419 l=0).fault, initiating reconnect
2013-06-08 20:25:43.493923 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59478 s=2 pgs=24625 cs=7119 l=0).fault, initiating reconnect
2013-06-08 20:25:43.494027 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36482 s=2 pgs=24844 cs=8475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.494151 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43435 s=2 pgs=18446 cs=5049 l=0).fault, initiating reconnect
2013-06-08 20:25:43.494535 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43349 s=2 pgs=20817 cs=4421 l=0).fault, initiating reconnect
2013-06-08 20:25:43.494548 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59482 s=2 pgs=24626 cs=7121 l=0).fault, initiating reconnect
2013-06-08 20:25:43.494728 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :33663 s=2 pgs=15011 cs=1731 l=0).fault, initiating reconnect
2013-06-08 20:25:43.494818 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36486 s=2 pgs=24845 cs=8477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.494974 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36349 s=2 pgs=18939 cs=6541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.495209 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43353 s=2 pgs=20818 cs=4423 l=0).fault, initiating reconnect
2013-06-08 20:25:43.495268 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59486 s=2 pgs=24627 cs=7123 l=0).fault, initiating reconnect
2013-06-08 20:25:43.495331 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43442 s=2 pgs=18447 cs=5051 l=0).fault, initiating reconnect
2013-06-08 20:25:43.495590 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36491 s=2 pgs=24846 cs=8479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.495822 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36372 s=2 pgs=18940 cs=6543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.495825 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=31 :33670 s=2 pgs=15012 cs=1733 l=0).fault, initiating reconnect
2013-06-08 20:25:43.495938 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43358 s=2 pgs=20819 cs=4425 l=0).fault, initiating reconnect
2013-06-08 20:25:43.496038 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59491 s=2 pgs=24628 cs=7125 l=0).fault, initiating reconnect
2013-06-08 20:25:43.496444 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43450 s=2 pgs=18448 cs=5053 l=0).fault, initiating reconnect
2013-06-08 20:25:43.496504 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36378 s=2 pgs=18941 cs=6545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.496718 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33677 s=2 pgs=15013 cs=1735 l=0).fault, initiating reconnect
2013-06-08 20:25:43.496725 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43364 s=2 pgs=20820 cs=4427 l=0).fault, initiating reconnect
2013-06-08 20:25:43.496814 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59497 s=2 pgs=24629 cs=7127 l=0).fault, initiating reconnect
2013-06-08 20:25:43.497177 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36382 s=2 pgs=18942 cs=6547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.497368 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43456 s=2 pgs=18449 cs=5055 l=0).fault, initiating reconnect
2013-06-08 20:25:43.497468 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59502 s=2 pgs=24630 cs=7129 l=0).fault, initiating reconnect
2013-06-08 20:25:43.497527 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33683 s=2 pgs=15014 cs=1737 l=0).fault, initiating reconnect
2013-06-08 20:25:43.497539 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43369 s=2 pgs=20821 cs=4429 l=0).fault, initiating reconnect
2013-06-08 20:25:43.497994 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36386 s=2 pgs=18943 cs=6549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498136 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59505 s=2 pgs=24631 cs=7131 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498233 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43462 s=2 pgs=18450 cs=5057 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498305 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43375 s=2 pgs=20822 cs=4431 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498379 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33689 s=2 pgs=15015 cs=1739 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498423 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36496 s=2 pgs=24847 cs=8481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498689 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36391 s=2 pgs=18944 cs=6551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498785 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59509 s=2 pgs=24632 cs=7133 l=0).fault, initiating reconnect
2013-06-08 20:25:43.498987 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43379 s=2 pgs=20823 cs=4433 l=0).fault, initiating reconnect
2013-06-08 20:25:43.499153 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43468 s=2 pgs=18451 cs=5059 l=0).fault, initiating reconnect
2013-06-08 20:25:43.499276 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36516 s=2 pgs=24848 cs=8483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.499367 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36397 s=2 pgs=18945 cs=6553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.499385 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33695 s=2 pgs=15016 cs=1741 l=0).fault, initiating reconnect
2013-06-08 20:25:43.499530 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59515 s=2 pgs=24633 cs=7135 l=0).fault, initiating reconnect
2013-06-08 20:25:43.499677 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43384 s=2 pgs=20824 cs=4435 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500034 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36521 s=2 pgs=24849 cs=8485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500075 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36402 s=2 pgs=18946 cs=6555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500129 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43475 s=2 pgs=18452 cs=5061 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500231 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59521 s=2 pgs=24634 cs=7137 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500263 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33703 s=2 pgs=15017 cs=1743 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500416 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43390 s=2 pgs=20825 cs=4437 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500802 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36526 s=2 pgs=24850 cs=8487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500814 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36407 s=2 pgs=18947 cs=6557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500878 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43483 s=2 pgs=18453 cs=5063 l=0).fault, initiating reconnect
2013-06-08 20:25:43.500923 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59526 s=2 pgs=24635 cs=7139 l=0).fault, initiating reconnect
2013-06-08 20:25:43.501211 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33710 s=2 pgs=15018 cs=1745 l=0).fault, initiating reconnect
2013-06-08 20:25:43.501465 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36413 s=2 pgs=18948 cs=6559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.501546 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59532 s=2 pgs=24636 cs=7141 l=0).fault, initiating reconnect
2013-06-08 20:25:43.501584 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36532 s=2 pgs=24851 cs=8489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.501855 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43489 s=2 pgs=18454 cs=5065 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502048 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33716 s=2 pgs=15019 cs=1747 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502177 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43396 s=2 pgs=20826 cs=4439 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502181 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36417 s=2 pgs=18949 cs=6561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502240 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59535 s=2 pgs=24637 cs=7143 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502446 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36539 s=2 pgs=24852 cs=8491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502850 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36423 s=2 pgs=18950 cs=6563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502900 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=29 :43407 s=2 pgs=20827 cs=4441 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502902 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=27 :43495 s=2 pgs=18455 cs=5067 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502923 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33721 s=2 pgs=15020 cs=1749 l=0).fault, initiating reconnect
2013-06-08 20:25:43.502957 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59541 s=2 pgs=24638 cs=7145 l=0).fault, initiating reconnect
2013-06-08 20:25:43.503280 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36545 s=2 pgs=24853 cs=8493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.503613 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=28 :59547 s=2 pgs=24639 cs=7147 l=0).fault, initiating reconnect
2013-06-08 20:25:43.503707 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43413 s=2 pgs=20828 cs=4443 l=0).fault, initiating reconnect
2013-06-08 20:25:43.503886 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43504 s=2 pgs=18456 cs=5069 l=0).fault, initiating reconnect
2013-06-08 20:25:43.503963 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33727 s=2 pgs=15021 cs=1751 l=0).fault, initiating reconnect
2013-06-08 20:25:43.504037 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36551 s=2 pgs=24854 cs=8495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.504356 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43418 s=2 pgs=20829 cs=4445 l=0).fault, initiating reconnect
2013-06-08 20:25:43.504358 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59549 s=2 pgs=24640 cs=7149 l=0).fault, initiating reconnect
2013-06-08 20:25:43.504733 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=30 :36556 s=2 pgs=24855 cs=8497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.504743 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43509 s=2 pgs=18457 cs=5071 l=0).fault, initiating reconnect
2013-06-08 20:25:43.504831 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33735 s=2 pgs=15022 cs=1753 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505061 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43423 s=2 pgs=20830 cs=4447 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505099 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59554 s=2 pgs=24641 cs=7151 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505283 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36426 s=2 pgs=18951 cs=6565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505524 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36559 s=2 pgs=24856 cs=8499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505661 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33741 s=2 pgs=15023 cs=1755 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505713 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43515 s=2 pgs=18458 cs=5073 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505809 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59560 s=2 pgs=24642 cs=7153 l=0).fault, initiating reconnect
2013-06-08 20:25:43.505817 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43427 s=2 pgs=20831 cs=4449 l=0).fault, initiating reconnect
2013-06-08 20:25:43.506147 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36444 s=2 pgs=18952 cs=6567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.506367 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36565 s=2 pgs=24857 cs=8501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.506481 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59565 s=2 pgs=24643 cs=7155 l=0).fault, initiating reconnect
2013-06-08 20:25:43.506556 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43434 s=2 pgs=20832 cs=4451 l=0).fault, initiating reconnect
2013-06-08 20:25:43.506723 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=30 :43522 s=2 pgs=18459 cs=5075 l=0).fault, initiating reconnect
2013-06-08 20:25:43.506732 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=24 :33746 s=2 pgs=15024 cs=1757 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507126 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36571 s=2 pgs=24858 cs=8503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507145 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59569 s=2 pgs=24644 cs=7157 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507171 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43438 s=2 pgs=20833 cs=4453 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507690 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43529 s=2 pgs=18460 cs=5077 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507717 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33755 s=2 pgs=15025 cs=1759 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507777 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59574 s=2 pgs=24645 cs=7159 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507873 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36576 s=2 pgs=24859 cs=8505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.507899 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43443 s=2 pgs=20834 cs=4455 l=0).fault, initiating reconnect
2013-06-08 20:25:43.508502 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59578 s=2 pgs=24646 cs=7161 l=0).fault, initiating reconnect
2013-06-08 20:25:43.508631 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36582 s=2 pgs=24860 cs=8507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.508651 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43534 s=2 pgs=18461 cs=5079 l=0).fault, initiating reconnect
2013-06-08 20:25:43.508920 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36450 s=2 pgs=18953 cs=6569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.509179 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59581 s=2 pgs=24647 cs=7163 l=0).fault, initiating reconnect
2013-06-08 20:25:43.509445 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33760 s=2 pgs=15026 cs=1761 l=0).fault, initiating reconnect
2013-06-08 20:25:43.509478 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36586 s=2 pgs=24861 cs=8509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.509649 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43540 s=2 pgs=18462 cs=5081 l=0).fault, initiating reconnect
2013-06-08 20:25:43.509744 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36467 s=2 pgs=18954 cs=6571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.509957 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59585 s=2 pgs=24648 cs=7165 l=0).fault, initiating reconnect
2013-06-08 20:25:43.509980 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43448 s=2 pgs=20835 cs=4457 l=0).fault, initiating reconnect
2013-06-08 20:25:43.510224 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36590 s=2 pgs=24862 cs=8511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.510328 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33769 s=2 pgs=15027 cs=1763 l=0).fault, initiating reconnect
2013-06-08 20:25:43.510498 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36472 s=2 pgs=18955 cs=6573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.510594 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59590 s=2 pgs=24649 cs=7167 l=0).fault, initiating reconnect
2013-06-08 20:25:43.510677 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=28 :43459 s=2 pgs=20836 cs=4459 l=0).fault, initiating reconnect
2013-06-08 20:25:43.510686 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43546 s=2 pgs=18463 cs=5083 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511037 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36595 s=2 pgs=24863 cs=8513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511213 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36477 s=2 pgs=18956 cs=6575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511266 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33776 s=2 pgs=15028 cs=1765 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511300 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59595 s=2 pgs=24650 cs=7169 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511304 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=24 :43464 s=2 pgs=20837 cs=4461 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511628 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43555 s=2 pgs=18464 cs=5085 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511755 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36601 s=2 pgs=24864 cs=8515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511913 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59600 s=2 pgs=24651 cs=7171 l=0).fault, initiating reconnect
2013-06-08 20:25:43.511938 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36482 s=2 pgs=18957 cs=6577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.512112 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43469 s=2 pgs=20838 cs=4463 l=0).fault, initiating reconnect
2013-06-08 20:25:43.512162 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33785 s=2 pgs=15029 cs=1767 l=0).fault, initiating reconnect
2013-06-08 20:25:43.512460 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36607 s=2 pgs=24865 cs=8517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.512746 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43561 s=2 pgs=18465 cs=5087 l=0).fault, initiating reconnect
2013-06-08 20:25:43.512748 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36488 s=2 pgs=18958 cs=6579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.512762 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59606 s=2 pgs=24652 cs=7173 l=0).fault, initiating reconnect
2013-06-08 20:25:43.512937 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43475 s=2 pgs=20839 cs=4465 l=0).fault, initiating reconnect
2013-06-08 20:25:43.513224 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36612 s=2 pgs=24866 cs=8519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.513478 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59611 s=2 pgs=24653 cs=7175 l=0).fault, initiating reconnect
2013-06-08 20:25:43.513498 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36495 s=2 pgs=18959 cs=6581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.513618 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43481 s=2 pgs=20840 cs=4467 l=0).fault, initiating reconnect
2013-06-08 20:25:43.513787 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43568 s=2 pgs=18466 cs=5089 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514003 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36617 s=2 pgs=24867 cs=8521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514229 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59616 s=2 pgs=24654 cs=7177 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514267 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36498 s=2 pgs=18960 cs=6583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514348 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43485 s=2 pgs=20841 cs=4469 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514804 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43576 s=2 pgs=18467 cs=5091 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514811 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36622 s=2 pgs=24868 cs=8523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514929 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59620 s=2 pgs=24655 cs=7179 l=0).fault, initiating reconnect
2013-06-08 20:25:43.514969 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36504 s=2 pgs=18961 cs=6585 l=0).fault, initiating reconnect
2013-06-08 20:25:43.515029 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43490 s=2 pgs=20842 cs=4471 l=0).fault, initiating reconnect
2013-06-08 20:25:43.515474 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36627 s=2 pgs=24869 cs=8525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.515535 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59625 s=2 pgs=24656 cs=7181 l=0).fault, initiating reconnect
2013-06-08 20:25:43.515705 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36509 s=2 pgs=18962 cs=6587 l=0).fault, initiating reconnect
2013-06-08 20:25:43.515794 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43495 s=2 pgs=20843 cs=4473 l=0).fault, initiating reconnect
2013-06-08 20:25:43.515881 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43581 s=2 pgs=18468 cs=5093 l=0).fault, initiating reconnect
2013-06-08 20:25:43.516241 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36632 s=2 pgs=24870 cs=8527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.516243 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59628 s=2 pgs=24657 cs=7183 l=0).fault, initiating reconnect
2013-06-08 20:25:43.516486 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36513 s=2 pgs=18963 cs=6589 l=0).fault, initiating reconnect
2013-06-08 20:25:43.516581 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43499 s=2 pgs=20844 cs=4475 l=0).fault, initiating reconnect
2013-06-08 20:25:43.516725 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43590 s=2 pgs=18469 cs=5095 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517003 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59634 s=2 pgs=24658 cs=7185 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517016 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36636 s=2 pgs=24871 cs=8529 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517173 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33791 s=2 pgs=15030 cs=1769 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517238 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36518 s=2 pgs=18964 cs=6591 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517280 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43504 s=2 pgs=20845 cs=4477 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517717 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43595 s=2 pgs=18470 cs=5097 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517714 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36641 s=2 pgs=24872 cs=8531 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517771 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59639 s=2 pgs=24659 cs=7187 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517978 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36524 s=2 pgs=18965 cs=6593 l=0).fault, initiating reconnect
2013-06-08 20:25:43.517992 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43510 s=2 pgs=20846 cs=4479 l=0).fault, initiating reconnect
2013-06-08 20:25:43.518400 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59645 s=2 pgs=24660 cs=7189 l=0).fault, initiating reconnect
2013-06-08 20:25:43.518509 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36647 s=2 pgs=24873 cs=8533 l=0).fault, initiating reconnect
2013-06-08 20:25:43.518700 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43515 s=2 pgs=20847 cs=4481 l=0).fault, initiating reconnect
2013-06-08 20:25:43.518738 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43601 s=2 pgs=18471 cs=5099 l=0).fault, initiating reconnect
2013-06-08 20:25:43.518785 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36529 s=2 pgs=18966 cs=6595 l=0).fault, initiating reconnect
2013-06-08 20:25:43.519064 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59648 s=2 pgs=24661 cs=7191 l=0).fault, initiating reconnect
2013-06-08 20:25:43.519235 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36652 s=2 pgs=24874 cs=8535 l=0).fault, initiating reconnect
2013-06-08 20:25:43.519377 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43518 s=2 pgs=20848 cs=4483 l=0).fault, initiating reconnect
2013-06-08 20:25:43.519488 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36535 s=2 pgs=18967 cs=6597 l=0).fault, initiating reconnect
2013-06-08 20:25:43.519695 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43609 s=2 pgs=18472 cs=5101 l=0).fault, initiating reconnect
2013-06-08 20:25:43.519862 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59653 s=2 pgs=24662 cs=7193 l=0).fault, initiating reconnect
2013-06-08 20:25:43.519919 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36657 s=2 pgs=24875 cs=8537 l=0).fault, initiating reconnect
2013-06-08 20:25:43.520086 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43523 s=2 pgs=20849 cs=4485 l=0).fault, initiating reconnect
2013-06-08 20:25:43.520163 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36539 s=2 pgs=18968 cs=6599 l=0).fault, initiating reconnect
2013-06-08 20:25:43.520749 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=29 :36662 s=2 pgs=24876 cs=8539 l=0).fault, initiating reconnect
2013-06-08 20:25:43.520752 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=28 :43615 s=2 pgs=18473 cs=5103 l=0).fault, initiating reconnect
2013-06-08 20:25:43.520874 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43528 s=2 pgs=20850 cs=4487 l=0).fault, initiating reconnect
2013-06-08 20:25:43.520887 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59658 s=2 pgs=24663 cs=7195 l=0).fault, initiating reconnect
2013-06-08 20:25:43.520926 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36544 s=2 pgs=18969 cs=6601 l=0).fault, initiating reconnect
2013-06-08 20:25:43.521045 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33823 s=2 pgs=15031 cs=1771 l=0).fault, initiating reconnect
2013-06-08 20:25:43.521514 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36665 s=2 pgs=24877 cs=8541 l=0).fault, initiating reconnect
2013-06-08 20:25:43.521586 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43532 s=2 pgs=20851 cs=4489 l=0).fault, initiating reconnect
2013-06-08 20:25:43.521630 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36549 s=2 pgs=18970 cs=6603 l=0).fault, initiating reconnect
2013-06-08 20:25:43.521650 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43621 s=2 pgs=18474 cs=5105 l=0).fault, initiating reconnect
2013-06-08 20:25:43.521653 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59665 s=2 pgs=24664 cs=7197 l=0).fault, initiating reconnect
2013-06-08 20:25:43.522203 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36671 s=2 pgs=24878 cs=8543 l=0).fault, initiating reconnect
2013-06-08 20:25:43.522271 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59672 s=2 pgs=24665 cs=7199 l=0).fault, initiating reconnect
2013-06-08 20:25:43.522276 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43537 s=2 pgs=20852 cs=4491 l=0).fault, initiating reconnect
2013-06-08 20:25:43.522365 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36553 s=2 pgs=18971 cs=6605 l=0).fault, initiating reconnect
2013-06-08 20:25:43.522667 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43629 s=2 pgs=18475 cs=5107 l=0).fault, initiating reconnect
2013-06-08 20:25:43.522903 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36676 s=2 pgs=24879 cs=8545 l=0).fault, initiating reconnect
2013-06-08 20:25:43.523003 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59674 s=2 pgs=24666 cs=7201 l=0).fault, initiating reconnect
2013-06-08 20:25:43.523038 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36559 s=2 pgs=18972 cs=6607 l=0).fault, initiating reconnect
2013-06-08 20:25:43.523359 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33850 s=2 pgs=15032 cs=1773 l=0).fault, initiating reconnect
2013-06-08 20:25:43.523530 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43635 s=2 pgs=18476 cs=5109 l=0).fault, initiating reconnect
2013-06-08 20:25:43.523643 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36681 s=2 pgs=24880 cs=8547 l=0).fault, initiating reconnect
2013-06-08 20:25:43.523754 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36563 s=2 pgs=18973 cs=6609 l=0).fault, initiating reconnect
2013-06-08 20:25:43.523775 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59679 s=2 pgs=24667 cs=7203 l=0).fault, initiating reconnect
2013-06-08 20:25:43.524047 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43543 s=2 pgs=20853 cs=4493 l=0).fault, initiating reconnect
2013-06-08 20:25:43.524351 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33864 s=2 pgs=15033 cs=1775 l=0).fault, initiating reconnect
2013-06-08 20:25:43.524408 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36686 s=2 pgs=24881 cs=8549 l=0).fault, initiating reconnect
2013-06-08 20:25:43.524459 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=31 :59685 s=2 pgs=24668 cs=7205 l=0).fault, initiating reconnect
2013-06-08 20:25:43.524461 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36567 s=2 pgs=18974 cs=6611 l=0).fault, initiating reconnect
2013-06-08 20:25:43.524515 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43640 s=2 pgs=18477 cs=5111 l=0).fault, initiating reconnect
2013-06-08 20:25:43.524763 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43554 s=2 pgs=20854 cs=4495 l=0).fault, initiating reconnect
2013-06-08 20:25:43.525144 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59689 s=2 pgs=24669 cs=7207 l=0).fault, initiating reconnect
2013-06-08 20:25:43.525172 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36691 s=2 pgs=24882 cs=8551 l=0).fault, initiating reconnect
2013-06-08 20:25:43.525333 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33870 s=2 pgs=15034 cs=1777 l=0).fault, initiating reconnect
2013-06-08 20:25:43.525471 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43560 s=2 pgs=20855 cs=4497 l=0).fault, initiating reconnect
2013-06-08 20:25:43.525477 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43649 s=2 pgs=18478 cs=5113 l=0).fault, initiating reconnect
2013-06-08 20:25:43.525927 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36696 s=2 pgs=24883 cs=8553 l=0).fault, initiating reconnect
2013-06-08 20:25:43.526039 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59694 s=2 pgs=24670 cs=7209 l=0).fault, initiating reconnect
2013-06-08 20:25:43.526152 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43564 s=2 pgs=20856 cs=4499 l=0).fault, initiating reconnect
2013-06-08 20:25:43.526301 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33878 s=2 pgs=15035 cs=1779 l=0).fault, initiating reconnect
2013-06-08 20:25:43.526460 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43655 s=2 pgs=18479 cs=5115 l=0).fault, initiating reconnect
2013-06-08 20:25:43.526727 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36701 s=2 pgs=24884 cs=8555 l=0).fault, initiating reconnect
2013-06-08 20:25:43.526743 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59699 s=2 pgs=24671 cs=7211 l=0).fault, initiating reconnect
2013-06-08 20:25:43.526996 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43568 s=2 pgs=20857 cs=4501 l=0).fault, initiating reconnect
2013-06-08 20:25:43.527468 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36706 s=2 pgs=24885 cs=8557 l=0).fault, initiating reconnect
2013-06-08 20:25:43.527470 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43660 s=2 pgs=18480 cs=5117 l=0).fault, initiating reconnect
2013-06-08 20:25:43.527475 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59704 s=2 pgs=24672 cs=7213 l=0).fault, initiating reconnect
2013-06-08 20:25:43.527524 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36573 s=2 pgs=18975 cs=6613 l=0).fault, initiating reconnect
2013-06-08 20:25:43.528138 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36711 s=2 pgs=24886 cs=8559 l=0).fault, initiating reconnect
2013-06-08 20:25:43.528252 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :59707 s=2 pgs=24673 cs=7215 l=0).fault, initiating reconnect
2013-06-08 20:25:43.528293 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36592 s=2 pgs=18976 cs=6615 l=0).fault, initiating reconnect
2013-06-08 20:25:43.528477 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43664 s=2 pgs=18481 cs=5119 l=0).fault, initiating reconnect
2013-06-08 20:25:43.528915 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36713 s=2 pgs=24887 cs=8561 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529082 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36595 s=2 pgs=18977 cs=6617 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529092 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :59711 s=2 pgs=24674 cs=7217 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529152 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43573 s=2 pgs=20858 cs=4503 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529412 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33884 s=2 pgs=15036 cs=1781 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529669 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36717 s=2 pgs=24888 cs=8563 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529694 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43671 s=2 pgs=18482 cs=5121 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529750 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36598 s=2 pgs=18978 cs=6619 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529770 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :59716 s=2 pgs=24675 cs=7219 l=0).fault, initiating reconnect
2013-06-08 20:25:43.529942 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43585 s=2 pgs=20859 cs=4505 l=0).fault, initiating reconnect
2013-06-08 20:25:43.530261 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33901 s=2 pgs=15037 cs=1783 l=0).fault, initiating reconnect
2013-06-08 20:25:43.530431 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36723 s=2 pgs=24889 cs=8565 l=0).fault, initiating reconnect
2013-06-08 20:25:43.530475 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36604 s=2 pgs=18979 cs=6621 l=0).fault, initiating reconnect
2013-06-08 20:25:43.530780 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43677 s=2 pgs=18483 cs=5123 l=0).fault, initiating reconnect
2013-06-08 20:25:43.530783 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43591 s=2 pgs=20860 cs=4507 l=0).fault, initiating reconnect
2013-06-08 20:25:43.531211 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36609 s=2 pgs=18980 cs=6623 l=0).fault, initiating reconnect
2013-06-08 20:25:43.531222 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36728 s=2 pgs=24890 cs=8567 l=0).fault, initiating reconnect
2013-06-08 20:25:43.531310 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33907 s=2 pgs=15038 cs=1785 l=0).fault, initiating reconnect
2013-06-08 20:25:43.531412 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43596 s=2 pgs=20861 cs=4509 l=0).fault, initiating reconnect
2013-06-08 20:25:43.531707 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43685 s=2 pgs=18484 cs=5125 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532004 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36613 s=2 pgs=18981 cs=6625 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532058 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36732 s=2 pgs=24891 cs=8569 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532060 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :59722 s=2 pgs=24676 cs=7221 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532103 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43600 s=2 pgs=20862 cs=4511 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532636 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43691 s=2 pgs=18485 cs=5127 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532712 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43605 s=2 pgs=20863 cs=4513 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532740 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36738 s=2 pgs=24892 cs=8571 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532759 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36617 s=2 pgs=18982 cs=6627 l=0).fault, initiating reconnect
2013-06-08 20:25:43.532859 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :59736 s=2 pgs=24677 cs=7223 l=0).fault, initiating reconnect
2013-06-08 20:25:43.533450 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=31 :36624 s=2 pgs=18983 cs=6629 l=0).fault, initiating reconnect
2013-06-08 20:25:43.533461 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=27 :43607 s=2 pgs=20864 cs=4515 l=0).fault, initiating reconnect
2013-06-08 20:25:43.533472 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36743 s=2 pgs=24893 cs=8573 l=0).fault, initiating reconnect
2013-06-08 20:25:43.533589 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :59742 s=2 pgs=24678 cs=7225 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534093 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43612 s=2 pgs=20865 cs=4517 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534172 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33914 s=2 pgs=15039 cs=1787 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534225 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36748 s=2 pgs=24894 cs=8575 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534226 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :36626 s=2 pgs=18984 cs=6631 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534286 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=29 :59746 s=2 pgs=24679 cs=7227 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534290 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=24 :43696 s=2 pgs=18486 cs=5129 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534775 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43615 s=2 pgs=20866 cs=4519 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534913 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59751 s=2 pgs=24680 cs=7229 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534967 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :36632 s=2 pgs=18985 cs=6633 l=0).fault, initiating reconnect
2013-06-08 20:25:43.534988 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36753 s=2 pgs=24895 cs=8577 l=0).fault, initiating reconnect
2013-06-08 20:25:43.535022 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33931 s=2 pgs=15040 cs=1789 l=0).fault, initiating reconnect
2013-06-08 20:25:43.535342 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43710 s=2 pgs=18487 cs=5131 l=0).fault, initiating reconnect
2013-06-08 20:25:43.535402 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43621 s=2 pgs=20867 cs=4521 l=0).fault, initiating reconnect
2013-06-08 20:25:43.535560 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59754 s=2 pgs=24681 cs=7231 l=0).fault, initiating reconnect
2013-06-08 20:25:43.535674 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :36638 s=2 pgs=18986 cs=6635 l=0).fault, initiating reconnect
2013-06-08 20:25:43.535765 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36759 s=2 pgs=24896 cs=8579 l=0).fault, initiating reconnect
2013-06-08 20:25:43.535912 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33940 s=2 pgs=15041 cs=1791 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536149 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43627 s=2 pgs=20868 cs=4523 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536201 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43716 s=2 pgs=18488 cs=5133 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536237 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=27 :36644 s=2 pgs=18987 cs=6637 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536242 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=24 :59760 s=2 pgs=24682 cs=7233 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536591 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36765 s=2 pgs=24897 cs=8581 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536843 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33946 s=2 pgs=15042 cs=1793 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536938 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36648 s=2 pgs=18988 cs=6639 l=0).fault, initiating reconnect
2013-06-08 20:25:43.536965 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43632 s=2 pgs=20869 cs=4525 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537004 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59766 s=2 pgs=24683 cs=7235 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537124 7fddcefdd700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.8:6803/7627 pipe(0x10bcac80 sd=29 :43725 s=2 pgs=18489 cs=5135 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537385 7fddc27ce700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.4:6803/2578 pipe(0x10bca780 sd=28 :36771 s=2 pgs=24898 cs=8583 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537635 7fddceedc700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.6:6801/18947 pipe(0xf5e5500 sd=24 :36653 s=2 pgs=18989 cs=6641 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537667 7fddca1ac700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.7:6804/16810 pipe(0xd0a5000 sd=27 :59772 s=2 pgs=24684 cs=7237 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537705 7fddcde8f700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.9:6802/13564 pipe(0x122f1a00 sd=30 :33952 s=2 pgs=15043 cs=1795 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537750 7fddc3c31700  0 -- 10.10.10.10:6800/17115 >> 10.10.10.5:6802/28355 pipe(0x122f1280 sd=31 :43639 s=2 pgs=20870 cs=4527 l=0).fault, initiating reconnect
2013-06-08 20:25:43.537918 7fdddb72a700  0 log [WRN] : map e4630 wrongly marked me down
2013-06-08 20:26:04.093764 7fddcbbf9700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.7:0/108444871 pipe(0x9953c80 sd=64 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.7:0/108444871 (socket is 10.10.10.7:34587/0)
2013-06-08 20:26:15.241355 7fddcbdbf700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.5:0/1050176078 pipe(0x9953000 sd=48 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.5:0/1050176078 (socket is 10.10.10.5:34278/0)
2013-06-08 20:26:17.916883 7fddc70be700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.4:0/3560449356 pipe(0x9f45280 sd=65 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.4:0/3560449356 (socket is 10.10.10.4:54535/0)
2013-06-08 20:26:51.775898 7fddc668a700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.6:0/3035720492 pipe(0x11f43a00 sd=67 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.6:0/3035720492 (socket is 10.10.10.6:57100/0)
2013-06-08 20:28:49.096706 7fddcbdbf700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.5:0/1050176078 pipe(0x11f43c80 sd=47 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.5:0/1050176078 (socket is 10.10.10.5:34312/0)
2013-06-08 20:29:30.699704 7fddc668a700  0 -- 10.10.10.10:6801/17115 >> 10.10.10.6:0/3035720492 pipe(0xc05c000 sd=48 :6801 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.10.10.6:0/3035720492 (socket is 10.10.10.6:57140/0)

[-- Attachment #4: mon0.log --]
[-- Type: text/plain, Size: 68630 bytes --]

2013-06-08 20:20:00.960216 7f05d2b94700  0 log [INF] : pgmap v17310666: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 452KB/s rd, 150KB/s wr, 36op/s
2013-06-08 20:20:04.614867 7f05d2b94700  0 log [INF] : pgmap v17310667: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 385KB/s rd, 87869B/s wr, 20op/s
2013-06-08 20:20:05.457115 7f05d2b94700  0 log [INF] : pgmap v17310668: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 36243B/s rd, 351KB/s wr, 40op/s
2013-06-08 20:20:06.661774 7f05d2b94700  0 log [INF] : pgmap v17310669: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 19216B/s rd, 342KB/s wr, 35op/s
2013-06-08 20:20:07.790098 7f05d2b94700  0 log [INF] : pgmap v17310670: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 4487B/s rd, 205KB/s wr, 11op/s
2013-06-08 20:20:09.078193 7f05d2b94700  0 log [INF] : pgmap v17310671: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6472B/s rd, 1058KB/s wr, 51op/s
2013-06-08 20:20:10.507052 7f05d2b94700  0 log [INF] : pgmap v17310672: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 8181B/s rd, 1354KB/s wr, 59op/s
2013-06-08 20:20:11.742365 7f05d2b94700  0 log [INF] : pgmap v17310673: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6223B/s rd, 896KB/s wr, 26op/s
2013-06-08 20:20:13.970267 7f05d2b94700  0 log [INF] : pgmap v17310674: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 2162KB/s wr, 68op/s
2013-06-08 20:20:15.200799 7f05d2b94700  0 log [INF] : pgmap v17310675: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7093B/s rd, 1989KB/s wr, 72op/s
2013-06-08 20:20:16.636567 7f05d2b94700  0 log [INF] : pgmap v17310676: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 12181B/s rd, 20882B/s wr, 11op/s
2013-06-08 20:20:17.763437 7f05d2b94700  0 log [INF] : pgmap v17310677: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1741B/s rd, 19155B/s wr, 2op/s
2013-06-08 20:20:18.944667 7f05d2b94700  0 log [INF] : pgmap v17310678: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 505KB/s wr, 69op/s
2013-06-08 20:20:19.993622 7f05d2b94700  0 log [INF] : pgmap v17310679: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6464B/s rd, 583KB/s wr, 87op/s
2013-06-08 20:20:21.276218 7f05d2b94700  0 log [INF] : pgmap v17310680: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6812B/s rd, 172KB/s wr, 23op/s
2013-06-08 20:20:22.326285 7f05d2b94700  0 log [INF] : pgmap v17310681: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1742B/s rd, 156KB/s wr, 19op/s
2013-06-08 20:20:23.566697 7f05d2b94700  0 log [INF] : pgmap v17310682: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1778B/s rd, 151KB/s wr, 26op/s
2013-06-08 20:20:24.012475 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183406716 avail 482795192
2013-06-08 20:20:24.773524 7f05d2b94700  0 log [INF] : pgmap v17310683: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10603B/s rd, 1115KB/s wr, 159op/s
2013-06-08 20:20:26.082776 7f05d2b94700  0 log [INF] : pgmap v17310684: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 9767B/s rd, 1049KB/s wr, 149op/s
2013-06-08 20:20:27.305506 7f05d2b94700  0 log [INF] : pgmap v17310685: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 138KB/s wr, 19op/s
2013-06-08 20:20:28.632027 7f05d2b94700  0 log [INF] : pgmap v17310686: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 99595B/s wr, 17op/s
2013-06-08 20:20:30.026626 7f05d2b94700  0 log [INF] : pgmap v17310687: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6242B/s rd, 811KB/s wr, 125op/s
2013-06-08 20:20:31.148521 7f05d2b94700  0 log [INF] : pgmap v17310688: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 8128B/s rd, 866KB/s wr, 125op/s
2013-06-08 20:20:32.454304 7f05d2b94700  0 log [INF] : pgmap v17310689: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1591B/s rd, 99482B/s wr, 8op/s
2013-06-08 20:20:33.550165 7f05d2b94700  0 log [INF] : pgmap v17310690: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10194B/s rd, 102KB/s wr, 17op/s
2013-06-08 20:20:34.673456 7f05d2b94700  0 log [INF] : pgmap v17310691: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 21533B/s rd, 349KB/s wr, 53op/s
2013-06-08 20:20:35.945824 7f05d2b94700  0 log [INF] : pgmap v17310692: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10569B/s rd, 322KB/s wr, 50op/s
2013-06-08 20:20:37.029949 7f05d2b94700  0 log [INF] : pgmap v17310693: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1735B/s rd, 172KB/s wr, 31op/s
2013-06-08 20:20:38.559210 7f05d2b94700  0 log [INF] : pgmap v17310694: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1518B/s rd, 244KB/s wr, 45op/s
2013-06-08 20:20:39.832506 7f05d2b94700  0 log [INF] : pgmap v17310695: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 13673B/s rd, 402KB/s wr, 66op/s
2013-06-08 20:20:40.948988 7f05d2b94700  0 log [INF] : pgmap v17310696: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15251B/s rd, 350KB/s wr, 50op/s
2013-06-08 20:20:42.229742 7f05d2b94700  0 log [INF] : pgmap v17310697: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1632B/s rd, 103KB/s wr, 12op/s
2013-06-08 20:20:44.465289 7f05d2b94700  0 log [INF] : pgmap v17310698: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 2341B/s rd, 302KB/s wr, 41op/s
2013-06-08 20:20:45.648381 7f05d2b94700  0 log [INF] : pgmap v17310699: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 8618B/s rd, 385KB/s wr, 61op/s
2013-06-08 20:20:46.956062 7f05d2b94700  0 log [INF] : pgmap v17310700: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 9764B/s rd, 170KB/s wr, 36op/s
2013-06-08 20:20:49.148596 7f05d2b94700  0 log [INF] : pgmap v17310701: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 128KB/s wr, 17op/s
2013-06-08 20:20:50.203076 7f05d2b94700  0 log [INF] : pgmap v17310702: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 4964B/s rd, 132KB/s wr, 21op/s
2013-06-08 20:20:51.405324 7f05d2b94700  0 log [INF] : pgmap v17310703: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7463B/s rd, 138KB/s wr, 27op/s
2013-06-08 20:20:52.542275 7f05d2b94700  0 log [INF] : pgmap v17310704: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 190KB/s wr, 35op/s
2013-06-08 20:20:53.776634 7f05d2b94700  0 log [INF] : pgmap v17310705: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 229KB/s wr, 37op/s
2013-06-08 20:20:54.984558 7f05d2b94700  0 log [INF] : pgmap v17310706: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10400B/s rd, 345KB/s wr, 59op/s
2013-06-08 20:20:56.428390 7f05d2b94700  0 log [INF] : pgmap v17310707: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 9347B/s rd, 407KB/s wr, 75op/s
2013-06-08 20:20:57.538223 7f05d2b94700  0 log [INF] : pgmap v17310708: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 406KB/s wr, 65op/s
2013-06-08 20:20:58.812485 7f05d2b94700  0 log [INF] : pgmap v17310709: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 75524B/s rd, 296KB/s wr, 63op/s
2013-06-08 20:21:00.150253 7f05d2b94700  0 log [INF] : pgmap v17310710: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 108KB/s rd, 231KB/s wr, 68op/s
2013-06-08 20:21:02.244635 7f05d2b94700  0 log [INF] : pgmap v17310711: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 37536B/s rd, 165KB/s wr, 41op/s
2013-06-08 20:21:03.608801 7f05d2b94700  0 log [INF] : pgmap v17310712: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 30624B/s rd, 73028B/s wr, 20op/s
2013-06-08 20:21:04.896354 7f05d2b94700  0 log [INF] : pgmap v17310713: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 483KB/s rd, 522KB/s wr, 85op/s
2013-06-08 20:21:06.037450 7f05d2b94700  0 log [INF] : pgmap v17310714: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 593KB/s rd, 686KB/s wr, 99op/s
2013-06-08 20:21:07.414869 7f05d2b94700  0 log [INF] : pgmap v17310715: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 255KB/s wr, 15op/s
2013-06-08 20:21:08.741996 7f05d2b94700  0 log [INF] : pgmap v17310716: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 235KB/s wr, 17op/s
2013-06-08 20:21:09.813578 7f05d2b94700  0 log [INF] : pgmap v17310717: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 208KB/s rd, 264KB/s wr, 36op/s
2013-06-08 20:21:11.066606 7f05d2b94700  0 log [INF] : pgmap v17310718: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 207KB/s rd, 282KB/s wr, 34op/s
2013-06-08 20:21:12.262205 7f05d2b94700  0 log [INF] : pgmap v17310719: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 66478B/s wr, 6op/s
2013-06-08 20:21:13.663315 7f05d2b94700  0 log [INF] : pgmap v17310720: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 57277B/s wr, 8op/s
2013-06-08 20:21:14.926532 7f05d2b94700  0 log [INF] : pgmap v17310721: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 9575B/s rd, 1008KB/s wr, 83op/s
2013-06-08 20:21:15.987785 7f05d2b94700  0 log [INF] : pgmap v17310722: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11911B/s rd, 1045KB/s wr, 85op/s
2013-06-08 20:21:17.354692 7f05d2b94700  0 log [INF] : pgmap v17310723: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 2093B/s rd, 18420B/s wr, 4op/s
2013-06-08 20:21:18.639339 7f05d2b94700  0 log [INF] : pgmap v17310724: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 395B/s rd, 64819B/s wr, 11op/s
2013-06-08 20:21:20.001101 7f05d2b94700  0 log [INF] : pgmap v17310725: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 12791B/s rd, 431KB/s wr, 93op/s
2013-06-08 20:21:21.347134 7f05d2b94700  0 log [INF] : pgmap v17310726: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 12634B/s rd, 418KB/s wr, 83op/s
2013-06-08 20:21:22.651667 7f05d2b94700  0 log [INF] : pgmap v17310727: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 55288B/s wr, 3op/s
2013-06-08 20:21:22.771042 7f05d2b94700  0 mon.0@0(leader) e8 handle_command mon_command(health v 0) v1
2013-06-08 20:21:23.941559 7f05d2b94700  0 log [INF] : pgmap v17310728: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 483KB/s wr, 70op/s
2013-06-08 20:21:24.012621 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183409564 avail 482792344
2013-06-08 20:21:25.227047 7f05d2b94700  0 log [INF] : pgmap v17310729: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10091B/s rd, 658KB/s wr, 102op/s
2013-06-08 20:21:26.669932 7f05d2b94700  0 log [INF] : pgmap v17310730: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 12001B/s rd, 189KB/s wr, 32op/s
2013-06-08 20:21:27.547134 7f05d2b94700  0 log [INF] : pgmap v17310731: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1730B/s rd, 72663B/s wr, 9op/s
2013-06-08 20:21:28.960081 7f05d2b94700  0 log [INF] : pgmap v17310732: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1588B/s rd, 1020KB/s wr, 110op/s
2013-06-08 20:21:30.136518 7f05d2b94700  0 log [INF] : pgmap v17310733: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7902B/s rd, 1135KB/s wr, 130op/s
2013-06-08 20:21:31.457067 7f05d2b94700  0 log [INF] : pgmap v17310734: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11397B/s rd, 216KB/s wr, 30op/s
2013-06-08 20:21:32.904127 7f05d2b94700  0 log [INF] : pgmap v17310735: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 4566B/s rd, 80669B/s wr, 8op/s
2013-06-08 20:21:34.117783 7f05d2b94700  0 log [INF] : pgmap v17310736: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 27294B/s rd, 480KB/s wr, 48op/s
2013-06-08 20:21:35.440947 7f05d2b94700  0 log [INF] : pgmap v17310737: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 694KB/s rd, 522KB/s wr, 65op/s
2013-06-08 20:21:37.280971 7f05d2b94700  0 log [INF] : pgmap v17310738: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 643KB/s rd, 84047B/s wr, 23op/s
2013-06-08 20:21:38.658727 7f05d2b94700  0 log [INF] : pgmap v17310739: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1183KB/s wr, 19op/s
2013-06-08 20:21:40.170000 7f05d2b94700  0 log [INF] : pgmap v17310740: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 13517B/s rd, 3035KB/s wr, 66op/s
2013-06-08 20:21:41.400815 7f05d2b94700  0 log [INF] : pgmap v17310741: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15387B/s rd, 2762KB/s wr, 62op/s
2013-06-08 20:21:42.687907 7f05d2b94700  0 log [INF] : pgmap v17310742: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1571B/s rd, 663KB/s wr, 13op/s
2013-06-08 20:21:43.889241 7f05d2b94700  0 log [INF] : pgmap v17310743: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 212KB/s rd, 244KB/s wr, 33op/s
2013-06-08 20:21:45.300850 7f05d2b94700  0 log [INF] : pgmap v17310744: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 220KB/s rd, 281KB/s wr, 44op/s
2013-06-08 20:21:46.471155 7f05d2b94700  0 log [INF] : pgmap v17310745: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10920B/s rd, 109KB/s wr, 23op/s
2013-06-08 20:21:48.007360 7f05d2b94700  0 log [INF] : pgmap v17310746: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 42248B/s wr, 8op/s
2013-06-08 20:21:49.340473 7f05d2b94700  0 log [INF] : pgmap v17310747: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 134KB/s wr, 14op/s
2013-06-08 20:21:50.580360 7f05d2b94700  0 log [INF] : pgmap v17310748: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 5627B/s rd, 240KB/s wr, 32op/s
2013-06-08 20:21:51.833339 7f05d2b94700  0 log [INF] : pgmap v17310749: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6872B/s rd, 347KB/s wr, 38op/s
2013-06-08 20:21:54.014209 7f05d2b94700  0 log [INF] : pgmap v17310750: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 424KB/s wr, 41op/s
2013-06-08 20:21:55.256720 7f05d2b94700  0 log [INF] : pgmap v17310751: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6965B/s rd, 300KB/s wr, 40op/s
2013-06-08 20:21:56.708435 7f05d2b94700  0 log [INF] : pgmap v17310752: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10101B/s rd, 124KB/s wr, 26op/s
2013-06-08 20:21:57.956501 7f05d2b94700  0 log [INF] : pgmap v17310753: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 195KB/s wr, 24op/s
2013-06-08 20:21:59.047760 7f05d2b94700  0 log [INF] : pgmap v17310754: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 200KB/s rd, 335KB/s wr, 44op/s
2013-06-08 20:22:00.228896 7f05d2b94700  0 log [INF] : pgmap v17310755: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 221KB/s rd, 266KB/s wr, 44op/s
2013-06-08 20:22:02.339580 7f05d2b94700  0 log [INF] : pgmap v17310756: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 8710B/s rd, 27872B/s wr, 13op/s
2013-06-08 20:22:03.562810 7f05d2b94700  0 log [INF] : pgmap v17310757: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 43576B/s wr, 7op/s
2013-06-08 20:22:04.600901 7f05d2b94700  0 log [INF] : pgmap v17310758: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 109KB/s rd, 503KB/s wr, 81op/s
2013-06-08 20:22:05.937346 7f05d2b94700  0 log [INF] : pgmap v17310759: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 147KB/s rd, 654KB/s wr, 107op/s
2013-06-08 20:22:07.077996 7f05d2b94700  0 log [INF] : pgmap v17310760: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 44123B/s rd, 261KB/s wr, 27op/s
2013-06-08 20:22:08.526176 7f05d2b94700  0 log [INF] : pgmap v17310761: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 34985B/s rd, 240KB/s wr, 25op/s
2013-06-08 20:22:09.656708 7f05d2b94700  0 log [INF] : pgmap v17310762: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 23393B/s rd, 1167KB/s wr, 101op/s
2013-06-08 20:22:11.009359 7f05d2b94700  0 log [INF] : pgmap v17310763: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 24310B/s rd, 1306KB/s wr, 105op/s
2013-06-08 20:22:12.123710 7f05d2b94700  0 log [INF] : pgmap v17310764: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 91874B/s wr, 6op/s
2013-06-08 20:22:13.690835 7f05d2b94700  0 log [INF] : pgmap v17310765: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 342KB/s wr, 47op/s
2013-06-08 20:22:14.976843 7f05d2b94700  0 log [INF] : pgmap v17310766: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10458B/s rd, 1066KB/s wr, 159op/s
2013-06-08 20:22:16.129056 7f05d2b94700  0 log [INF] : pgmap v17310767: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11216B/s rd, 1112KB/s wr, 162op/s
2013-06-08 20:22:17.539875 7f05d2b94700  0 log [INF] : pgmap v17310768: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 524KB/s wr, 76op/s
2013-06-08 20:22:18.933020 7f05d2b94700  0 log [INF] : pgmap v17310769: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 257KB/s wr, 43op/s
2013-06-08 20:22:20.243622 7f05d2b94700  0 log [INF] : pgmap v17310770: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 165KB/s rd, 454KB/s wr, 84op/s
2013-06-08 20:22:21.371003 7f05d2b94700  0 log [INF] : pgmap v17310771: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 172KB/s rd, 454KB/s wr, 85op/s
2013-06-08 20:22:23.506676 7f05d2b94700  0 log [INF] : pgmap v17310772: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 29562B/s wr, 6op/s
2013-06-08 20:22:24.012746 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183412484 avail 482789424
2013-06-08 20:22:24.564165 7f05d2b94700  0 log [INF] : pgmap v17310773: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 171KB/s rd, 691KB/s wr, 97op/s
2013-06-08 20:22:25.750507 7f05d2b94700  0 log [INF] : pgmap v17310774: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 187KB/s rd, 857KB/s wr, 116op/s
2013-06-08 20:22:26.940253 7f05d2b94700  0 log [INF] : pgmap v17310775: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 12344B/s rd, 237KB/s wr, 28op/s
2013-06-08 20:22:28.537978 7f05d2b94700  0 log [INF] : pgmap v17310776: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 4213B/s rd, 57591B/s wr, 10op/s
2013-06-08 20:22:30.100546 7f05d2b94700  0 log [INF] : pgmap v17310777: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 184KB/s rd, 826KB/s wr, 120op/s
2013-06-08 20:22:31.253077 7f05d2b94700  0 log [INF] : pgmap v17310778: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 208KB/s rd, 948KB/s wr, 136op/s
2013-06-08 20:22:32.565286 7f05d2b94700  0 log [INF] : pgmap v17310779: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10390B/s rd, 95367B/s wr, 10op/s
2013-06-08 20:22:33.670125 7f05d2b94700  0 log [INF] : pgmap v17310780: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11376B/s rd, 127KB/s wr, 11op/s
2013-06-08 20:22:34.826112 7f05d2b94700  0 log [INF] : pgmap v17310781: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10880B/s rd, 393KB/s wr, 50op/s
2013-06-08 20:22:36.985506 7f05d2b94700  0 log [INF] : pgmap v17310782: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10166B/s rd, 320KB/s wr, 42op/s
2013-06-08 20:22:38.418088 7f05d2b94700  0 log [INF] : pgmap v17310783: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 48433B/s wr, 6op/s
2013-06-08 20:22:39.953696 7f05d2b94700  0 log [INF] : pgmap v17310784: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1204B/s rd, 334KB/s wr, 27op/s
2013-06-08 20:22:40.857924 7f05d2b94700  0 log [INF] : pgmap v17310785: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7504B/s rd, 479KB/s wr, 42op/s
2013-06-08 20:22:41.903127 7f05d2b94700  0 log [INF] : pgmap v17310786: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6643B/s rd, 142KB/s wr, 19op/s
2013-06-08 20:22:43.707914 7f05d2b94700  0 log [INF] : pgmap v17310787: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 82019B/s wr, 15op/s
2013-06-08 20:22:44.943677 7f05d2b94700  0 log [INF] : pgmap v17310788: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 8580B/s rd, 328KB/s wr, 51op/s
2013-06-08 20:22:46.207713 7f05d2b94700  0 log [INF] : pgmap v17310789: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11213B/s rd, 322KB/s wr, 50op/s
2013-06-08 20:22:47.403005 7f05d2b94700  0 log [INF] : pgmap v17310790: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1614B/s rd, 46812B/s wr, 9op/s
2013-06-08 20:22:48.632929 7f05d2b94700  0 log [INF] : pgmap v17310791: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 3208B/s rd, 99470B/s wr, 18op/s
2013-06-08 20:22:49.933785 7f05d2b94700  0 log [INF] : pgmap v17310792: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 237KB/s rd, 262KB/s wr, 44op/s
2013-06-08 20:22:51.414509 7f05d2b94700  0 log [INF] : pgmap v17310793: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 240KB/s rd, 258KB/s wr, 40op/s
2013-06-08 20:22:52.673569 7f05d2b94700  0 log [INF] : pgmap v17310794: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1499B/s rd, 92947B/s wr, 16op/s
2013-06-08 20:22:53.750049 7f05d2b94700  0 log [INF] : pgmap v17310795: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 18749B/s rd, 1050KB/s wr, 138op/s
2013-06-08 20:22:54.847996 7f05d2b94700  0 log [INF] : pgmap v17310796: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 31914B/s rd, 1415KB/s wr, 203op/s
2013-06-08 20:22:56.154813 7f05d2b94700  0 log [INF] : pgmap v17310797: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10677B/s rd, 450KB/s wr, 85op/s
2013-06-08 20:22:58.502533 7f05d2b94700  0 log [INF] : pgmap v17310798: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 506KB/s wr, 78op/s
2013-06-08 20:22:59.802605 7f05d2b94700  0 log [INF] : pgmap v17310799: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 4479B/s rd, 430KB/s wr, 66op/s
2013-06-08 20:23:01.057723 7f05d2b94700  0 log [INF] : pgmap v17310800: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10258B/s rd, 233KB/s wr, 40op/s
2013-06-08 20:23:02.565137 7f05d2b94700  0 log [INF] : pgmap v17310801: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 41430B/s rd, 76723B/s wr, 23op/s
2013-06-08 20:23:03.758324 7f05d2b94700  0 log [INF] : pgmap v17310802: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 80452B/s rd, 140KB/s wr, 43op/s
2013-06-08 20:23:04.829223 7f05d2b94700  0 log [INF] : pgmap v17310803: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 193KB/s rd, 750KB/s wr, 143op/s
2013-06-08 20:23:05.894906 7f05d2b94700  0 log [INF] : pgmap v17310804: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 154KB/s rd, 723KB/s wr, 119op/s
2013-06-08 20:23:07.097920 7f05d2b94700  0 log [INF] : pgmap v17310805: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 355KB/s wr, 15op/s
2013-06-08 20:23:09.326177 7f05d2b94700  0 log [INF] : pgmap v17310806: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6088B/s rd, 269KB/s wr, 20op/s
2013-06-08 20:23:10.522911 7f05d2b94700  0 log [INF] : pgmap v17310807: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 17128B/s rd, 78915B/s wr, 17op/s
2013-06-08 20:23:11.758903 7f05d2b94700  0 log [INF] : pgmap v17310808: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15794B/s rd, 138KB/s wr, 18op/s
2013-06-08 20:23:13.560101 7f05d2b94700  0 log [INF] : pgmap v17310809: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 18626B/s rd, 155KB/s wr, 13op/s
2013-06-08 20:23:14.704766 7f05d2b94700  0 log [INF] : pgmap v17310810: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 28474B/s rd, 1098KB/s wr, 95op/s
2013-06-08 20:23:15.911634 7f05d2b94700  0 log [INF] : pgmap v17310811: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 12023B/s rd, 1310KB/s wr, 114op/s
2013-06-08 20:23:17.070668 7f05d2b94700  0 log [INF] : pgmap v17310812: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 67118B/s wr, 12op/s
2013-06-08 20:23:18.523593 7f05d2b94700  0 log [INF] : pgmap v17310813: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 89259B/s wr, 15op/s
2013-06-08 20:23:19.645360 7f05d2b94700  0 log [INF] : pgmap v17310814: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6351B/s rd, 510KB/s wr, 83op/s
2013-06-08 20:23:20.916265 7f05d2b94700  0 log [INF] : pgmap v17310815: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7012B/s rd, 576KB/s wr, 88op/s
2013-06-08 20:23:22.334781 7f05d2b94700  0 log [INF] : pgmap v17310816: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 62414B/s wr, 4op/s
2013-06-08 20:23:23.606848 7f05d2b94700  0 log [INF] : pgmap v17310817: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 42606B/s wr, 7op/s
2013-06-08 20:23:24.012895 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183407872 avail 482794036
2013-06-08 20:23:24.711271 7f05d2b94700  0 log [INF] : pgmap v17310818: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 14303B/s rd, 826KB/s wr, 124op/s
2013-06-08 20:23:25.981543 7f05d2b94700  0 log [INF] : pgmap v17310819: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15528B/s rd, 959KB/s wr, 132op/s
2013-06-08 20:23:27.118534 7f05d2b94700  0 log [INF] : pgmap v17310820: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 112KB/s wr, 6op/s
2013-06-08 20:23:28.678794 7f05d2b94700  0 log [INF] : pgmap v17310821: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 3151B/s rd, 51996B/s wr, 10op/s
2013-06-08 20:23:29.918631 7f05d2b94700  0 log [INF] : pgmap v17310822: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 34279B/s rd, 937KB/s wr, 141op/s
2013-06-08 20:23:31.023023 7f05d2b94700  0 log [INF] : pgmap v17310823: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 36289B/s rd, 1012KB/s wr, 152op/s
2013-06-08 20:23:32.989628 7f05d2b94700  0 log [INF] : pgmap v17310824: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1665B/s rd, 61625B/s wr, 11op/s
2013-06-08 20:23:33.641796 7f05d2b94700  0 log [INF] : pgmap v17310825: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1587B/s rd, 115KB/s wr, 18op/s
2013-06-08 20:23:34.950124 7f05d2b94700  0 log [INF] : pgmap v17310826: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 49896B/s rd, 448KB/s wr, 77op/s
2013-06-08 20:23:36.247258 7f05d2b94700  0 log [INF] : pgmap v17310827: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 47086B/s rd, 383KB/s wr, 67op/s
2013-06-08 20:23:37.558969 7f05d2b94700  0 log [INF] : pgmap v17310828: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 86925B/s wr, 11op/s
2013-06-08 20:23:38.925237 7f05d2b94700  0 log [INF] : pgmap v17310829: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 184KB/s wr, 26op/s
2013-06-08 20:23:40.264779 7f05d2b94700  0 log [INF] : pgmap v17310830: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6290B/s rd, 316KB/s wr, 41op/s
2013-06-08 20:23:41.574675 7f05d2b94700  0 log [INF] : pgmap v17310831: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6075B/s rd, 245KB/s wr, 31op/s
2013-06-08 20:23:42.597104 7f05d2b94700  0 log [INF] : pgmap v17310832: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 93526B/s wr, 14op/s
2013-06-08 20:23:43.872179 7f05d2b94700  0 log [INF] : pgmap v17310833: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 500KB/s wr, 52op/s
2013-06-08 20:23:45.081456 7f05d2b94700  0 log [INF] : pgmap v17310834: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10396B/s rd, 549KB/s wr, 71op/s
2013-06-08 20:23:46.582241 7f05d2b94700  0 log [INF] : pgmap v17310835: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11250B/s rd, 106KB/s wr, 30op/s
2013-06-08 20:23:47.612946 7f05d2b94700  0 log [INF] : pgmap v17310836: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1601B/s rd, 56049B/s wr, 11op/s
2013-06-08 20:23:48.859212 7f05d2b94700  0 log [INF] : pgmap v17310837: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 371KB/s wr, 37op/s
2013-06-08 20:23:50.072948 7f05d2b94700  0 log [INF] : pgmap v17310838: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 14805B/s rd, 424KB/s wr, 50op/s
2013-06-08 20:23:51.229121 7f05d2b94700  0 log [INF] : pgmap v17310839: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15886B/s rd, 148KB/s wr, 27op/s
2013-06-08 20:23:52.536680 7f05d2b94700  0 log [INF] : pgmap v17310840: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 5015B/s rd, 100301B/s wr, 18op/s
2013-06-08 20:23:53.774475 7f05d2b94700  0 log [INF] : pgmap v17310841: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6789B/s rd, 66193B/s wr, 15op/s
2013-06-08 20:23:54.859595 7f05d2b94700  0 log [INF] : pgmap v17310842: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15587B/s rd, 312KB/s wr, 52op/s
2013-06-08 20:23:55.926544 7f05d2b94700  0 log [INF] : pgmap v17310843: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 13785B/s rd, 360KB/s wr, 63op/s
2013-06-08 20:23:57.131372 7f05d2b94700  0 log [INF] : pgmap v17310844: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 179KB/s wr, 28op/s
2013-06-08 20:23:59.360359 7f05d2b94700  0 log [INF] : pgmap v17310845: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 345KB/s wr, 42op/s
2013-06-08 20:24:00.464725 7f05d2b94700  0 log [INF] : pgmap v17310846: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6160B/s rd, 347KB/s wr, 52op/s
2013-06-08 20:24:01.950903 7f05d2b94700  0 log [INF] : pgmap v17310847: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 8610B/s rd, 117KB/s wr, 25op/s
2013-06-08 20:24:04.484001 7f05d2b94700  0 log [INF] : pgmap v17310848: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 3237B/s rd, 408KB/s wr, 41op/s
2013-06-08 20:24:05.493081 7f05d2b94700  0 log [INF] : pgmap v17310849: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 12429B/s rd, 454KB/s wr, 55op/s
2013-06-08 20:24:06.780673 7f05d2b94700  0 log [INF] : pgmap v17310850: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 22463B/s rd, 349KB/s wr, 35op/s
2013-06-08 20:24:09.658879 7f05d2b94700  0 log [INF] : pgmap v17310851: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 13738B/s rd, 727KB/s wr, 69op/s
2013-06-08 20:24:10.733284 7f05d2b94700  0 log [INF] : pgmap v17310852: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 16462B/s rd, 555KB/s wr, 68op/s
2013-06-08 20:24:11.970800 7f05d2b94700  0 log [INF] : pgmap v17310853: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 14168B/s rd, 125KB/s wr, 25op/s
2013-06-08 20:24:14.175862 7f05d2b94700  0 log [INF] : pgmap v17310854: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11814B/s rd, 134KB/s wr, 21op/s
2013-06-08 20:24:15.310353 7f05d2b94700  0 log [INF] : pgmap v17310855: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 19834B/s rd, 158KB/s wr, 27op/s
2013-06-08 20:24:16.425383 7f05d2b94700  0 log [INF] : pgmap v17310856: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 18406B/s rd, 97555B/s wr, 21op/s
2013-06-08 20:24:17.871116 7f05d2b94700  0 log [INF] : pgmap v17310857: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 10602B/s rd, 24739B/s wr, 7op/s
2013-06-08 20:24:19.025093 7f05d2b94700  0 log [INF] : pgmap v17310858: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7927B/s rd, 261KB/s wr, 48op/s
2013-06-08 20:24:20.287787 7f05d2b94700  0 log [INF] : pgmap v17310859: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 9485B/s rd, 259KB/s wr, 53op/s
2013-06-08 20:24:21.887869 7f05d2b94700  0 log [INF] : pgmap v17310860: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6618B/s rd, 11582B/s wr, 8op/s
2013-06-08 20:24:23.261252 7f05d2b94700  0 log [INF] : pgmap v17310861: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6955B/s wr, 1op/s
2013-06-08 20:24:24.013066 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183409996 avail 482791912
2013-06-08 20:24:24.479352 7f05d2b94700  0 log [INF] : pgmap v17310862: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1016KB/s wr, 117op/s
2013-06-08 20:24:25.568924 7f05d2b94700  0 log [INF] : pgmap v17310863: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11732B/s rd, 1446KB/s wr, 184op/s
2013-06-08 20:24:26.940488 7f05d2b94700  0 log [INF] : pgmap v17310864: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11843B/s rd, 242KB/s wr, 47op/s
2013-06-08 20:24:29.239346 7f05d2b94700  0 log [INF] : pgmap v17310865: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 289KB/s wr, 40op/s
2013-06-08 20:24:30.325344 7f05d2b94700  0 log [INF] : pgmap v17310866: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 4647B/s rd, 291KB/s wr, 44op/s
2013-06-08 20:24:31.869219 7f05d2b94700  0 log [INF] : pgmap v17310867: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7186B/s rd, 21560B/s wr, 11op/s
2013-06-08 20:24:33.761752 7f05d2b94700  0 log [INF] : pgmap v17310868: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 17004B/s wr, 4op/s
2013-06-08 20:24:35.000008 7f05d2b94700  0 log [INF] : pgmap v17310869: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 7063B/s rd, 12949B/s wr, 9op/s
2013-06-08 20:24:36.192512 7f05d2b94700  0 log [INF] : pgmap v17310870: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 11592B/s rd, 8280B/s wr, 10op/s
2013-06-08 20:24:38.614581 7f05d2b94700  0 log [INF] : pgmap v17310871: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1133B/s rd, 24931B/s wr, 6op/s
2013-06-08 20:24:39.763894 7f05d2b94700  0 log [INF] : pgmap v17310872: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 4640B/s rd, 58005B/s wr, 15op/s
2013-06-08 20:24:40.954038 7f05d2b94700  0 log [INF] : pgmap v17310873: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 6696B/s rd, 51901B/s wr, 15op/s
2013-06-08 20:24:43.349733 7f05d2b94700  1 mon.0@0(leader).osd e4628 prepare_failure osd.6 10.10.10.10:6801/17115 from osd.2 10.10.10.6:6800/18947 is reporting failure:1
2013-06-08 20:24:43.349764 7f05d2b94700  0 log [DBG] : osd.6 10.10.10.10:6801/17115 reported failed by osd.2 10.10.10.6:6800/18947
2013-06-08 20:24:43.545673 7f05d2b94700  1 mon.0@0(leader).osd e4628 prepare_failure osd.6 10.10.10.10:6801/17115 from osd.5 10.10.10.9:6801/13564 is reporting failure:1
2013-06-08 20:24:43.545694 7f05d2b94700  0 log [DBG] : osd.6 10.10.10.10:6801/17115 reported failed by osd.5 10.10.10.9:6801/13564
2013-06-08 20:24:43.680434 7f05d2b94700  0 log [INF] : pgmap v17310874: 768 pgs: 768 active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 1062B/s rd, 20188B/s wr, 4op/s
2013-06-08 20:24:43.747866 7f05d2b94700  1 mon.0@0(leader).osd e4628 prepare_failure osd.6 10.10.10.10:6801/17115 from osd.1 10.10.10.5:6800/28355 is reporting failure:1
2013-06-08 20:24:43.747889 7f05d2b94700  0 log [DBG] : osd.6 10.10.10.10:6801/17115 reported failed by osd.1 10.10.10.5:6800/28355
2013-06-08 20:24:44.353422 7f05d2b94700  1 mon.0@0(leader).osd e4628 prepare_failure osd.6 10.10.10.10:6801/17115 from osd.3 10.10.10.7:6800/16810 is reporting failure:1
2013-06-08 20:24:44.353453 7f05d2b94700  0 log [DBG] : osd.6 10.10.10.10:6801/17115 reported failed by osd.3 10.10.10.7:6800/16810
2013-06-08 20:24:44.353504 7f05d2b94700  1 mon.0@0(leader).osd e4628  we have enough reports/reporters to mark osd.6 down
2013-06-08 20:24:44.353518 7f05d2b94700  0 log [INF] : osd.6 10.10.10.10:6801/17115 failed (4 reports from 4 peers after 2013-06-08 20:25:06.353436 >= grace 20.000000)
2013-06-08 20:24:44.832178 7f05d2b94700  1 mon.0@0(leader).osd e4629 e4629: 7 osds: 6 up, 7 in
2013-06-08 20:24:44.970585 7f05d2b94700  0 log [INF] : osdmap e4629: 7 osds: 6 up, 7 in
2013-06-08 20:24:45.270560 7f05d2b94700  0 log [INF] : pgmap v17310876: 768 pgs: 648 active+clean, 120 stale+active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 14400B/s rd, 60004B/s wr, 22op/s
2013-06-08 20:24:45.916407 7f05d2b94700  1 mon.0@0(leader).osd e4630 e4630: 7 osds: 6 up, 7 in
2013-06-08 20:24:46.121494 7f05d2b94700  0 log [INF] : osdmap e4630: 7 osds: 6 up, 7 in
2013-06-08 20:24:46.445427 7f05d2b94700  0 log [INF] : pgmap v17310877: 768 pgs: 648 active+clean, 120 stale+active+clean; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail
2013-06-08 20:24:51.662042 7f05d2b94700  0 log [INF] : pgmap v17310878: 768 pgs: 542 active+clean, 36 stale+active+clean, 190 active+degraded; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15EB/s rd, 1144KB/s wr, 85op/s; 104345/919709 degraded (11.345%);  recovering 0 o/s, 15EB/s
2013-06-08 20:24:53.052491 7f05d2b94700  0 log [INF] : pgmap v17310879: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3493 GB used, 2679 GB / 6359 GB avail; 15EB/s rd, 1442KB/s wr, 150op/s; 143789/919695 degraded (15.634%);  recovering 8 o/s, 15EB/s
2013-06-08 20:24:55.874918 7f05d2b94700  0 log [INF] : pgmap v17310880: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3493 GB used, 2680 GB / 6359 GB avail; 37734B/s rd, 879KB/s wr, 137op/s; 143776/919619 degraded (15.634%);  recovering 9 o/s, 29085B/s
2013-06-08 20:24:56.843633 7f05d2b94700  0 log [INF] : pgmap v17310881: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3493 GB used, 2680 GB / 6359 GB avail; 13493B/s rd, 642KB/s wr, 86op/s; 143768/919571 degraded (15.634%)
2013-06-08 20:25:01.470862 7f05d2b94700  0 log [INF] : pgmap v17310882: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3493 GB used, 2680 GB / 6359 GB avail; 3373B/s rd, 244KB/s wr, 44op/s; 143760/919533 degraded (15.634%)
2013-06-08 20:25:03.623097 7f05d2b94700  0 log [INF] : pgmap v17310883: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3492 GB used, 2680 GB / 6359 GB avail; 4821B/s rd, 207KB/s wr, 46op/s; 143751/919447 degraded (15.635%)
2013-06-08 20:25:07.956777 7f05d2b94700  0 log [INF] : pgmap v17310884: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3492 GB used, 2680 GB / 6359 GB avail; 3680B/s rd, 417KB/s wr, 50op/s; 143738/919385 degraded (15.634%)
2013-06-08 20:25:09.907220 7f05d2b94700  0 log [INF] : pgmap v17310885: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3492 GB used, 2680 GB / 6359 GB avail; 2233B/s rd, 329KB/s wr, 28op/s; 143735/919373 degraded (15.634%)
2013-06-08 20:25:11.278973 7f05d2b94700  0 log [INF] : pgmap v17310886: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3492 GB used, 2681 GB / 6359 GB avail; 14499B/s rd, 2360KB/s wr, 136op/s; 143728/919321 degraded (15.634%)
2013-06-08 20:25:12.763578 7f05d2b94700  0 log [INF] : pgmap v17310887: 768 pgs: 504 active+clean, 264 active+degraded; 1747 GB data, 3492 GB used, 2681 GB / 6359 GB avail; 13565B/s rd, 3793KB/s wr, 167op/s; 143727/919311 degraded (15.634%)
2013-06-08 20:25:16.016741 7f05d2b94700  0 log [INF] : pgmap v17310888: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3492 GB used, 2681 GB / 6359 GB avail; 880B/s rd, 757KB/s wr, 18op/s; 143726/919299 degraded (15.634%)
2013-06-08 20:25:20.937105 7f05d2b94700  0 log [INF] : pgmap v17310889: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3492 GB used, 2681 GB / 6359 GB avail; 3441B/s rd, 355KB/s wr, 60op/s; 143708/919195 degraded (15.634%)
2013-06-08 20:25:21.662379 7f05d2b94700  0 log [INF] : pgmap v17310890: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2681 GB / 6359 GB avail; 6626B/s rd, 494KB/s wr, 89op/s; 143701/919151 degraded (15.634%)
2013-06-08 20:25:24.013301 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183405696 avail 482796212
2013-06-08 20:25:25.598584 7f05d2b94700  0 log [INF] : pgmap v17310891: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2681 GB / 6359 GB avail; 3354B/s rd, 223KB/s wr, 38op/s; 143699/919143 degraded (15.634%)
2013-06-08 20:25:26.643605 7f05d2b94700  0 log [INF] : pgmap v17310892: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2681 GB / 6359 GB avail; 4112B/s rd, 797KB/s wr, 117op/s; 143691/919087 degraded (15.634%)
2013-06-08 20:25:30.611115 7f05d2b94700  0 log [INF] : pgmap v17310893: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2681 GB / 6359 GB avail; 3276B/s rd, 748KB/s wr, 109op/s; 143689/919079 degraded (15.634%)
2013-06-08 20:25:31.810150 7f05d2b94700  0 log [INF] : pgmap v17310894: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2681 GB / 6359 GB avail; 4893B/s rd, 364KB/s wr, 58op/s; 143679/919025 degraded (15.634%)
2013-06-08 20:25:35.514146 7f05d2b94700  0 log [INF] : pgmap v17310895: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2682 GB / 6359 GB avail; 4915B/s rd, 376KB/s wr, 61op/s; 143675/919005 degraded (15.634%)
2013-06-08 20:25:36.643348 7f05d2b94700  0 log [INF] : pgmap v17310896: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2682 GB / 6359 GB avail; 4990B/s rd, 281KB/s wr, 41op/s; 143662/918931 degraded (15.634%)
2013-06-08 20:25:40.485737 7f05d2b94700  0 log [INF] : pgmap v17310897: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2682 GB / 6359 GB avail; 4914B/s rd, 368KB/s wr, 55op/s; 143657/918911 degraded (15.633%)
2013-06-08 20:25:41.830836 7f05d2b94700  0 log [INF] : pgmap v17310898: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2682 GB / 6359 GB avail; 5746B/s rd, 938KB/s wr, 147op/s; 143641/918833 degraded (15.633%)
2013-06-08 20:25:43.537377 7f05d2b94700  1 mon.0@0(leader).pg v17310898  ignoring stats from non-active osd.
2013-06-08 20:25:44.681196 7f05d2b94700  1 mon.0@0(leader).osd e4631 e4631: 7 osds: 7 up, 7 in
2013-06-08 20:25:44.773552 7f05d2b94700  0 log [INF] : osd.6 10.10.10.10:6801/17115 boot
2013-06-08 20:25:44.774350 7f05d2b94700  0 log [INF] : osdmap e4631: 7 osds: 7 up, 7 in
2013-06-08 20:25:44.843087 7f05d2b94700  0 log [INF] : pgmap v17310899: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2682 GB / 6359 GB avail; 6513B/s rd, 915KB/s wr, 144op/s; 143641/918833 degraded (15.633%)
2013-06-08 20:25:45.831584 7f05d2b94700  1 mon.0@0(leader).osd e4632 e4632: 7 osds: 7 up, 7 in
2013-06-08 20:25:46.042054 7f05d2b94700  0 log [INF] : osdmap e4632: 7 osds: 7 up, 7 in
2013-06-08 20:25:46.392899 7f05d2b94700  0 log [INF] : pgmap v17310900: 768 pgs: 504 active+clean, 264 active+degraded; 1746 GB data, 3491 GB used, 2682 GB / 6359 GB avail; 143641/918833 degraded (15.633%)
2013-06-08 20:25:50.548814 7f05d2b94700  0 log [INF] : pgmap v17310901: 768 pgs: 76 active, 504 active+clean, 1 active+recovery_wait, 187 active+degraded; 1746 GB data, 3490 GB used, 2682 GB / 6359 GB avail; 20026B/s rd, 142KB/s wr, 40op/s; 105677/918739 degraded (11.502%)
2013-06-08 20:25:51.795481 7f05d2b94700  0 log [INF] : pgmap v17310902: 768 pgs: 190 active, 504 active+clean, 2 active+recovery_wait, 72 peering; 1745 GB data, 3490 GB used, 2683 GB / 6359 GB avail; 161KB/s rd, 231KB/s wr, 62op/s; 14/918675 degraded (0.002%);  recovering 15E o/s, 1433KB/s
2013-06-08 20:25:55.580158 7f05d2b94700  0 log [INF] : pgmap v17310903: 768 pgs: 174 active, 517 active+clean, 5 active+recovery_wait, 72 peering; 1745 GB data, 3490 GB used, 2683 GB / 6359 GB avail; 165KB/s rd, 143KB/s wr, 32op/s; 14/918675 degraded (0.002%);  recovering 15E o/s, 4903KB/s
2013-06-08 20:25:56.786360 7f05d2b94700  0 log [INF] : pgmap v17310904: 768 pgs: 199 active, 528 active+clean, 21 active+recovery_wait, 20 peering; 1745 GB data, 3490 GB used, 2683 GB / 6359 GB avail; 4178B/s rd, 153KB/s wr, 29op/s; 51/918669 degraded (0.006%);  recovering 1 o/s, 4178KB/s
2013-06-08 20:26:00.643654 7f05d2b94700  0 log [INF] : pgmap v17310905: 768 pgs: 151 active, 564 active+clean, 32 active+recovery_wait, 20 peering, 1 active+recovering; 1745 GB data, 3490 GB used, 2683 GB / 6359 GB avail; 4913B/s rd, 143KB/s wr, 33op/s; 59/918669 degraded (0.006%);  recovering 1 o/s, 4591KB/s
2013-06-08 20:26:01.763842 7f05d2b94700  0 log [INF] : pgmap v17310906: 768 pgs: 93 active, 626 active+clean, 48 active+recovery_wait, 1 active+recovering; 1745 GB data, 3490 GB used, 2683 GB / 6359 GB avail; 4841B/s rd, 184KB/s wr, 35op/s; 73/918661 degraded (0.008%);  recovering 1 o/s, 6944KB/s
2013-06-08 20:26:05.704839 7f05d2b94700  0 log [INF] : pgmap v17310907: 768 pgs: 81 active, 638 active+clean, 47 active+recovery_wait, 2 active+recovering; 1745 GB data, 3490 GB used, 2683 GB / 6359 GB avail; 6757B/s rd, 227KB/s wr, 32op/s; 70/918657 degraded (0.008%);  recovering 1 o/s, 4966KB/s
2013-06-08 20:26:06.932379 7f05d2b94700  0 log [INF] : pgmap v17310908: 768 pgs: 697 active+clean, 64 active+recovery_wait, 7 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 92154B/s rd, 146KB/s wr, 36op/s; 61/918651 degraded (0.007%);  recovering 1 o/s, 6844KB/s
2013-06-08 20:26:10.628429 7f05d2b94700  0 log [INF] : pgmap v17310909: 768 pgs: 698 active+clean, 62 active+recovery_wait, 8 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 427KB/s rd, 308KB/s wr, 128op/s; 53/918651 degraded (0.006%);  recovering 1 o/s, 6988KB/s
2013-06-08 20:26:11.872408 7f05d2b94700  0 log [INF] : pgmap v17310910: 768 pgs: 699 active+clean, 60 active+recovery_wait, 9 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 415KB/s rd, 558KB/s wr, 145op/s; 46/918651 degraded (0.005%);  recovering 2 o/s, 8358KB/s
2013-06-08 20:26:15.702702 7f05d2b94700  0 log [INF] : pgmap v17310911: 768 pgs: 699 active+clean, 60 active+recovery_wait, 9 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 241KB/s rd, 381KB/s wr, 74op/s; 43/918651 degraded (0.005%);  recovering 1 o/s, 8190KB/s
2013-06-08 20:26:17.329549 7f05d2b94700  0 log [INF] : pgmap v17310912: 768 pgs: 699 active+clean, 54 active+recovery_wait, 15 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 309KB/s rd, 569KB/s wr, 112op/s; 33/918651 degraded (0.004%);  recovering 3 o/s, 12698KB/s
2013-06-08 20:26:20.650087 7f05d2b94700  0 log [INF] : pgmap v17310913: 768 pgs: 702 active+clean, 53 active+recovery_wait, 13 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 6532KB/s rd, 684KB/s wr, 1327op/s; 32/918639 degraded (0.003%);  recovering 3 o/s, 12659KB/s
2013-06-08 20:26:22.089918 7f05d2b94700  0 log [INF] : pgmap v17310914: 768 pgs: 709 active+clean, 47 active+recovery_wait, 12 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 9278KB/s rd, 746KB/s wr, 1448op/s; 25/918633 degraded (0.003%);  recovering 4 o/s, 15368KB/s
2013-06-08 20:26:24.013445 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183399112 avail 482802796
2013-06-08 20:26:25.654908 7f05d2b94700  0 log [INF] : pgmap v17310915: 768 pgs: 714 active+clean, 43 active+recovery_wait, 11 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 5456KB/s rd, 749KB/s wr, 331op/s; 36/918617 degraded (0.004%);  recovering 4 o/s, 17984KB/s
2013-06-08 20:26:27.157826 7f05d2b94700  0 log [INF] : pgmap v17310916: 768 pgs: 725 active+clean, 36 active+recovery_wait, 7 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 12404KB/s rd, 971KB/s wr, 605op/s; 40/918609 degraded (0.004%);  recovering 3 o/s, 15560KB/s
2013-06-08 20:26:30.561290 7f05d2b94700  0 log [INF] : pgmap v17310917: 768 pgs: 731 active+clean, 30 active+recovery_wait, 7 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 12978KB/s rd, 960KB/s wr, 1029op/s; 43/918609 degraded (0.005%);  recovering 4 o/s, 18016KB/s
2013-06-08 20:26:31.893076 7f05d2b94700  0 log [INF] : pgmap v17310918: 768 pgs: 739 active+clean, 21 active+recovery_wait, 8 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 5028KB/s rd, 699KB/s wr, 759op/s; 33/918601 degraded (0.004%);  recovering 4 o/s, 19803KB/s
2013-06-08 20:26:35.677095 7f05d2b94700  0 log [INF] : pgmap v17310919: 768 pgs: 740 active+clean, 20 active+recovery_wait, 8 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 6261KB/s rd, 560KB/s wr, 325op/s; 33/918599 degraded (0.004%);  recovering 3 o/s, 14424KB/s
2013-06-08 20:26:36.734108 7f05d2b94700  0 log [INF] : pgmap v17310920: 768 pgs: 752 active+clean, 10 active+recovery_wait, 6 active+recovering; 1745 GB data, 3489 GB used, 2683 GB / 6359 GB avail; 8897KB/s rd, 234KB/s wr, 310op/s; 19/918579 degraded (0.002%);  recovering 4 o/s, 17187KB/s
2013-06-08 20:26:40.664487 7f05d2b94700  0 log [INF] : pgmap v17310921: 768 pgs: 752 active+clean, 10 active+recovery_wait, 6 active+recovering; 1745 GB data, 3489 GB used, 2684 GB / 6359 GB avail; 5957KB/s rd, 595KB/s wr, 320op/s; 19/918555 degraded (0.002%);  recovering 3 o/s, 15565KB/s
2013-06-08 20:26:42.028894 7f05d2b94700  0 log [INF] : pgmap v17310922: 768 pgs: 765 active+clean, 3 active+recovering; 1745 GB data, 3489 GB used, 2684 GB / 6359 GB avail; 4388KB/s rd, 966KB/s wr, 346op/s; -1/918515 degraded (-0.000%);  recovering 3 o/s, 14291KB/s
2013-06-08 20:26:45.576655 7f05d2b94700  0 log [INF] : pgmap v17310923: 768 pgs: 765 active+clean, 3 active+recovering; 1745 GB data, 3489 GB used, 2684 GB / 6359 GB avail; 6884KB/s rd, 692KB/s wr, 345op/s; -1/918475 degraded (-0.000%);  recovering 3 o/s, 14538KB/s
2013-06-08 20:26:46.698675 7f05d2b94700  0 log [INF] : pgmap v17310924: 768 pgs: 768 active+clean; 1745 GB data, 3489 GB used, 2684 GB / 6359 GB avail; 11603KB/s rd, 236KB/s wr, 352op/s
2013-06-08 20:26:50.541001 7f05d2b94700  0 log [INF] : pgmap v17310925: 768 pgs: 768 active+clean; 1745 GB data, 3488 GB used, 2684 GB / 6359 GB avail; 9526KB/s rd, 198KB/s wr, 332op/s
2013-06-08 20:26:51.875663 7f05d2b94700  0 log [INF] : pgmap v17310926: 768 pgs: 768 active+clean; 1744 GB data, 3488 GB used, 2685 GB / 6359 GB avail; 7259KB/s rd, 392KB/s wr, 410op/s
2013-06-08 20:26:55.591201 7f05d2b94700  0 log [INF] : pgmap v17310927: 768 pgs: 768 active+clean; 1744 GB data, 3488 GB used, 2685 GB / 6359 GB avail; 7649KB/s rd, 373KB/s wr, 396op/s
2013-06-08 20:26:56.686470 7f05d2b94700  0 log [INF] : pgmap v17310928: 768 pgs: 768 active+clean; 1744 GB data, 3487 GB used, 2685 GB / 6359 GB avail; 7323KB/s rd, 275KB/s wr, 343op/s
2013-06-08 20:27:00.677030 7f05d2b94700  0 log [INF] : pgmap v17310929: 768 pgs: 768 active+clean; 1744 GB data, 3487 GB used, 2685 GB / 6359 GB avail; 9544KB/s rd, 286KB/s wr, 414op/s
2013-06-08 20:27:02.076378 7f05d2b94700  0 log [INF] : pgmap v17310930: 768 pgs: 768 active+clean; 1744 GB data, 3487 GB used, 2685 GB / 6359 GB avail; 10955KB/s rd, 282KB/s wr, 472op/s
2013-06-08 20:27:05.620556 7f05d2b94700  0 log [INF] : pgmap v17310931: 768 pgs: 768 active+clean; 1744 GB data, 3487 GB used, 2686 GB / 6359 GB avail; 15988KB/s rd, 428KB/s wr, 455op/s
2013-06-08 20:27:06.933975 7f05d2b94700  0 log [INF] : pgmap v17310932: 768 pgs: 768 active+clean; 1744 GB data, 3487 GB used, 2686 GB / 6359 GB avail; 25309KB/s rd, 651KB/s wr, 440op/s
2013-06-08 20:27:10.550986 7f05d2b94700  0 log [INF] : pgmap v17310933: 768 pgs: 768 active+clean; 1744 GB data, 3487 GB used, 2686 GB / 6359 GB avail; 16093KB/s rd, 526KB/s wr, 305op/s
2013-06-08 20:27:11.829468 7f05d2b94700  0 log [INF] : pgmap v17310934: 768 pgs: 768 active+clean; 1744 GB data, 3486 GB used, 2686 GB / 6359 GB avail; 4196KB/s rd, 879KB/s wr, 192op/s
2013-06-08 20:27:15.550051 7f05d2b94700  0 log [INF] : pgmap v17310935: 768 pgs: 768 active+clean; 1744 GB data, 3486 GB used, 2687 GB / 6359 GB avail; 4394KB/s rd, 854KB/s wr, 307op/s
2013-06-08 20:27:16.752701 7f05d2b94700  0 log [INF] : pgmap v17310936: 768 pgs: 768 active+clean; 1744 GB data, 3486 GB used, 2687 GB / 6359 GB avail; 5047KB/s rd, 362KB/s wr, 325op/s
2013-06-08 20:27:20.613878 7f05d2b94700  0 log [INF] : pgmap v17310937: 768 pgs: 768 active+clean; 1743 GB data, 3486 GB used, 2687 GB / 6359 GB avail; 6443KB/s rd, 1061KB/s wr, 562op/s
2013-06-08 20:27:21.742396 7f05d2b94700  0 log [INF] : pgmap v17310938: 768 pgs: 768 active+clean; 1743 GB data, 3486 GB used, 2687 GB / 6359 GB avail; 5518KB/s rd, 2589KB/s wr, 980op/s
2013-06-08 20:27:24.013578 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183401932 avail 482799976
2013-06-08 20:27:25.631662 7f05d2b94700  0 log [INF] : pgmap v17310939: 768 pgs: 768 active+clean; 1743 GB data, 3485 GB used, 2687 GB / 6359 GB avail; 3236KB/s rd, 1886KB/s wr, 700op/s
2013-06-08 20:27:26.890549 7f05d2b94700  0 log [INF] : pgmap v17310940: 768 pgs: 768 active+clean; 1743 GB data, 3485 GB used, 2688 GB / 6359 GB avail; 2314KB/s rd, 588KB/s wr, 499op/s
2013-06-08 20:27:30.577580 7f05d2b94700  0 log [INF] : pgmap v17310941: 768 pgs: 768 active+clean; 1743 GB data, 3485 GB used, 2688 GB / 6359 GB avail; 2179KB/s rd, 921KB/s wr, 512op/s
2013-06-08 20:27:31.717757 7f05d2b94700  0 log [INF] : pgmap v17310942: 768 pgs: 768 active+clean; 1743 GB data, 3484 GB used, 2688 GB / 6359 GB avail; 879KB/s rd, 1267KB/s wr, 318op/s
2013-06-08 20:27:35.538389 7f05d2b94700  0 log [INF] : pgmap v17310943: 768 pgs: 768 active+clean; 1743 GB data, 3484 GB used, 2688 GB / 6359 GB avail; 1358KB/s rd, 917KB/s wr, 346op/s
2013-06-08 20:27:36.693854 7f05d2b94700  0 log [INF] : pgmap v17310944: 768 pgs: 768 active+clean; 1743 GB data, 3484 GB used, 2689 GB / 6359 GB avail; 1499KB/s rd, 225KB/s wr, 251op/s
2013-06-08 20:27:40.591723 7f05d2b94700  0 log [INF] : pgmap v17310945: 768 pgs: 768 active+clean; 1743 GB data, 3484 GB used, 2689 GB / 6359 GB avail; 2590KB/s rd, 319KB/s wr, 176op/s
2013-06-08 20:27:41.731017 7f05d2b94700  0 log [INF] : pgmap v17310946: 768 pgs: 768 active+clean; 1742 GB data, 3484 GB used, 2689 GB / 6359 GB avail; 4505KB/s rd, 231KB/s wr, 215op/s
2013-06-08 20:27:45.722008 7f05d2b94700  0 log [INF] : pgmap v17310947: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2689 GB / 6359 GB avail; 3015KB/s rd, 146KB/s wr, 242op/s
2013-06-08 20:27:46.848882 7f05d2b94700  0 log [INF] : pgmap v17310948: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2689 GB / 6359 GB avail; 1181KB/s rd, 211KB/s wr, 258op/s
2013-06-08 20:27:50.564373 7f05d2b94700  0 log [INF] : pgmap v17310949: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 1460KB/s rd, 248KB/s wr, 325op/s
2013-06-08 20:27:51.938020 7f05d2b94700  0 log [INF] : pgmap v17310950: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 1702KB/s rd, 190KB/s wr, 320op/s
2013-06-08 20:27:55.641503 7f05d2b94700  0 log [INF] : pgmap v17310951: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 905KB/s rd, 182KB/s wr, 165op/s
2013-06-08 20:27:56.898073 7f05d2b94700  0 log [INF] : pgmap v17310952: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 7283B/s rd, 354KB/s wr, 46op/s
2013-06-08 20:28:00.542653 7f05d2b94700  0 log [INF] : pgmap v17310953: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 194KB/s rd, 353KB/s wr, 52op/s
2013-06-08 20:28:01.797859 7f05d2b94700  0 log [INF] : pgmap v17310954: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 208KB/s rd, 300KB/s wr, 53op/s
2013-06-08 20:28:05.531524 7f05d2b94700  0 log [INF] : pgmap v17310955: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 6823KB/s rd, 304KB/s wr, 100op/s
2013-06-08 20:28:06.914065 7f05d2b94700  0 log [INF] : pgmap v17310956: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 9340KB/s rd, 540KB/s wr, 115op/s
2013-06-08 20:28:10.705717 7f05d2b94700  0 log [INF] : pgmap v17310957: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 2652KB/s rd, 774KB/s wr, 100op/s
2013-06-08 20:28:12.276809 7f05d2b94700  0 log [INF] : pgmap v17310958: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 204KB/s rd, 1358KB/s wr, 164op/s
2013-06-08 20:28:15.637075 7f05d2b94700  0 log [INF] : pgmap v17310959: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 205KB/s rd, 1108KB/s wr, 122op/s
2013-06-08 20:28:17.038885 7f05d2b94700  0 log [INF] : pgmap v17310960: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 364KB/s rd, 254KB/s wr, 39op/s
2013-06-08 20:28:20.540488 7f05d2b94700  0 log [INF] : pgmap v17310961: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 426KB/s rd, 253KB/s wr, 42op/s
2013-06-08 20:28:21.716121 7f05d2b94700  0 log [INF] : pgmap v17310962: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 364KB/s rd, 136KB/s wr, 29op/s
2013-06-08 20:28:24.013718 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183404056 avail 482797852
2013-06-08 20:28:25.623357 7f05d2b94700  0 log [INF] : pgmap v17310963: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 284KB/s rd, 214KB/s wr, 31op/s
2013-06-08 20:28:26.805809 7f05d2b94700  0 log [INF] : pgmap v17310964: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 4863B/s rd, 753KB/s wr, 78op/s
2013-06-08 20:28:30.650162 7f05d2b94700  0 log [INF] : pgmap v17310965: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 5733B/s rd, 705KB/s wr, 81op/s
2013-06-08 20:28:31.803551 7f05d2b94700  0 log [INF] : pgmap v17310966: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 264KB/s rd, 299KB/s wr, 60op/s
2013-06-08 20:28:35.557523 7f05d2b94700  0 log [INF] : pgmap v17310967: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 264KB/s rd, 302KB/s wr, 56op/s
2013-06-08 20:28:36.944374 7f05d2b94700  0 log [INF] : pgmap v17310968: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 3324B/s rd, 210KB/s wr, 31op/s
2013-06-08 20:28:40.544778 7f05d2b94700  0 log [INF] : pgmap v17310969: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 5732B/s rd, 1256KB/s wr, 38op/s
2013-06-08 20:28:41.740564 7f05d2b94700  0 log [INF] : pgmap v17310970: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 5741B/s rd, 4475KB/s wr, 33op/s
2013-06-08 20:28:45.584728 7f05d2b94700  0 log [INF] : pgmap v17310971: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 43397B/s rd, 3459KB/s wr, 34op/s
2013-06-08 20:28:46.785569 7f05d2b94700  0 log [INF] : pgmap v17310972: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 287KB/s rd, 262KB/s wr, 36op/s
2013-06-08 20:28:50.649594 7f05d2b94700  0 log [INF] : pgmap v17310973: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 268KB/s rd, 214KB/s wr, 35op/s
2013-06-08 20:28:51.769056 7f05d2b94700  0 log [INF] : pgmap v17310974: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 182KB/s rd, 126KB/s wr, 28op/s
2013-06-08 20:28:55.634932 7f05d2b94700  0 log [INF] : pgmap v17310975: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 167KB/s rd, 203KB/s wr, 30op/s
2013-06-08 20:28:56.834607 7f05d2b94700  0 log [INF] : pgmap v17310976: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 96941B/s rd, 317KB/s wr, 43op/s
2013-06-08 20:29:00.545670 7f05d2b94700  0 log [INF] : pgmap v17310977: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 96635B/s rd, 246KB/s wr, 38op/s
2013-06-08 20:29:02.156716 7f05d2b94700  0 log [INF] : pgmap v17310978: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 374KB/s rd, 228KB/s wr, 39op/s
2013-06-08 20:29:05.558198 7f05d2b94700  0 log [INF] : pgmap v17310979: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 396KB/s rd, 347KB/s wr, 46op/s
2013-06-08 20:29:06.673040 7f05d2b94700  0 log [INF] : pgmap v17310980: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 258KB/s rd, 646KB/s wr, 68op/s
2013-06-08 20:29:10.540656 7f05d2b94700  0 log [INF] : pgmap v17310981: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 236KB/s rd, 558KB/s wr, 59op/s
2013-06-08 20:29:11.806911 7f05d2b94700  0 log [INF] : pgmap v17310982: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 90281B/s rd, 701KB/s wr, 65op/s
2013-06-08 20:29:15.721033 7f05d2b94700  0 log [INF] : pgmap v17310983: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 87626B/s rd, 631KB/s wr, 59op/s
2013-06-08 20:29:17.006503 7f05d2b94700  0 log [INF] : pgmap v17310984: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 249KB/s rd, 73134B/s wr, 17op/s
2013-06-08 20:29:20.611624 7f05d2b94700  0 log [INF] : pgmap v17310985: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 261KB/s rd, 99920B/s wr, 21op/s
2013-06-08 20:29:21.715112 7f05d2b94700  0 log [INF] : pgmap v17310986: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 350KB/s rd, 311KB/s wr, 53op/s
2013-06-08 20:29:24.013875 7f05d3395700  0 mon.0@0(leader).data_health(34350) update_stats avail 68% total 701854104 used 183405880 avail 482796028
2013-06-08 20:29:25.606006 7f05d2b94700  0 log [INF] : pgmap v17310987: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 998KB/s rd, 347KB/s wr, 93op/s
2013-06-08 20:29:26.838764 7f05d2b94700  0 log [INF] : pgmap v17310988: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 1993KB/s rd, 623KB/s wr, 188op/s
2013-06-08 20:29:30.624603 7f05d2b94700  0 log [INF] : pgmap v17310989: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 1372KB/s rd, 597KB/s wr, 153op/s
2013-06-08 20:29:31.885869 7f05d2b94700  0 log [INF] : pgmap v17310990: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 203KB/s rd, 622KB/s wr, 84op/s
2013-06-08 20:29:35.675525 7f05d2b94700  0 log [INF] : pgmap v17310991: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 214KB/s rd, 677KB/s wr, 90op/s
2013-06-08 20:29:37.123236 7f05d2b94700  0 log [INF] : pgmap v17310992: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 181KB/s rd, 307KB/s wr, 70op/s
2013-06-08 20:29:40.725133 7f05d2b94700  0 log [INF] : pgmap v17310993: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 147KB/s rd, 523KB/s wr, 103op/s
2013-06-08 20:29:41.829435 7f05d2b94700  0 log [INF] : pgmap v17310994: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 5780B/s rd, 900KB/s wr, 128op/s
2013-06-08 20:29:45.605111 7f05d2b94700  0 log [INF] : pgmap v17310995: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 3276B/s rd, 636KB/s wr, 86op/s
2013-06-08 20:29:46.965575 7f05d2b94700  0 log [INF] : pgmap v17310996: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 3315B/s rd, 140KB/s wr, 24op/s
2013-06-08 20:29:50.637184 7f05d2b94700  0 log [INF] : pgmap v17310997: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 4912B/s rd, 119KB/s wr, 26op/s
2013-06-08 20:29:51.882554 7f05d2b94700  0 log [INF] : pgmap v17310998: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 4841B/s rd, 115KB/s wr, 20op/s
2013-06-08 20:29:55.618473 7f05d2b94700  0 log [INF] : pgmap v17310999: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 4096B/s rd, 152KB/s wr, 24op/s
2013-06-08 20:29:56.963372 7f05d2b94700  0 log [INF] : pgmap v17311000: 768 pgs: 768 active+clean; 1742 GB data, 3483 GB used, 2690 GB / 6359 GB avail; 4886B/s rd, 224KB/s wr, 39op/s

[-- Attachment #5: Type: text/plain, Size: 178 bytes --]

_______________________________________________
ceph-users mailing list
ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [ceph-users] rbd rm <image> results in osd marked down wrongly with 0.61.3
  2013-06-11 14:19 rbd rm <image> results in osd marked down wrongly with 0.61.3 Smart Weblications GmbH - Florian Wiessner
@ 2013-06-13 12:25 ` Smart Weblications GmbH - Florian Wiessner
       [not found]   ` <51B9BA40.6040901-o+pLhCRhXQuTURD7UP6EnqXJknND6eY5@public.gmane.org>
  0 siblings, 1 reply; 5+ messages in thread
From: Smart Weblications GmbH - Florian Wiessner @ 2013-06-13 12:25 UTC (permalink / raw)
  Cc: ceph-devel, ceph-users

Hi,

Is really no one on the list interrested in fixing this? Or am i the only one
having this kind of bug/problem?

Am 11.06.2013 16:19, schrieb Smart Weblications GmbH - Florian Wiessner:
> Hi List,
> 
> i observed that an rbd rm <image> results in some osds mark one osd as down
> wrongly in cuttlefish.
> 
> The situation gets even worse if there are more than one rbd rm <image> running
> in parallel.
> 
> Please see attached logfiles. The rbd rm command was issued on 20:24:00 via
> cronjob, 40 seconds later the osd 6 got marked down...
> 
> 
> ceph osd tree
> 
> # id    weight  type name       up/down reweight
> -1      7       pool default
> -3      7               rack unknownrack
> -2      1                       host node01
> 0       1                               osd.0   up      1
> -4      1                       host node02
> 1       1                               osd.1   up      1
> -5      1                       host node03
> 2       1                               osd.2   up      1
> -6      1                       host node04
> 3       1                               osd.3   up      1
> -7      1                       host node06
> 5       1                               osd.5   up      1
> -8      1                       host node05
> 4       1                               osd.4   up      1
> -9      1                       host node07
> 6       1                               osd.6   up      1
> 
> 
> I have seen some patches to parallelize rbd rm, but i think there must be some
> other issue, as my clients seem to not be able to do IO when ceph is
> recovering... I think this has worked better in 0.56.x - there was IO while
> recovering.
> 
> I also observed in the log of osd.6 that after heartbeat_map reset_timeout, the
> osd tries to connect to the other osds, but it retries so fast that you could
> think this is a DoS attack...
> 
> 
> Please advise..
> 


-- 

Mit freundlichen Grüßen,

Florian Wiessner

Smart Weblications GmbH
Martinsberger Str. 1
D-95119 Naila

fon.: +49 9282 9638 200
fax.: +49 9282 9638 205
24/7: +49 900 144 000 00 - 0,99 EUR/Min*
http://www.smart-weblications.de

--
Sitz der Gesellschaft: Naila
Geschäftsführer: Florian Wiessner
HRB-Nr.: HRB 3840 Amtsgericht Hof
*aus dem dt. Festnetz, ggf. abweichende Preise aus dem Mobilfunknetz
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: rbd rm <image> results in osd marked down wrongly with 0.61.3
       [not found]   ` <51B9BA40.6040901-o+pLhCRhXQuTURD7UP6EnqXJknND6eY5@public.gmane.org>
@ 2013-06-13 14:59     ` Sage Weil
  2013-06-17 22:50     ` Sage Weil
  1 sibling, 0 replies; 5+ messages in thread
From: Sage Weil @ 2013-06-13 14:59 UTC (permalink / raw)
  To: Smart Weblications GmbH - Florian Wiessner
  Cc: ceph-devel-u79uwXL29TY76Z2rM5mHXA, ceph-users-idqoXFIVOFJgJs9I8MT0rw

Hi Florian,

Sorry, I missed this one.  Since this is fully reproducible, can you 
generate a log of the crash by doing something like

 ceph osd tell \* injectargs '--debug-osd 20 --debug-filestore 20 --debug-ms 20'

(that is a lot of logging, btw), triggering a crash, and then sending us 
the log on the failed osd?  You'll want to turn the logs down again after 
with

 ceph osd tell \* injectargs '--debug-osd 0 --debug-filestore 0 --debug-ms 0'

I've opened a ticket for this,

Thanks!
sage


On Thu, 13 Jun 2013, Smart Weblications GmbH - Florian Wiessner wrote:

> Hi,
> 
> Is really no one on the list interrested in fixing this? Or am i the only one
> having this kind of bug/problem?
> 
> Am 11.06.2013 16:19, schrieb Smart Weblications GmbH - Florian Wiessner:
> > Hi List,
> > 
> > i observed that an rbd rm <image> results in some osds mark one osd as down
> > wrongly in cuttlefish.
> > 
> > The situation gets even worse if there are more than one rbd rm <image> running
> > in parallel.
> > 
> > Please see attached logfiles. The rbd rm command was issued on 20:24:00 via
> > cronjob, 40 seconds later the osd 6 got marked down...
> > 
> > 
> > ceph osd tree
> > 
> > # id    weight  type name       up/down reweight
> > -1      7       pool default
> > -3      7               rack unknownrack
> > -2      1                       host node01
> > 0       1                               osd.0   up      1
> > -4      1                       host node02
> > 1       1                               osd.1   up      1
> > -5      1                       host node03
> > 2       1                               osd.2   up      1
> > -6      1                       host node04
> > 3       1                               osd.3   up      1
> > -7      1                       host node06
> > 5       1                               osd.5   up      1
> > -8      1                       host node05
> > 4       1                               osd.4   up      1
> > -9      1                       host node07
> > 6       1                               osd.6   up      1
> > 
> > 
> > I have seen some patches to parallelize rbd rm, but i think there must be some
> > other issue, as my clients seem to not be able to do IO when ceph is
> > recovering... I think this has worked better in 0.56.x - there was IO while
> > recovering.
> > 
> > I also observed in the log of osd.6 that after heartbeat_map reset_timeout, the
> > osd tries to connect to the other osds, but it retries so fast that you could
> > think this is a DoS attack...
> > 
> > 
> > Please advise..
> > 
> 
> 
> -- 
> 
> Mit freundlichen Gr??en,
> 
> Florian Wiessner
> 
> Smart Weblications GmbH
> Martinsberger Str. 1
> D-95119 Naila
> 
> fon.: +49 9282 9638 200
> fax.: +49 9282 9638 205
> 24/7: +49 900 144 000 00 - 0,99 EUR/Min*
> http://www.smart-weblications.de
> 
> --
> Sitz der Gesellschaft: Naila
> Gesch?ftsf?hrer: Florian Wiessner
> HRB-Nr.: HRB 3840 Amtsgericht Hof
> *aus dem dt. Festnetz, ggf. abweichende Preise aus dem Mobilfunknetz
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> 

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: rbd rm <image> results in osd marked down wrongly with 0.61.3
       [not found]   ` <51B9BA40.6040901-o+pLhCRhXQuTURD7UP6EnqXJknND6eY5@public.gmane.org>
  2013-06-13 14:59     ` Sage Weil
@ 2013-06-17 22:50     ` Sage Weil
  2013-06-26  0:30       ` [ceph-users] " Sage Weil
  1 sibling, 1 reply; 5+ messages in thread
From: Sage Weil @ 2013-06-17 22:50 UTC (permalink / raw)
  To: Smart Weblications GmbH - Florian Wiessner
  Cc: ceph-devel-u79uwXL29TY76Z2rM5mHXA, ceph-users-idqoXFIVOFJgJs9I8MT0rw

Hi Florian,

If you can trigger this with logs, we're very eager to see what they say 
about this!  The http://tracker.ceph.com/issues/5336 bug is open to track 
this issue.

Thanks!
sage


On Thu, 13 Jun 2013, Smart Weblications GmbH - Florian Wiessner wrote:

> Hi,
> 
> Is really no one on the list interrested in fixing this? Or am i the only one
> having this kind of bug/problem?
> 
> Am 11.06.2013 16:19, schrieb Smart Weblications GmbH - Florian Wiessner:
> > Hi List,
> > 
> > i observed that an rbd rm <image> results in some osds mark one osd as down
> > wrongly in cuttlefish.
> > 
> > The situation gets even worse if there are more than one rbd rm <image> running
> > in parallel.
> > 
> > Please see attached logfiles. The rbd rm command was issued on 20:24:00 via
> > cronjob, 40 seconds later the osd 6 got marked down...
> > 
> > 
> > ceph osd tree
> > 
> > # id    weight  type name       up/down reweight
> > -1      7       pool default
> > -3      7               rack unknownrack
> > -2      1                       host node01
> > 0       1                               osd.0   up      1
> > -4      1                       host node02
> > 1       1                               osd.1   up      1
> > -5      1                       host node03
> > 2       1                               osd.2   up      1
> > -6      1                       host node04
> > 3       1                               osd.3   up      1
> > -7      1                       host node06
> > 5       1                               osd.5   up      1
> > -8      1                       host node05
> > 4       1                               osd.4   up      1
> > -9      1                       host node07
> > 6       1                               osd.6   up      1
> > 
> > 
> > I have seen some patches to parallelize rbd rm, but i think there must be some
> > other issue, as my clients seem to not be able to do IO when ceph is
> > recovering... I think this has worked better in 0.56.x - there was IO while
> > recovering.
> > 
> > I also observed in the log of osd.6 that after heartbeat_map reset_timeout, the
> > osd tries to connect to the other osds, but it retries so fast that you could
> > think this is a DoS attack...
> > 
> > 
> > Please advise..
> > 
> 
> 
> -- 
> 
> Mit freundlichen Gr??en,
> 
> Florian Wiessner
> 
> Smart Weblications GmbH
> Martinsberger Str. 1
> D-95119 Naila
> 
> fon.: +49 9282 9638 200
> fax.: +49 9282 9638 205
> 24/7: +49 900 144 000 00 - 0,99 EUR/Min*
> http://www.smart-weblications.de
> 
> --
> Sitz der Gesellschaft: Naila
> Gesch?ftsf?hrer: Florian Wiessner
> HRB-Nr.: HRB 3840 Amtsgericht Hof
> *aus dem dt. Festnetz, ggf. abweichende Preise aus dem Mobilfunknetz
> _______________________________________________
> ceph-users mailing list
> ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
> 

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [ceph-users] rbd rm <image> results in osd marked down wrongly with 0.61.3
  2013-06-17 22:50     ` Sage Weil
@ 2013-06-26  0:30       ` Sage Weil
  0 siblings, 0 replies; 5+ messages in thread
From: Sage Weil @ 2013-06-26  0:30 UTC (permalink / raw)
  To: Smart Weblications GmbH - Florian Wiessner; +Cc: ceph-devel, ceph-users

On Mon, 17 Jun 2013, Sage Weil wrote:
> Hi Florian,
> 
> If you can trigger this with logs, we're very eager to see what they say 
> about this!  The http://tracker.ceph.com/issues/5336 bug is open to track 
> this issue.

Downgrading this bug until we hear back.

sage

> 
> Thanks!
> sage
> 
> 
> On Thu, 13 Jun 2013, Smart Weblications GmbH - Florian Wiessner wrote:
> 
> > Hi,
> > 
> > Is really no one on the list interrested in fixing this? Or am i the only one
> > having this kind of bug/problem?
> > 
> > Am 11.06.2013 16:19, schrieb Smart Weblications GmbH - Florian Wiessner:
> > > Hi List,
> > > 
> > > i observed that an rbd rm <image> results in some osds mark one osd as down
> > > wrongly in cuttlefish.
> > > 
> > > The situation gets even worse if there are more than one rbd rm <image> running
> > > in parallel.
> > > 
> > > Please see attached logfiles. The rbd rm command was issued on 20:24:00 via
> > > cronjob, 40 seconds later the osd 6 got marked down...
> > > 
> > > 
> > > ceph osd tree
> > > 
> > > # id    weight  type name       up/down reweight
> > > -1      7       pool default
> > > -3      7               rack unknownrack
> > > -2      1                       host node01
> > > 0       1                               osd.0   up      1
> > > -4      1                       host node02
> > > 1       1                               osd.1   up      1
> > > -5      1                       host node03
> > > 2       1                               osd.2   up      1
> > > -6      1                       host node04
> > > 3       1                               osd.3   up      1
> > > -7      1                       host node06
> > > 5       1                               osd.5   up      1
> > > -8      1                       host node05
> > > 4       1                               osd.4   up      1
> > > -9      1                       host node07
> > > 6       1                               osd.6   up      1
> > > 
> > > 
> > > I have seen some patches to parallelize rbd rm, but i think there must be some
> > > other issue, as my clients seem to not be able to do IO when ceph is
> > > recovering... I think this has worked better in 0.56.x - there was IO while
> > > recovering.
> > > 
> > > I also observed in the log of osd.6 that after heartbeat_map reset_timeout, the
> > > osd tries to connect to the other osds, but it retries so fast that you could
> > > think this is a DoS attack...
> > > 
> > > 
> > > Please advise..
> > > 
> > 
> > 
> > -- 
> > 
> > Mit freundlichen Gr??en,
> > 
> > Florian Wiessner
> > 
> > Smart Weblications GmbH
> > Martinsberger Str. 1
> > D-95119 Naila
> > 
> > fon.: +49 9282 9638 200
> > fax.: +49 9282 9638 205
> > 24/7: +49 900 144 000 00 - 0,99 EUR/Min*
> > http://www.smart-weblications.de
> > 
> > --
> > Sitz der Gesellschaft: Naila
> > Gesch?ftsf?hrer: Florian Wiessner
> > HRB-Nr.: HRB 3840 Amtsgericht Hof
> > *aus dem dt. Festnetz, ggf. abweichende Preise aus dem Mobilfunknetz
> > _______________________________________________
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> > 
> > 
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
> 

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2013-06-26  0:30 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2013-06-11 14:19 rbd rm <image> results in osd marked down wrongly with 0.61.3 Smart Weblications GmbH - Florian Wiessner
2013-06-13 12:25 ` [ceph-users] " Smart Weblications GmbH - Florian Wiessner
     [not found]   ` <51B9BA40.6040901-o+pLhCRhXQuTURD7UP6EnqXJknND6eY5@public.gmane.org>
2013-06-13 14:59     ` Sage Weil
2013-06-17 22:50     ` Sage Weil
2013-06-26  0:30       ` [ceph-users] " Sage Weil

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.