Re: Slow request warnings on 0.48

[Gregory Farnum <greg@inktank.com>]

That's odd — there isn't too much that went into the OSD between 0.47 and 0.48 that I can think of, and most of that only impact OSDs when they go through bootup. What does ceph -s display — are all the PGs healthy?  
-Greg


On Wednesday, July 4, 2012 at 9:58 AM, Alexandre DERUMIER wrote:

> Hi, I see same messages here after upgrade to 0.48.
>  
> with random write benchmark.
>  
> I have more lags than before with 0.47 (but disks are at 100% usage, so can't tell if it's normal or not)
>  
>  
> ----- Mail original -----  
>  
> De: "David Blundell" <David.Blundell@100percentit.com (mailto:David.Blundell@100percentit.com)>  
> À: ceph-devel@vger.kernel.org (mailto:ceph-devel@vger.kernel.org)  
> Envoyé: Mercredi 4 Juillet 2012 18:53:02  
> Objet: Slow request warnings on 0.48  
>  
> I have three servers running mon and osd using Ubuntu 12.04 that I have been testing with RADOS storing RBD KVM instances  
>  
> 0.47.3 worked extremely well (once I got over a few btrfs issues). The same servers running 0.48 give a large number of "[WRN] slow request" messages whenever I generate a lot of random IO in the KVM instances using iozone. The slow responses eventually leads to disk timeouts on the KVM instances.  
>  
> I have erased the osds and recreated on new btrfs volumes with the same result.  
>  
> I have also tried switching to xfs using mkfs.xfs -n size=64k with noatime, inode64,delaylog,logbufs=8,logbsize=256k  
>  
> Xfs gives the same result - the iozone tests run fine until the random IO starts and then there are lots of slow request warnings.  
>  
> Does anyone have any ideas about the best place to start troubleshooting / debugging?  
>  
> Thanks,  
>  
> David  
> --  
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in  
> the body of a message to majordomo@vger.kernel.org (mailto:majordomo@vger.kernel.org)  
> More majordomo info at http://vger.kernel.org/majordomo-info.html  
>  
>  
>  
> --  
>  
> --  
>  
>  
>  
>  
> Alexandre D e rumier  
>  
> Ingénieur Systèmes et Réseaux  
>  
>  
> Fixe : 03 20 68 88 85  
>  
> Fax : 03 20 68 90 88  
>  
>  
> 45 Bvd du Général Leclerc 59100 Roubaix  
> 12 rue Marivaux 75002 Paris  
>  
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org (mailto:majordomo@vger.kernel.org)
> More majordomo info at http://vger.kernel.org/majordomo-info.html



--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html