Re: OSD Hardware questions

[Stefan Priebe - Profihost AG <s.priebe@profihost.ag>]

Am 29.06.2012 13:37, schrieb Mark Nelson:
> On 6/28/12 4:25 PM, Stefan Priebe wrote:
>> Am 28.06.2012 17:33, schrieb Sage Weil:
>>> Have you tried adjusting 'osd op threads'? The default is 2, but bumping
>>> that to, say, 8, might give you better concurrency and throughput.
>> For me this doesn't change anything. I believe the ceph-osd processes
>> are the problem. I mean i've 8 cores x 3,6Ghz and 4 ceph-osd processses
>> use around 80%.
>>
>>> "Mark Nelson" <mark.nelson@inktank.com> wrote:
>>>> It would be interesting to see where all your CPU time is being spent.
>>>> What benchmark are you using to do the random writes?
>>>
>>> Definitely. Seeing perf/oprofile/whatever results for the osd under that
>>> workload would be very interesting! We need to get perf going in our
>>> testing environment...
>> I have it working. But even a call graph of 10s is around 120 000 lines
>> long ?!
>>
>> Stefan
>
> What tool did you use to do the profiling?

i used the perf tool bundled with the kernel source. I can send you the 
perf.data file if you want. But i don't see anything interesting. But 
maybe i've just used perf the wrong way.

Stefan