* RE: load-gen from an osd node
@ 2015-06-29 22:27 Deneau, Tom
2015-07-01 16:04 ` Gregory Farnum
0 siblings, 1 reply; 5+ messages in thread
From: Deneau, Tom @ 2015-06-29 22:27 UTC (permalink / raw)
To: ceph-devel
Oh, I just noticed that the client nodes I spoke of where load-gen actually worked were
running 0.94, not 9.0.1. And when I upgrade them to 9.0.1, load-gen no longer works.
So more likely this is just a problem with newer rados load-gens
-- Tom
> -----Original Message-----
> From: Deneau, Tom
> Sent: Friday, June 26, 2015 7:48 PM
> To: ceph-devel
> Subject: load-gen from an osd node
>
> I am running 9.0.1 and I noticed when I run rados load-gen from one of the
> osd nodes, it creates the objects but then always reports a throughput of 0
> MB/sec.
>
> But if I run it from a separate client node, it works fine.
> Why would this be?
>
> I'm not sure but I thought in earlier versions load-gen could be run from an
> osd node.
>
> -- Tom Deneau
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: load-gen from an osd node
2015-06-29 22:27 load-gen from an osd node Deneau, Tom
@ 2015-07-01 16:04 ` Gregory Farnum
2015-07-08 16:17 ` Deneau, Tom
0 siblings, 1 reply; 5+ messages in thread
From: Gregory Farnum @ 2015-07-01 16:04 UTC (permalink / raw)
To: Deneau, Tom; +Cc: ceph-devel
Hmm, the only changes I see between those two versions are some pretty
precise cleanups which shouldn't cause this. But it means that a
bisect or determined look should be easy. Can you create a ticket
which includes the exact output you're seeing and the exact versions
you're running?
-Greg
On Mon, Jun 29, 2015 at 11:27 PM, Deneau, Tom <tom.deneau@amd.com> wrote:
> Oh, I just noticed that the client nodes I spoke of where load-gen actually worked were
> running 0.94, not 9.0.1. And when I upgrade them to 9.0.1, load-gen no longer works.
>
> So more likely this is just a problem with newer rados load-gens
>
> -- Tom
>
>
>
>> -----Original Message-----
>> From: Deneau, Tom
>> Sent: Friday, June 26, 2015 7:48 PM
>> To: ceph-devel
>> Subject: load-gen from an osd node
>>
>> I am running 9.0.1 and I noticed when I run rados load-gen from one of the
>> osd nodes, it creates the objects but then always reports a throughput of 0
>> MB/sec.
>>
>> But if I run it from a separate client node, it works fine.
>> Why would this be?
>>
>> I'm not sure but I thought in earlier versions load-gen could be run from an
>> osd node.
>>
>> -- Tom Deneau
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 5+ messages in thread
* RE: load-gen from an osd node
2015-07-01 16:04 ` Gregory Farnum
@ 2015-07-08 16:17 ` Deneau, Tom
2015-07-10 10:25 ` Gregory Farnum
0 siblings, 1 reply; 5+ messages in thread
From: Deneau, Tom @ 2015-07-08 16:17 UTC (permalink / raw)
To: Gregory Farnum; +Cc: ceph-devel
With the newer rados, just running rados -p somepool load-gen, we get
preparing 200 objects
load-gen will run 60 seconds
1: throughput=0MB/sec pending data=0
2: throughput=0MB/sec pending data=0
3: throughput=0MB/sec pending data=0
4: throughput=0MB/sec pending data=0
5: throughput=0MB/sec pending data=0
6: throughput=0MB/sec pending data=0
But I see the change that caused this behavior was explicitly initializing lg.max_ops to 0.
Before this, max_ops was just whatever happened to be in memory.
So the newer load-gen works fine as long as you explicitly set --max-ops on the command line.
-- Tom Deneau
> -----Original Message-----
> From: Gregory Farnum [mailto:greg@gregs42.com]
> Sent: Wednesday, July 01, 2015 11:05 AM
> To: Deneau, Tom
> Cc: ceph-devel
> Subject: Re: load-gen from an osd node
>
> Hmm, the only changes I see between those two versions are some pretty
> precise cleanups which shouldn't cause this. But it means that a bisect or
> determined look should be easy. Can you create a ticket which includes the
> exact output you're seeing and the exact versions you're running?
> -Greg
>
> On Mon, Jun 29, 2015 at 11:27 PM, Deneau, Tom <tom.deneau@amd.com> wrote:
> > Oh, I just noticed that the client nodes I spoke of where load-gen
> > actually worked were running 0.94, not 9.0.1. And when I upgrade them to
> 9.0.1, load-gen no longer works.
> >
> > So more likely this is just a problem with newer rados load-gens
> >
> > -- Tom
> >
> >
> >
> >> -----Original Message-----
> >> From: Deneau, Tom
> >> Sent: Friday, June 26, 2015 7:48 PM
> >> To: ceph-devel
> >> Subject: load-gen from an osd node
> >>
> >> I am running 9.0.1 and I noticed when I run rados load-gen from one
> >> of the osd nodes, it creates the objects but then always reports a
> >> throughput of 0 MB/sec.
> >>
> >> But if I run it from a separate client node, it works fine.
> >> Why would this be?
> >>
> >> I'm not sure but I thought in earlier versions load-gen could be run
> >> from an osd node.
> >>
> >> -- Tom Deneau
> > --
> > To unsubscribe from this list: send the line "unsubscribe ceph-devel"
> > in the body of a message to majordomo@vger.kernel.org More majordomo
> > info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: load-gen from an osd node
2015-07-08 16:17 ` Deneau, Tom
@ 2015-07-10 10:25 ` Gregory Farnum
0 siblings, 0 replies; 5+ messages in thread
From: Gregory Farnum @ 2015-07-10 10:25 UTC (permalink / raw)
To: Deneau, Tom; +Cc: ceph-devel
On Wed, Jul 8, 2015 at 5:17 PM, Deneau, Tom <tom.deneau@amd.com> wrote:
> With the newer rados, just running rados -p somepool load-gen, we get
>
> preparing 200 objects
> load-gen will run 60 seconds
> 1: throughput=0MB/sec pending data=0
> 2: throughput=0MB/sec pending data=0
> 3: throughput=0MB/sec pending data=0
> 4: throughput=0MB/sec pending data=0
> 5: throughput=0MB/sec pending data=0
> 6: throughput=0MB/sec pending data=0
>
> But I see the change that caused this behavior was explicitly initializing lg.max_ops to 0.
> Before this, max_ops was just whatever happened to be in memory.
>
> So the newer load-gen works fine as long as you explicitly set --max-ops on the command line.
Can you create a ticket on the tracker describing this issue? That's
the kind of thing we'll want to fix. ;)
-Greg
>
> -- Tom Deneau
>
>
>> -----Original Message-----
>> From: Gregory Farnum [mailto:greg@gregs42.com]
>> Sent: Wednesday, July 01, 2015 11:05 AM
>> To: Deneau, Tom
>> Cc: ceph-devel
>> Subject: Re: load-gen from an osd node
>>
>> Hmm, the only changes I see between those two versions are some pretty
>> precise cleanups which shouldn't cause this. But it means that a bisect or
>> determined look should be easy. Can you create a ticket which includes the
>> exact output you're seeing and the exact versions you're running?
>> -Greg
>>
>> On Mon, Jun 29, 2015 at 11:27 PM, Deneau, Tom <tom.deneau@amd.com> wrote:
>> > Oh, I just noticed that the client nodes I spoke of where load-gen
>> > actually worked were running 0.94, not 9.0.1. And when I upgrade them to
>> 9.0.1, load-gen no longer works.
>> >
>> > So more likely this is just a problem with newer rados load-gens
>> >
>> > -- Tom
>> >
>> >
>> >
>> >> -----Original Message-----
>> >> From: Deneau, Tom
>> >> Sent: Friday, June 26, 2015 7:48 PM
>> >> To: ceph-devel
>> >> Subject: load-gen from an osd node
>> >>
>> >> I am running 9.0.1 and I noticed when I run rados load-gen from one
>> >> of the osd nodes, it creates the objects but then always reports a
>> >> throughput of 0 MB/sec.
>> >>
>> >> But if I run it from a separate client node, it works fine.
>> >> Why would this be?
>> >>
>> >> I'm not sure but I thought in earlier versions load-gen could be run
>> >> from an osd node.
>> >>
>> >> -- Tom Deneau
>> > --
>> > To unsubscribe from this list: send the line "unsubscribe ceph-devel"
>> > in the body of a message to majordomo@vger.kernel.org More majordomo
>> > info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 5+ messages in thread
* load-gen from an osd node
@ 2015-06-27 0:48 Deneau, Tom
0 siblings, 0 replies; 5+ messages in thread
From: Deneau, Tom @ 2015-06-27 0:48 UTC (permalink / raw)
To: ceph-devel
I am running 9.0.1 and I noticed when I run rados load-gen from one of the osd nodes,
it creates the objects but then always reports a throughput of 0 MB/sec.
But if I run it from a separate client node, it works fine.
Why would this be?
I'm not sure but I thought in earlier versions load-gen could be run from an osd node.
-- Tom Deneau
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2015-07-10 10:25 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-06-29 22:27 load-gen from an osd node Deneau, Tom
2015-07-01 16:04 ` Gregory Farnum
2015-07-08 16:17 ` Deneau, Tom
2015-07-10 10:25 ` Gregory Farnum
-- strict thread matches above, loose matches on Subject: below --
2015-06-27 0:48 Deneau, Tom
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.