12.2.2 status

12.2.2 status

[Abhishek Lekshmanan]

A first round of PRs were tested on Luminous integration branch, results
updated at http://tracker.ceph.com/issues/21830,
RADOS suite was green, RBD, RGW & FS hit some known failures

ceph-disk has hit a failure with dmcrypt, details at
http://tracker.ceph.com/issues/21830#note-10 which doesn't seem to have
occured in QE runs before but there is a bug report, is anyone aware of
past issues with ceph-disk & dmcrypt?

Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
critical PRs that we need to have in 12.2.2 so that we can include
them in the next round of testing before handing over to QE?

Best,
Abhishek & Karol

Re: 12.2.2 status

[Jason Dillaman]

I would like to see the following additional tickets:

http://tracker.ceph.com/issues/21918
http://tracker.ceph.com/issues/21688
http://tracker.ceph.com/issues/21914

Thanks,

On Thu, Oct 26, 2017 at 11:19 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
>
> A first round of PRs were tested on Luminous integration branch, results
> updated at http://tracker.ceph.com/issues/21830,
> RADOS suite was green, RBD, RGW & FS hit some known failures
>
> ceph-disk has hit a failure with dmcrypt, details at
> http://tracker.ceph.com/issues/21830#note-10 which doesn't seem to have
> occured in QE runs before but there is a bug report, is anyone aware of
> past issues with ceph-disk & dmcrypt?
>
> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
> critical PRs that we need to have in 12.2.2 so that we can include
> them in the next round of testing before handing over to QE?
>
> Best,
> Abhishek & Karol
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html



-- 
Jason

Re: 12.2.2 status

[Karol Mroz]

[-- Attachment #1: Type: text/plain, Size: 497 bytes --]

Hi Jason,

Following PRs are up to address your luminous backport tickets...

> On Oct 26, 2017, at 8:40 AM, Jason Dillaman <jdillama@redhat.com> wrote:
> 
> I would like to see the following additional tickets:
> 
> http://tracker.ceph.com/issues/21918

https://github.com/ceph/ceph/pull/18529


> http://tracker.ceph.com/issues/21688

https://github.com/ceph/ceph/pull/18564


> http://tracker.ceph.com/issues/21914

https://github.com/ceph/ceph/pull/18566

Regards,
Karol Mroz
kmroz@suse.de




[-- Attachment #2: Message signed with OpenPGP --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

Re: 12.2.2 status

[Jason Dillaman]

Awesome, thanks!

On Thu, Oct 26, 2017 at 6:38 PM, Karol Mroz <kmroz@suse.de> wrote:
> Hi Jason,
>
> Following PRs are up to address your luminous backport tickets...
>
>> On Oct 26, 2017, at 8:40 AM, Jason Dillaman <jdillama@redhat.com> wrote:
>>
>> I would like to see the following additional tickets:
>>
>> http://tracker.ceph.com/issues/21918
>
> https://github.com/ceph/ceph/pull/18529
>
>
>> http://tracker.ceph.com/issues/21688
>
> https://github.com/ceph/ceph/pull/18564
>
>
>> http://tracker.ceph.com/issues/21914
>
> https://github.com/ceph/ceph/pull/18566
>
> Regards,
> Karol Mroz
> kmroz@suse.de
>
>
>



-- 
Jason

Re: 12.2.2 status

[Jason Dillaman]

Hate to be that guy, but this [1] just popped up this morning and I
think it should be backported into 12.2.2 once it's merged into
master.

Thanks.

[1] http://tracker.ceph.com/issues/21956

On Thu, Oct 26, 2017 at 6:42 PM, Jason Dillaman <jdillama@redhat.com> wrote:
> Awesome, thanks!
>
> On Thu, Oct 26, 2017 at 6:38 PM, Karol Mroz <kmroz@suse.de> wrote:
>> Hi Jason,
>>
>> Following PRs are up to address your luminous backport tickets...
>>
>>> On Oct 26, 2017, at 8:40 AM, Jason Dillaman <jdillama@redhat.com> wrote:
>>>
>>> I would like to see the following additional tickets:
>>>
>>> http://tracker.ceph.com/issues/21918
>>
>> https://github.com/ceph/ceph/pull/18529
>>
>>
>>> http://tracker.ceph.com/issues/21688
>>
>> https://github.com/ceph/ceph/pull/18564
>>
>>
>>> http://tracker.ceph.com/issues/21914
>>
>> https://github.com/ceph/ceph/pull/18566
>>
>> Regards,
>> Karol Mroz
>> kmroz@suse.de
>>
>>
>>
>
>
>
> --
> Jason



-- 
Jason

Re: 12.2.2 status

[kefu chai]

Abhishek,

 it'd be great if we can include:

- https://github.com/ceph/ceph/pull/18620
- https://github.com/ceph/ceph/pull/18621

On Fri, Oct 27, 2017 at 10:02 PM, Jason Dillaman <jdillama@redhat.com> wrote:
> Hate to be that guy, but this [1] just popped up this morning and I
> think it should be backported into 12.2.2 once it's merged into
> master.
>
> Thanks.
>
> [1] http://tracker.ceph.com/issues/21956
>
> On Thu, Oct 26, 2017 at 6:42 PM, Jason Dillaman <jdillama@redhat.com> wrote:
>> Awesome, thanks!
>>
>> On Thu, Oct 26, 2017 at 6:38 PM, Karol Mroz <kmroz@suse.de> wrote:
>>> Hi Jason,
>>>
>>> Following PRs are up to address your luminous backport tickets...
>>>
>>>> On Oct 26, 2017, at 8:40 AM, Jason Dillaman <jdillama@redhat.com> wrote:
>>>>
>>>> I would like to see the following additional tickets:
>>>>
>>>> http://tracker.ceph.com/issues/21918
>>>
>>> https://github.com/ceph/ceph/pull/18529
>>>
>>>
>>>> http://tracker.ceph.com/issues/21688
>>>
>>> https://github.com/ceph/ceph/pull/18564
>>>
>>>
>>>> http://tracker.ceph.com/issues/21914
>>>
>>> https://github.com/ceph/ceph/pull/18566
>>>
>>> Regards,
>>> Karol Mroz
>>> kmroz@suse.de
>>>
>>>
>>>
>>
>>
>>
>> --
>> Jason
>
>
>
> --
> Jason
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html



-- 
Regards
Kefu Chai

Re: 12.2.2 status

[Jason Dillaman]

Here is the related Luminous PR for that tracker ticket:
https://github.com/ceph/ceph/pull/18626

Thanks!

On Fri, Oct 27, 2017 at 10:02 AM, Jason Dillaman <jdillama@redhat.com> wrote:
> Hate to be that guy, but this [1] just popped up this morning and I
> think it should be backported into 12.2.2 once it's merged into
> master.
>
> Thanks.
>
> [1] http://tracker.ceph.com/issues/21956
>
> On Thu, Oct 26, 2017 at 6:42 PM, Jason Dillaman <jdillama@redhat.com> wrote:
>> Awesome, thanks!
>>
>> On Thu, Oct 26, 2017 at 6:38 PM, Karol Mroz <kmroz@suse.de> wrote:
>>> Hi Jason,
>>>
>>> Following PRs are up to address your luminous backport tickets...
>>>
>>>> On Oct 26, 2017, at 8:40 AM, Jason Dillaman <jdillama@redhat.com> wrote:
>>>>
>>>> I would like to see the following additional tickets:
>>>>
>>>> http://tracker.ceph.com/issues/21918
>>>
>>> https://github.com/ceph/ceph/pull/18529
>>>
>>>
>>>> http://tracker.ceph.com/issues/21688
>>>
>>> https://github.com/ceph/ceph/pull/18564
>>>
>>>
>>>> http://tracker.ceph.com/issues/21914
>>>
>>> https://github.com/ceph/ceph/pull/18566
>>>
>>> Regards,
>>> Karol Mroz
>>> kmroz@suse.de
>>>
>>>
>>>
>>
>>
>>
>> --
>> Jason
>
>
>
> --
> Jason



-- 
Jason

Re: 12.2.2 status

[Sage Weil]

On Thu, 26 Oct 2017, Abhishek Lekshmanan wrote:
> A first round of PRs were tested on Luminous integration branch, results
> updated at http://tracker.ceph.com/issues/21830,
> RADOS suite was green, RBD, RGW & FS hit some known failures
> 
> ceph-disk has hit a failure with dmcrypt, details at
> http://tracker.ceph.com/issues/21830#note-10 which doesn't seem to have
> occured in QE runs before but there is a bug report, is anyone aware of
> past issues with ceph-disk & dmcrypt?
> 
> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
> critical PRs that we need to have in 12.2.2 so that we can include
> them in the next round of testing before handing over to QE?

I need to get

	https://github.com/ceph/ceph/pull/18524

into master and then backport it.  Except that it relies on another PR 
that introduces a new feature bit to get all of this in place.. and it's 
brand new.  So I think I'm going ot do a targetted fix for luminous and 
then sort out the backport conflicts later.  In any case, I should 
have the luminous PR to resolve it today.

sage

Re: 12.2.2 status

[Abhishek Lekshmanan]

Also created a label to track the current PRs already tested
https://github.com/ceph/ceph/pulls?q=is%3Aopen+is%3Apr+label%3Awip-abhi-testing

> A first round of PRs were tested on Luminous integration branch, results
> updated at http://tracker.ceph.com/issues/21830,
> RADOS suite was green, RBD, RGW & FS hit some known failures
>
> ceph-disk has hit a failure with dmcrypt, details at
> http://tracker.ceph.com/issues/21830#note-10 which doesn't seem to have
> occured in QE runs before but there is a bug report, is anyone aware of
> past issues with ceph-disk & dmcrypt?
>
> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
> critical PRs that we need to have in 12.2.2 so that we can include
> them in the next round of testing before handing over to QE?
>
> Best,
> Abhishek & Karol
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>

-- 
Abhishek Lekshmanan
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton,
HRB 21284 (AG Nürnberg)

Re: 12.2.2 status

[Yehuda Sadeh-Weinraub]

On Thu, Oct 26, 2017 at 8:19 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
>
> A first round of PRs were tested on Luminous integration branch, results
> updated at http://tracker.ceph.com/issues/21830,
> RADOS suite was green, RBD, RGW & FS hit some known failures
>
> ceph-disk has hit a failure with dmcrypt, details at
> http://tracker.ceph.com/issues/21830#note-10 which doesn't seem to have
> occured in QE runs before but there is a bug report, is anyone aware of
> past issues with ceph-disk & dmcrypt?
>
> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
> critical PRs that we need to have in 12.2.2 so that we can include
> them in the next round of testing before handing over to QE?
>

I'd be happy to see these fixed:
http://tracker.ceph.com/issues/21819
http://tracker.ceph.com/issues/21735

however, these are not in master yet, need validation.

This one is ready I think:
http://tracker.ceph.com/issues/21500

> Best,
> Abhishek & Karol
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: 12.2.2 status

[Karol Mroz]

[-- Attachment #1: Type: text/plain, Size: 937 bytes --]

+CC Casey

Hi Yehuda and Casey,


> On Oct 26, 2017, at 9:50 AM, Yehuda Sadeh-Weinraub <yehuda@redhat.com> wrote:
[…]
> 
> I'd be happy to see these fixed:
> http://tracker.ceph.com/issues/21819

Opened backport ticket http://tracker.ceph.com/issues/21937
https://github.com/ceph/ceph/pull/18539


> http://tracker.ceph.com/issues/21735

Opened backport ticket http://tracker.ceph.com/issues/21938
Final commit of https://github.com/ceph/ceph/pull/18198 appears dependent on at least: cbb84cb13db and 53526d5050a in master.  Please advise.

> 
> however, these are not in master yet, need validation.
> 
> This one is ready I think:
> http://tracker.ceph.com/issues/21500

Opened: http://tracker.ceph.com/issues/21939
https://github.com/ceph/ceph/pull/18569
  - Still need https://github.com/ceph/s3-tests/pull/189 backported to ceph-luminous branch of s3tests

Regards,
Karol Mroz
kmroz@suse.de




[-- Attachment #2: Message signed with OpenPGP --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

Re: 12.2.2 status

[Casey Bodley]

On 10/26/2017 06:48 PM, Karol Mroz wrote:
> +CC Casey
>
> Hi Yehuda and Casey,
>
>
>> On Oct 26, 2017, at 9:50 AM, Yehuda Sadeh-Weinraub <yehuda@redhat.com> wrote:
> […]
>> I'd be happy to see these fixed:
>> http://tracker.ceph.com/issues/21819
> Opened backport ticket http://tracker.ceph.com/issues/21937
> https://github.com/ceph/ceph/pull/18539
>
>
>> http://tracker.ceph.com/issues/21735
> Opened backport ticket http://tracker.ceph.com/issues/21938
> Final commit of https://github.com/ceph/ceph/pull/18198 appears dependent on at least: cbb84cb13db and 53526d5050a in master.  Please advise.

resolved this conflict in https://github.com/ceph/ceph/pull/18591

>> however, these are not in master yet, need validation.
>>
>> This one is ready I think:
>> http://tracker.ceph.com/issues/21500
> Opened: http://tracker.ceph.com/issues/21939
> https://github.com/ceph/ceph/pull/18569
>    - Still need https://github.com/ceph/s3-tests/pull/189 backported to ceph-luminous branch of s3tests

do you want me to cherry-pick that s3test before the backport merges? 
it's likely to cause failures for teuthology runs that don't include 
https://github.com/ceph/ceph/pull/18569

>
> Regards,
> Karol Mroz
> kmroz@suse.de
>
>
>

Re: 12.2.2 status

[Karol Mroz]

[-- Attachment #1: Type: text/plain, Size: 1534 bytes --]

Hey Casey,

Please see inline…

> On Oct 27, 2017, at 6:57 AM, Casey Bodley <cbodley@redhat.com> wrote:
> 
> 
> 
> On 10/26/2017 06:48 PM, Karol Mroz wrote:
>> +CC Casey
>> 
>> Hi Yehuda and Casey,
>> 
>> 
>>> On Oct 26, 2017, at 9:50 AM, Yehuda Sadeh-Weinraub <yehuda@redhat.com> wrote:
>> […]
>>> I'd be happy to see these fixed:
>>> http://tracker.ceph.com/issues/21819
>> Opened backport ticket http://tracker.ceph.com/issues/21937
>> https://github.com/ceph/ceph/pull/18539
>> 
>> 
>>> http://tracker.ceph.com/issues/21735
>> Opened backport ticket http://tracker.ceph.com/issues/21938
>> Final commit of https://github.com/ceph/ceph/pull/18198 appears dependent on at least: cbb84cb13db and 53526d5050a in master.  Please advise.
> 
> resolved this conflict in https://github.com/ceph/ceph/pull/18591

Awesome, thanks!

> 
>>> however, these are not in master yet, need validation.
>>> 
>>> This one is ready I think:
>>> http://tracker.ceph.com/issues/21500
>> Opened: http://tracker.ceph.com/issues/21939
>> https://github.com/ceph/ceph/pull/18569
>>   - Still need https://github.com/ceph/s3-tests/pull/189 backported to ceph-luminous branch of s3tests
> 
> do you want me to cherry-pick that s3test before the backport merges? it's likely to cause failures for teuthology runs that don't include https://github.com/ceph/ceph/pull/18569

Taken care of here: https://github.com/ceph/s3-tests/pull/193  If you could please take a look.

Regards,
Karol Mroz
kmroz@suse.de




[-- Attachment #2: Message signed with OpenPGP --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

Re: 12.2.2 status

[Patrick Donnelly]

On Thu, Oct 26, 2017 at 8:19 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
> critical PRs that we need to have in 12.2.2 so that we can include
> them in the next round of testing before handing over to QE?

Please include:

https://github.com/ceph/ceph/pull/18019
https://github.com/ceph/ceph/pull/18008

Thanks,

-- 
Patrick Donnelly

Re: 12.2.2 status

[Abhishek Lekshmanan]

Patrick Donnelly <pdonnell@redhat.com> writes:

> On Thu, Oct 26, 2017 at 8:19 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
>> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
>> critical PRs that we need to have in 12.2.2 so that we can include
>> them in the next round of testing before handing over to QE?
>
> Please include:
>
> https://github.com/ceph/ceph/pull/18019
> https://github.com/ceph/ceph/pull/18008

I've added the all the PRs in the milestone with the label wip-abhi-testing,
https://github.com/ceph/ceph/pulls?q=is%3Aopen+is%3Apr+label%3Awip-abhi-testing

However all the ubuntu/debian tests in teuthology seem to fail with a
dependency issue not seen in centos,

For eg: 
http://pulpito.ceph.com/abhi-2017-11-03_16:49:11-ceph-disk-wip-luminous-backports-distro-basic-vps/

or
http://pulpito.ceph.com/abhi-2017-11-03_15:09:21-rados-wip-luminous-backports-distro-basic-smithi/

something in the lines of
ceph-mds : Depends: ceph-base (= 12.2.1-688-g83b8263-1trusty) but it is
not going to be installed

though not sure why these are failing as the packages themselves seem to
be present at the chacra url, so something else in the dependency chain
somewhere? Has anyone else seen errors of this nature ?


-- 
Abhishek 

Re: 12.2.2 status

[Sage Weil]

It's probably https://github.com/ceph/ceph/pull/18589 ?

On Fri, 3 Nov 2017, Abhishek Lekshmanan wrote:

> Patrick Donnelly <pdonnell@redhat.com> writes:
> 
> > On Thu, Oct 26, 2017 at 8:19 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
> >> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
> >> critical PRs that we need to have in 12.2.2 so that we can include
> >> them in the next round of testing before handing over to QE?
> >
> > Please include:
> >
> > https://github.com/ceph/ceph/pull/18019
> > https://github.com/ceph/ceph/pull/18008
> 
> I've added the all the PRs in the milestone with the label wip-abhi-testing,
> https://github.com/ceph/ceph/pulls?q=is%3Aopen+is%3Apr+label%3Awip-abhi-testing
> 
> However all the ubuntu/debian tests in teuthology seem to fail with a
> dependency issue not seen in centos,
> 
> For eg: 
> http://pulpito.ceph.com/abhi-2017-11-03_16:49:11-ceph-disk-wip-luminous-backports-distro-basic-vps/
> 
> or
> http://pulpito.ceph.com/abhi-2017-11-03_15:09:21-rados-wip-luminous-backports-distro-basic-smithi/
> 
> something in the lines of
> ceph-mds : Depends: ceph-base (= 12.2.1-688-g83b8263-1trusty) but it is
> not going to be installed
> 
> though not sure why these are failing as the packages themselves seem to
> be present at the chacra url, so something else in the dependency chain
> somewhere? Has anyone else seen errors of this nature ?
> 
> 
> -- 
> Abhishek 
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> 

Re: 12.2.2 status

[Abhishek Lekshmanan]

Sage Weil <sweil@redhat.com> writes:

> It's probably https://github.com/ceph/ceph/pull/18589 ?

Looks like it. I'm not sure whether this PR needs to go in for 12.2.2 or
post 12.2.2,  and how the ceph-test breaks << 12.2.2 affects this. Can
Kefu/ Ken comment on whether this needs to be included and what
additional steps we need to get the packaging fixed.

Thanks
Abhishek

>
> On Fri, 3 Nov 2017, Abhishek Lekshmanan wrote:
>
>> Patrick Donnelly <pdonnell@redhat.com> writes:
>> 
>> > On Thu, Oct 26, 2017 at 8:19 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
>> >> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
>> >> critical PRs that we need to have in 12.2.2 so that we can include
>> >> them in the next round of testing before handing over to QE?
>> >
>> > Please include:
>> >
>> > https://github.com/ceph/ceph/pull/18019
>> > https://github.com/ceph/ceph/pull/18008
>> 
>> I've added the all the PRs in the milestone with the label wip-abhi-testing,
>> https://github.com/ceph/ceph/pulls?q=is%3Aopen+is%3Apr+label%3Awip-abhi-testing
>> 
>> However all the ubuntu/debian tests in teuthology seem to fail with a
>> dependency issue not seen in centos,
>> 
>> For eg: 
>> http://pulpito.ceph.com/abhi-2017-11-03_16:49:11-ceph-disk-wip-luminous-backports-distro-basic-vps/
>> 
>> or
>> http://pulpito.ceph.com/abhi-2017-11-03_15:09:21-rados-wip-luminous-backports-distro-basic-smithi/
>> 
>> something in the lines of
>> ceph-mds : Depends: ceph-base (= 12.2.1-688-g83b8263-1trusty) but it is
>> not going to be installed
>> 
>> though not sure why these are failing as the packages themselves seem to
>> be present at the chacra url, so something else in the dependency chain
>> somewhere? Has anyone else seen errors of this nature ?
>> 
>> 
>> -- 
>> Abhishek 
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> 
>> 
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>

-- 
Abhishek Lekshmanan
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton,
HRB 21284 (AG Nürnberg)

Re: 12.2.2 status

[kefu chai]

On Sat, Nov 4, 2017 at 2:02 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
> Sage Weil <sweil@redhat.com> writes:
>
>> It's probably https://github.com/ceph/ceph/pull/18589 ?
>
> Looks like it. I'm not sure whether this PR needs to go in for 12.2.2 or
> post 12.2.2,  and how the ceph-test breaks << 12.2.2 affects this. Can
> Kefu/ Ken comment on whether this needs to be included and what
> additional steps we need to get the packaging fixed.

+ vikyat.

all or nothing. if we want to backport the fix of
http://tracker.ceph.com/issues/21762, we will have to backport the
"debian: fix package relationships after" fixes. so i think pull/18589
is self-contained. and no additional step is needed.

and per http://tracker.ceph.com/issues/21762, we need to have it in
luminous. but i have no strong opinion on including it in 12.2.2 or
post 12.2.2. Vikhyat and Nathan, what do you think?

>
> Thanks
> Abhishek
>
>>
>> On Fri, 3 Nov 2017, Abhishek Lekshmanan wrote:
>>
>>> Patrick Donnelly <pdonnell@redhat.com> writes:
>>>
>>> > On Thu, Oct 26, 2017 at 8:19 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
>>> >> Also for the leads, Sage, Yehuda. Jason, Josh, Patrick are there any
>>> >> critical PRs that we need to have in 12.2.2 so that we can include
>>> >> them in the next round of testing before handing over to QE?
>>> >
>>> > Please include:
>>> >
>>> > https://github.com/ceph/ceph/pull/18019
>>> > https://github.com/ceph/ceph/pull/18008
>>>
>>> I've added the all the PRs in the milestone with the label wip-abhi-testing,
>>> https://github.com/ceph/ceph/pulls?q=is%3Aopen+is%3Apr+label%3Awip-abhi-testing
>>>
>>> However all the ubuntu/debian tests in teuthology seem to fail with a
>>> dependency issue not seen in centos,
>>>
>>> For eg:
>>> http://pulpito.ceph.com/abhi-2017-11-03_16:49:11-ceph-disk-wip-luminous-backports-distro-basic-vps/
>>>
>>> or
>>> http://pulpito.ceph.com/abhi-2017-11-03_15:09:21-rados-wip-luminous-backports-distro-basic-smithi/
>>>
>>> something in the lines of
>>> ceph-mds : Depends: ceph-base (= 12.2.1-688-g83b8263-1trusty) but it is
>>> not going to be installed
>>>
>>> though not sure why these are failing as the packages themselves seem to
>>> be present at the chacra url, so something else in the dependency chain
>>> somewhere? Has anyone else seen errors of this nature ?
>>>
>>>
>>> --
>>> Abhishek
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>
>>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>
>
> --
> Abhishek Lekshmanan
> SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton,
> HRB 21284 (AG Nürnberg)



-- 
Regards
Kefu Chai

Re: 12.2.2 status

[Nathan Cutler]

> all or nothing. if we want to backport the fix of
> http://tracker.ceph.com/issues/21762, we will have to backport the
> "debian: fix package relationships after" fixes. so i think pull/18589
> is self-contained. and no additional step is needed.
> 
> and per http://tracker.ceph.com/issues/21762, we need to have it in
> luminous. but i have no strong opinion on including it in 12.2.2 or
> post 12.2.2. Vikhyat and Nathan, what do you think?

Yes, I tried to make 18589 self-contained by pulling in Kefu's and 
Abhishek's follow-on fixes. I think it would be nice to have it in 12.2.2.

Nathan

Re: 12.2.2 status

[Abhishek L]

On Sat, Nov 4, 2017 at 8:51 AM, Nathan Cutler <ncutler@suse.cz> wrote:
>> all or nothing. if we want to backport the fix of
>> http://tracker.ceph.com/issues/21762, we will have to backport the
>> "debian: fix package relationships after" fixes. so i think pull/18589
>> is self-contained. and no additional step is needed.
>>
>> and per http://tracker.ceph.com/issues/21762, we need to have it in
>> luminous. but i have no strong opinion on including it in 12.2.2 or
>> post 12.2.2. Vikhyat and Nathan, what do you think?
>
>
> Yes, I tried to make 18589 self-contained by pulling in Kefu's and
> Abhishek's follow-on fixes. I think it would be nice to have it in 12.2.2.

Rebuilt the integration branch with the newer PR and it still fails
with the same reason
http://pulpito.ceph.com/abhi-2017-11-05_11:53:02-ceph-disk-wip-abhi-testing-2017-11-05-0933-distro-basic-vps/
for eg.

Kefu, are there any more commits we need to solve the dependency issue?

Thanks
Abhishek
> Nathan
>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: 12.2.2 status

[kefu chai]

On Sun, Nov 5, 2017 at 8:17 PM, Abhishek L
<abhishek.lekshmanan@gmail.com> wrote:
> On Sat, Nov 4, 2017 at 8:51 AM, Nathan Cutler <ncutler@suse.cz> wrote:
>>> all or nothing. if we want to backport the fix of
>>> http://tracker.ceph.com/issues/21762, we will have to backport the
>>> "debian: fix package relationships after" fixes. so i think pull/18589
>>> is self-contained. and no additional step is needed.
>>>
>>> and per http://tracker.ceph.com/issues/21762, we need to have it in
>>> luminous. but i have no strong opinion on including it in 12.2.2 or
>>> post 12.2.2. Vikhyat and Nathan, what do you think?
>>
>>
>> Yes, I tried to make 18589 self-contained by pulling in Kefu's and
>> Abhishek's follow-on fixes. I think it would be nice to have it in 12.2.2.
>
> Rebuilt the integration branch with the newer PR and it still fails
> with the same reason
> http://pulpito.ceph.com/abhi-2017-11-05_11:53:02-ceph-disk-wip-abhi-testing-2017-11-05-0933-distro-basic-vps/
> for eg.
>
> Kefu, are there any more commits we need to solve the dependency issue?

well, yes and no.

we need to "dch" the changelog, to bump up the version number to
12.2.2 to address this issue. but i thought this was a step of our
release process: see
https://github.com/ceph/ceph-build/blob/2cb4f4069c7a0fac1abecd76e6014272f22cf139/ansible/roles/ceph-release/tasks/release/stable.yml#L3.

that's why i believed that PR#18589 was self-contained. anyway, we can
"fix" this issue in two ways:

1. "dch" the changelog in a commit only for testing, and it will not
be merged into luminous. run that the upgrade suites using dch'ed
version, and wait until the jenkins builder to tag and dch
automatically for the official release of 12.2.2
2. just drop the PR#18589. so and include it in post 12.2.2. so the
problem will be resolved w/o any efforts by then.


-- 
Regards
Kefu Chai

Re: 12.2.2 status

[Abhishek Lekshmanan]

kefu chai <tchaikov@gmail.com> writes:

> On Sun, Nov 5, 2017 at 8:17 PM, Abhishek L
> <abhishek.lekshmanan@gmail.com> wrote:
>> On Sat, Nov 4, 2017 at 8:51 AM, Nathan Cutler <ncutler@suse.cz> wrote:
>>>> all or nothing. if we want to backport the fix of
>>>> http://tracker.ceph.com/issues/21762, we will have to backport the
>>>> "debian: fix package relationships after" fixes. so i think pull/18589
>>>> is self-contained. and no additional step is needed.
>>>>
>>>> and per http://tracker.ceph.com/issues/21762, we need to have it in
>>>> luminous. but i have no strong opinion on including it in 12.2.2 or
>>>> post 12.2.2. Vikhyat and Nathan, what do you think?
>>>
>>>
>>> Yes, I tried to make 18589 self-contained by pulling in Kefu's and
>>> Abhishek's follow-on fixes. I think it would be nice to have it in 12.2.2.
>>
>> Rebuilt the integration branch with the newer PR and it still fails
>> with the same reason
>> http://pulpito.ceph.com/abhi-2017-11-05_11:53:02-ceph-disk-wip-abhi-testing-2017-11-05-0933-distro-basic-vps/
>> for eg.
>>
>> Kefu, are there any more commits we need to solve the dependency issue?
>
> well, yes and no.
>
> we need to "dch" the changelog, to bump up the version number to
> 12.2.2 to address this issue. but i thought this was a step of our
> release process: see
> https://github.com/ceph/ceph-build/blob/2cb4f4069c7a0fac1abecd76e6014272f22cf139/ansible/roles/ceph-release/tasks/release/stable.yml#L3.
>
> that's why i believed that PR#18589 was self-contained. anyway, we can
> "fix" this issue in two ways:
>
> 1. "dch" the changelog in a commit only for testing, and it will not
> be merged into luminous. run that the upgrade suites using dch'ed
> version, and wait until the jenkins builder to tag and dch
> automatically for the official release of 12.2.2
> 2. just drop the PR#18589. so and include it in post 12.2.2. so the
> problem will be resolved w/o any efforts by then.

I'm inclined to do #2, either way I've scheduled suites (which has
completed now) without this PR since I couldn't get moving with the PR
included, I'll post the results soon & hopefully we can handover to QE
today itself

-- 
Abhishek Lekshmanan
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton,
HRB 21284 (AG Nürnberg)

Re: 12.2.2 status

[Abhishek Lekshmanan]

Abhishek Lekshmanan <abhishek@suse.com> writes:

> kefu chai <tchaikov@gmail.com> writes:
>
>> On Sun, Nov 5, 2017 at 8:17 PM, Abhishek L
>> <abhishek.lekshmanan@gmail.com> wrote:
>>> On Sat, Nov 4, 2017 at 8:51 AM, Nathan Cutler <ncutler@suse.cz> wrote:
>>>>> all or nothing. if we want to backport the fix of
>>>>> http://tracker.ceph.com/issues/21762, we will have to backport the
>>>>> "debian: fix package relationships after" fixes. so i think pull/18589
>>>>> is self-contained. and no additional step is needed.
>>>>>
>>>>> and per http://tracker.ceph.com/issues/21762, we need to have it in
>>>>> luminous. but i have no strong opinion on including it in 12.2.2 or
>>>>> post 12.2.2. Vikhyat and Nathan, what do you think?
>>>>
>>>>
>>>> Yes, I tried to make 18589 self-contained by pulling in Kefu's and
>>>> Abhishek's follow-on fixes. I think it would be nice to have it in 12.2.2.
>>>
>>> Rebuilt the integration branch with the newer PR and it still fails
>>> with the same reason
>>> http://pulpito.ceph.com/abhi-2017-11-05_11:53:02-ceph-disk-wip-abhi-testing-2017-11-05-0933-distro-basic-vps/
>>> for eg.
>>>
>>> Kefu, are there any more commits we need to solve the dependency issue?
>>
>> well, yes and no.
>>
>> we need to "dch" the changelog, to bump up the version number to
>> 12.2.2 to address this issue. but i thought this was a step of our
>> release process: see
>> https://github.com/ceph/ceph-build/blob/2cb4f4069c7a0fac1abecd76e6014272f22cf139/ansible/roles/ceph-release/tasks/release/stable.yml#L3.
>>
>> that's why i believed that PR#18589 was self-contained. anyway, we can
>> "fix" this issue in two ways:
>>
>> 1. "dch" the changelog in a commit only for testing, and it will not
>> be merged into luminous. run that the upgrade suites using dch'ed
>> version, and wait until the jenkins builder to tag and dch
>> automatically for the official release of 12.2.2
>> 2. just drop the PR#18589. so and include it in post 12.2.2. so the
>> problem will be resolved w/o any efforts by then.
>
> I'm inclined to do #2, either way I've scheduled suites (which has
> completed now) without this PR since I couldn't get moving with the PR
> included, I'll post the results soon & hopefully we can handover to QE
> today itself

update:

refer http://tracker.ceph.com/issues/21830 for update information

RADOS, RBD suites were green, ran into a couple of possible env. errors
which didn't reproduce in the rerun. A possible timing issue (didn't
reproduce) http://tracker.ceph.com/issues/22047

CephFS runs seem to hit http://tracker.ceph.com/issues/22039
consistently, the other failures look environmental. run info
http://tracker.ceph.com/issues/21830#note-23
@Patrick can you take a look.

RGW initially hit some failures due to s3-tests branch which was fixed,
the tests are still running though failures so far have been
environmental or known.
http://tracker.ceph.com/issues/21830#note-18

Saw a valgrind leak on mons in one of the RGW runs, reported at
http://tracker.ceph.com/issues/22052

ceph-disk consistently seems to run into a nearfull failure (was present
in the first integration branch run as well) possibly related to
dmcrypt. (a python backtrace is thrown as unknown key managment-mode)
tracker.ceph.com/issues/21830#note-19, don't see any recent patches that
went into master/luminous that could explain this failure unfortunately. 


Upgrade luminous-x seems to consistently fail with being unable to find
ceph-common packages, eg. run:
http://pulpito.ceph.com/abhi-2017-11-06_15:35:39-upgrade:luminous-x-wip-abhi-testing-2017-11-05-1320-distro-basic-smithi/ 

-- 
Abhishek Lekshmanan
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton,
HRB 21284 (AG Nürnberg)

Re: 12.2.2 status

[Patrick Donnelly]

On Tue, Nov 7, 2017 at 5:29 AM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
> CephFS runs seem to hit http://tracker.ceph.com/issues/22039
> consistently, the other failures look environmental. run info
> http://tracker.ceph.com/issues/21830#note-23
> @Patrick can you take a look.

Sage has a debug PR for bluestore to run with the fs suite to help
diagnose that. I'm going to queue up a run now.

-- 
Patrick Donnelly

Re: 12.2.2 status

[Abhishek]

On 2017-11-06 20:55, Patrick Donnelly wrote:
> On Tue, Nov 7, 2017 at 5:29 AM, Abhishek Lekshmanan <abhishek@suse.com> 
> wrote:
>> CephFS runs seem to hit http://tracker.ceph.com/issues/22039
>> consistently, the other failures look environmental. run info
>> http://tracker.ceph.com/issues/21830#note-23
>> @Patrick can you take a look.
> 
> Sage has a debug PR for bluestore to run with the fs suite to help
> diagnose that. I'm going to queue up a run now.

This is the final list of PRs that we have pending merge onto Luminous:

QE
https://github.com/ceph/ceph/pull/18702 (good to go)
RBD:
https://github.com/ceph/ceph/pull/18564 (waiting on jenkins for clicking 
the big green button)

RGW
https://github.com/ceph/ceph/pull/18794
https://github.com/ceph/ceph/pull/18800
https://github.com/ceph/ceph/pull/18801


Assuming these are merged in,
Patrick, Jason, John, Josh & Yehuda/Matt, do we need anything else for 
12.2.2 before handing over to QE for the final round of testing?

Best,
Abhishek

Re: 12.2.2 status

[Patrick Donnelly]

On Wed, Nov 8, 2017 at 8:59 AM, Abhishek <abhishek@suse.com> wrote:
> Patrick, Jason, John, Josh & Yehuda/Matt, do we need anything else for
> 12.2.2 before handing over to QE for the final round of testing?

CephFS is ready.

-- 
Patrick Donnelly

Re: 12.2.2 status

[Matt Benjamin]

I think that's everything.

Matt

On Tue, Nov 7, 2017 at 4:59 PM, Abhishek <abhishek@suse.com> wrote:
> On 2017-11-06 20:55, Patrick Donnelly wrote:
>>
>> On Tue, Nov 7, 2017 at 5:29 AM, Abhishek Lekshmanan <abhishek@suse.com>
>> wrote:
>>>
>>> CephFS runs seem to hit http://tracker.ceph.com/issues/22039
>>> consistently, the other failures look environmental. run info
>>> http://tracker.ceph.com/issues/21830#note-23
>>> @Patrick can you take a look.
>>
>>
>> Sage has a debug PR for bluestore to run with the fs suite to help
>> diagnose that. I'm going to queue up a run now.
>
>
> This is the final list of PRs that we have pending merge onto Luminous:
>
> QE
> https://github.com/ceph/ceph/pull/18702 (good to go)
> RBD:
> https://github.com/ceph/ceph/pull/18564 (waiting on jenkins for clicking the
> big green button)
>
> RGW
> https://github.com/ceph/ceph/pull/18794
> https://github.com/ceph/ceph/pull/18800
> https://github.com/ceph/ceph/pull/18801
>
>
> Assuming these are merged in,
> Patrick, Jason, John, Josh & Yehuda/Matt, do we need anything else for
> 12.2.2 before handing over to QE for the final round of testing?
>
> Best,
> Abhishek



-- 

Matt Benjamin
Red Hat, Inc.
315 West Huron Street, Suite 140A
Ann Arbor, Michigan 48103

http://www.redhat.com/en/technologies/storage

tel.  734-821-5101
fax.  734-769-8938
cel.  734-216-5309