From mboxrd@z Thu Jan 1 00:00:00 1970 MIME-Version: 1.0 References: <2a6d7691-b8a5-da92-865c-8cdf5efb673f@collabora.com> <285b11ad-40dc-eb88-427e-f32c4a422c85@collabora.com> <803b89a9-9141-636f-8fd3-f519b0440075@collabora.com> In-Reply-To: <803b89a9-9141-636f-8fd3-f519b0440075@collabora.com> From: Todd Kjos Date: Fri, 18 Mar 2022 08:47:22 -0700 Message-ID: Subject: Re: can't access kernelci results Content-Type: multipart/alternative; boundary="000000000000bfaf5405da801043" List-ID: To: Guillaume Tucker Cc: =?UTF-8?B?TWljaGHFgiBHYcWCa2E=?= , kernelci@groups.io, Guenter Roeck , Kevin Hilman --000000000000bfaf5405da801043 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Is the MongoDB server down again? I don't get results at https://linux.kernelci.org/job/android/. On Wed, Dec 1, 2021 at 1:49 AM Guillaume Tucker < guillaume.tucker@collabora.com> wrote: > Hi Todd, > > On 30/11/2021 16:54, Todd Kjos wrote: > > ...and now it's working again. Sorry about the noise if the issue was > > on my side. > > The MongoDB server did crash but it was restarted a few minutes > later. There's some kind of watchdog to do that automatically, > maybe you were out of luck and checked the website during that > window. Thanks for reporting the issue in any case. > > Best wishes, > Guillaume > > > On Tue, Nov 30, 2021 at 8:35 AM Todd Kjos wrote: > >> > >> I can't load the data from https://linux.kernelci.org/job/android/ > >> ("Error loading build data."). Is mongod "borked" again? > >> > >> On Thu, Sep 2, 2021 at 12:28 PM Todd Kjos wrote: > >>> > >>> It's working again. Thanks. > >>> > >>> On Thu, Sep 2, 2021 at 8:58 AM Todd Kjos wrote: > >>>> > >>>> I'm getting errors again when attempting to access > >>>> https://linux.kernelci.org/job/android/. mongod issues again? > >>>> > >>>> "Error while loading data from the server (error code: 500). Please > >>>> contact the website administrator" > >>>> > >>>> On Tue, Jun 22, 2021 at 8:17 AM Guillaume Tucker > >>>> wrote: > >>>>> > >>>>> On 22/06/2021 16:07, Todd Kjos wrote: > >>>>>> Hmm, it's still not working for me -- did it break again? > >>>>> > >>>>> Yes there was an OOM issue: > >>>>> > >>>>> [4316410.416514] Killed process 20620 (mongod) total-vm:20171340kB, > anon-rss:18654740kB, file-rss:0kB, shmem-rss:0kB > >>>>> [4316412.060511] oom_reaper: reaped process 20620 (mongod), now > anon-rss:0kB, file-rss:0kB, shmem-rss:0kB > >>>>> > >>>>> We're looking into moving the Mongo DB instance to the cloud in > >>>>> Azure. Hopefully that will save us fixing this kind of > >>>>> maintenance issues. Meanwhile, we should take a look and see if > >>>>> there's some config option to limit the amount of RAM used by > >>>>> Mongo DB to work around the problem. > >>>>> > >>>>> Best wishes, > >>>>> Guillaume > >>>>> > >>>>> > >>>>>> On Tue, Jun 22, 2021 at 2:43 AM Micha=C5=82 Ga=C5=82ka < > michal.galka@collabora.com > wrote: > >>>>>> > >>>>>> On 21.06.2021 21:59, Todd Kjos via groups.io > wrote: > >>>>>> > I'm having this issue again (can't access kernelci results > >>>>>> > at https://linux.kernelci.org/job/android/ < > https://linux.kernelci.org/job/android/> > >>>>>> > https://linux.kernelci.org/job/android/>>). Is the mongod service borked > >>>>>> > again? > >>>>>> > > >>>>>> > >>>>>> Yes, there was an issue with mongod service again. It's workin= g > now, > >>>>>> celery processed pending tasks and everything seems responsive= . > >>>>>> > >>>>>> Thanks, > >>>>>> Micha=C5=82 > >>>>>> > >>>>> > > --000000000000bfaf5405da801043 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Is the MongoDB server down again? I don't get results = at=C2=A0https://linux.k= ernelci.org/job/android/.

On Wed, Dec 1, 2021 at 1:49 AM Guillaume Tuck= er <guillaume.tucker@c= ollabora.com> wrote:
Hi Todd,

On 30/11/2021 16:54, Todd Kjos wrote:
> ...and now it's working again. Sorry about the noise if the issue = was
> on my side.

The MongoDB server did crash but it was restarted a few minutes
later.=C2=A0 There's some kind of watchdog to do that automatically, maybe you were out of luck and checked the website during that
window.=C2=A0 Thanks for reporting the issue in any case.

Best wishes,
Guillaume

> On Tue, Nov 30, 2021 at 8:35 AM Todd Kjos <tkjos@google.com> wrote:
>>
>> I can't load the data from https://linux.kernelc= i.org/job/android/
>> ("Error loading build data."). Is mongod "borked&qu= ot; again?
>>
>> On Thu, Sep 2, 2021 at 12:28 PM Todd Kjos <tkjos@google.com> wrote:
>>>
>>> It's working again. Thanks.
>>>
>>> On Thu, Sep 2, 2021 at 8:58 AM Todd Kjos <tkjos@google.com> wrote:
>>>>
>>>> I'm getting errors again when attempting to access
>>>> https://linux.kernelci.org/job/android/.= mongod issues again?
>>>>
>>>> "Error while loading data from the server (error code= : 500). Please
>>>> contact the website administrator"
>>>>
>>>> On Tue, Jun 22, 2021 at 8:17 AM Guillaume Tucker
>>>> <guillaume.tucker@collabora.com> wrote:
>>>>>
>>>>> On 22/06/2021 16:07, Todd Kjos wrote:
>>>>>> Hmm, it's still not working for me -- did it b= reak again?
>>>>>
>>>>> Yes there was an OOM issue:
>>>>>
>>>>> [4316410.416514] Killed process 20620 (mongod) total-v= m:20171340kB, anon-rss:18654740kB, file-rss:0kB, shmem-rss:0kB
>>>>> [4316412.060511] oom_reaper: reaped process 20620 (mon= god), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
>>>>>
>>>>> We're looking into moving the Mongo DB instance to= the cloud in
>>>>> Azure.=C2=A0 Hopefully that will save us fixing this k= ind of
>>>>> maintenance issues.=C2=A0 Meanwhile, we should take a = look and see if
>>>>> there's some config option to limit the amount of = RAM used by
>>>>> Mongo DB to work around the problem.
>>>>>
>>>>> Best wishes,
>>>>> Guillaume
>>>>>
>>>>>
>>>>>> On Tue, Jun 22, 2021 at 2:43 AM Micha=C5=82 Ga=C5= =82ka <m= ichal.galka@collabora.com <mailto:michal.galka@collabora.com>> wrote:=
>>>>>>
>>>>>>=C2=A0 =C2=A0 =C2=A0On 21.06.2021 21:59, Todd Kjos = via group= s.io <http://groups.io> wrote:
>>>>>>=C2=A0 =C2=A0 =C2=A0> I'm having this issue = again (can't access kernelci results
>>>>>>=C2=A0 =C2=A0 =C2=A0> at https://l= inux.kernelci.org/job/android/ <https://linux.kernelci= .org/job/android/>
>>>>>>=C2=A0 =C2=A0 =C2=A0> <https://= linux.kernelci.org/job/android/ <https://linux.kernelc= i.org/job/android/>>). Is the mongod service borked
>>>>>>=C2=A0 =C2=A0 =C2=A0> again?
>>>>>>=C2=A0 =C2=A0 =C2=A0>
>>>>>>
>>>>>>=C2=A0 =C2=A0 =C2=A0Yes, there was an issue with mo= ngod service again. It's working now,
>>>>>>=C2=A0 =C2=A0 =C2=A0celery processed pending tasks = and everything seems responsive.
>>>>>>
>>>>>>=C2=A0 =C2=A0 =C2=A0Thanks,
>>>>>>=C2=A0 =C2=A0 =C2=A0Micha=C5=82
>>>>>>
>>>>>

--000000000000bfaf5405da801043--