From: Todd Kjos <tkjos@google.com>
To: Denys Fedoryshchenko <denys.f@collabora.com>
Cc: kernelci@groups.io,
"Guillaume Tucker" <guillaume.tucker@collabora.com>,
"Michał Gałka" <michal.galka@collabora.com>,
"Guenter Roeck" <groeck@google.com>,
"Kevin Hilman" <khilman@baylibre.com>
Subject: Re: can't access kernelci results
Date: Fri, 21 Oct 2022 09:25:02 -0700 [thread overview]
Message-ID: <CAHRSSEy=nx4+MDz7ofOsJgeoTYE2Khp_XRSWcysUPw_mtiBG5g@mail.gmail.com> (raw)
In-Reply-To: <CAHRSSExho+0=LJHxzqoUpX3aZOerE9BOi3cyjgFR+zvdnAOecw@mail.gmail.com>
Dashboard broken again (https://linux.kernelci.org/job/android/)? (Error
while loading data from the server (error code: 500). Please contact the
website administrator)
On Fri, Oct 14, 2022 at 11:39 AM Todd Kjos <tkjos@google.com> wrote:
> Thanks. It's working again.
>
> On Fri, Oct 14, 2022 at 11:17 AM Denys Fedoryshchenko <
> denys.f@collabora.com> wrote:
>
>> Thanks for info, i am investigating issue and will fix problem shortly.
>> Hopefully next week we will have monitoring system in place.
>>
>> On Fri, 2022-10-14 at 11:12 -0700, Todd Kjos wrote:
>>
>> The dashboard is broken again. Known issue?
>>
>> "Error while loading data from the server (error code: 500). Please
>> contact the website administrator"
>>
>> On Mon, Sep 26, 2022 at 9:13 AM Todd Kjos <tkjos@google.com> wrote:
>>
>> Thanks for the quick response! It's working for me now.
>>
>> On Mon, Sep 26, 2022 at 9:06 AM Denys Fedoryshchenko <
>> denys.f@collabora.com> wrote:
>>
>> Upd: dashboard should be fine now, but we are running update right now,
>> so some glitches might happen.
>>
>> On Mon, 2022-09-26 at 18:35 +0300, Denys Fedoryshchenko wrote:
>> > We are investingating right now and trying to solve the issue.
>> >
>> > On Mon, 2022-09-26 at 08:29 -0700, Todd Kjos via groups.io wrote:
>> > > Having trouble accessing
>> > > https://linux.kernelci.org/job/android/ today -
>> > > server issues?
>> > >
>> > > On Fri, Mar 18, 2022 at 10:26 AM Guillaume Tucker <
>> > > guillaume.tucker@collabora.com> wrote:
>> > >
>> > > > On 18/03/2022 17:19, Guillaume Tucker wrote:
>> > > >
>> > > > On 18/03/2022 15:47, Todd Kjos wrote:
>> > > >
>> > > > Is the MongoDB server down again? I don't get results at
>> > > > https://linux.kernelci.org/job/android/.
>> > > >
>> > > > It's not that, unfortunately there's some persisting issue which
>> > > > seems to
>> > > > have started yesterday. We're investigating now, please bear with
>> > > > us. Thank
>> > > > you for reporting the problem.
>> > > >
>> > > > Alright, there was a problem with background processing tasks on
>> > > > the
>> > > > server. That's resolved now, although a number of kernel builds
>> > > > need to be
>> > > > restarted which is why so many trees appear to be "in progress"
>> > > > on
>> > > > the web
>> > > > dashboard. Things will start picking up again gradually, it might
>> > > > take a
>> > > > few hours to get back to normal. Sorry for the inconvenience.
>> > > >
>> > > > Best wishes,
>> > > > Guillaume
>> > > >
>> > > >
>> > > > On Wed, Dec 1, 2021 at 1:49 AM Guillaume Tucker <
>> > > > guillaume.tucker@collabora.com> wrote:
>> > > >
>> > > > > Hi Todd,
>> > > > >
>> > > > > On 30/11/2021 16:54, Todd Kjos wrote:
>> > > > > > ...and now it's working again. Sorry about the noise if the
>> > > > > > issue was
>> > > > > > on my side.
>> > > > >
>> > > > > The MongoDB server did crash but it was restarted a few minutes
>> > > > > later. There's some kind of watchdog to do that automatically,
>> > > > > maybe you were out of luck and checked the website during that
>> > > > > window. Thanks for reporting the issue in any case.
>> > > > >
>> > > > > Best wishes,
>> > > > > Guillaume
>> > > > >
>> > > > > > On Tue, Nov 30, 2021 at 8:35 AM Todd Kjos <tkjos@google.com>
>> > > > > > wrote:
>> > > > > > >
>> > > > > > > I can't load the data from
>> > > > > > > https://linux.kernelci.org/job/android/
>> > > > > > > ("Error loading build data."). Is mongod "borked" again?
>> > > > > > >
>> > > > > > > On Thu, Sep 2, 2021 at 12:28 PM Todd Kjos
>> > > > > > > <tkjos@google.com>
>> > > > > > > wrote:
>> > > > > > > >
>> > > > > > > > It's working again. Thanks.
>> > > > > > > >
>> > > > > > > > On Thu, Sep 2, 2021 at 8:58 AM Todd Kjos
>> > > > > > > > <tkjos@google.com>
>> > > > > > > > wrote:
>> > > > > > > > >
>> > > > > > > > > I'm getting errors again when attempting to access
>> > > > > > > > > https://linux.kernelci.org/job/android/. mongod issues
>> > > > > > > > > again?
>> > > > > > > > >
>> > > > > > > > > "Error while loading data from the server (error code:
>> > > > > > > > > 500). Please
>> > > > > > > > > contact the website administrator"
>> > > > > > > > >
>> > > > > > > > > On Tue, Jun 22, 2021 at 8:17 AM Guillaume Tucker
>> > > > > > > > > <guillaume.tucker@collabora.com> wrote:
>> > > > > > > > > >
>> > > > > > > > > > On 22/06/2021 16:07, Todd Kjos wrote:
>> > > > > > > > > > > Hmm, it's still not working for me -- did it break
>> > > > > > > > > > > again?
>> > > > > > > > > >
>> > > > > > > > > > Yes there was an OOM issue:
>> > > > > > > > > >
>> > > > > > > > > > [4316410.416514] Killed process 20620 (mongod) total-
>> > > > > > > > > > vm:20171340kB,
>> > > > > anon-rss:18654740kB, file-rss:0kB, shmem-rss:0kB
>> > > > > > > > > > [4316412.060511] oom_reaper: reaped process 20620
>> > > > > > > > > > (mongod), now
>> > > > > anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
>> > > > > > > > > >
>> > > > > > > > > > We're looking into moving the Mongo DB instance to
>> > > > > > > > > > the
>> > > > > > > > > > cloud in
>> > > > > > > > > > Azure. Hopefully that will save us fixing this kind
>> > > > > > > > > > of
>> > > > > > > > > > maintenance issues. Meanwhile, we should take a look
>> > > > > > > > > > and see if
>> > > > > > > > > > there's some config option to limit the amount of RAM
>> > > > > > > > > > used by
>> > > > > > > > > > Mongo DB to work around the problem.
>> > > > > > > > > >
>> > > > > > > > > > Best wishes,
>> > > > > > > > > > Guillaume
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > > > On Tue, Jun 22, 2021 at 2:43 AM Michał Gałka <
>> > > > > michal.galka@collabora.com <mailto:michal.galka@collabora.com>>
>> > > > > wrote:
>> > > > > > > > > > >
>> > > > > > > > > > > On 21.06.2021 21:59, Todd Kjos via groups.io
>> > > > > > > > > > > <http://groups.io>
>> > > > > wrote:
>> > > > > > > > > > > > I'm having this issue again (can't access
>> > > > > > > > > > > kernelci results
>> > > > > > > > > > > > at https://linux.kernelci.org/job/android/ <
>> > > > > https://linux.kernelci.org/job/android/>
>> > > > > > > > > > > > <https://linux.kernelci.org/job/android/ <
>> > > > > https://linux.kernelci.org/job/android/>>). Is the mongod
>> > > > > service
>> > > > > borked
>> > > > > > > > > > > > again?
>> > > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > > Yes, there was an issue with mongod service
>> > > > > > > > > > > again. It's
>> > > > > working now,
>> > > > > > > > > > > celery processed pending tasks and everything
>> > > > > > > > > > > seems responsive.
>> > > > > > > > > > >
>> > > > > > > > > > > Thanks,
>> > > > > > > > > > > Michał
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>>
>>
>>
>>
next prev parent reply other threads:[~2022-10-21 16:25 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-04-05 19:02 can't access kernelci results Todd Kjos
2021-04-05 20:39 ` Guenter Roeck
2021-04-05 20:58 ` Guillaume Tucker
2021-04-05 23:14 ` Todd Kjos
2021-06-21 19:59 ` Todd Kjos
2021-06-22 9:43 ` Michał Gałka
2021-06-22 15:07 ` Todd Kjos
2021-06-22 15:16 ` Guillaume Tucker
2021-09-02 15:58 ` Todd Kjos
2021-09-02 19:28 ` Todd Kjos
2021-11-30 16:35 ` Todd Kjos
2021-11-30 16:54 ` Todd Kjos
2021-12-01 9:48 ` Guillaume Tucker
2022-03-18 15:47 ` Todd Kjos
2022-03-18 17:19 ` Guillaume Tucker
2022-03-18 17:26 ` Guillaume Tucker
2022-09-26 15:29 ` Todd Kjos
2022-09-26 15:35 ` Denys Fedoryshchenko
[not found] ` <17187305E642C450.18151@groups.io>
2022-09-26 16:06 ` Denys Fedoryshchenko
2022-09-26 16:13 ` Todd Kjos
2022-10-14 18:12 ` Todd Kjos
2022-10-14 18:16 ` Denys Fedoryshchenko
2022-10-14 18:39 ` Todd Kjos
2022-10-21 16:25 ` Todd Kjos [this message]
2022-10-22 7:00 ` Denys Fedoryshchenko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CAHRSSEy=nx4+MDz7ofOsJgeoTYE2Khp_XRSWcysUPw_mtiBG5g@mail.gmail.com' \
--to=tkjos@google.com \
--cc=denys.f@collabora.com \
--cc=groeck@google.com \
--cc=guillaume.tucker@collabora.com \
--cc=kernelci@groups.io \
--cc=khilman@baylibre.com \
--cc=michal.galka@collabora.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).