Is the MongoDB server down again? I don't get results at https://linux.kernelci.org/job/android/.

On Wed, Dec 1, 2021 at 1:49 AM Guillaume Tucker <guillaume.tucker@collabora.com> wrote:
Hi Todd,

On 30/11/2021 16:54, Todd Kjos wrote:
> ...and now it's working again. Sorry about the noise if the issue was
> on my side.

The MongoDB server did crash but it was restarted a few minutes
later.  There's some kind of watchdog to do that automatically,
maybe you were out of luck and checked the website during that
window.  Thanks for reporting the issue in any case.

Best wishes,
Guillaume

> On Tue, Nov 30, 2021 at 8:35 AM Todd Kjos <tkjos@google.com> wrote:
>>
>> I can't load the data from https://linux.kernelci.org/job/android/
>> ("Error loading build data."). Is mongod "borked" again?
>>
>> On Thu, Sep 2, 2021 at 12:28 PM Todd Kjos <tkjos@google.com> wrote:
>>>
>>> It's working again. Thanks.
>>>
>>> On Thu, Sep 2, 2021 at 8:58 AM Todd Kjos <tkjos@google.com> wrote:
>>>>
>>>> I'm getting errors again when attempting to access
>>>> https://linux.kernelci.org/job/android/. mongod issues again?
>>>>
>>>> "Error while loading data from the server (error code: 500). Please
>>>> contact the website administrator"
>>>>
>>>> On Tue, Jun 22, 2021 at 8:17 AM Guillaume Tucker
>>>> <guillaume.tucker@collabora.com> wrote:
>>>>>
>>>>> On 22/06/2021 16:07, Todd Kjos wrote:
>>>>>> Hmm, it's still not working for me -- did it break again?
>>>>>
>>>>> Yes there was an OOM issue:
>>>>>
>>>>> [4316410.416514] Killed process 20620 (mongod) total-vm:20171340kB, anon-rss:18654740kB, file-rss:0kB, shmem-rss:0kB
>>>>> [4316412.060511] oom_reaper: reaped process 20620 (mongod), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
>>>>>
>>>>> We're looking into moving the Mongo DB instance to the cloud in
>>>>> Azure.  Hopefully that will save us fixing this kind of
>>>>> maintenance issues.  Meanwhile, we should take a look and see if
>>>>> there's some config option to limit the amount of RAM used by
>>>>> Mongo DB to work around the problem.
>>>>>
>>>>> Best wishes,
>>>>> Guillaume
>>>>>
>>>>>
>>>>>> On Tue, Jun 22, 2021 at 2:43 AM Michał Gałka <michal.galka@collabora.com <mailto:michal.galka@collabora.com>> wrote:
>>>>>>
>>>>>>     On 21.06.2021 21:59, Todd Kjos via groups.io <http://groups.io> wrote:
>>>>>>     > I'm having this issue again (can't access kernelci results
>>>>>>     > at https://linux.kernelci.org/job/android/ <https://linux.kernelci.org/job/android/>
>>>>>>     > <https://linux.kernelci.org/job/android/ <https://linux.kernelci.org/job/android/>>). Is the mongod service borked
>>>>>>     > again?
>>>>>>     >
>>>>>>
>>>>>>     Yes, there was an issue with mongod service again. It's working now,
>>>>>>     celery processed pending tasks and everything seems responsive.
>>>>>>
>>>>>>     Thanks,
>>>>>>     Michał
>>>>>>
>>>>>