[cip-dev] A lot of compiles failing

[cip-dev] A lot of compiles failing

[Pavel Machek]

[-- Attachment #1.1: Type: text/plain, Size: 1239 bytes --]

Hi!

This is going on for a few days now, but today it seems worse than
usual:

https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843

builds are failing, 'HTTP 500 curl 22' error, so not a real build
problem. I can probably just click restart... 6 times. But something
is not there, and it is getting worse.

Best regards,
								Pavel


g for pod gitlab/runner-bcrayztp-project-2678032-concurrent-7hmhsr to be running, status is Pending
74Running on runner-bcrayztp-project-2678032-concurrent-7hmhsr via cip-project-v3-gitlab-runner-6dbd79945f-wdqqw...
76
Fetching changes with git depth set to 10...
00:18
77Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-cip/.git/
78Created fresh repository.
79error: RPC failed; HTTP 500 curl 22 The requested URL returned error: 500 
80fatal: the remote end hung up unexpectedly
82
Uploading artifacts...
00:00
83WARNING: output: no matching files                 
84ERROR: No files to upload                          
86ERROR: Job failed: command terminated with exit code 1
-- 
DENX Software Engineering GmbH,      Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 195 bytes --]

[-- Attachment #2: Type: text/plain, Size: 420 bytes --]


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#5826): https://lists.cip-project.org/g/cip-dev/message/5826
Mute This Topic: https://lists.cip-project.org/mt/78460850/4520388
Group Owner: cip-dev+owner@lists.cip-project.org
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [cip-dev@archiver.kernel.org]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [cip-dev] A lot of compiles failing

[Chris Paterson]

[-- Attachment #1: Type: text/plain, Size: 1701 bytes --]

Hello Pavel,

> From: Pavel Machek <pavel@denx.de>
> Sent: 23 November 2020 19:10
>
> *** gpg4o | The signature of this email could not be verified because the
> following public key is missing. Click here to search and import the key
> 30E7F06A95DBFAF2 ***
>
> Hi!
>
> This is going on for a few days now, but today it seems worse than
> usual:

For me things seems to have stabilised now.
Are you still seeing a lot of issues?

Kind regards, Chris


>
> https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843
>
> builds are failing, 'HTTP 500 curl 22' error, so not a real build
> problem. I can probably just click restart... 6 times. But something
> is not there, and it is getting worse.
>
> Best regards,
>                                                               Pavel
>
>
> g for pod gitlab/runner-bcrayztp-project-2678032-concurrent-7hmhsr to be
> running, status is Pending
> 74Running on runner-bcrayztp-project-2678032-concurrent-7hmhsr via cip-
> project-v3-gitlab-runner-6dbd79945f-wdqqw...
> 76
> Fetching changes with git depth set to 10...
> 00:18
> 77Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-
> cip/.git/
> 78Created fresh repository.
> 79error: RPC failed; HTTP 500 curl 22 The requested URL returned error: 500
> 80fatal: the remote end hung up unexpectedly
> 82
> Uploading artifacts...
> 00:00
> 83WARNING: output: no matching files
> 84ERROR: No files to upload
> 86ERROR: Job failed: command terminated with exit code 1
> --
> DENX Software Engineering GmbH,      Managing Director: Wolfgang Denk
> HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

[-- Attachment #2: Type: text/plain, Size: 420 bytes --]


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#5928): https://lists.cip-project.org/g/cip-dev/message/5928
Mute This Topic: https://lists.cip-project.org/mt/78460850/4520388
Group Owner: cip-dev+owner@lists.cip-project.org
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [cip-dev@archiver.kernel.org]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [cip-dev] A lot of compiles failing

[Pavel Machek]

[-- Attachment #1.1: Type: text/plain, Size: 1164 bytes --]

Hi!

> > From: Pavel Machek <pavel@denx.de>
> > Sent: 23 November 2020 19:10
> >
> > *** gpg4o | The signature of this email could not be verified because the
> > following public key is missing. Click here to search and import the key
> > 30E7F06A95DBFAF2 ***
> >
> > Hi!
> >
> > This is going on for a few days now, but today it seems worse than
> > usual:
> 
> For me things seems to have stabilised now.
> Are you still seeing a lot of issues?

I still see them:

https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/pipelines/225881953

2 builds failed, for example:

https://gitlab.com/cip-project/cip-testing/linux-stable-rc-ci/-/jobs/893211490

225
Cloning into '.'...
00:32
226$ git clone --depth 10 --branch $CI_COMMIT_REF_NAME
https://gitlab.com/cip-project/cip-testing/linux-stable-rc.git .
227error: RPC failed; HTTP 500 curl 22 The requested URL returned
error: 500 Server Error
228fatal: The remote end hung up unexpectedly

Best regards,
								Pavel

-- 
DENX Software Engineering GmbH,      Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

[-- Attachment #2: Type: text/plain, Size: 420 bytes --]


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#5946): https://lists.cip-project.org/g/cip-dev/message/5946
Mute This Topic: https://lists.cip-project.org/mt/78460850/4520388
Group Owner: cip-dev+owner@lists.cip-project.org
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [cip-dev@archiver.kernel.org]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [cip-dev] A lot of compiles failing

[Pavel Machek]

[-- Attachment #1.1: Type: text/plain, Size: 1508 bytes --]

Hi!

> This is going on for a few days now, but today it seems worse than
> usual:
> 
> https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843
> 
> builds are failing, 'HTTP 500 curl 22' error, so not a real build
> problem. I can probably just click restart... 6 times. But something
> is not there, and it is getting worse.

Today I got new one....

Waiting for pod gitlab/runner-bcrayztp-project-2678032-concurrent-392fb6 to be running, status is Pending
217Running on runner-bcrayztp-project-2678032-concurrent-392fb6 via cip-project-v3-gitlab-runner-6dbd79945f-wdqqw...
219
Fetching changes with git depth set to 10...
00:35
220Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-cip/.git/
221Created fresh repository.
222error: RPC failed; curl 92 HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2)
223fatal: the remote end hung up unexpectedly
224fatal: early EOF
225fatal: index-pack failed
227
Uploading artifacts.

I wonder... Is each of our workers pulling full copy of kernel from
gitlab?

If so, I understand that gitlab might be a bit unhappy. We probably
should populate the initial version from our servers (or from
kernel.org), or maybe include copy of recent linux directly into
machine images... to reduce load on gitlab.

Best regards,
								Pavel

-- 
DENX Software Engineering GmbH,      Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 195 bytes --]

[-- Attachment #2: Type: text/plain, Size: 420 bytes --]


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#5861): https://lists.cip-project.org/g/cip-dev/message/5861
Mute This Topic: https://lists.cip-project.org/mt/78460850/4520388
Group Owner: cip-dev+owner@lists.cip-project.org
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [cip-dev@archiver.kernel.org]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [cip-dev] A lot of compiles failing

[Sudip Mukherjee]

[-- Attachment #1: Type: text/plain, Size: 1469 bytes --]

Hi Pavel,

On 24/11/2020 18:44, Pavel Machek wrote:
> Hi!
> 
>> This is going on for a few days now, but today it seems worse than
>> usual:
>>
>> https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/220169843
>>
>> builds are failing, 'HTTP 500 curl 22' error, so not a real build
>> problem. I can probably just click restart... 6 times. But something
>> is not there, and it is getting worse.
> 
> Today I got new one....
> 
> Waiting for pod gitlab/runner-bcrayztp-project-2678032-concurrent-392fb6 to be running, status is Pending
> 217Running on runner-bcrayztp-project-2678032-concurrent-392fb6 via cip-project-v3-gitlab-runner-6dbd79945f-wdqqw...
> 219
> Fetching changes with git depth set to 10...
> 00:35
> 220Initialized empty Git repository in /builds/cip-project/cip-kernel/linux-cip/.git/
> 221Created fresh repository.
> 222error: RPC failed; curl 92 HTTP/2 stream 0 was not closed cleanly: INTERNAL_ERROR (err 2)
> 223fatal: the remote end hung up unexpectedly
> 224fatal: early EOF
> 225fatal: index-pack failed
> 227
> Uploading artifacts.
> 
> I wonder... Is each of our workers pulling full copy of kernel from
> gitlab?
> 
> If so, I understand that gitlab might be a bit unhappy. We probably
> should populate the initial version from our servers (or from
> kernel.org), or maybe include copy of recent linux directly into
> machine images... to reduce load on gitlab.

Maybe you can consider using git depth of 1.


-- 
Regards
Sudip

[-- Attachment #2: Type: text/plain, Size: 420 bytes --]


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#5862): https://lists.cip-project.org/g/cip-dev/message/5862
Mute This Topic: https://lists.cip-project.org/mt/78460850/4520388
Group Owner: cip-dev+owner@lists.cip-project.org
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [cip-dev@archiver.kernel.org]
-=-=-=-=-=-=-=-=-=-=-=-