next-20190903 kselftest results

next-20190903 kselftest results

[ci_notify]

[-- Attachment #1: Type: text/plain, Size: 2344 bytes --]

Summary
------------------------------------------------------------------------
kernel: 5.3.0-rc7
git repo: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
git branch: master
git commit: 7dc4585e03786f84d6e9dc16caa3ba5b8b44d986
git describe: next-20190903
Test details: https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20190903

Regressions (compared to build next-20190902)
------------------------------------------------------------------------
No regressions                                                                                                          
                                                                                                                       
Fixes (compared to build next-20190902)                                                                   
------------------------------------------------------------------------                                               
No fixes

In total:
------------------------------------------------------------------------
Ran 12 total tests in the following environments and test suites.
pass 0
fail 12
xfail 0
skip 0

Environments
--------------
- dragonboard-410c - arm64
- hi6220-hikey - arm64
- i386
- juno-r2 - arm64
- qemu_arm
- qemu_arm64
- qemu_i386
- qemu_x86_64
- x15 - arm
- x86_64

Test Suites
-----------
* boot-lkft-kselftests-master-598
* boot-lkft-kselftests-vsyscall-mode-native-master-598
* boot-lkft-kselftests-vsyscall-mode-none-master-598


Failures
------------------------------------------------------------------------

i386:
* boot-lkft-kselftests-master-598/x86

juno-r2:
* boot-lkft-kselftests-master-598/juno-r2

qemu_x86_64:
* boot-lkft-kselftests-master-598/qemu

x86:
* boot-lkft-kselftests-vsyscall-mode-none-master-598/x86
* boot-lkft-kselftests-vsyscall-mode-native-master-598/x86
* boot-lkft-kselftests-master-598/x86

qemu_i386:
* boot-lkft-kselftests-master-598/qemu

qemu_arm:
* boot-lkft-kselftests-master-598/qemu-arm

x15:
* boot-lkft-kselftests-master-598/x15

dragonboard-410c:
* boot-lkft-kselftests-master-598/dragonboard-410c

hi6220-hikey:
* boot-lkft-kselftests-master-598/hi6220-hikey-r2

qemu_arm64:
* boot-lkft-kselftests-master-598/qemu-arm


Skips
------------------------------------------------------------------------
No skips


-- 
Linaro LKFT
https://lkft.linaro.org

Re: next-20190903 kselftest results

[shuah]

On 9/3/19 8:00 AM, ci_notify@linaro.org wrote:
> Summary
> ------------------------------------------------------------------------
> kernel: 5.3.0-rc7
> git repo: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
> git branch: master
> git commit: 7dc4585e03786f84d6e9dc16caa3ba5b8b44d986
> git describe: next-20190903
> Test details: https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20190903
> 
> Regressions (compared to build next-20190902)

Looks like you are running kselftest from 5.2 on this linux-next.
You won't be able to find any kselftest test regressions this way.
You aren't testing the kselftest patches that are in linux-next
for Linux 5.4-rc1.

It would be helpful if you match the kernel and kselftest for linux-next
and Linux mainline.

It will help find test bugs quicker that way.

thanks,
-- Shuah

Re: next-20190903 kselftest results

[Daniel Díaz]

Hello!

On Wed, 4 Sep 2019 at 17:44, shuah <shuah@kernel.org> wrote:
> On 9/3/19 8:00 AM, ci_notify@linaro.org wrote:
> > Summary
> > ------------------------------------------------------------------------
> > kernel: 5.3.0-rc7
> > git repo: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
> > git branch: master
> > git commit: 7dc4585e03786f84d6e9dc16caa3ba5b8b44d986
> > git describe: next-20190903
> > Test details: https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20190903
> >
> > Regressions (compared to build next-20190902)
>
> Looks like you are running kselftest from 5.2 on this linux-next.
> You won't be able to find any kselftest test regressions this way.
> You aren't testing the kselftest patches that are in linux-next
> for Linux 5.4-rc1.

The way OE refers to versions can be confusing (it was for me, at
least). The version is said to be "5.2+gitAUTOINC+7dc4585e03", which
means that it's 5.2 (last known version) + some Git commits. In this
case, 7dc4585e03 points to next-20190903.


> It would be helpful if you match the kernel and kselftest for linux-next
> and Linux mainline.

Indeed, we do that exactly:
* linux-next is tested with the in-kernel version of kselftests
* linux-mainline is tested with the in-kernel version of kselftests
* linux-stable 5.2 is tested with the latest released kselftests
(*should* be 5.2.11)
* linux-stable 4.19 is tested with the latest released kselftests
(*should* be 5.2.11)
* and so on for 4.14, 4.9 and 4.4

Greetings!

Daniel Díaz
daniel.diaz@linaro.org

Re: next-20190903 kselftest results

[shuah]

On 9/4/19 7:10 PM, Daniel Díaz wrote:
> Hello!
> 
> On Wed, 4 Sep 2019 at 17:44, shuah <shuah@kernel.org> wrote:
>> On 9/3/19 8:00 AM, ci_notify@linaro.org wrote:
>>> Summary
>>> ------------------------------------------------------------------------
>>> kernel: 5.3.0-rc7
>>> git repo: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
>>> git branch: master
>>> git commit: 7dc4585e03786f84d6e9dc16caa3ba5b8b44d986
>>> git describe: next-20190903
>>> Test details: https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20190903 >>>
>>> Regressions (compared to build next-20190902)
>>
>> Looks like you are running kselftest from 5.2 on this linux-next.
>> You won't be able to find any kselftest test regressions this way.
>> You aren't testing the kselftest patches that are in linux-next
>> for Linux 5.4-rc1.
> 
> The way OE refers to versions can be confusing (it was for me, at
> least). The version is said to be "5.2+gitAUTOINC+7dc4585e03", which
> means that it's 5.2 (last known version) + some Git commits. In this
> case, 7dc4585e03 points to next-20190903.
> 
> 
>> It would be helpful if you match the kernel and kselftest for linux-next
>> and Linux mainline.
> 
> Indeed, we do that exactly:
> * linux-next is tested with the in-kernel version of kselftests
> * linux-mainline is tested with the in-kernel version of kselftests
> * linux-stable 5.2 is tested with the latest released kselftests
> (*should* be 5.2.11)
> * linux-stable 4.19 is tested with the latest released kselftests
> (*should* be 5.2.11)
> * and so on for 4.14, 4.9 and 4.4
> 

Yeah then why does the site show the following?


 >>> Test details: 
https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20190903
kselftest__version 5.2+gitAUTOINC+7dc4585e03
libhugetlbfs__version 2.21
make_kernelversion 5.3.0-rc7

This is why I asked the above question about revisions.

thanks,
-- Shuah