Fwd: ❌ FAIL: Test report for kernel 5.7.0-f359287.cki (mainline.kernel.org)

Fwd: ❌ FAIL: Test report for kernel 5.7.0-f359287.cki (mainline.kernel.org)

[Ondrej Mosnacek]

Hi all,

it seems that the "overlay" subtest of the selinux-testsuite started
failing on the latest Linus' tree - see below. The relevant log is
here:
https://cki-artifacts.s3.us-east-2.amazonaws.com/datawarehouse/2020/06/01/590497/selinux_policy__serge_testsuite/x86_64_1_selinux_taskout.log

Pasting in the relevant excerpt from the log:
==============8<==============
[...]
overlay/test ................
overlay/test ................ 1/119 rm: cannot remove
'overlay/container1/merged/transition': Permission denied

#   Failed test at overlay/test line 429.

#   Failed test at overlay/test line 447.
rm: cannot remove 'overlay/container1/merged/writedir': Permission denied

#   Failed test at overlay/test line 465.

overlay/test ................ 41/119 unlink: cannot unlink
'overlay/container1/merged/writefile': Permission denied

#   Failed test at overlay/test line 582.
rm: cannot remove 'overlay/container1/merged/transition': Permission denied

#   Failed test at overlay/test line 429.
rm: cannot remove 'overlay/container1/merged/writedir': Permission denied

#   Failed test at overlay/test line 465.
unlink: cannot unlink 'overlay/container1/merged/client_nounlinkfile':
Permission denied

#   Failed test at overlay/test line 573.
unlink: cannot unlink 'overlay/container1/merged/writefile': Permission denied

#   Failed test at overlay/test line 582.
unlink: cannot unlink 'overlay/container1/merged/mounterfile': Permission denied

#   Failed test at overlay/test line 600.

overlay/test ................ 113/119 # Looks like you failed 9 tests of 119.


overlay/test ................ Dubious, test returned 9 (wstat 2304, 0x900)
Failed 9/119 subtests
[...]
Test Summary Report
-------------------
overlay/test              (Wstat: 2304 Tests: 119 Failed: 9)
  Failed tests:  35, 37-38, 51, 93, 96, 108-110
  Non-zero exit status: 9
Files=61, Tests=811, 165 wallclock secs ( 0.41 usr  0.09 sys +  4.87
cusr  6.68 csys = 12.05 CPU)
Result: FAIL
Failed 1/61 test programs. 9/811 subtests failed.
==============8<==============

I haven't tried to reproduce/debug it locally yet. Just posting here
as a heads-up. The last known good commit is c2b0fc847f31 ("Merge tag
'for-linus' of git://git.armlinux.org.uk/~rmk/linux-arm"), first known
failing is f359287765c0 ("Merge branch 'from-miklos' of
git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs").

---------- Forwarded message ---------
From: CKI Project <cki-project@redhat.com>
Date: Tue, Jun 2, 2020 at 6:14 AM
Subject: ❌ FAIL: Test report for kernel 5.7.0-f359287.cki (mainline.kernel.org)
To:
Cc: Milos Malik <mmalik@redhat.com>, Ondrej Mosnacek
<omosnace@redhat.com>, Memory Management <mm-qe@redhat.com>, Jan
Stancek <jstancek@redhat.com>, Fei Liu <feliu@redhat.com>, Jianlin Shi
<jishi@redhat.com>, Jianwen Ji <jiji@redhat.com>, Hangbin Liu
<haliu@redhat.com>

Hello,

We ran automated tests on a recent commit from this kernel tree:

       Kernel repo:
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
            Commit: f359287765c0 - Merge branch 'from-miklos' of
git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

The results of these automated tests are provided below.

    Overall result: FAILED (see details below)
             Merge: OK
           Compile: OK
             Tests: FAILED

All kernel binaries, config files, and logs are available for download here:

  https://cki-artifacts.s3.us-east-2.amazonaws.com/index.html?prefix=datawarehouse/2020/06/01/590497

One or more kernel tests failed:

    x86_64:
     ❌ selinux-policy: serge-testsuite

<snip>

Compile testing
---------------

We compiled the kernel for 1 architecture:

    x86_64:
      make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg



Hardware testing
----------------
We booted each kernel and ran the following tests:

  x86_64:
    Host 1:
       ✅ Boot test
       ✅ xfstests - ext4
       ✅ xfstests - xfs
       ❌ selinux-policy: serge-testsuite
       ✅ storage: software RAID testing
       ✅ stress: stress-ng
        ✅ CPU: Frequency Driver Test
        ✅ CPU: Idle Test
        ✅ IOMMU boot test
        ✅ IPMI driver test
        ✅ IPMItool loop stress test
        ✅ Storage blktests

    Host 2:
       ✅ Boot test
        ✅ kdump - sysrq-c

    Host 3:
       ✅ Boot test
       ✅ Podman system integration test - as root
       ✅ Podman system integration test - as user
       ❌ LTP
       ✅ Loopdev Sanity
       ✅ Memory function: memfd_create
       ✅ AMTU (Abstract Machine Test Utility)
       ❌ Networking bridge: sanity
       ✅ Ethernet drivers sanity
       ✅ Networking socket: fuzz
       ✅ Networking: igmp conformance test
       ❌ Networking route: pmtu
       ❌ Networking route_func - local
       ❌ Networking route_func - forward
       ✅ Networking TCP: keepalive test
       ✅ Networking UDP: socket
       ✅ Networking tunnel: geneve basic test
       ✅ Networking tunnel: gre basic
       ✅ L2TP basic test
       ✅ Networking tunnel: vxlan basic
       ✅ Networking ipsec: basic netns - transport
       ✅ Networking ipsec: basic netns - tunnel
       ✅ Libkcapi AF_ALG test
       ✅ pciutils: sanity smoke test
       ✅ pciutils: update pci ids test
       ✅ ALSA PCM loopback test
       ✅ ALSA Control (mixer) Userspace Element test
       ✅ storage: SCSI VPD
        ✅ CIFS Connectathon
        ✅ POSIX pjd-fstest suites
        ✅ jvm - DaCapo Benchmark Suite
        ✅ jvm - jcstress tests
        ✅ Memory function: kaslr
        ✅ Networking firewall: basic netfilter test
        ✅ audit: audit testsuite test
        ✅ trace: ftrace/tracer
        ✅ kdump - kexec_boot

  Test sources: https://github.com/CKI-project/tests-beaker
    Pull requests are welcome for new tests or improvements to existing tests!

Aborted tests
-------------
Tests that didn't complete running successfully are marked with ⚡⚡⚡.
If this was caused by an infrastructure issue, we try to mark that
explicitly in the report.

Waived tests
------------
If the test run included waived tests, they are marked with . Such tests are
executed but their results are not taken into account. Tests are waived when
their results are not reliable enough, e.g. when they're just introduced or are
being fixed.

Testing timeout
---------------
We aim to provide a report within reasonable timeframe. Tests that haven't
finished running yet are marked with ⏱.

--
Ondrej Mosnacek
Software Engineer, Platform Security - SELinux kernel
Red Hat, Inc.

Re: ❌ FAIL: Test report for kernel 5.7.0-f359287.cki (mainline.kernel.org)

[Miklos Szeredi]

On Tue, Jun 2, 2020 at 11:27 AM Ondrej Mosnacek <omosnace@redhat.com> wrote:

> I haven't tried to reproduce/debug it locally yet. Just posting here
> as a heads-up. The last known good commit is c2b0fc847f31 ("Merge tag
> 'for-linus' of git://git.armlinux.org.uk/~rmk/linux-arm"), first known
> failing is f359287765c0 ("Merge branch 'from-miklos' of
> git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs").

Likely culprit is:

a3c751a50fe6 ("vfs: allow unprivileged whiteout creation")

And the change of behavior vs. LSM are expected due to the fact that
now whiteout creation calls the security_inode_mknod() whereas before
the patch that hook wasn't called.  This was discussed here:

https://lore.kernel.org/linux-fsdevel/20200409212859.GH28467@miu.piliscsaba.redhat.com/

Thanks,
Miklos