All of lore.kernel.org
 help / color / mirror / Atom feed
* Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
       [not found]   ` <BYAPR16MB261513751DCF34B035660665E2610@BYAPR16MB2615.namprd16.prod.outlook.com>
@ 2020-07-14 17:34     ` Vidhesh Ramesh
  2020-07-14 17:42       ` Kenneth Dsouza
  0 siblings, 1 reply; 7+ messages in thread
From: Vidhesh Ramesh @ 2020-07-14 17:34 UTC (permalink / raw)
  To: linux-cifs

Adding linux-cifs mailing list.

Vidhesh Ramesh


From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
Sent: Tuesday, July 14, 2020 10:18 AM
To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 
 
Hi Steve et all,

Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.


Vidhesh Ramesh


From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
Sent: Thursday, July 2, 2020 12:21 AM
To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 
 
Hi Steve et all,

Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.

Vidhesh Ramesh







From: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
Sent: Wednesday, June 24, 2020 10:26 PM
To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
Subject: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 
 
Hi Steve et al,
   My name is Ameya and I work for www.komprise.com.  The linux kernel with above mentioned version has been panicing, though randomly, but the stack trace appears is consistent.  You can find more details in the attachments.  Below is the brief description of the problem -

[1.] One line summary of the problem:
oops kernel panic
[2.] Full description of the problem/report:
ESX VM hangs with a kernel panic when cifs shares are mounted. Unable to ssh to the VM and the console of the VM is also not responding. With kdump service running and core collected the VM restarts successfully.
[3.] Keywords (i.e., modules, networking, kernel):
cifs, kernel, panic, strcmp, mount
[4.] Kernel information
[4.1.] Kernel version (from /proc/version):
Linux version 4.16.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)) #1 SMP Thu Apr 12 09:08:05 EDT 2018
[4.2.] Kernel .config file:
Please check the file uploaded
[5.] Most recent kernel version which did not have the bug:
[6.] Output of Oops.. message (if applicable) with symbolic information
     resolved (see Documentation/admin-guide/oops-tracing.rst)
[442282.069937] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
[442282.071474] IP: strcmp+0xe/0x30
[442282.072892] PGD 0 P4D 0
[442282.074196] Oops: 0000 [#1] SMP PTI
[442282.075561] Modules linked in: binfmt_misc fuse cmac rpcsec_gss_krb5 nfsv4 arc4 md4 nls_utf8 cifs ccm dns_resolver nfsv3 nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel vmw_balloon crypto_simd glue_helper cryptd sg intel_rapl_perf input_leds pcspkr joydev shpchp
[442282.090386]  parport_pc parport i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod pata_acpi crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih vmxnet3 drm mptbase libata floppy dm_mirror dm_region_hash dm_log dm_mod dax
[442282.095332] CPU: 4 PID: 9273 Comm: mount.cifs Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
[442282.097802] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
[442282.100363] RIP: 0010:strcmp+0xe/0x30
[442282.101645] RSP: 0018:ffffc9001bff7c88 EFLAGS: 00010202
[442282.102919] RAX: 0000000000000001 RBX: ffff8802ad7c2400 RCX: 0000000001240404
[442282.104207] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
[442282.105497] RBP: ffffc9001bff7c88 R08: 0000000001240404 R09: 0000000000000001
[442282.106765] R10: ffff88017d2c2b40 R11: ffff8801744c0e50 R12: ffff88011f793000
[442282.108038] R13: ffff88042b105800 R14: ffffc9001bff7d98 R15: ffff8801b63c0f00
[442282.109318] FS:  00007f3e90ee6780(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
[442282.110630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[442282.111970] CR2: 0000000000000000 CR3: 000000011b2ea000 CR4: 00000000000406e0
[442282.113405] Call Trace:
[442282.114849]  cifs_match_super+0x123/0x210 [cifs]
[442282.116211]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
[442282.117541]  sget_userns+0x88/0x4a0
[442282.118877]  ? cifs_kill_sb+0x30/0x30 [cifs]
[442282.120203]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
[442282.121502]  sget+0x7d/0xa0
[442282.122781]  ? cifs_kill_sb+0x30/0x30 [cifs]
[442282.124072]  cifs_do_mount+0x168/0x5a0 [cifs]
[442282.125364]  mount_fs+0x3e/0x150
[442282.126627]  vfs_kern_mount+0x67/0x130
[442282.127850]  do_mount+0x1f5/0xca0
[442282.129047]  SyS_mount+0x83/0xd0
[442282.130257]  do_syscall_64+0x79/0x1b0
[442282.131583]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[442282.132687] RIP: 0033:0x7f3e907fdfea
[442282.133754] RSP: 002b:00007ffee9139868 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
[442282.134842] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3e907fdfea
[442282.135909] RDX: 000055d13f5953b2 RSI: 000055d13f5953f9 RDI: 00007ffee913bb51
[442282.136944] RBP: 00007ffee913bb46 R08: 000055d1415e80d0 R09: 0000000000001000
[442282.137962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3e90ef0000
[442282.138957] R13: 000055d1415e80d0 R14: 00007f3e90ef290f R15: 0000000000000000
[442282.139918] Code: 80 3a 00 75 f7 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed 5d c3 0f 1f 00 55 48 89 e5 eb 04 84 c0 74 18 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 74 eb 19 c0 83 c8 01 5d c3 31
[442282.142829] RIP: strcmp+0xe/0x30 RSP: ffffc9001bff7c88
[442282.143759] CR2: 0000000000000000
[7.] A small shell script or example program which triggers the
     problem (if possible)

My colleague Vidhesh (CC'ed) will be glad to share further details on the test scenario and/or in-house reproduction.  Please let us know of workarounds, if any.

Thanks and Regards,
= Ameya


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
  2020-07-14 17:34     ` Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 Vidhesh Ramesh
@ 2020-07-14 17:42       ` Kenneth Dsouza
  2020-07-14 17:49         ` Steve French
  0 siblings, 1 reply; 7+ messages in thread
From: Kenneth Dsouza @ 2020-07-14 17:42 UTC (permalink / raw)
  To: Vidhesh Ramesh; +Cc: linux-cifs

You are hitting a known bug which has been fixed by below patch and is
part of v5.6 and above.

commit fe1292686333d1dadaf84091f585ee903b9ddb84
Author: Ronnie Sahlberg <lsahlber@redhat.com>
Date:   Wed Jan 22 11:07:56 2020 +1000

    cifs: fix NULL dereference in match_prepath

    RHBZ: 1760879

    Fix an oops in match_prepath() by making sure that the prepath string is not
    NULL before we pass it into strcmp().

    This is similar to other checks we make for example in cifs_root_iget()

    Signed-off-by: Ronnie Sahlberg <lsahlber@redhat.com>
    Signed-off-by: Steve French <stfrench@microsoft.com>

On Tue, Jul 14, 2020 at 11:05 PM Vidhesh Ramesh
<vidhesh.ramesh@komprise.com> wrote:
>
> Adding linux-cifs mailing list.
>
> Vidhesh Ramesh
>
>
> From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> Sent: Tuesday, July 14, 2020 10:18 AM
> To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> Hi Steve et all,
>
> Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
>
>
> Vidhesh Ramesh
>
>
> From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> Sent: Thursday, July 2, 2020 12:21 AM
> To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> Hi Steve et all,
>
> Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
>
> Vidhesh Ramesh
>
>
>
>
>
>
>
> From: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> Sent: Wednesday, June 24, 2020 10:26 PM
> To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> Subject: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> Hi Steve et al,
>    My name is Ameya and I work for www.komprise.com.  The linux kernel with above mentioned version has been panicing, though randomly, but the stack trace appears is consistent.  You can find more details in the attachments.  Below is the brief description of the problem -
>
> [1.] One line summary of the problem:
> oops kernel panic
> [2.] Full description of the problem/report:
> ESX VM hangs with a kernel panic when cifs shares are mounted. Unable to ssh to the VM and the console of the VM is also not responding. With kdump service running and core collected the VM restarts successfully.
> [3.] Keywords (i.e., modules, networking, kernel):
> cifs, kernel, panic, strcmp, mount
> [4.] Kernel information
> [4.1.] Kernel version (from /proc/version):
> Linux version 4.16.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)) #1 SMP Thu Apr 12 09:08:05 EDT 2018
> [4.2.] Kernel .config file:
> Please check the file uploaded
> [5.] Most recent kernel version which did not have the bug:
> [6.] Output of Oops.. message (if applicable) with symbolic information
>      resolved (see Documentation/admin-guide/oops-tracing.rst)
> [442282.069937] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
> [442282.071474] IP: strcmp+0xe/0x30
> [442282.072892] PGD 0 P4D 0
> [442282.074196] Oops: 0000 [#1] SMP PTI
> [442282.075561] Modules linked in: binfmt_misc fuse cmac rpcsec_gss_krb5 nfsv4 arc4 md4 nls_utf8 cifs ccm dns_resolver nfsv3 nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel vmw_balloon crypto_simd glue_helper cryptd sg intel_rapl_perf input_leds pcspkr joydev shpchp
> [442282.090386]  parport_pc parport i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod pata_acpi crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih vmxnet3 drm mptbase libata floppy dm_mirror dm_region_hash dm_log dm_mod dax
> [442282.095332] CPU: 4 PID: 9273 Comm: mount.cifs Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
> [442282.097802] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
> [442282.100363] RIP: 0010:strcmp+0xe/0x30
> [442282.101645] RSP: 0018:ffffc9001bff7c88 EFLAGS: 00010202
> [442282.102919] RAX: 0000000000000001 RBX: ffff8802ad7c2400 RCX: 0000000001240404
> [442282.104207] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
> [442282.105497] RBP: ffffc9001bff7c88 R08: 0000000001240404 R09: 0000000000000001
> [442282.106765] R10: ffff88017d2c2b40 R11: ffff8801744c0e50 R12: ffff88011f793000
> [442282.108038] R13: ffff88042b105800 R14: ffffc9001bff7d98 R15: ffff8801b63c0f00
> [442282.109318] FS:  00007f3e90ee6780(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
> [442282.110630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [442282.111970] CR2: 0000000000000000 CR3: 000000011b2ea000 CR4: 00000000000406e0
> [442282.113405] Call Trace:
> [442282.114849]  cifs_match_super+0x123/0x210 [cifs]
> [442282.116211]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> [442282.117541]  sget_userns+0x88/0x4a0
> [442282.118877]  ? cifs_kill_sb+0x30/0x30 [cifs]
> [442282.120203]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> [442282.121502]  sget+0x7d/0xa0
> [442282.122781]  ? cifs_kill_sb+0x30/0x30 [cifs]
> [442282.124072]  cifs_do_mount+0x168/0x5a0 [cifs]
> [442282.125364]  mount_fs+0x3e/0x150
> [442282.126627]  vfs_kern_mount+0x67/0x130
> [442282.127850]  do_mount+0x1f5/0xca0
> [442282.129047]  SyS_mount+0x83/0xd0
> [442282.130257]  do_syscall_64+0x79/0x1b0
> [442282.131583]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
> [442282.132687] RIP: 0033:0x7f3e907fdfea
> [442282.133754] RSP: 002b:00007ffee9139868 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
> [442282.134842] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3e907fdfea
> [442282.135909] RDX: 000055d13f5953b2 RSI: 000055d13f5953f9 RDI: 00007ffee913bb51
> [442282.136944] RBP: 00007ffee913bb46 R08: 000055d1415e80d0 R09: 0000000000001000
> [442282.137962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3e90ef0000
> [442282.138957] R13: 000055d1415e80d0 R14: 00007f3e90ef290f R15: 0000000000000000
> [442282.139918] Code: 80 3a 00 75 f7 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed 5d c3 0f 1f 00 55 48 89 e5 eb 04 84 c0 74 18 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 74 eb 19 c0 83 c8 01 5d c3 31
> [442282.142829] RIP: strcmp+0xe/0x30 RSP: ffffc9001bff7c88
> [442282.143759] CR2: 0000000000000000
> [7.] A small shell script or example program which triggers the
>      problem (if possible)
>
> My colleague Vidhesh (CC'ed) will be glad to share further details on the test scenario and/or in-house reproduction.  Please let us know of workarounds, if any.
>
> Thanks and Regards,
> = Ameya
>
>
>


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
  2020-07-14 17:42       ` Kenneth Dsouza
@ 2020-07-14 17:49         ` Steve French
       [not found]           ` <BYAPR16MB26156E99DAEAC5AB16C644A0E27C0@BYAPR16MB2615.namprd16.prod.outlook.com>
  0 siblings, 1 reply; 7+ messages in thread
From: Steve French @ 2020-07-14 17:49 UTC (permalink / raw)
  To: Kenneth Dsouza; +Cc: Vidhesh Ramesh, linux-cifs

If you have a particular stable kernel used for your distro you can
email stable@vger.kernel.org with the commit id and version you want
it backported for.

On Tue, Jul 14, 2020 at 12:43 PM Kenneth Dsouza <kdsouza@redhat.com> wrote:
>
> You are hitting a known bug which has been fixed by below patch and is
> part of v5.6 and above.
>
> commit fe1292686333d1dadaf84091f585ee903b9ddb84
> Author: Ronnie Sahlberg <lsahlber@redhat.com>
> Date:   Wed Jan 22 11:07:56 2020 +1000
>
>     cifs: fix NULL dereference in match_prepath
>
>     RHBZ: 1760879
>
>     Fix an oops in match_prepath() by making sure that the prepath string is not
>     NULL before we pass it into strcmp().
>
>     This is similar to other checks we make for example in cifs_root_iget()
>
>     Signed-off-by: Ronnie Sahlberg <lsahlber@redhat.com>
>     Signed-off-by: Steve French <stfrench@microsoft.com>
>
> On Tue, Jul 14, 2020 at 11:05 PM Vidhesh Ramesh
> <vidhesh.ramesh@komprise.com> wrote:
> >
> > Adding linux-cifs mailing list.
> >
> > Vidhesh Ramesh
> >
> >
> > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > Sent: Tuesday, July 14, 2020 10:18 AM
> > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> >
> > Hi Steve et all,
> >
> > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> >
> >
> > Vidhesh Ramesh
> >
> >
> > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > Sent: Thursday, July 2, 2020 12:21 AM
> > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> >
> > Hi Steve et all,
> >
> > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> >
> > Vidhesh Ramesh
> >
> >
> >
> >
> >
> >
> >
> > From: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > Sent: Wednesday, June 24, 2020 10:26 PM
> > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > Subject: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> >
> > Hi Steve et al,
> >    My name is Ameya and I work for www.komprise.com.  The linux kernel with above mentioned version has been panicing, though randomly, but the stack trace appears is consistent.  You can find more details in the attachments.  Below is the brief description of the problem -
> >
> > [1.] One line summary of the problem:
> > oops kernel panic
> > [2.] Full description of the problem/report:
> > ESX VM hangs with a kernel panic when cifs shares are mounted. Unable to ssh to the VM and the console of the VM is also not responding. With kdump service running and core collected the VM restarts successfully.
> > [3.] Keywords (i.e., modules, networking, kernel):
> > cifs, kernel, panic, strcmp, mount
> > [4.] Kernel information
> > [4.1.] Kernel version (from /proc/version):
> > Linux version 4.16.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)) #1 SMP Thu Apr 12 09:08:05 EDT 2018
> > [4.2.] Kernel .config file:
> > Please check the file uploaded
> > [5.] Most recent kernel version which did not have the bug:
> > [6.] Output of Oops.. message (if applicable) with symbolic information
> >      resolved (see Documentation/admin-guide/oops-tracing.rst)
> > [442282.069937] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
> > [442282.071474] IP: strcmp+0xe/0x30
> > [442282.072892] PGD 0 P4D 0
> > [442282.074196] Oops: 0000 [#1] SMP PTI
> > [442282.075561] Modules linked in: binfmt_misc fuse cmac rpcsec_gss_krb5 nfsv4 arc4 md4 nls_utf8 cifs ccm dns_resolver nfsv3 nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel vmw_balloon crypto_simd glue_helper cryptd sg intel_rapl_perf input_leds pcspkr joydev shpchp
> > [442282.090386]  parport_pc parport i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod pata_acpi crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih vmxnet3 drm mptbase libata floppy dm_mirror dm_region_hash dm_log dm_mod dax
> > [442282.095332] CPU: 4 PID: 9273 Comm: mount.cifs Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
> > [442282.097802] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
> > [442282.100363] RIP: 0010:strcmp+0xe/0x30
> > [442282.101645] RSP: 0018:ffffc9001bff7c88 EFLAGS: 00010202
> > [442282.102919] RAX: 0000000000000001 RBX: ffff8802ad7c2400 RCX: 0000000001240404
> > [442282.104207] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
> > [442282.105497] RBP: ffffc9001bff7c88 R08: 0000000001240404 R09: 0000000000000001
> > [442282.106765] R10: ffff88017d2c2b40 R11: ffff8801744c0e50 R12: ffff88011f793000
> > [442282.108038] R13: ffff88042b105800 R14: ffffc9001bff7d98 R15: ffff8801b63c0f00
> > [442282.109318] FS:  00007f3e90ee6780(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
> > [442282.110630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [442282.111970] CR2: 0000000000000000 CR3: 000000011b2ea000 CR4: 00000000000406e0
> > [442282.113405] Call Trace:
> > [442282.114849]  cifs_match_super+0x123/0x210 [cifs]
> > [442282.116211]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > [442282.117541]  sget_userns+0x88/0x4a0
> > [442282.118877]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > [442282.120203]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > [442282.121502]  sget+0x7d/0xa0
> > [442282.122781]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > [442282.124072]  cifs_do_mount+0x168/0x5a0 [cifs]
> > [442282.125364]  mount_fs+0x3e/0x150
> > [442282.126627]  vfs_kern_mount+0x67/0x130
> > [442282.127850]  do_mount+0x1f5/0xca0
> > [442282.129047]  SyS_mount+0x83/0xd0
> > [442282.130257]  do_syscall_64+0x79/0x1b0
> > [442282.131583]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
> > [442282.132687] RIP: 0033:0x7f3e907fdfea
> > [442282.133754] RSP: 002b:00007ffee9139868 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
> > [442282.134842] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3e907fdfea
> > [442282.135909] RDX: 000055d13f5953b2 RSI: 000055d13f5953f9 RDI: 00007ffee913bb51
> > [442282.136944] RBP: 00007ffee913bb46 R08: 000055d1415e80d0 R09: 0000000000001000
> > [442282.137962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3e90ef0000
> > [442282.138957] R13: 000055d1415e80d0 R14: 00007f3e90ef290f R15: 0000000000000000
> > [442282.139918] Code: 80 3a 00 75 f7 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed 5d c3 0f 1f 00 55 48 89 e5 eb 04 84 c0 74 18 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 74 eb 19 c0 83 c8 01 5d c3 31
> > [442282.142829] RIP: strcmp+0xe/0x30 RSP: ffffc9001bff7c88
> > [442282.143759] CR2: 0000000000000000
> > [7.] A small shell script or example program which triggers the
> >      problem (if possible)
> >
> > My colleague Vidhesh (CC'ed) will be glad to share further details on the test scenario and/or in-house reproduction.  Please let us know of workarounds, if any.
> >
> > Thanks and Regards,
> > = Ameya
> >
> >
> >
>


-- 
Thanks,

Steve

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
       [not found]             ` <CAH2r5ms2jsH2ka-9SAaN8v61YL16jN401uEDZJ7Uo0H0pLtH7g@mail.gmail.com>
@ 2020-07-17 21:23               ` Vidhesh Ramesh
  2020-07-17 21:34                 ` Steve French
  2020-07-17 21:44                 ` Steve French
  0 siblings, 2 replies; 7+ messages in thread
From: Vidhesh Ramesh @ 2020-07-17 21:23 UTC (permalink / raw)
  To: Steve French; +Cc: Kenneth Dsouza, CIFS

Thanks Steve. 
We have few more bug fixes that we need in 4.19 LT kernel. However I am unable to get a built kernel RPM of latest build 133 of kernel 4.19.
The latest I could get is build 113 of kernel 4.19 at https://buildlogs.centos.org/c7-kernels.x86_64/kernel/20200330213326/4.19.113-300.el8.x86_64/kernel-4.19.113-300.el7.x86_64.rpm

Vidhesh Ramesh

From: Steve French <smfrench@gmail.com>
Sent: Friday, July 17, 2020 7:05 AM
To: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
Cc: Kenneth Dsouza <kdsouza@redhat.com>; CIFS <linux-cifs@vger.kernel.org>
Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 
 
I am not familiar with your distro but a Google search matched on this as a more recent kernel rpm download with similar sounding name http://lists.elrepo.org/pipermail/elrepo/2018-May/004282.html 

But there should be more recent kernels than that are eg based on newer 4.6.18 stable branch https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/log/?h=linux-4.16.y

On Fri, Jul 17, 2020, 04:12 Vidhesh Ramesh <vidhesh.ramesh@komprise.com> wrote:
Thanks Steve and Kenneth for your responses.

I did look at the commits and found that this has been fixed in a patch of 4.19. Is there an archive where I can download latest 4.19 kernel rpm so that I can verify the fix ? 

Vidhesh Ramesh






From: Steve French <smfrench@gmail.com>
Sent: Tuesday, July 14, 2020 10:49 AM
To: Kenneth Dsouza <kdsouza@redhat.com>
Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>
Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 
 
If you have a particular stable kernel used for your distro you can
email stable@vger.kernel.org with the commit id and version you want
it backported for.

On Tue, Jul 14, 2020 at 12:43 PM Kenneth Dsouza <kdsouza@redhat.com> wrote:
>
> You are hitting a known bug which has been fixed by below patch and is
> part of v5.6 and above.
>
> commit fe1292686333d1dadaf84091f585ee903b9ddb84
> Author: Ronnie Sahlberg <lsahlber@redhat.com>
> Date:   Wed Jan 22 11:07:56 2020 +1000
>
>     cifs: fix NULL dereference in match_prepath
>
>     RHBZ: 1760879
>
>     Fix an oops in match_prepath() by making sure that the prepath string is not
>     NULL before we pass it into strcmp().
>
>     This is similar to other checks we make for example in cifs_root_iget()
>
>     Signed-off-by: Ronnie Sahlberg <lsahlber@redhat.com>
>     Signed-off-by: Steve French <stfrench@microsoft.com>
>
> On Tue, Jul 14, 2020 at 11:05 PM Vidhesh Ramesh
> <vidhesh.ramesh@komprise.com> wrote:
> >
> > Adding linux-cifs mailing list.
> >
> > Vidhesh Ramesh
> >
> >
> > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > Sent: Tuesday, July 14, 2020 10:18 AM
> > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> >
> > Hi Steve et all,
> >
> > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> >
> >
> > Vidhesh Ramesh
> >
> >
> > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > Sent: Thursday, July 2, 2020 12:21 AM
> > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> >
> > Hi Steve et all,
> >
> > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> >
> > Vidhesh Ramesh
> >
> >
> >
> >
> >
> >
> >
> > From: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > Sent: Wednesday, June 24, 2020 10:26 PM
> > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > Subject: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> >
> > Hi Steve et al,
> >    My name is Ameya and I work for www.komprise.com.  The linux kernel with above mentioned version has been panicing, though randomly, but the stack trace appears is consistent.  You can find more details in the attachments.  Below is the brief description of the problem -
> >
> > [1.] One line summary of the problem:
> > oops kernel panic
> > [2.] Full description of the problem/report:
> > ESX VM hangs with a kernel panic when cifs shares are mounted. Unable to ssh to the VM and the console of the VM is also not responding. With kdump service running and core collected the VM restarts successfully.
> > [3.] Keywords (i.e., modules, networking, kernel):
> > cifs, kernel, panic, strcmp, mount
> > [4.] Kernel information
> > [4.1.] Kernel version (from /proc/version):
> > Linux version 4.16.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)) #1 SMP Thu Apr 12 09:08:05 EDT 2018
> > [4.2.] Kernel .config file:
> > Please check the file uploaded
> > [5.] Most recent kernel version which did not have the bug:
> > [6.] Output of Oops.. message (if applicable) with symbolic information
> >      resolved (see Documentation/admin-guide/oops-tracing.rst)
> > [442282.069937] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
> > [442282.071474] IP: strcmp+0xe/0x30
> > [442282.072892] PGD 0 P4D 0
> > [442282.074196] Oops: 0000 [#1] SMP PTI
> > [442282.075561] Modules linked in: binfmt_misc fuse cmac rpcsec_gss_krb5 nfsv4 arc4 md4 nls_utf8 cifs ccm dns_resolver nfsv3 nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel vmw_balloon crypto_simd glue_helper cryptd sg intel_rapl_perf input_leds pcspkr joydev shpchp
> > [442282.090386]  parport_pc parport i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod pata_acpi crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih vmxnet3 drm mptbase libata floppy dm_mirror dm_region_hash dm_log dm_mod dax
> > [442282.095332] CPU: 4 PID: 9273 Comm: mount.cifs Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
> > [442282.097802] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
> > [442282.100363] RIP: 0010:strcmp+0xe/0x30
> > [442282.101645] RSP: 0018:ffffc9001bff7c88 EFLAGS: 00010202
> > [442282.102919] RAX: 0000000000000001 RBX: ffff8802ad7c2400 RCX: 0000000001240404
> > [442282.104207] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
> > [442282.105497] RBP: ffffc9001bff7c88 R08: 0000000001240404 R09: 0000000000000001
> > [442282.106765] R10: ffff88017d2c2b40 R11: ffff8801744c0e50 R12: ffff88011f793000
> > [442282.108038] R13: ffff88042b105800 R14: ffffc9001bff7d98 R15: ffff8801b63c0f00
> > [442282.109318] FS:  00007f3e90ee6780(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
> > [442282.110630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [442282.111970] CR2: 0000000000000000 CR3: 000000011b2ea000 CR4: 00000000000406e0
> > [442282.113405] Call Trace:
> > [442282.114849]  cifs_match_super+0x123/0x210 [cifs]
> > [442282.116211]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > [442282.117541]  sget_userns+0x88/0x4a0
> > [442282.118877]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > [442282.120203]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > [442282.121502]  sget+0x7d/0xa0
> > [442282.122781]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > [442282.124072]  cifs_do_mount+0x168/0x5a0 [cifs]
> > [442282.125364]  mount_fs+0x3e/0x150
> > [442282.126627]  vfs_kern_mount+0x67/0x130
> > [442282.127850]  do_mount+0x1f5/0xca0
> > [442282.129047]  SyS_mount+0x83/0xd0
> > [442282.130257]  do_syscall_64+0x79/0x1b0
> > [442282.131583]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
> > [442282.132687] RIP: 0033:0x7f3e907fdfea
> > [442282.133754] RSP: 002b:00007ffee9139868 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
> > [442282.134842] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3e907fdfea
> > [442282.135909] RDX: 000055d13f5953b2 RSI: 000055d13f5953f9 RDI: 00007ffee913bb51
> > [442282.136944] RBP: 00007ffee913bb46 R08: 000055d1415e80d0 R09: 0000000000001000
> > [442282.137962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3e90ef0000
> > [442282.138957] R13: 000055d1415e80d0 R14: 00007f3e90ef290f R15: 0000000000000000
> > [442282.139918] Code: 80 3a 00 75 f7 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed 5d c3 0f 1f 00 55 48 89 e5 eb 04 84 c0 74 18 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 74 eb 19 c0 83 c8 01 5d c3 31
> > [442282.142829] RIP: strcmp+0xe/0x30 RSP: ffffc9001bff7c88
> > [442282.143759] CR2: 0000000000000000
> > [7.] A small shell script or example program which triggers the
> >      problem (if possible)
> >
> > My colleague Vidhesh (CC'ed) will be glad to share further details on the test scenario and/or in-house reproduction.  Please let us know of workarounds, if any.
> >
> > Thanks and Regards,
> > = Ameya
> >
> >
> >
>


-- 
Thanks,

Steve

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
  2020-07-17 21:23               ` Vidhesh Ramesh
@ 2020-07-17 21:34                 ` Steve French
  2020-07-17 21:44                 ` Steve French
  1 sibling, 0 replies; 7+ messages in thread
From: Steve French @ 2020-07-17 21:34 UTC (permalink / raw)
  To: Vidhesh Ramesh; +Cc: Kenneth Dsouza, CIFS

At least it is very easy to build cifs.ko out of tree for old distros
that don't keep up to date with stable patches (e.g. something similar
to: cd into fs/cifs directory then "make C=1 -C
/usr/src/linux-headers-`uname -r` M=`pwd` modules") ... assuming you
can get src rpms for your distro version for the kernel.

On Fri, Jul 17, 2020 at 4:23 PM Vidhesh Ramesh
<vidhesh.ramesh@komprise.com> wrote:
>
> Thanks Steve.
> We have few more bug fixes that we need in 4.19 LT kernel. However I am unable to get a built kernel RPM of latest build 133 of kernel 4.19.
> The latest I could get is build 113 of kernel 4.19 at https://buildlogs.centos.org/c7-kernels.x86_64/kernel/20200330213326/4.19.113-300.el8.x86_64/kernel-4.19.113-300.el7.x86_64.rpm
>
> Vidhesh Ramesh
>
> From: Steve French <smfrench@gmail.com>
> Sent: Friday, July 17, 2020 7:05 AM
> To: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> Cc: Kenneth Dsouza <kdsouza@redhat.com>; CIFS <linux-cifs@vger.kernel.org>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> I am not familiar with your distro but a Google search matched on this as a more recent kernel rpm download with similar sounding name http://lists.elrepo.org/pipermail/elrepo/2018-May/004282.html
>
> But there should be more recent kernels than that are eg based on newer 4.6.18 stable branch https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/log/?h=linux-4.16.y
>
> On Fri, Jul 17, 2020, 04:12 Vidhesh Ramesh <vidhesh.ramesh@komprise.com> wrote:
> Thanks Steve and Kenneth for your responses.
>
> I did look at the commits and found that this has been fixed in a patch of 4.19. Is there an archive where I can download latest 4.19 kernel rpm so that I can verify the fix ?
>
> Vidhesh Ramesh
>
>
>
>
>
>
> From: Steve French <smfrench@gmail.com>
> Sent: Tuesday, July 14, 2020 10:49 AM
> To: Kenneth Dsouza <kdsouza@redhat.com>
> Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> If you have a particular stable kernel used for your distro you can
> email stable@vger.kernel.org with the commit id and version you want
> it backported for.
>
> On Tue, Jul 14, 2020 at 12:43 PM Kenneth Dsouza <kdsouza@redhat.com> wrote:
> >
> > You are hitting a known bug which has been fixed by below patch and is
> > part of v5.6 and above.
> >
> > commit fe1292686333d1dadaf84091f585ee903b9ddb84
> > Author: Ronnie Sahlberg <lsahlber@redhat.com>
> > Date:   Wed Jan 22 11:07:56 2020 +1000
> >
> >     cifs: fix NULL dereference in match_prepath
> >
> >     RHBZ: 1760879
> >
> >     Fix an oops in match_prepath() by making sure that the prepath string is not
> >     NULL before we pass it into strcmp().
> >
> >     This is similar to other checks we make for example in cifs_root_iget()
> >
> >     Signed-off-by: Ronnie Sahlberg <lsahlber@redhat.com>
> >     Signed-off-by: Steve French <stfrench@microsoft.com>
> >
> > On Tue, Jul 14, 2020 at 11:05 PM Vidhesh Ramesh
> > <vidhesh.ramesh@komprise.com> wrote:
> > >
> > > Adding linux-cifs mailing list.
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Sent: Tuesday, July 14, 2020 10:18 AM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et all,
> > >
> > > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> > >
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Sent: Thursday, July 2, 2020 12:21 AM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et all,
> > >
> > > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > From: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Sent: Wednesday, June 24, 2020 10:26 PM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Subject: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et al,
> > >    My name is Ameya and I work for www.komprise.com.  The linux kernel with above mentioned version has been panicing, though randomly, but the stack trace appears is consistent.  You can find more details in the attachments.  Below is the brief description of the problem -
> > >
> > > [1.] One line summary of the problem:
> > > oops kernel panic
> > > [2.] Full description of the problem/report:
> > > ESX VM hangs with a kernel panic when cifs shares are mounted. Unable to ssh to the VM and the console of the VM is also not responding. With kdump service running and core collected the VM restarts successfully.
> > > [3.] Keywords (i.e., modules, networking, kernel):
> > > cifs, kernel, panic, strcmp, mount
> > > [4.] Kernel information
> > > [4.1.] Kernel version (from /proc/version):
> > > Linux version 4.16.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)) #1 SMP Thu Apr 12 09:08:05 EDT 2018
> > > [4.2.] Kernel .config file:
> > > Please check the file uploaded
> > > [5.] Most recent kernel version which did not have the bug:
> > > [6.] Output of Oops.. message (if applicable) with symbolic information
> > >      resolved (see Documentation/admin-guide/oops-tracing.rst)
> > > [442282.069937] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
> > > [442282.071474] IP: strcmp+0xe/0x30
> > > [442282.072892] PGD 0 P4D 0
> > > [442282.074196] Oops: 0000 [#1] SMP PTI
> > > [442282.075561] Modules linked in: binfmt_misc fuse cmac rpcsec_gss_krb5 nfsv4 arc4 md4 nls_utf8 cifs ccm dns_resolver nfsv3 nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel vmw_balloon crypto_simd glue_helper cryptd sg intel_rapl_perf input_leds pcspkr joydev shpchp
> > > [442282.090386]  parport_pc parport i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod pata_acpi crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih vmxnet3 drm mptbase libata floppy dm_mirror dm_region_hash dm_log dm_mod dax
> > > [442282.095332] CPU: 4 PID: 9273 Comm: mount.cifs Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
> > > [442282.097802] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
> > > [442282.100363] RIP: 0010:strcmp+0xe/0x30
> > > [442282.101645] RSP: 0018:ffffc9001bff7c88 EFLAGS: 00010202
> > > [442282.102919] RAX: 0000000000000001 RBX: ffff8802ad7c2400 RCX: 0000000001240404
> > > [442282.104207] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
> > > [442282.105497] RBP: ffffc9001bff7c88 R08: 0000000001240404 R09: 0000000000000001
> > > [442282.106765] R10: ffff88017d2c2b40 R11: ffff8801744c0e50 R12: ffff88011f793000
> > > [442282.108038] R13: ffff88042b105800 R14: ffffc9001bff7d98 R15: ffff8801b63c0f00
> > > [442282.109318] FS:  00007f3e90ee6780(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
> > > [442282.110630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > > [442282.111970] CR2: 0000000000000000 CR3: 000000011b2ea000 CR4: 00000000000406e0
> > > [442282.113405] Call Trace:
> > > [442282.114849]  cifs_match_super+0x123/0x210 [cifs]
> > > [442282.116211]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > > [442282.117541]  sget_userns+0x88/0x4a0
> > > [442282.118877]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > > [442282.120203]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > > [442282.121502]  sget+0x7d/0xa0
> > > [442282.122781]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > > [442282.124072]  cifs_do_mount+0x168/0x5a0 [cifs]
> > > [442282.125364]  mount_fs+0x3e/0x150
> > > [442282.126627]  vfs_kern_mount+0x67/0x130
> > > [442282.127850]  do_mount+0x1f5/0xca0
> > > [442282.129047]  SyS_mount+0x83/0xd0
> > > [442282.130257]  do_syscall_64+0x79/0x1b0
> > > [442282.131583]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
> > > [442282.132687] RIP: 0033:0x7f3e907fdfea
> > > [442282.133754] RSP: 002b:00007ffee9139868 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
> > > [442282.134842] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3e907fdfea
> > > [442282.135909] RDX: 000055d13f5953b2 RSI: 000055d13f5953f9 RDI: 00007ffee913bb51
> > > [442282.136944] RBP: 00007ffee913bb46 R08: 000055d1415e80d0 R09: 0000000000001000
> > > [442282.137962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3e90ef0000
> > > [442282.138957] R13: 000055d1415e80d0 R14: 00007f3e90ef290f R15: 0000000000000000
> > > [442282.139918] Code: 80 3a 00 75 f7 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed 5d c3 0f 1f 00 55 48 89 e5 eb 04 84 c0 74 18 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 74 eb 19 c0 83 c8 01 5d c3 31
> > > [442282.142829] RIP: strcmp+0xe/0x30 RSP: ffffc9001bff7c88
> > > [442282.143759] CR2: 0000000000000000
> > > [7.] A small shell script or example program which triggers the
> > >      problem (if possible)
> > >
> > > My colleague Vidhesh (CC'ed) will be glad to share further details on the test scenario and/or in-house reproduction.  Please let us know of workarounds, if any.
> > >
> > > Thanks and Regards,
> > > = Ameya
> > >
> > >
> > >
> >
>
>
> --
> Thanks,
>
> Steve



-- 
Thanks,

Steve

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
  2020-07-17 21:23               ` Vidhesh Ramesh
  2020-07-17 21:34                 ` Steve French
@ 2020-07-17 21:44                 ` Steve French
  2020-08-14 19:44                   ` Vidhesh Ramesh
  1 sibling, 1 reply; 7+ messages in thread
From: Steve French @ 2020-07-17 21:44 UTC (permalink / raw)
  To: Vidhesh Ramesh; +Cc: Kenneth Dsouza, CIFS

[-- Attachment #1: Type: text/plain, Size: 11724 bytes --]

I see only 13 'cc:stable' patches missing from 4.19.113 for cifs.ko. See below:

smfrench@smfrench-ThinkPad-P52:~/linux-stable-rc$ git log --oneline
v4.19.113.. fs/cifs
38bcc785c2eb cifs: update ctime and mtime during truncate
e1afc2c1baa5 cifs: Fix the target file was deleted when rename failed.
6f9e471d62ae SMB3: Honor lease disabling for multiuser mounts
da6845a443dc SMB3: Honor persistent/resilient handle flags for multiuser mounts
c0651cd829ee SMB3: Honor 'seal' flag for multiuser mounts
1fa012710599 SMB3: Honor 'posix' flag for multiuser mounts
39dad7304057 cifs/smb3: Fix data inconsistent when zero file range
f4c710c4a39b cifs/smb3: Fix data inconsistent when punch hole
4d9248f989ec cifs: Fix null pointer check in cifs_read
ad149b6e08f1 cifs: fix leaked reference on requeued write
6c662c519277 cifs: protect updating server->dstaddr with a spinlock
731a3bc2be26 cifs: Allocate encryption header through kmalloc
9bc022589575 CIFS: Fix bug which the return value by asynchronous read is error

There are 113 cifs (cc:stable) patches in the 4.19.133 tree (out of
the 628 total patches to cifs.ko between 4.19 and now, 5.8-rc). See
attached

On Fri, Jul 17, 2020 at 4:23 PM Vidhesh Ramesh
<vidhesh.ramesh@komprise.com> wrote:
>
> Thanks Steve.
> We have few more bug fixes that we need in 4.19 LT kernel. However I am unable to get a built kernel RPM of latest build 133 of kernel 4.19.
> The latest I could get is build 113 of kernel 4.19 at https://buildlogs.centos.org/c7-kernels.x86_64/kernel/20200330213326/4.19.113-300.el8.x86_64/kernel-4.19.113-300.el7.x86_64.rpm
>
> Vidhesh Ramesh
>
> From: Steve French <smfrench@gmail.com>
> Sent: Friday, July 17, 2020 7:05 AM
> To: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> Cc: Kenneth Dsouza <kdsouza@redhat.com>; CIFS <linux-cifs@vger.kernel.org>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> I am not familiar with your distro but a Google search matched on this as a more recent kernel rpm download with similar sounding name http://lists.elrepo.org/pipermail/elrepo/2018-May/004282.html
>
> But there should be more recent kernels than that are eg based on newer 4.6.18 stable branch https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/log/?h=linux-4.16.y
>
> On Fri, Jul 17, 2020, 04:12 Vidhesh Ramesh <vidhesh.ramesh@komprise.com> wrote:
> Thanks Steve and Kenneth for your responses.
>
> I did look at the commits and found that this has been fixed in a patch of 4.19. Is there an archive where I can download latest 4.19 kernel rpm so that I can verify the fix ?
>
> Vidhesh Ramesh
>
>
>
>
>
>
> From: Steve French <smfrench@gmail.com>
> Sent: Tuesday, July 14, 2020 10:49 AM
> To: Kenneth Dsouza <kdsouza@redhat.com>
> Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> If you have a particular stable kernel used for your distro you can
> email stable@vger.kernel.org with the commit id and version you want
> it backported for.
>
> On Tue, Jul 14, 2020 at 12:43 PM Kenneth Dsouza <kdsouza@redhat.com> wrote:
> >
> > You are hitting a known bug which has been fixed by below patch and is
> > part of v5.6 and above.
> >
> > commit fe1292686333d1dadaf84091f585ee903b9ddb84
> > Author: Ronnie Sahlberg <lsahlber@redhat.com>
> > Date:   Wed Jan 22 11:07:56 2020 +1000
> >
> >     cifs: fix NULL dereference in match_prepath
> >
> >     RHBZ: 1760879
> >
> >     Fix an oops in match_prepath() by making sure that the prepath string is not
> >     NULL before we pass it into strcmp().
> >
> >     This is similar to other checks we make for example in cifs_root_iget()
> >
> >     Signed-off-by: Ronnie Sahlberg <lsahlber@redhat.com>
> >     Signed-off-by: Steve French <stfrench@microsoft.com>
> >
> > On Tue, Jul 14, 2020 at 11:05 PM Vidhesh Ramesh
> > <vidhesh.ramesh@komprise.com> wrote:
> > >
> > > Adding linux-cifs mailing list.
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Sent: Tuesday, July 14, 2020 10:18 AM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et all,
> > >
> > > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> > >
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Sent: Thursday, July 2, 2020 12:21 AM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et all,
> > >
> > > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > From: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Sent: Wednesday, June 24, 2020 10:26 PM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Subject: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et al,
> > >    My name is Ameya and I work for www.komprise.com.  The linux kernel with above mentioned version has been panicing, though randomly, but the stack trace appears is consistent.  You can find more details in the attachments.  Below is the brief description of the problem -
> > >
> > > [1.] One line summary of the problem:
> > > oops kernel panic
> > > [2.] Full description of the problem/report:
> > > ESX VM hangs with a kernel panic when cifs shares are mounted. Unable to ssh to the VM and the console of the VM is also not responding. With kdump service running and core collected the VM restarts successfully.
> > > [3.] Keywords (i.e., modules, networking, kernel):
> > > cifs, kernel, panic, strcmp, mount
> > > [4.] Kernel information
> > > [4.1.] Kernel version (from /proc/version):
> > > Linux version 4.16.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)) #1 SMP Thu Apr 12 09:08:05 EDT 2018
> > > [4.2.] Kernel .config file:
> > > Please check the file uploaded
> > > [5.] Most recent kernel version which did not have the bug:
> > > [6.] Output of Oops.. message (if applicable) with symbolic information
> > >      resolved (see Documentation/admin-guide/oops-tracing.rst)
> > > [442282.069937] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
> > > [442282.071474] IP: strcmp+0xe/0x30
> > > [442282.072892] PGD 0 P4D 0
> > > [442282.074196] Oops: 0000 [#1] SMP PTI
> > > [442282.075561] Modules linked in: binfmt_misc fuse cmac rpcsec_gss_krb5 nfsv4 arc4 md4 nls_utf8 cifs ccm dns_resolver nfsv3 nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel vmw_balloon crypto_simd glue_helper cryptd sg intel_rapl_perf input_leds pcspkr joydev shpchp
> > > [442282.090386]  parport_pc parport i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod pata_acpi crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih vmxnet3 drm mptbase libata floppy dm_mirror dm_region_hash dm_log dm_mod dax
> > > [442282.095332] CPU: 4 PID: 9273 Comm: mount.cifs Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
> > > [442282.097802] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
> > > [442282.100363] RIP: 0010:strcmp+0xe/0x30
> > > [442282.101645] RSP: 0018:ffffc9001bff7c88 EFLAGS: 00010202
> > > [442282.102919] RAX: 0000000000000001 RBX: ffff8802ad7c2400 RCX: 0000000001240404
> > > [442282.104207] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
> > > [442282.105497] RBP: ffffc9001bff7c88 R08: 0000000001240404 R09: 0000000000000001
> > > [442282.106765] R10: ffff88017d2c2b40 R11: ffff8801744c0e50 R12: ffff88011f793000
> > > [442282.108038] R13: ffff88042b105800 R14: ffffc9001bff7d98 R15: ffff8801b63c0f00
> > > [442282.109318] FS:  00007f3e90ee6780(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
> > > [442282.110630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > > [442282.111970] CR2: 0000000000000000 CR3: 000000011b2ea000 CR4: 00000000000406e0
> > > [442282.113405] Call Trace:
> > > [442282.114849]  cifs_match_super+0x123/0x210 [cifs]
> > > [442282.116211]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > > [442282.117541]  sget_userns+0x88/0x4a0
> > > [442282.118877]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > > [442282.120203]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > > [442282.121502]  sget+0x7d/0xa0
> > > [442282.122781]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > > [442282.124072]  cifs_do_mount+0x168/0x5a0 [cifs]
> > > [442282.125364]  mount_fs+0x3e/0x150
> > > [442282.126627]  vfs_kern_mount+0x67/0x130
> > > [442282.127850]  do_mount+0x1f5/0xca0
> > > [442282.129047]  SyS_mount+0x83/0xd0
> > > [442282.130257]  do_syscall_64+0x79/0x1b0
> > > [442282.131583]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
> > > [442282.132687] RIP: 0033:0x7f3e907fdfea
> > > [442282.133754] RSP: 002b:00007ffee9139868 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
> > > [442282.134842] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3e907fdfea
> > > [442282.135909] RDX: 000055d13f5953b2 RSI: 000055d13f5953f9 RDI: 00007ffee913bb51
> > > [442282.136944] RBP: 00007ffee913bb46 R08: 000055d1415e80d0 R09: 0000000000001000
> > > [442282.137962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3e90ef0000
> > > [442282.138957] R13: 000055d1415e80d0 R14: 00007f3e90ef290f R15: 0000000000000000
> > > [442282.139918] Code: 80 3a 00 75 f7 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed 5d c3 0f 1f 00 55 48 89 e5 eb 04 84 c0 74 18 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 74 eb 19 c0 83 c8 01 5d c3 31
> > > [442282.142829] RIP: strcmp+0xe/0x30 RSP: ffffc9001bff7c88
> > > [442282.143759] CR2: 0000000000000000
> > > [7.] A small shell script or example program which triggers the
> > >      problem (if possible)
> > >
> > > My colleague Vidhesh (CC'ed) will be glad to share further details on the test scenario and/or in-house reproduction.  Please let us know of workarounds, if any.
> > >
> > > Thanks and Regards,
> > > = Ameya
> > >
> > >
> > >
> >
>
>
> --
> Thanks,
>
> Steve



-- 
Thanks,

Steve

[-- Attachment #2: 4.19-stable-patches --]
[-- Type: application/octet-stream, Size: 7573 bytes --]

38bcc785c2eb cifs: update ctime and mtime during truncate
e1afc2c1baa5 cifs: Fix the target file was deleted when rename failed.
6f9e471d62ae SMB3: Honor lease disabling for multiuser mounts
da6845a443dc SMB3: Honor persistent/resilient handle flags for multiuser mounts
c0651cd829ee SMB3: Honor 'seal' flag for multiuser mounts
1fa012710599 SMB3: Honor 'posix' flag for multiuser mounts
39dad7304057 cifs/smb3: Fix data inconsistent when zero file range
f4c710c4a39b cifs/smb3: Fix data inconsistent when punch hole
4d9248f989ec cifs: Fix null pointer check in cifs_read
ad149b6e08f1 cifs: fix leaked reference on requeued write
6c662c519277 cifs: protect updating server->dstaddr with a spinlock
731a3bc2be26 cifs: Allocate encryption header through kmalloc
9bc022589575 CIFS: Fix bug which the return value by asynchronous read is error
a8ab0b709790 cifs_atomic_open(): fix double-put on late allocation failure
3e319f242af3 cifs: don't leak -EAGAIN for stat() during reconnect
b6b77b5ed35c cifs: Fix mode output in debugging statements
3edf85591fb5 cifs: log warning message (once) if out of disk space
35c9bcb672e3 cifs: fix NULL dereference in match_prepath
71a47ed651c0 cifs: fail i/o on soft mounts if sessionsetup errors out
33da1cf0820d smb3: fix signing verification of large reads
f93743a333ea cifs: Fix memory allocation in __smb2_handle_cancelled_cmd()
6db0e28b893a signal: Allow cifs and drbd to receive their terminating signals
7f6a96dd8223 cifs: fix rmmod regression in cifs.ko caused by force_sig changes
e6a13c753f91 signal/cifs: Fix cifs_put_tcp_session to call send_sig instead of force_sig
b524247efb99 cifs: Adjust indentation in smb2_open_file
e8b26877c429 CIFS: Close open handle after interrupted close
3ddc09c8233e CIFS: Respect O_SYNC and O_DIRECT flags during reconnect
5948e7ec0708 cifs: Don't display RDMA transport on reconnect
33852a95011b cifs: smbd: Return -EINVAL when the number of iovs exceeds SMBDIRECT_MAX_SGE
674b7b6c9f18 cifs: smbd: Add messages on RDMA session destroy and reconnection
5cceead714c5 cifs: smbd: Return -EAGAIN when transport is reconnecting
14cb20ad6bfc cifs: Fix potential softlockups while refreshing DFS cache
d4785d88459e CIFS: Fix SMB2 oplock break processing
df871e551d0a CIFS: Fix NULL-pointer dereference in smb2_push_mandatory_locks
6c2075f792c6 fs/cifs: fix uninitialised variable warnings
d8a76e300e37 SMB3: Fix persistent handles reconnect
80b42f4381c2 cifs: Fix cifsInodeInfo lock_sem deadlock when reconnect occurs
497fd98a50b2 fs: cifs: mute -Wunused-const-variable message
b73132b74d25 cifs: add credits from unmatched responses/messages
ee4d28a716e8 CIFS: Respect SMB2 hdr preamble size in read responses
01332b037066 CIFS: Fix use after free of file info structures
71cf88165ff0 CIFS: avoid using MID 0xFFFF
a8de7090805d cifs: use cifsInodeInfo->open_file_lock while iterating to avoid a panic
230b339a7c75 CIFS: Force reval dentry if LOOKUP_REVAL flag is set
0bc78de461b4 CIFS: Force revalidate inode when dentry is stale
d72c2115108f CIFS: Gracefully handle QueryInfo errors during open
4290a9e59323 CIFS: Fix oplock handling for SMB 2.1+ protocols
a3a150895b6f CIFS: fix max ea value size
2e96c9332595 smb3: allow disabling requesting leases
e867ef113004 CIFS: fix deadlock in cached root handling
b62946852afa cifs: Use kzfree() to zero out the password
325fa2a6729b cifs: set domainName when a domain-key is used in multiuser
987564c28e8a cifs: Properly handle auto disabling of serverino option
acc07941e224 cifs: add spinlock for the openFileList to cifsInodeInfo
96b44c20e6f0 cifs: smbd: take an array of reqeusts when sending upper layer data
4061e662c8e9 cifs: Fix lease buffer length error
778d626c6af3 CIFS: Fix leaking locked VFS cache pages in writeback retry
fb2dabeabb17 CIFS: Fix error paths in writeback code
33bdea175df0 SMB3: Kernel oops mounting a encryptData share with CONFIG_DEBUG_VIRTUAL
fab5a1fd17a6 SMB3: Fix potential memory leak when processing compound chain
898c19f1b4c8 smb3: send CAP_DFS capability during session setup
50831f1a2f57 SMB3: Fix deadlock in validate negotiate hits reconnect
d29fbf677963 cifs: Fix a race condition with cifs_echo_request
5293c79c6f60 SMB3: retry on STATUS_INSUFFICIENT_RESOURCES instead of failing write
297a251062c0 CIFS: cifs_read_allocate_pages: don't iterate through whole page array on ENOMEM
32d57c0c063c cifs: fix memory leak of pneg_inbuf on -EOPNOTSUPP ioctl case
939db6fdbea6 cifs: fix strcat buffer overflow and reduce raciness in smb21_set_oplock_level()
ee231063ff95 cifs: do not attempt cifs operation on smb2+ rename error
d5bf783a09a0 cifs: fix memory leak in SMB2_read
2fcee5eaae6e cifs: fix handle leak in smb2_query_symlink()
c69330a855ab cifs: Fix use-after-free in SMB2_read
8fb89b43b65f cifs: Fix use-after-free in SMB2_write
8092ecc306d8 CIFS: keep FileInfo handle live during oplock break
e9603cffb1ca cifs: fallback to older infolevels on findfirst queryinfo retry
40276e4e2fd0 fix incorrect error code mapping for OBJECTID_NOT_FOUND
36a3219e617a cifs: Fix NULL pointer dereference of devname
d579b4eae836 cifs: Accept validate negotiate if server return NT_STATUS_NOT_SUPPORTED
626d98bbdb30 cifs: use correct format characters
2938651d36ca CIFS: fix POSIX lock leak and invalid ptr deref
38bd575b9aef SMB3: Fix SMB3.1.1 guest mounts to Samba
14c52acaac86 cifs: allow guest mounts to work for smb3.11
43eaa6cc1775 CIFS: Fix read after write for files with read caching
dc8e8ad962a8 CIFS: Do not skip SMB2 message IDs on send failures
3ed9f22e28dd CIFS: Do not reset lease state to NONE on lease break
b4d965a37d89 cifs: allow calling SMB2_xxx_free(NULL)
6efd69d63339 cifs: fix computation for MAX_SMB2_HDR_SIZE
b1765ebd9d12 CIFS: Do not assume one credit for async responses
63715c1f0a67 cifs: Limit memory used by lock request calls to a page
5d3b4cd8734b cifs: check ntwrk_buf_start for NULL before dereferencing it
c0be624777ba cifs: Always resolve hostname before reconnecting
e9d56f920bb2 CIFS: Do not consider -ENODATA as stat failure for reads
6e7045ec336b CIFS: Fix trace command logging for SMB2 reads and writes
c6961288a5f4 CIFS: Do not count -ENODATA as failure for query directory
06d9f987201f smb3: add credits we receive from oplock/break PDUs
779c65bb7739 CIFS: Do not reconnect TCP session in add_credits()
2ae6fedbd5cb CIFS: Fix credit calculation for encrypted reads with errors
0380ed9b1cd3 CIFS: Fix credits calculations for reads with errors
07b9e5e35e8f CIFS: Fix possible hang during async MTU reads and writes
2a71a47e03ff cifs: Fix potential OOB access of lock element array
7dcc5b36ea7f CIFS: Fix credit computation for compounded requests
d2f76f6f9fa9 CIFS: Do not hide EINTR after sending network packets
c3606c646783 CIFS: Do not set credits to 1 if the server didn't grant anything
d1130682d127 CIFS: Fix adjustment of credits for MTU requests
ba77e8c7f704 smb3: fix large reads on encrypted connections
1827d1c439bc CIFS: Fix error mapping for SMB2_LOCK command which caused OFD lock problem
b5a8028c25f3 cifs: In Kconfig CONFIG_CIFS_POSIX needs depends on legacy (insecure cifs)
99c694081ba2 cifs: Fix separator when building path from dentry
e4ed4e68c6d8 cifs: fix return value for cifs_listxattr
ad1834fd8a47 cifs: don't dereference smb_file_target before null check
93e2e8674548 smb3: on kerberos mount if server doesn't specify auth type use krb5
108b981d48f1 smb3: do not attempt cifs operation in smb3 query info error path
eb7814c36f49 smb3: allow stats which track session and share reconnects to be reset
c24f57c61277 cifs: fix a credits leak for compund commands

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
  2020-07-17 21:44                 ` Steve French
@ 2020-08-14 19:44                   ` Vidhesh Ramesh
  0 siblings, 0 replies; 7+ messages in thread
From: Vidhesh Ramesh @ 2020-08-14 19:44 UTC (permalink / raw)
  To: Steve French; +Cc: Kenneth Dsouza, CIFS

Thanks Steve,

I was able to get hold of 4.19 build 134.

I am also seeing the following 2 NPE in CIFS on kernel 4.16.2.1 and was hoping to see if these 2 are also fixed in 4.19 kernel ?

[255120.498118] BUG: unable to handle kernel NULL pointer dereference at 0000000000000038
[255120.498520] IP: cifs_negotiate_protocol+0x15/0xd0 [cifs]
[255120.498805] PGD 800000042a54c067 P4D 800000042a54c067 PUD 4276f0067 PMD 0
[255120.499119] Oops: 0000 [#1] SMP PTI
[255120.499398] Modules linked in: rpcsec_gss_krb5 cmac nfsv4 nfs fscache arc4 md4 nls_utf8 cifs ccm dns_resolver nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ppdev sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc vmw_balloon aesni_intel crypto_simd glue_helper cryptd intel_rapl_perf joydev input_leds pcspkr sg parport_pc parport vmw_vmci shpchp
[255120.503180]  i2c_piix4 nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic pata_acpi serio_raw crc32c_intel floppy vmxnet3 vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi mptscsih mptbase scsi_transport_spi dm_mirror dm_region_hash dm_log dm_mod dax
[255120.505469] CPU: 0 PID: 6419 Comm: kworker/0:0 Not tainted 4.16.2-1.el7.elrepo.x86_64 #1
[255120.506098] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
[255120.507412] Workqueue: cifsiod smb2_reconnect_server [cifs]
[255120.508111] RIP: 0010:cifs_negotiate_protocol+0x15/0xd0 [cifs]
[255120.508827] RSP: 0018:ffffc900113e7d40 EFLAGS: 00010246
[255120.509536] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffa061a340
[255120.510256] RDX: ffff88042d725d00 RSI: ffff88042bb9ae00 RDI: 0000000000000000
[255120.510987] RBP: ffffc900113e7d58 R08: 0000000000000271 R09: 0000000000000000
[255120.511724] R10: 0000000000000001 R11: 000000000000026b R12: ffff88042bb9ae00
[255120.512476] R13: ffff880399229568 R14: ffffffffa061a000 R15: 0000000000000001
[255120.513246] FS:  0000000000000000(0000) GS:ffff88043fc00000(0000) knlGS:0000000000000000
[255120.514048] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[255120.514832] CR2: 0000000000000038 CR3: 000000042a5b2000 CR4: 00000000000406f0
[255120.515696] Call Trace:
[255120.516545]  smb2_reconnect+0x108/0x420 [cifs]
[255120.517410]  ? remove_wait_queue+0x60/0x60
[255120.518249]  smb2_reconnect_server+0x1d4/0x340 [cifs]
[255120.519102]  process_one_work+0x15f/0x370
[255120.519962]  worker_thread+0x4d/0x3e0
[255120.520808]  kthread+0x105/0x140
[255120.521642]  ? max_active_store+0x80/0x80
[255120.522456]  ? kthread_bind+0x20/0x20
[255120.523254]  ? do_syscall_64+0x79/0x1b0
[255120.524035]  ret_from_fork+0x35/0x40
[255120.524791] Code: 64 a0 e8 ff 08 ab e0 5b 41 5c 41 5d 5d c3 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 41 55 41 54 49 89 f4 53 48 8b 5e 48 <48> 8b 43 38 48 8b 90 b8 00 00 00 48 85 d2 0f 84 97 00 00 00 48
[255120.527052] RIP: cifs_negotiate_protocol+0x15/0xd0 [cifs] RSP: ffffc900113e7d40
[255120.527807] CR2: 0000000000000038

[366603.058360] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
[366603.058730] IP: cifs_reconnect+0x286/0x620 [cifs]
[366603.059062] PGD 8000000426291067 P4D 8000000426291067 PUD 42af59067 PMD 0
[366603.059418] Oops: 0000 [#1] SMP PTI
[366603.059803] Modules linked in: rpcsec_gss_krb5 nfsv4 nfs cmac fscache arc4 md4 nls_utf8 cifs ccm dns_resolver nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel crypto_simd glue_helper cryptd vmw_balloon intel_rapl_perf pcspkr joydev input_leds sg parport_pc parport i2c_piix4
[366603.064108]  vmw_vmci shpchp nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic pata_acpi crc32c_intel serio_raw vmxnet3 mptspi mptscsih mptbase scsi_transport_spi vmwgfx ata_piix drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libata drm floppy dm_mirror dm_region_hash dm_log dm_mod dax
[366603.066558] CPU: 6 PID: 5920 Comm: cifsd Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
[366603.067888] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
[366603.069252] RIP: 0010:cifs_reconnect+0x286/0x620 [cifs]
[366603.069947] RSP: 0018:ffffc90005a53d70 EFLAGS: 00010203
[366603.070641] RAX: 0000000000000001 RBX: ffff88042b599c00 RCX: 0000000000000000
[366603.071413] RDX: 0000000000000000 RSI: 0000000000000246 RDI: 0000000000000246
[366603.072144] RBP: ffffc90005a53dc0 R08: 0000000000000005 R09: ffff88042d6c8000
[366603.072934] R10: 00000000000002d4 R11: 000000000000b6bf R12: 0000000000000000
[366603.073669] R13: ffffc90005a53d80 R14: ffff88035d086680 R15: ffff88035d086f00
[366603.074406] FS:  0000000000000000(0000) GS:ffff88043fd80000(0000) knlGS:0000000000000000
[366603.075162] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[366603.076031] CR2: 0000000000000000 CR3: 0000000427c88000 CR4: 00000000000406e0
[366603.076896] Call Trace:
[366603.077706]  cifs_readv_from_socket+0x1b4/0x200 [cifs]
[366603.078621]  cifs_read_from_socket+0x52/0x70 [cifs]
[366603.079458]  cifs_demultiplex_thread+0x11b/0xa90 [cifs]
[366603.080313]  kthread+0x105/0x140
[366603.081182]  ? cifs_handle_standard+0x190/0x190 [cifs]
[366603.082048]  ? kthread_bind+0x20/0x20
[366603.082896]  ? do_syscall_64+0x79/0x1b0
[366603.083716]  ret_from_fork+0x35/0x40
[366603.084541] Code: e7 da e0 84 c0 74 0e 49 8b 17 49 8b 47 08 48 89 42 08 48 89 10 49 8b 47 38 4d 89 3f 4c 89 ff 4d 89 7f 08 e8 4d 3f 5e e1 4d 39 ec <49> 8b 04 24 75 c4 65 4c 8b 2c 25 40 5c 01 00 eb 31 f6 05 66 0a
[366603.087050] RIP: cifs_reconnect+0x286/0x620 [cifs] RSP: ffffc90005a53d70
[366603.087856] CR2: 0000000000000000





Vidhesh Ramesh


















From: Steve French <smfrench@gmail.com>
Sent: Friday, July 17, 2020 2:44 PM
To: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
Cc: Kenneth Dsouza <kdsouza@redhat.com>; CIFS <linux-cifs@vger.kernel.org>
Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 
 
I see only 13 'cc:stable' patches missing from 4.19.113 for cifs.ko. See below:

smfrench@smfrench-ThinkPad-P52:~/linux-stable-rc$ git log --oneline
v4.19.113.. fs/cifs
38bcc785c2eb cifs: update ctime and mtime during truncate
e1afc2c1baa5 cifs: Fix the target file was deleted when rename failed.
6f9e471d62ae SMB3: Honor lease disabling for multiuser mounts
da6845a443dc SMB3: Honor persistent/resilient handle flags for multiuser mounts
c0651cd829ee SMB3: Honor 'seal' flag for multiuser mounts
1fa012710599 SMB3: Honor 'posix' flag for multiuser mounts
39dad7304057 cifs/smb3: Fix data inconsistent when zero file range
f4c710c4a39b cifs/smb3: Fix data inconsistent when punch hole
4d9248f989ec cifs: Fix null pointer check in cifs_read
ad149b6e08f1 cifs: fix leaked reference on requeued write
6c662c519277 cifs: protect updating server->dstaddr with a spinlock
731a3bc2be26 cifs: Allocate encryption header through kmalloc
9bc022589575 CIFS: Fix bug which the return value by asynchronous read is error

There are 113 cifs (cc:stable) patches in the 4.19.133 tree (out of
the 628 total patches to cifs.ko between 4.19 and now, 5.8-rc). See
attached

On Fri, Jul 17, 2020 at 4:23 PM Vidhesh Ramesh
<vidhesh.ramesh@komprise.com> wrote:
>
> Thanks Steve.
> We have few more bug fixes that we need in 4.19 LT kernel. However I am unable to get a built kernel RPM of latest build 133 of kernel 4.19.
> The latest I could get is build 113 of kernel 4.19 at https://buildlogs.centos.org/c7-kernels.x86_64/kernel/20200330213326/4.19.113-300.el8.x86_64/kernel-4.19.113-300.el7.x86_64.rpm
>
> Vidhesh Ramesh
>
> From: Steve French <smfrench@gmail.com>
> Sent: Friday, July 17, 2020 7:05 AM
> To: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> Cc: Kenneth Dsouza <kdsouza@redhat.com>; CIFS <linux-cifs@vger.kernel.org>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> I am not familiar with your distro but a Google search matched on this as a more recent kernel rpm download with similar sounding name http://lists.elrepo.org/pipermail/elrepo/2018-May/004282.html
>
> But there should be more recent kernels than that are eg based on newer 4.6.18 stable branch https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/log/?h=linux-4.16.y
>
> On Fri, Jul 17, 2020, 04:12 Vidhesh Ramesh <vidhesh.ramesh@komprise.com> wrote:
> Thanks Steve and Kenneth for your responses.
>
> I did look at the commits and found that this has been fixed in a patch of 4.19. Is there an archive where I can download latest 4.19 kernel rpm so that I can verify the fix ?
>
> Vidhesh Ramesh
>
>
>
>
>
>
> From: Steve French <smfrench@gmail.com>
> Sent: Tuesday, July 14, 2020 10:49 AM
> To: Kenneth Dsouza <kdsouza@redhat.com>
> Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>
> Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
>
> If you have a particular stable kernel used for your distro you can
> email stable@vger.kernel.org with the commit id and version you want
> it backported for.
>
> On Tue, Jul 14, 2020 at 12:43 PM Kenneth Dsouza <kdsouza@redhat.com> wrote:
> >
> > You are hitting a known bug which has been fixed by below patch and is
> > part of v5.6 and above.
> >
> > commit fe1292686333d1dadaf84091f585ee903b9ddb84
> > Author: Ronnie Sahlberg <lsahlber@redhat.com>
> > Date:   Wed Jan 22 11:07:56 2020 +1000
> >
> >     cifs: fix NULL dereference in match_prepath
> >
> >     RHBZ: 1760879
> >
> >     Fix an oops in match_prepath() by making sure that the prepath string is not
> >     NULL before we pass it into strcmp().
> >
> >     This is similar to other checks we make for example in cifs_root_iget()
> >
> >     Signed-off-by: Ronnie Sahlberg <lsahlber@redhat.com>
> >     Signed-off-by: Steve French <stfrench@microsoft.com>
> >
> > On Tue, Jul 14, 2020 at 11:05 PM Vidhesh Ramesh
> > <vidhesh.ramesh@komprise.com> wrote:
> > >
> > > Adding linux-cifs mailing list.
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Sent: Tuesday, July 14, 2020 10:18 AM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et all,
> > >
> > > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> > >
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > > From: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Sent: Thursday, July 2, 2020 12:21 AM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Subject: Re: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et all,
> > >
> > > Resending this as a gentle reminder if anyone got a chance to look at the below mentioned oops kernel panic.
> > >
> > > Vidhesh Ramesh
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > From: Ameya Usgaonkar <ameya.usgaonkar@komprise.com>
> > > Sent: Wednesday, June 24, 2020 10:26 PM
> > > To: Steve French <sfrench@samba.org>; linux-cifs@vger.kernel.org <linux-cifs@vger.kernel.org>; samba-technical@lists.samba.org <samba-technical@lists.samba.org>
> > > Cc: Vidhesh Ramesh <vidhesh.ramesh@komprise.com>
> > > Subject: Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64
> > >
> > > Hi Steve et al,
> > >    My name is Ameya and I work for www.komprise.com.  The linux kernel with above mentioned version has been panicing, though randomly, but the stack trace appears is consistent.  You can find more details in the attachments.  Below is the brief description of the problem -
> > >
> > > [1.] One line summary of the problem:
> > > oops kernel panic
> > > [2.] Full description of the problem/report:
> > > ESX VM hangs with a kernel panic when cifs shares are mounted. Unable to ssh to the VM and the console of the VM is also not responding. With kdump service running and core collected the VM restarts successfully.
> > > [3.] Keywords (i.e., modules, networking, kernel):
> > > cifs, kernel, panic, strcmp, mount
> > > [4.] Kernel information
> > > [4.1.] Kernel version (from /proc/version):
> > > Linux version 4.16.2-1.el7.elrepo.x86_64 (mockbuild@Build64R7) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC)) #1 SMP Thu Apr 12 09:08:05 EDT 2018
> > > [4.2.] Kernel .config file:
> > > Please check the file uploaded
> > > [5.] Most recent kernel version which did not have the bug:
> > > [6.] Output of Oops.. message (if applicable) with symbolic information
> > >      resolved (see Documentation/admin-guide/oops-tracing.rst)
> > > [442282.069937] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
> > > [442282.071474] IP: strcmp+0xe/0x30
> > > [442282.072892] PGD 0 P4D 0
> > > [442282.074196] Oops: 0000 [#1] SMP PTI
> > > [442282.075561] Modules linked in: binfmt_misc fuse cmac rpcsec_gss_krb5 nfsv4 arc4 md4 nls_utf8 cifs ccm dns_resolver nfsv3 nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast xt_CT ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc ppdev aesni_intel vmw_balloon crypto_simd glue_helper cryptd sg intel_rapl_perf input_leds pcspkr joydev shpchp
> > > [442282.090386]  parport_pc parport i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod pata_acpi crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih vmxnet3 drm mptbase libata floppy dm_mirror dm_region_hash dm_log dm_mod dax
> > > [442282.095332] CPU: 4 PID: 9273 Comm: mount.cifs Tainted: G        W        4.16.2-1.el7.elrepo.x86_64 #1
> > > [442282.097802] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
> > > [442282.100363] RIP: 0010:strcmp+0xe/0x30
> > > [442282.101645] RSP: 0018:ffffc9001bff7c88 EFLAGS: 00010202
> > > [442282.102919] RAX: 0000000000000001 RBX: ffff8802ad7c2400 RCX: 0000000001240404
> > > [442282.104207] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
> > > [442282.105497] RBP: ffffc9001bff7c88 R08: 0000000001240404 R09: 0000000000000001
> > > [442282.106765] R10: ffff88017d2c2b40 R11: ffff8801744c0e50 R12: ffff88011f793000
> > > [442282.108038] R13: ffff88042b105800 R14: ffffc9001bff7d98 R15: ffff8801b63c0f00
> > > [442282.109318] FS:  00007f3e90ee6780(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
> > > [442282.110630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > > [442282.111970] CR2: 0000000000000000 CR3: 000000011b2ea000 CR4: 00000000000406e0
> > > [442282.113405] Call Trace:
> > > [442282.114849]  cifs_match_super+0x123/0x210 [cifs]
> > > [442282.116211]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > > [442282.117541]  sget_userns+0x88/0x4a0
> > > [442282.118877]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > > [442282.120203]  ? cifs_prune_tlinks+0xe0/0xe0 [cifs]
> > > [442282.121502]  sget+0x7d/0xa0
> > > [442282.122781]  ? cifs_kill_sb+0x30/0x30 [cifs]
> > > [442282.124072]  cifs_do_mount+0x168/0x5a0 [cifs]
> > > [442282.125364]  mount_fs+0x3e/0x150
> > > [442282.126627]  vfs_kern_mount+0x67/0x130
> > > [442282.127850]  do_mount+0x1f5/0xca0
> > > [442282.129047]  SyS_mount+0x83/0xd0
> > > [442282.130257]  do_syscall_64+0x79/0x1b0
> > > [442282.131583]  entry_SYSCALL_64_after_hwframe+0x3d/0xa2
> > > [442282.132687] RIP: 0033:0x7f3e907fdfea
> > > [442282.133754] RSP: 002b:00007ffee9139868 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
> > > [442282.134842] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3e907fdfea
> > > [442282.135909] RDX: 000055d13f5953b2 RSI: 000055d13f5953f9 RDI: 00007ffee913bb51
> > > [442282.136944] RBP: 00007ffee913bb46 R08: 000055d1415e80d0 R09: 0000000000001000
> > > [442282.137962] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3e90ef0000
> > > [442282.138957] R13: 000055d1415e80d0 R14: 00007f3e90ef290f R15: 0000000000000000
> > > [442282.139918] Code: 80 3a 00 75 f7 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed 5d c3 0f 1f 00 55 48 89 e5 eb 04 84 c0 74 18 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 74 eb 19 c0 83 c8 01 5d c3 31
> > > [442282.142829] RIP: strcmp+0xe/0x30 RSP: ffffc9001bff7c88
> > > [442282.143759] CR2: 0000000000000000
> > > [7.] A small shell script or example program which triggers the
> > >      problem (if possible)
> > >
> > > My colleague Vidhesh (CC'ed) will be glad to share further details on the test scenario and/or in-house reproduction.  Please let us know of workarounds, if any.
> > >
> > > Thanks and Regards,
> > > = Ameya
> > >
> > >
> > >
> >
>
>
> --
> Thanks,
>
> Steve



-- 
Thanks,

Steve

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2020-08-14 19:45 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <MW3PR16MB37063A82C9A57CC67EB5BE1F87920@MW3PR16MB3706.namprd16.prod.outlook.com>
     [not found] ` <BYAPR16MB26152FB66647DB8FCAED346CE26D0@BYAPR16MB2615.namprd16.prod.outlook.com>
     [not found]   ` <BYAPR16MB261513751DCF34B035660665E2610@BYAPR16MB2615.namprd16.prod.outlook.com>
2020-07-14 17:34     ` Oops in cifs_match_super() - linux kernel 4.16.2-1.el7.elrepo.x86_64 Vidhesh Ramesh
2020-07-14 17:42       ` Kenneth Dsouza
2020-07-14 17:49         ` Steve French
     [not found]           ` <BYAPR16MB26156E99DAEAC5AB16C644A0E27C0@BYAPR16MB2615.namprd16.prod.outlook.com>
     [not found]             ` <CAH2r5ms2jsH2ka-9SAaN8v61YL16jN401uEDZJ7Uo0H0pLtH7g@mail.gmail.com>
2020-07-17 21:23               ` Vidhesh Ramesh
2020-07-17 21:34                 ` Steve French
2020-07-17 21:44                 ` Steve French
2020-08-14 19:44                   ` Vidhesh Ramesh

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.