linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* 5.19.0-rc5 : Raspberry Pi 4 : Unable to handle kernel paging request at virtual address
@ 2022-07-04  7:58 Naresh Kamboju
  2022-07-04 11:26 ` Will Deacon
  0 siblings, 1 reply; 5+ messages in thread
From: Naresh Kamboju @ 2022-07-04  7:58 UTC (permalink / raw)
  To: open list, lkft-triage, regressions, Linux ARM, LTP List
  Cc: Linus Torvalds, Will Deacon, Catalin Marinas, brauner, Vincent Guittot

While running LTP controllers tests on arm64 Raspberry Pi 4 Model B
the following kernel crash noticed.

Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>

metadata:
  git_ref: master
  git_repo: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline
  git_sha: 88084a3df1672e131ddc1b4e39eeacfd39864acf
  kernel_version: 5.19.0-rc5
  kernel-config: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/config
  build-url: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/-/pipelines/579007773
  artifact-location: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh
  vmlinux.xz: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/vmlinux.xz
  System.map: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/System.map
  toolchain: gcc-11

Steps to reproduce:
-------------------
./runltp -p -q -f controllers

Test log:
----------
cgroup_fj_stress_blkio_4_4_each 1 TPASS: All done!
cgroup_fj_stress_blkio_4_4_each 2 TINFO: Removing all ltp subgroups...
cgroup_fj_stress_blkio_2_9_each 1 TINFO: Subsystem blkio is mounted at
/sys/fs/cgroup/blkio
cgroup_fj_stress_blkio_2_9_each 1 TINFO: Creating subgroups ...
[ 2414.973441] Unable to handle kernel paging request at virtual
address 00620000090336a0
[ 2414.981581] Mem abort info:
[ 2414.984480]   ESR = 0x0000000086000004
[ 2414.988323]   EC = 0x21: IABT (current EL), IL = 32 bits
[ 2414.993765]   SET = 0, FnV = 0
[ 2414.996905]   EA = 0, S1PTW = 0
[ 2415.000124]   FSC = 0x04: level 0 translation fault
[ 2415.005118] [00620000090336a0] address between user and kernel address ranges
[ 2415.012393] Internal error: Oops: 86000004 [#1] PREEMPT SMP
[ 2415.018048] Modules linked in: btrfs blake2b_generic libcrc32c
raid6_pq zstd_compress xhci_pci snd_soc_hdmi_codec xhci_pci_renesas
raspberrypi_cpufreq hci_uart btqca brcmfmac brcmutil btbcm vc4
bluetooth cfg80211 cec drm_display_helper drm_cma_helper rfkill
clk_raspberrypi reset_raspberrypi drm_kms_helper crct10dif_ce
raspberrypi_hwmon drm i2c_bcm2835 iproc_rng200 rng_core pwm_bcm2835
bcm2711_thermal pcie_brcmstb fuse
[ 2415.055725] CPU: 0 PID: 11626 Comm: cgroup_fj_stres Not taintedlinu#1
[ 2415.062965] Hardware name: Raspberry Pi 4 Model B (DT)
[ 2415.068175] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 2415.075238] pc : 0x620000090336a0
[ 2415.078600] lr : ktime_get+0x50/0xac
[ 2415.082228] sp : ffff80000dfdbb90
[ 2415.085585] x29: ffff80000dfdbb90 x28: 00000000ffffffff x27: ffff00006405e580
[ 2415.092832] x26: ffff00006405e748 x25: 0000000001200000 x24: ffff00006405e180
[ 2415.100076] x23: ffff80000dfdbd68 x22: 0000000000000000 x21: 000002321545f201
[ 2415.107320] x20: 000000000012017e x19: ffff80000ae3b440 x18: ffff000000000000
[ 2415.114564] x17: 0000000000000000 x16: 0000000000000000 x15: 00000000000000dc
[ 2415.121809] x14: 0000000001200011 x13: 0000000060000000 x12: 0000ffffa7b6c1e8
[ 2415.129052] x11: 0000000000000040 x10: ffff80000a96c5c0 x9 : ffff8000080990d4
[ 2415.136295] x8 : 0000000000000000 x7 : 0000000000a9c84a x6 : 4480001ec1769752
[ 2415.143538] x5 : 00ffbffeffffffff x4 : 0000000900000000 x3 : 0000000000000000
[ 2415.150781] x2 : ffff80000a94e000 x1 : ffff8000090336a0 x0 : ffff80000ad102f0
[ 2415.158025] Call trace:
[ 2415.160498]  0x620000090336a0
[ 2415.163505]  copy_process+0xe34/0x1534
[ 2415.167307]  kernel_clone+0x98/0x430
[ 2415.170931]  __do_sys_clone+0x70/0xb0
[ 2415.174643]  __arm64_sys_clone+0x2c/0x40
[ 2415.178621]  invoke_syscall+0x50/0x120
[ 2415.182425]  el0_svc_common.constprop.0+0x104/0x124
[ 2415.187375]  do_el0_svc+0x3c/0xcc
[ 2415.190736]  el0_svc+0x38/0xc0
[ 2415.193832]  el0t_64_sync_handler+0xbc/0x140
[ 2415.198162]  el0t_64_sync+0x18c/0x190
[ 2415.201880] Code: bad PC value
[ 2415.204975] ---[ end trace 0000000000000000 ]---
[ 2435.982529] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 2435.988717] rcu: 0-...0: (8 ticks this GP)
idle=c29/1/0x4000000000000000 softirq=479942/479942 fqs=2433
[ 2435.998423] (detected by 2, t=5255 jiffies, g=905669, q=285 ncpus=4)
[ 2436.004953] Task dump for CPU 0:
[ 2436.008218] task:cgroup_fj_stres state:R  running task     stack:
 0 pid:11626 ppid:   502 flags:0x00000202
[ 2436.018278] Call trace:
[ 2436.020749]  __switch_to+0xf0/0x160
[ 2436.024291]  0x3600d98dadcfb700
[ 2499.046529] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:

full log links,
https://qa-reports.linaro.org/lkft/linux-mainline-master/build/v5.19-rc5/testrun/10489769/suite/log-parser-test/test/check-kernel-oops-5238392/details/
https://lkft.validation.linaro.org/scheduler/job/5238392

--
Linaro LKFT
https://lkft.linaro.org

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: 5.19.0-rc5 : Raspberry Pi 4 : Unable to handle kernel paging request at virtual address
  2022-07-04  7:58 5.19.0-rc5 : Raspberry Pi 4 : Unable to handle kernel paging request at virtual address Naresh Kamboju
@ 2022-07-04 11:26 ` Will Deacon
  2022-07-04 13:37   ` Robin Murphy
  0 siblings, 1 reply; 5+ messages in thread
From: Will Deacon @ 2022-07-04 11:26 UTC (permalink / raw)
  To: Naresh Kamboju
  Cc: open list, lkft-triage, regressions, Linux ARM, LTP List,
	Linus Torvalds, Catalin Marinas, brauner, Vincent Guittot

On Mon, Jul 04, 2022 at 01:28:30PM +0530, Naresh Kamboju wrote:
> While running LTP controllers tests on arm64 Raspberry Pi 4 Model B
> the following kernel crash noticed.
> 
> Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
> 
> metadata:
>   git_ref: master
>   git_repo: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline
>   git_sha: 88084a3df1672e131ddc1b4e39eeacfd39864acf
>   kernel_version: 5.19.0-rc5
>   kernel-config: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/config
>   build-url: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/-/pipelines/579007773
>   artifact-location: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh
>   vmlinux.xz: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/vmlinux.xz
>   System.map: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/System.map
>   toolchain: gcc-11
> 
> Steps to reproduce:
> -------------------
> ./runltp -p -q -f controllers
> 
> Test log:
> ----------
> cgroup_fj_stress_blkio_4_4_each 1 TPASS: All done!
> cgroup_fj_stress_blkio_4_4_each 2 TINFO: Removing all ltp subgroups...
> cgroup_fj_stress_blkio_2_9_each 1 TINFO: Subsystem blkio is mounted at
> /sys/fs/cgroup/blkio
> cgroup_fj_stress_blkio_2_9_each 1 TINFO: Creating subgroups ...
> [ 2414.973441] Unable to handle kernel paging request at virtual
> address 00620000090336a0
> [ 2414.981581] Mem abort info:
> [ 2414.984480]   ESR = 0x0000000086000004
> [ 2414.988323]   EC = 0x21: IABT (current EL), IL = 32 bits
> [ 2414.993765]   SET = 0, FnV = 0
> [ 2414.996905]   EA = 0, S1PTW = 0
> [ 2415.000124]   FSC = 0x04: level 0 translation fault
> [ 2415.005118] [00620000090336a0] address between user and kernel address ranges
> [ 2415.012393] Internal error: Oops: 86000004 [#1] PREEMPT SMP
> [ 2415.018048] Modules linked in: btrfs blake2b_generic libcrc32c
> raid6_pq zstd_compress xhci_pci snd_soc_hdmi_codec xhci_pci_renesas
> raspberrypi_cpufreq hci_uart btqca brcmfmac brcmutil btbcm vc4
> bluetooth cfg80211 cec drm_display_helper drm_cma_helper rfkill
> clk_raspberrypi reset_raspberrypi drm_kms_helper crct10dif_ce
> raspberrypi_hwmon drm i2c_bcm2835 iproc_rng200 rng_core pwm_bcm2835
> bcm2711_thermal pcie_brcmstb fuse
> [ 2415.055725] CPU: 0 PID: 11626 Comm: cgroup_fj_stres Not taintedlinu#1
> [ 2415.062965] Hardware name: Raspberry Pi 4 Model B (DT)
> [ 2415.068175] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
> [ 2415.075238] pc : 0x620000090336a0
> [ 2415.078600] lr : ktime_get+0x50/0xac
> [ 2415.082228] sp : ffff80000dfdbb90
> [ 2415.085585] x29: ffff80000dfdbb90 x28: 00000000ffffffff x27: ffff00006405e580
> [ 2415.092832] x26: ffff00006405e748 x25: 0000000001200000 x24: ffff00006405e180
> [ 2415.100076] x23: ffff80000dfdbd68 x22: 0000000000000000 x21: 000002321545f201
> [ 2415.107320] x20: 000000000012017e x19: ffff80000ae3b440 x18: ffff000000000000
> [ 2415.114564] x17: 0000000000000000 x16: 0000000000000000 x15: 00000000000000dc
> [ 2415.121809] x14: 0000000001200011 x13: 0000000060000000 x12: 0000ffffa7b6c1e8
> [ 2415.129052] x11: 0000000000000040 x10: ffff80000a96c5c0 x9 : ffff8000080990d4
> [ 2415.136295] x8 : 0000000000000000 x7 : 0000000000a9c84a x6 : 4480001ec1769752
> [ 2415.143538] x5 : 00ffbffeffffffff x4 : 0000000900000000 x3 : 0000000000000000
> [ 2415.150781] x2 : ffff80000a94e000 x1 : ffff8000090336a0 x0 : ffff80000ad102f0
> [ 2415.158025] Call trace:
> [ 2415.160498]  0x620000090336a0
> [ 2415.163505]  copy_process+0xe34/0x1534

Do you have the disassembly (and source:line infor) around
copy_process+0xe34/0x1534? The faulting PC is like a messed up copy of x1
where the upper bits have been corrupted somehow.

Will

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: 5.19.0-rc5 : Raspberry Pi 4 : Unable to handle kernel paging request at virtual address
  2022-07-04 11:26 ` Will Deacon
@ 2022-07-04 13:37   ` Robin Murphy
  2022-07-04 14:19     ` Will Deacon
  0 siblings, 1 reply; 5+ messages in thread
From: Robin Murphy @ 2022-07-04 13:37 UTC (permalink / raw)
  To: Will Deacon, Naresh Kamboju
  Cc: open list, lkft-triage, regressions, Linux ARM, LTP List,
	Linus Torvalds, Catalin Marinas, brauner, Vincent Guittot

On 2022-07-04 12:26, Will Deacon wrote:
> On Mon, Jul 04, 2022 at 01:28:30PM +0530, Naresh Kamboju wrote:
>> While running LTP controllers tests on arm64 Raspberry Pi 4 Model B
>> the following kernel crash noticed.
>>
>> Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
>>
>> metadata:
>>    git_ref: master
>>    git_repo: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline
>>    git_sha: 88084a3df1672e131ddc1b4e39eeacfd39864acf
>>    kernel_version: 5.19.0-rc5
>>    kernel-config: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/config
>>    build-url: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/-/pipelines/579007773
>>    artifact-location: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh
>>    vmlinux.xz: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/vmlinux.xz
>>    System.map: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/System.map
>>    toolchain: gcc-11
>>
>> Steps to reproduce:
>> -------------------
>> ./runltp -p -q -f controllers
>>
>> Test log:
>> ----------
>> cgroup_fj_stress_blkio_4_4_each 1 TPASS: All done!
>> cgroup_fj_stress_blkio_4_4_each 2 TINFO: Removing all ltp subgroups...
>> cgroup_fj_stress_blkio_2_9_each 1 TINFO: Subsystem blkio is mounted at
>> /sys/fs/cgroup/blkio
>> cgroup_fj_stress_blkio_2_9_each 1 TINFO: Creating subgroups ...
>> [ 2414.973441] Unable to handle kernel paging request at virtual
>> address 00620000090336a0
>> [ 2414.981581] Mem abort info:
>> [ 2414.984480]   ESR = 0x0000000086000004
>> [ 2414.988323]   EC = 0x21: IABT (current EL), IL = 32 bits
>> [ 2414.993765]   SET = 0, FnV = 0
>> [ 2414.996905]   EA = 0, S1PTW = 0
>> [ 2415.000124]   FSC = 0x04: level 0 translation fault
>> [ 2415.005118] [00620000090336a0] address between user and kernel address ranges
>> [ 2415.012393] Internal error: Oops: 86000004 [#1] PREEMPT SMP
>> [ 2415.018048] Modules linked in: btrfs blake2b_generic libcrc32c
>> raid6_pq zstd_compress xhci_pci snd_soc_hdmi_codec xhci_pci_renesas
>> raspberrypi_cpufreq hci_uart btqca brcmfmac brcmutil btbcm vc4
>> bluetooth cfg80211 cec drm_display_helper drm_cma_helper rfkill
>> clk_raspberrypi reset_raspberrypi drm_kms_helper crct10dif_ce
>> raspberrypi_hwmon drm i2c_bcm2835 iproc_rng200 rng_core pwm_bcm2835
>> bcm2711_thermal pcie_brcmstb fuse
>> [ 2415.055725] CPU: 0 PID: 11626 Comm: cgroup_fj_stres Not taintedlinu#1
>> [ 2415.062965] Hardware name: Raspberry Pi 4 Model B (DT)
>> [ 2415.068175] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
>> [ 2415.075238] pc : 0x620000090336a0
>> [ 2415.078600] lr : ktime_get+0x50/0xac
>> [ 2415.082228] sp : ffff80000dfdbb90
>> [ 2415.085585] x29: ffff80000dfdbb90 x28: 00000000ffffffff x27: ffff00006405e580
>> [ 2415.092832] x26: ffff00006405e748 x25: 0000000001200000 x24: ffff00006405e180
>> [ 2415.100076] x23: ffff80000dfdbd68 x22: 0000000000000000 x21: 000002321545f201
>> [ 2415.107320] x20: 000000000012017e x19: ffff80000ae3b440 x18: ffff000000000000
>> [ 2415.114564] x17: 0000000000000000 x16: 0000000000000000 x15: 00000000000000dc
>> [ 2415.121809] x14: 0000000001200011 x13: 0000000060000000 x12: 0000ffffa7b6c1e8
>> [ 2415.129052] x11: 0000000000000040 x10: ffff80000a96c5c0 x9 : ffff8000080990d4
>> [ 2415.136295] x8 : 0000000000000000 x7 : 0000000000a9c84a x6 : 4480001ec1769752
>> [ 2415.143538] x5 : 00ffbffeffffffff x4 : 0000000900000000 x3 : 0000000000000000
>> [ 2415.150781] x2 : ffff80000a94e000 x1 : ffff8000090336a0 x0 : ffff80000ad102f0
>> [ 2415.158025] Call trace:
>> [ 2415.160498]  0x620000090336a0
>> [ 2415.163505]  copy_process+0xe34/0x1534
> 
> Do you have the disassembly (and source:line infor) around
> copy_process+0xe34/0x1534? The faulting PC is like a messed up copy of x1
> where the upper bits have been corrupted somehow.

Even better, according to the vmlinux that LR value points right after a 
"blr x1". From the shape of it, looks like it's probably the 
tk_clock_read() call.

Robin.

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: 5.19.0-rc5 : Raspberry Pi 4 : Unable to handle kernel paging request at virtual address
  2022-07-04 13:37   ` Robin Murphy
@ 2022-07-04 14:19     ` Will Deacon
  2022-07-04 17:14       ` Naresh Kamboju
  0 siblings, 1 reply; 5+ messages in thread
From: Will Deacon @ 2022-07-04 14:19 UTC (permalink / raw)
  To: Robin Murphy
  Cc: Naresh Kamboju, open list, lkft-triage, regressions, Linux ARM,
	LTP List, Linus Torvalds, Catalin Marinas, brauner,
	Vincent Guittot

On Mon, Jul 04, 2022 at 02:37:52PM +0100, Robin Murphy wrote:
> On 2022-07-04 12:26, Will Deacon wrote:
> > On Mon, Jul 04, 2022 at 01:28:30PM +0530, Naresh Kamboju wrote:
> > > While running LTP controllers tests on arm64 Raspberry Pi 4 Model B
> > > the following kernel crash noticed.
> > > 
> > > Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
> > > 
> > > metadata:
> > >    git_ref: master
> > >    git_repo: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline
> > >    git_sha: 88084a3df1672e131ddc1b4e39eeacfd39864acf
> > >    kernel_version: 5.19.0-rc5
> > >    kernel-config: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/config
> > >    build-url: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/-/pipelines/579007773
> > >    artifact-location: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh
> > >    vmlinux.xz: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/vmlinux.xz
> > >    System.map: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/System.map
> > >    toolchain: gcc-11
> > > 
> > > Steps to reproduce:
> > > -------------------
> > > ./runltp -p -q -f controllers
> > > 
> > > Test log:
> > > ----------
> > > cgroup_fj_stress_blkio_4_4_each 1 TPASS: All done!
> > > cgroup_fj_stress_blkio_4_4_each 2 TINFO: Removing all ltp subgroups...
> > > cgroup_fj_stress_blkio_2_9_each 1 TINFO: Subsystem blkio is mounted at
> > > /sys/fs/cgroup/blkio
> > > cgroup_fj_stress_blkio_2_9_each 1 TINFO: Creating subgroups ...
> > > [ 2414.973441] Unable to handle kernel paging request at virtual
> > > address 00620000090336a0
> > > [ 2414.981581] Mem abort info:
> > > [ 2414.984480]   ESR = 0x0000000086000004
> > > [ 2414.988323]   EC = 0x21: IABT (current EL), IL = 32 bits
> > > [ 2414.993765]   SET = 0, FnV = 0
> > > [ 2414.996905]   EA = 0, S1PTW = 0
> > > [ 2415.000124]   FSC = 0x04: level 0 translation fault
> > > [ 2415.005118] [00620000090336a0] address between user and kernel address ranges
> > > [ 2415.012393] Internal error: Oops: 86000004 [#1] PREEMPT SMP
> > > [ 2415.018048] Modules linked in: btrfs blake2b_generic libcrc32c
> > > raid6_pq zstd_compress xhci_pci snd_soc_hdmi_codec xhci_pci_renesas
> > > raspberrypi_cpufreq hci_uart btqca brcmfmac brcmutil btbcm vc4
> > > bluetooth cfg80211 cec drm_display_helper drm_cma_helper rfkill
> > > clk_raspberrypi reset_raspberrypi drm_kms_helper crct10dif_ce
> > > raspberrypi_hwmon drm i2c_bcm2835 iproc_rng200 rng_core pwm_bcm2835
> > > bcm2711_thermal pcie_brcmstb fuse
> > > [ 2415.055725] CPU: 0 PID: 11626 Comm: cgroup_fj_stres Not taintedlinu#1
> > > [ 2415.062965] Hardware name: Raspberry Pi 4 Model B (DT)
> > > [ 2415.068175] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
> > > [ 2415.075238] pc : 0x620000090336a0
> > > [ 2415.078600] lr : ktime_get+0x50/0xac
> > > [ 2415.082228] sp : ffff80000dfdbb90
> > > [ 2415.085585] x29: ffff80000dfdbb90 x28: 00000000ffffffff x27: ffff00006405e580
> > > [ 2415.092832] x26: ffff00006405e748 x25: 0000000001200000 x24: ffff00006405e180
> > > [ 2415.100076] x23: ffff80000dfdbd68 x22: 0000000000000000 x21: 000002321545f201
> > > [ 2415.107320] x20: 000000000012017e x19: ffff80000ae3b440 x18: ffff000000000000
> > > [ 2415.114564] x17: 0000000000000000 x16: 0000000000000000 x15: 00000000000000dc
> > > [ 2415.121809] x14: 0000000001200011 x13: 0000000060000000 x12: 0000ffffa7b6c1e8
> > > [ 2415.129052] x11: 0000000000000040 x10: ffff80000a96c5c0 x9 : ffff8000080990d4
> > > [ 2415.136295] x8 : 0000000000000000 x7 : 0000000000a9c84a x6 : 4480001ec1769752
> > > [ 2415.143538] x5 : 00ffbffeffffffff x4 : 0000000900000000 x3 : 0000000000000000
> > > [ 2415.150781] x2 : ffff80000a94e000 x1 : ffff8000090336a0 x0 : ffff80000ad102f0
> > > [ 2415.158025] Call trace:
> > > [ 2415.160498]  0x620000090336a0
> > > [ 2415.163505]  copy_process+0xe34/0x1534
> > 
> > Do you have the disassembly (and source:line infor) around
> > copy_process+0xe34/0x1534? The faulting PC is like a messed up copy of x1
> > where the upper bits have been corrupted somehow.
> 
> Even better, according to the vmlinux that LR value points right after a
> "blr x1". From the shape of it, looks like it's probably the tk_clock_read()
> call.

System.map has:

ffff8000090336a0 t arch_counter_read

so yes, it looks like we want to call that via:

	clock->read(clock);

but the indirect branch goes wrong :/

Naresh -- do you see this repeatably and on more than just one board?

Will

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: 5.19.0-rc5 : Raspberry Pi 4 : Unable to handle kernel paging request at virtual address
  2022-07-04 14:19     ` Will Deacon
@ 2022-07-04 17:14       ` Naresh Kamboju
  0 siblings, 0 replies; 5+ messages in thread
From: Naresh Kamboju @ 2022-07-04 17:14 UTC (permalink / raw)
  To: Will Deacon
  Cc: Robin Murphy, open list, lkft-triage, regressions, Linux ARM,
	LTP List, Linus Torvalds, Catalin Marinas, brauner,
	Vincent Guittot

On Mon, 4 Jul 2022 at 19:49, Will Deacon <will@kernel.org> wrote:
>
> On Mon, Jul 04, 2022 at 02:37:52PM +0100, Robin Murphy wrote:
> > On 2022-07-04 12:26, Will Deacon wrote:
> > > On Mon, Jul 04, 2022 at 01:28:30PM +0530, Naresh Kamboju wrote:
> > > > While running LTP controllers tests on arm64 Raspberry Pi 4 Model B
> > > > the following kernel crash noticed.
> > > >
> > > > Reported-by: Linux Kernel Functional Testing <lkft@linaro.org>
> > > >
> > > > metadata:
> > > >    git_ref: master
> > > >    git_repo: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline
> > > >    git_sha: 88084a3df1672e131ddc1b4e39eeacfd39864acf
> > > >    kernel_version: 5.19.0-rc5
> > > >    kernel-config: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/config
> > > >    build-url: https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/-/pipelines/579007773
> > > >    artifact-location: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh
> > > >    vmlinux.xz: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/vmlinux.xz
> > > >    System.map: https://builds.tuxbuild.com/2BSEyt8Sb19HSj6SnBFiMo6kiQh/System.map
> > > >    toolchain: gcc-11
> > > >
> > > > Steps to reproduce:
> > > > -------------------
> > > > ./runltp -p -q -f controllers
> > > >
> > > > Test log:
> > > > ----------
> > > > cgroup_fj_stress_blkio_4_4_each 1 TPASS: All done!
> > > > cgroup_fj_stress_blkio_4_4_each 2 TINFO: Removing all ltp subgroups...
> > > > cgroup_fj_stress_blkio_2_9_each 1 TINFO: Subsystem blkio is mounted at
> > > > /sys/fs/cgroup/blkio
> > > > cgroup_fj_stress_blkio_2_9_each 1 TINFO: Creating subgroups ...
> > > > [ 2414.973441] Unable to handle kernel paging request at virtual
> > > > address 00620000090336a0
> > > > [ 2414.981581] Mem abort info:
> > > > [ 2414.984480]   ESR = 0x0000000086000004
> > > > [ 2414.988323]   EC = 0x21: IABT (current EL), IL = 32 bits
> > > > [ 2414.993765]   SET = 0, FnV = 0
> > > > [ 2414.996905]   EA = 0, S1PTW = 0
> > > > [ 2415.000124]   FSC = 0x04: level 0 translation fault
> > > > [ 2415.005118] [00620000090336a0] address between user and kernel address ranges
> > > > [ 2415.012393] Internal error: Oops: 86000004 [#1] PREEMPT SMP
> > > > [ 2415.018048] Modules linked in: btrfs blake2b_generic libcrc32c
> > > > raid6_pq zstd_compress xhci_pci snd_soc_hdmi_codec xhci_pci_renesas
> > > > raspberrypi_cpufreq hci_uart btqca brcmfmac brcmutil btbcm vc4
> > > > bluetooth cfg80211 cec drm_display_helper drm_cma_helper rfkill
> > > > clk_raspberrypi reset_raspberrypi drm_kms_helper crct10dif_ce
> > > > raspberrypi_hwmon drm i2c_bcm2835 iproc_rng200 rng_core pwm_bcm2835
> > > > bcm2711_thermal pcie_brcmstb fuse
> > > > [ 2415.055725] CPU: 0 PID: 11626 Comm: cgroup_fj_stres Not taintedlinu#1
> > > > [ 2415.062965] Hardware name: Raspberry Pi 4 Model B (DT)
> > > > [ 2415.068175] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
> > > > [ 2415.075238] pc : 0x620000090336a0
> > > > [ 2415.078600] lr : ktime_get+0x50/0xac
> > > > [ 2415.082228] sp : ffff80000dfdbb90
> > > > [ 2415.085585] x29: ffff80000dfdbb90 x28: 00000000ffffffff x27: ffff00006405e580
> > > > [ 2415.092832] x26: ffff00006405e748 x25: 0000000001200000 x24: ffff00006405e180
> > > > [ 2415.100076] x23: ffff80000dfdbd68 x22: 0000000000000000 x21: 000002321545f201
> > > > [ 2415.107320] x20: 000000000012017e x19: ffff80000ae3b440 x18: ffff000000000000
> > > > [ 2415.114564] x17: 0000000000000000 x16: 0000000000000000 x15: 00000000000000dc
> > > > [ 2415.121809] x14: 0000000001200011 x13: 0000000060000000 x12: 0000ffffa7b6c1e8
> > > > [ 2415.129052] x11: 0000000000000040 x10: ffff80000a96c5c0 x9 : ffff8000080990d4
> > > > [ 2415.136295] x8 : 0000000000000000 x7 : 0000000000a9c84a x6 : 4480001ec1769752
> > > > [ 2415.143538] x5 : 00ffbffeffffffff x4 : 0000000900000000 x3 : 0000000000000000
> > > > [ 2415.150781] x2 : ffff80000a94e000 x1 : ffff8000090336a0 x0 : ffff80000ad102f0
> > > > [ 2415.158025] Call trace:
> > > > [ 2415.160498]  0x620000090336a0
> > > > [ 2415.163505]  copy_process+0xe34/0x1534
> > >
> > > Do you have the disassembly (and source:line infor) around
> > > copy_process+0xe34/0x1534? The faulting PC is like a messed up copy of x1
> > > where the upper bits have been corrupted somehow.
> >
> > Even better, according to the vmlinux that LR value points right after a
> > "blr x1". From the shape of it, looks like it's probably the tk_clock_read()
> > call.
>
> System.map has:
>
> ffff8000090336a0 t arch_counter_read
>
> so yes, it looks like we want to call that via:
>
>         clock->read(clock);
>
> but the indirect branch goes wrong :/
>
> Naresh -- do you see this repeatably and on more than just one board?

I have been trying to reproduce this problem on a pool of Raspberry Pi 4 boards
but have not been successful yet.

- Naresh

>
> Will

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2022-07-04 17:15 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-07-04  7:58 5.19.0-rc5 : Raspberry Pi 4 : Unable to handle kernel paging request at virtual address Naresh Kamboju
2022-07-04 11:26 ` Will Deacon
2022-07-04 13:37   ` Robin Murphy
2022-07-04 14:19     ` Will Deacon
2022-07-04 17:14       ` Naresh Kamboju

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).