linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* RPM raw-wakeref not held in intel_pxp_fini_hw
@ 2021-11-22 16:47 Jason A. Donenfeld
  2021-11-22 16:53 ` Daniele Ceraolo Spurio
  0 siblings, 1 reply; 4+ messages in thread
From: Jason A. Donenfeld @ 2021-11-22 16:47 UTC (permalink / raw)
  To: Vitaly Lubart, Anshuman Gupta, Daniele Ceraolo Spurio
  Cc: LKML, intel-gfx, dri-devel

Hey Intel PXPers,

I hit this splat on 5.16-rc1 during system suspend:

Nov 22 13:54:09 thinkpad systemd-logind[934]: Lid closed.
Nov 22 13:54:09 thinkpad systemd[1]: Reached target Sleep.
Nov 22 13:54:09 thinkpad systemd[1]: Starting System Suspend...
Nov 22 13:54:09 thinkpad systemd-sleep[519259]: Entering sleep state
'suspend'...
Nov 22 13:54:09 thinkpad kernel: PM: suspend entry (s2idle)
Nov 22 15:22:05 thinkpad kernel: Filesystems sync: 0.124 seconds
Nov 22 15:22:05 thinkpad kernel: Freezing user space processes ...
(elapsed 0.001 seconds) done.
Nov 22 15:22:05 thinkpad kernel: OOM killer disabled.
Nov 22 15:22:05 thinkpad kernel: Freezing remaining freezable tasks
... (elapsed 0.001 seconds) done.
Nov 22 15:22:05 thinkpad kernel: printk: Suspending console(s) (use
no_console_suspend to debug)
Nov 22 15:22:05 thinkpad kernel: ------------[ cut here ]------------
Nov 22 15:22:05 thinkpad kernel: RPM wakelock ref not held during HW access
Nov 22 15:22:05 thinkpad kernel: WARNING: CPU: 10 PID: 519259 at
drivers/gpu/drm/i915/intel_runtime_pm.h:112
fwtable_write32+0x1cb/0x200 [i915]
Nov 22 15:22:05 thinkpad kernel: Modules linked in: cdc_mbim cdc_wdm
cdc_ncm cdc_ether usbnet mii snd_seq_dummy snd_hrtimer snd_seq
snd_seq_device rfcomm cmac algif_skcipher bnep uvcvideo
videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 btusb
videobuf2_common btintel blue>
Nov 22 15:22:05 thinkpad kernel:  i2c_designware_platform
i2c_designware_core mei_pxp mei_hdcp ac97_bus kvm_intel snd_hda_intel
snd_intel_dspcfg intel_rapl_msr think_lmi snd_intel_sdw_acpi i915
firmware_attributes_class wmi_bmof snd_hda_codec kvm i2c_algo_bit
snd_hwdep int>
Nov 22 15:22:05 thinkpad kernel: CPU: 10 PID: 519259 Comm:
systemd-sleep Tainted: G S   U            5.16.0-rc1+ #192
Nov 22 15:22:05 thinkpad kernel: Hardware name: LENOVO
20Y5CTO1WW/20Y5CTO1WW, BIOS N40ET28W (1.10 ) 09/09/2021
Nov 22 15:22:05 thinkpad kernel: RIP: 0010:fwtable_write32+0x1cb/0x200 [i915]
Nov 22 15:22:05 thinkpad kernel: Code: 21 cb df 0f 0b e9 85 fe ff ff
80 3d 36 68 1f 00 00 0f 85 82 fe ff ff 48 c7 c7 70 cf c4 a1 c6 05 22
68 1f 00 01 e8 1c 21 cb df <0f> 0b e9 68 fe ff ff 48 8b bb 40 01 00 00
e8 a2 cf ce df b9 01 00
Nov 22 15:22:05 thinkpad kernel: RSP: 0018:ffff88821d283c80 EFLAGS: 00010282
Nov 22 15:22:05 thinkpad kernel: RAX: 000000000000002a RBX:
ffff88813df707d0 RCX: 0000000000000027
Nov 22 15:22:05 thinkpad kernel: RDX: ffff88901f69b448 RSI:
0000000000000001 RDI: ffff88901f69b440
Nov 22 15:22:05 thinkpad kernel: RBP: 00000000000320f0 R08:
0000000000000d17 R09: ffff88821d283c20
Nov 22 15:22:05 thinkpad kernel: R10: 3fffffffffffffff R11:
fffffffffff93a78 R12: 0000000040000000
Nov 22 15:22:05 thinkpad kernel: R13: 0000000000000000 R14:
ffff888101311150 R15: ffffffff81491b20
Nov 22 15:22:05 thinkpad kernel: FS:  00007efcfaa87800(0000)
GS:ffff88901f680000(0000) knlGS:0000000000000000
Nov 22 15:22:05 thinkpad kernel: CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Nov 22 15:22:05 thinkpad kernel: CR2: 00007efcfb41e6f0 CR3:
00000005ed937004 CR4: 0000000000770ee0
Nov 22 15:22:05 thinkpad kernel: PKRU: 55555554
Nov 22 15:22:05 thinkpad kernel: Call Trace:
Nov 22 15:22:05 thinkpad kernel:  <TASK>
Nov 22 15:22:05 thinkpad kernel:  intel_pxp_fini_hw+0x23/0x30 [i915]
Nov 22 15:22:05 thinkpad kernel:  intel_pxp_suspend+0x2f/0x40 [i915]
Nov 22 15:22:05 thinkpad kernel:  i915_gem_backup_suspend+0x6e/0x150 [i915]
Nov 22 15:22:05 thinkpad kernel:  ? pci_target_state+0xc/0xc0
Nov 22 15:22:05 thinkpad kernel:  pci_pm_prepare+0x28/0x60
Nov 22 15:22:05 thinkpad kernel:  dpm_prepare+0xbd/0x370
Nov 22 15:22:05 thinkpad kernel:  dpm_suspend_start+0x16/0x80
Nov 22 15:22:05 thinkpad kernel:  suspend_devices_and_enter+0x104/0x6d0
Nov 22 15:22:05 thinkpad kernel:  pm_suspend.cold+0x2f6/0x33d
Nov 22 15:22:05 thinkpad kernel:  state_store+0x6b/0xe0
Nov 22 15:22:05 thinkpad kernel:  kernfs_fop_write_iter+0x107/0x190
Nov 22 15:22:05 thinkpad kernel:  new_sync_write+0x100/0x170
Nov 22 15:22:05 thinkpad kernel:  vfs_write+0x1c5/0x260
Nov 22 15:22:05 thinkpad kernel:  ksys_write+0x4a/0xc0
Nov 22 15:22:05 thinkpad kernel:  do_syscall_64+0x35/0x80
Nov 22 15:22:05 thinkpad kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xae
Nov 22 15:22:05 thinkpad kernel: RIP: 0033:0x7efcfb27ccb3
Nov 22 15:22:05 thinkpad kernel: Code: 8b 15 81 11 0f 00 f7 d8 64 89
02 48 c7 c0 ff ff ff ff eb b7 0f 1f 00 64 8b 04 25 18 00 00 00 85 c0
75 14 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 55 c3 0f 1f 40 00 48
83 ec 28 48 89 54 24 18
Nov 22 15:22:05 thinkpad kernel: RSP: 002b:00007fff279a5308 EFLAGS:
00000246 ORIG_RAX: 0000000000000001
Nov 22 15:22:05 thinkpad kernel: RAX: ffffffffffffffda RBX:
0000000000000004 RCX: 00007efcfb27ccb3
Nov 22 15:22:05 thinkpad kernel: RDX: 0000000000000004 RSI:
00007fff279a5400 RDI: 0000000000000004
Nov 22 15:22:05 thinkpad kernel: RBP: 00005571997e72d0 R08:
0000000000000007 R09: 00005571997eb4a0
Nov 22 15:22:05 thinkpad kernel: R10: 11500bc5676901a3 R11:
0000000000000246 R12: 0000000000000004
Nov 22 15:22:05 thinkpad kernel: R13: 00007fff279a5400 R14:
0000000000000004 R15: 00007efcfb36aa00
Nov 22 15:22:05 thinkpad kernel:  </TASK>
Nov 22 15:22:05 thinkpad kernel: ---[ end trace efcf3c6627ff7163 ]---
Nov 22 15:22:05 thinkpad kernel: ------------[ cut here ]------------
Nov 22 15:22:05 thinkpad kernel: RPM raw-wakeref not held
Nov 22 15:22:05 thinkpad kernel: WARNING: CPU: 0 PID: 518230 at
drivers/gpu/drm/i915/intel_runtime_pm.h:104
fwtable_write32+0x1a4/0x200 [i915]
Nov 22 15:22:05 thinkpad kernel: Modules linked in: cdc_mbim cdc_wdm
cdc_ncm cdc_ether usbnet mii snd_seq_dummy snd_hrtimer snd_seq
snd_seq_device rfcomm cmac algif_skcipher bnep uvcvideo
videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 btusb
videobuf2_common btintel blue>
Nov 22 15:22:05 thinkpad kernel:  i2c_designware_platform
i2c_designware_core mei_pxp mei_hdcp ac97_bus kvm_intel snd_hda_intel
snd_intel_dspcfg intel_rapl_msr think_lmi snd_intel_sdw_acpi i915
firmware_attributes_class wmi_bmof snd_hda_codec kvm i2c_algo_bit
snd_hwdep int>
Nov 22 15:22:05 thinkpad kernel: CPU: 0 PID: 518230 Comm:
kworker/u32:4 Tainted: G S   U  W         5.16.0-rc1+ #192
Nov 22 15:22:05 thinkpad kernel: Hardware name: LENOVO
20Y5CTO1WW/20Y5CTO1WW, BIOS N40ET28W (1.10 ) 09/09/2021
Nov 22 15:22:05 thinkpad kernel: Workqueue: events_unbound async_run_entry_fn
Nov 22 15:22:05 thinkpad kernel: RIP: 0010:fwtable_write32+0x1a4/0x200 [i915]
Nov 22 15:22:05 thinkpad kernel: Code: 00 00 c6 00 00 e9 02 ff ff ff
80 3d 5e 68 1f 00 00 0f 85 9f fe ff ff 48 c7 c7 a0 51 c7 a1 c6 05 4a
68 1f 00 01 e8 43 21 cb df <0f> 0b e9 85 fe ff ff 80 3d 36 68 1f 00 00
0f 85 82 fe ff ff 48 c7
Nov 22 15:22:05 thinkpad kernel: RSP: 0018:ffff8882e341bc60 EFLAGS: 00010286
Nov 22 15:22:05 thinkpad kernel: RAX: 0000000000000018 RBX:
ffff88813df707d0 RCX: 0000000000000027
Nov 22 15:22:05 thinkpad kernel: RDX: ffff88901f41b448 RSI:
0000000000000001 RDI: ffff88901f41b440
Nov 22 15:22:05 thinkpad kernel: RBP: 00000000000320f0 R08:
0000000000000da7 R09: ffff8882e341bc00
Nov 22 15:22:05 thinkpad kernel: R10: 3fffffffffffffff R11:
fffffffffff94e08 R12: 0000000040000000
Nov 22 15:22:05 thinkpad kernel: R13: 0000000000000000 R14:
ffff888102394150 R15: ffff888100068005
Nov 22 15:22:05 thinkpad kernel: FS:  0000000000000000(0000)
GS:ffff88901f400000(0000) knlGS:0000000000000000
Nov 22 15:22:05 thinkpad kernel: CS:  0010 DS: 0000 ES: 0000 CR0:
0000000080050033
Nov 22 15:22:05 thinkpad kernel: CR2: 00007f3018027098 CR3:
000000000200a001 CR4: 0000000000770ef0
Nov 22 15:22:05 thinkpad kernel: PKRU: 55555554
Nov 22 15:22:05 thinkpad kernel: Call Trace:
Nov 22 15:22:05 thinkpad kernel:  <TASK>
Nov 22 15:22:05 thinkpad kernel:  intel_pxp_fini_hw+0x23/0x30 [i915]
Nov 22 15:22:05 thinkpad kernel:  i915_pxp_tee_component_unbind+0x19/0x40 [i915]
Nov 22 15:22:05 thinkpad kernel:  component_unbind+0x26/0x40
Nov 22 15:22:05 thinkpad kernel:  component_unbind_all+0x85/0x90
Nov 22 15:22:05 thinkpad kernel:  component_master_del+0x73/0x90
Nov 22 15:22:05 thinkpad kernel:  mei_pxp_remove+0x23/0x50 [mei_pxp]
Nov 22 15:22:05 thinkpad kernel:  mei_cl_device_remove+0x1a/0x80 [mei]
Nov 22 15:22:05 thinkpad kernel:  __device_release_driver+0x172/0x230
Nov 22 15:22:05 thinkpad kernel:  device_release_driver+0x1f/0x30
Nov 22 15:22:05 thinkpad kernel:  mei_cl_bus_remove_devices+0x56/0x70 [mei]
Nov 22 15:22:05 thinkpad kernel:  mei_stop+0x32/0xc0 [mei]
Nov 22 15:22:05 thinkpad kernel:  mei_me_pci_suspend+0x1f/0x50 [mei_me]
Nov 22 15:22:05 thinkpad kernel:  ? pci_pm_suspend_noirq+0x270/0x270
Nov 22 15:22:05 thinkpad kernel:  pci_pm_suspend+0x6c/0x200
Nov 22 15:22:05 thinkpad kernel:  ? pci_pm_suspend_noirq+0x270/0x270
Nov 22 15:22:05 thinkpad kernel:  dpm_run_callback+0x36/0x100
Nov 22 15:22:05 thinkpad kernel:  __device_suspend+0x122/0x4c0
Nov 22 15:22:05 thinkpad kernel:  async_suspend+0x16/0x90
Nov 22 15:22:05 thinkpad kernel:  async_run_entry_fn+0x15/0x90
Nov 22 15:22:05 thinkpad kernel:  process_one_work+0x1ce/0x370
Nov 22 15:22:05 thinkpad kernel:  worker_thread+0x48/0x3c0
Nov 22 15:22:05 thinkpad kernel:  ? rescuer_thread+0x350/0x350
Nov 22 15:22:05 thinkpad kernel:  kthread+0x13c/0x160
Nov 22 15:22:05 thinkpad kernel:  ? set_kthread_struct+0x40/0x40
Nov 22 15:22:05 thinkpad kernel:  ret_from_fork+0x1f/0x30
Nov 22 15:22:05 thinkpad kernel:  </TASK>
Nov 22 15:22:05 thinkpad kernel: ---[ end trace efcf3c6627ff7164 ]---

As this is new code in 5.16, I thought I should report it to you. I
haven't started debugging it yet, and I'll load up rc2 this evening as
well.

Jason

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: RPM raw-wakeref not held in intel_pxp_fini_hw
  2021-11-22 16:47 RPM raw-wakeref not held in intel_pxp_fini_hw Jason A. Donenfeld
@ 2021-11-22 16:53 ` Daniele Ceraolo Spurio
  2021-11-22 16:54   ` Jason A. Donenfeld
  2021-11-22 17:34   ` Lubart, Vitaly
  0 siblings, 2 replies; 4+ messages in thread
From: Daniele Ceraolo Spurio @ 2021-11-22 16:53 UTC (permalink / raw)
  To: Jason A. Donenfeld, Vitaly Lubart, Anshuman Gupta, Tejas Upadhyay
  Cc: LKML, intel-gfx, dri-devel

Hi,

The fix for this is in flight:

https://patchwork.freedesktop.org/series/96658/

It just needs a last round of testing before we merge it.

Thanks,
Daniele

On 11/22/2021 8:47 AM, Jason A. Donenfeld wrote:
> Hey Intel PXPers,
>
> I hit this splat on 5.16-rc1 during system suspend:
>
> Nov 22 13:54:09 thinkpad systemd-logind[934]: Lid closed.
> Nov 22 13:54:09 thinkpad systemd[1]: Reached target Sleep.
> Nov 22 13:54:09 thinkpad systemd[1]: Starting System Suspend...
> Nov 22 13:54:09 thinkpad systemd-sleep[519259]: Entering sleep state
> 'suspend'...
> Nov 22 13:54:09 thinkpad kernel: PM: suspend entry (s2idle)
> Nov 22 15:22:05 thinkpad kernel: Filesystems sync: 0.124 seconds
> Nov 22 15:22:05 thinkpad kernel: Freezing user space processes ...
> (elapsed 0.001 seconds) done.
> Nov 22 15:22:05 thinkpad kernel: OOM killer disabled.
> Nov 22 15:22:05 thinkpad kernel: Freezing remaining freezable tasks
> ... (elapsed 0.001 seconds) done.
> Nov 22 15:22:05 thinkpad kernel: printk: Suspending console(s) (use
> no_console_suspend to debug)
> Nov 22 15:22:05 thinkpad kernel: ------------[ cut here ]------------
> Nov 22 15:22:05 thinkpad kernel: RPM wakelock ref not held during HW access
> Nov 22 15:22:05 thinkpad kernel: WARNING: CPU: 10 PID: 519259 at
> drivers/gpu/drm/i915/intel_runtime_pm.h:112
> fwtable_write32+0x1cb/0x200 [i915]
> Nov 22 15:22:05 thinkpad kernel: Modules linked in: cdc_mbim cdc_wdm
> cdc_ncm cdc_ether usbnet mii snd_seq_dummy snd_hrtimer snd_seq
> snd_seq_device rfcomm cmac algif_skcipher bnep uvcvideo
> videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 btusb
> videobuf2_common btintel blue>
> Nov 22 15:22:05 thinkpad kernel:  i2c_designware_platform
> i2c_designware_core mei_pxp mei_hdcp ac97_bus kvm_intel snd_hda_intel
> snd_intel_dspcfg intel_rapl_msr think_lmi snd_intel_sdw_acpi i915
> firmware_attributes_class wmi_bmof snd_hda_codec kvm i2c_algo_bit
> snd_hwdep int>
> Nov 22 15:22:05 thinkpad kernel: CPU: 10 PID: 519259 Comm:
> systemd-sleep Tainted: G S   U            5.16.0-rc1+ #192
> Nov 22 15:22:05 thinkpad kernel: Hardware name: LENOVO
> 20Y5CTO1WW/20Y5CTO1WW, BIOS N40ET28W (1.10 ) 09/09/2021
> Nov 22 15:22:05 thinkpad kernel: RIP: 0010:fwtable_write32+0x1cb/0x200 [i915]
> Nov 22 15:22:05 thinkpad kernel: Code: 21 cb df 0f 0b e9 85 fe ff ff
> 80 3d 36 68 1f 00 00 0f 85 82 fe ff ff 48 c7 c7 70 cf c4 a1 c6 05 22
> 68 1f 00 01 e8 1c 21 cb df <0f> 0b e9 68 fe ff ff 48 8b bb 40 01 00 00
> e8 a2 cf ce df b9 01 00
> Nov 22 15:22:05 thinkpad kernel: RSP: 0018:ffff88821d283c80 EFLAGS: 00010282
> Nov 22 15:22:05 thinkpad kernel: RAX: 000000000000002a RBX:
> ffff88813df707d0 RCX: 0000000000000027
> Nov 22 15:22:05 thinkpad kernel: RDX: ffff88901f69b448 RSI:
> 0000000000000001 RDI: ffff88901f69b440
> Nov 22 15:22:05 thinkpad kernel: RBP: 00000000000320f0 R08:
> 0000000000000d17 R09: ffff88821d283c20
> Nov 22 15:22:05 thinkpad kernel: R10: 3fffffffffffffff R11:
> fffffffffff93a78 R12: 0000000040000000
> Nov 22 15:22:05 thinkpad kernel: R13: 0000000000000000 R14:
> ffff888101311150 R15: ffffffff81491b20
> Nov 22 15:22:05 thinkpad kernel: FS:  00007efcfaa87800(0000)
> GS:ffff88901f680000(0000) knlGS:0000000000000000
> Nov 22 15:22:05 thinkpad kernel: CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Nov 22 15:22:05 thinkpad kernel: CR2: 00007efcfb41e6f0 CR3:
> 00000005ed937004 CR4: 0000000000770ee0
> Nov 22 15:22:05 thinkpad kernel: PKRU: 55555554
> Nov 22 15:22:05 thinkpad kernel: Call Trace:
> Nov 22 15:22:05 thinkpad kernel:  <TASK>
> Nov 22 15:22:05 thinkpad kernel:  intel_pxp_fini_hw+0x23/0x30 [i915]
> Nov 22 15:22:05 thinkpad kernel:  intel_pxp_suspend+0x2f/0x40 [i915]
> Nov 22 15:22:05 thinkpad kernel:  i915_gem_backup_suspend+0x6e/0x150 [i915]
> Nov 22 15:22:05 thinkpad kernel:  ? pci_target_state+0xc/0xc0
> Nov 22 15:22:05 thinkpad kernel:  pci_pm_prepare+0x28/0x60
> Nov 22 15:22:05 thinkpad kernel:  dpm_prepare+0xbd/0x370
> Nov 22 15:22:05 thinkpad kernel:  dpm_suspend_start+0x16/0x80
> Nov 22 15:22:05 thinkpad kernel:  suspend_devices_and_enter+0x104/0x6d0
> Nov 22 15:22:05 thinkpad kernel:  pm_suspend.cold+0x2f6/0x33d
> Nov 22 15:22:05 thinkpad kernel:  state_store+0x6b/0xe0
> Nov 22 15:22:05 thinkpad kernel:  kernfs_fop_write_iter+0x107/0x190
> Nov 22 15:22:05 thinkpad kernel:  new_sync_write+0x100/0x170
> Nov 22 15:22:05 thinkpad kernel:  vfs_write+0x1c5/0x260
> Nov 22 15:22:05 thinkpad kernel:  ksys_write+0x4a/0xc0
> Nov 22 15:22:05 thinkpad kernel:  do_syscall_64+0x35/0x80
> Nov 22 15:22:05 thinkpad kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xae
> Nov 22 15:22:05 thinkpad kernel: RIP: 0033:0x7efcfb27ccb3
> Nov 22 15:22:05 thinkpad kernel: Code: 8b 15 81 11 0f 00 f7 d8 64 89
> 02 48 c7 c0 ff ff ff ff eb b7 0f 1f 00 64 8b 04 25 18 00 00 00 85 c0
> 75 14 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 55 c3 0f 1f 40 00 48
> 83 ec 28 48 89 54 24 18
> Nov 22 15:22:05 thinkpad kernel: RSP: 002b:00007fff279a5308 EFLAGS:
> 00000246 ORIG_RAX: 0000000000000001
> Nov 22 15:22:05 thinkpad kernel: RAX: ffffffffffffffda RBX:
> 0000000000000004 RCX: 00007efcfb27ccb3
> Nov 22 15:22:05 thinkpad kernel: RDX: 0000000000000004 RSI:
> 00007fff279a5400 RDI: 0000000000000004
> Nov 22 15:22:05 thinkpad kernel: RBP: 00005571997e72d0 R08:
> 0000000000000007 R09: 00005571997eb4a0
> Nov 22 15:22:05 thinkpad kernel: R10: 11500bc5676901a3 R11:
> 0000000000000246 R12: 0000000000000004
> Nov 22 15:22:05 thinkpad kernel: R13: 00007fff279a5400 R14:
> 0000000000000004 R15: 00007efcfb36aa00
> Nov 22 15:22:05 thinkpad kernel:  </TASK>
> Nov 22 15:22:05 thinkpad kernel: ---[ end trace efcf3c6627ff7163 ]---
> Nov 22 15:22:05 thinkpad kernel: ------------[ cut here ]------------
> Nov 22 15:22:05 thinkpad kernel: RPM raw-wakeref not held
> Nov 22 15:22:05 thinkpad kernel: WARNING: CPU: 0 PID: 518230 at
> drivers/gpu/drm/i915/intel_runtime_pm.h:104
> fwtable_write32+0x1a4/0x200 [i915]
> Nov 22 15:22:05 thinkpad kernel: Modules linked in: cdc_mbim cdc_wdm
> cdc_ncm cdc_ether usbnet mii snd_seq_dummy snd_hrtimer snd_seq
> snd_seq_device rfcomm cmac algif_skcipher bnep uvcvideo
> videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 btusb
> videobuf2_common btintel blue>
> Nov 22 15:22:05 thinkpad kernel:  i2c_designware_platform
> i2c_designware_core mei_pxp mei_hdcp ac97_bus kvm_intel snd_hda_intel
> snd_intel_dspcfg intel_rapl_msr think_lmi snd_intel_sdw_acpi i915
> firmware_attributes_class wmi_bmof snd_hda_codec kvm i2c_algo_bit
> snd_hwdep int>
> Nov 22 15:22:05 thinkpad kernel: CPU: 0 PID: 518230 Comm:
> kworker/u32:4 Tainted: G S   U  W         5.16.0-rc1+ #192
> Nov 22 15:22:05 thinkpad kernel: Hardware name: LENOVO
> 20Y5CTO1WW/20Y5CTO1WW, BIOS N40ET28W (1.10 ) 09/09/2021
> Nov 22 15:22:05 thinkpad kernel: Workqueue: events_unbound async_run_entry_fn
> Nov 22 15:22:05 thinkpad kernel: RIP: 0010:fwtable_write32+0x1a4/0x200 [i915]
> Nov 22 15:22:05 thinkpad kernel: Code: 00 00 c6 00 00 e9 02 ff ff ff
> 80 3d 5e 68 1f 00 00 0f 85 9f fe ff ff 48 c7 c7 a0 51 c7 a1 c6 05 4a
> 68 1f 00 01 e8 43 21 cb df <0f> 0b e9 85 fe ff ff 80 3d 36 68 1f 00 00
> 0f 85 82 fe ff ff 48 c7
> Nov 22 15:22:05 thinkpad kernel: RSP: 0018:ffff8882e341bc60 EFLAGS: 00010286
> Nov 22 15:22:05 thinkpad kernel: RAX: 0000000000000018 RBX:
> ffff88813df707d0 RCX: 0000000000000027
> Nov 22 15:22:05 thinkpad kernel: RDX: ffff88901f41b448 RSI:
> 0000000000000001 RDI: ffff88901f41b440
> Nov 22 15:22:05 thinkpad kernel: RBP: 00000000000320f0 R08:
> 0000000000000da7 R09: ffff8882e341bc00
> Nov 22 15:22:05 thinkpad kernel: R10: 3fffffffffffffff R11:
> fffffffffff94e08 R12: 0000000040000000
> Nov 22 15:22:05 thinkpad kernel: R13: 0000000000000000 R14:
> ffff888102394150 R15: ffff888100068005
> Nov 22 15:22:05 thinkpad kernel: FS:  0000000000000000(0000)
> GS:ffff88901f400000(0000) knlGS:0000000000000000
> Nov 22 15:22:05 thinkpad kernel: CS:  0010 DS: 0000 ES: 0000 CR0:
> 0000000080050033
> Nov 22 15:22:05 thinkpad kernel: CR2: 00007f3018027098 CR3:
> 000000000200a001 CR4: 0000000000770ef0
> Nov 22 15:22:05 thinkpad kernel: PKRU: 55555554
> Nov 22 15:22:05 thinkpad kernel: Call Trace:
> Nov 22 15:22:05 thinkpad kernel:  <TASK>
> Nov 22 15:22:05 thinkpad kernel:  intel_pxp_fini_hw+0x23/0x30 [i915]
> Nov 22 15:22:05 thinkpad kernel:  i915_pxp_tee_component_unbind+0x19/0x40 [i915]
> Nov 22 15:22:05 thinkpad kernel:  component_unbind+0x26/0x40
> Nov 22 15:22:05 thinkpad kernel:  component_unbind_all+0x85/0x90
> Nov 22 15:22:05 thinkpad kernel:  component_master_del+0x73/0x90
> Nov 22 15:22:05 thinkpad kernel:  mei_pxp_remove+0x23/0x50 [mei_pxp]
> Nov 22 15:22:05 thinkpad kernel:  mei_cl_device_remove+0x1a/0x80 [mei]
> Nov 22 15:22:05 thinkpad kernel:  __device_release_driver+0x172/0x230
> Nov 22 15:22:05 thinkpad kernel:  device_release_driver+0x1f/0x30
> Nov 22 15:22:05 thinkpad kernel:  mei_cl_bus_remove_devices+0x56/0x70 [mei]
> Nov 22 15:22:05 thinkpad kernel:  mei_stop+0x32/0xc0 [mei]
> Nov 22 15:22:05 thinkpad kernel:  mei_me_pci_suspend+0x1f/0x50 [mei_me]
> Nov 22 15:22:05 thinkpad kernel:  ? pci_pm_suspend_noirq+0x270/0x270
> Nov 22 15:22:05 thinkpad kernel:  pci_pm_suspend+0x6c/0x200
> Nov 22 15:22:05 thinkpad kernel:  ? pci_pm_suspend_noirq+0x270/0x270
> Nov 22 15:22:05 thinkpad kernel:  dpm_run_callback+0x36/0x100
> Nov 22 15:22:05 thinkpad kernel:  __device_suspend+0x122/0x4c0
> Nov 22 15:22:05 thinkpad kernel:  async_suspend+0x16/0x90
> Nov 22 15:22:05 thinkpad kernel:  async_run_entry_fn+0x15/0x90
> Nov 22 15:22:05 thinkpad kernel:  process_one_work+0x1ce/0x370
> Nov 22 15:22:05 thinkpad kernel:  worker_thread+0x48/0x3c0
> Nov 22 15:22:05 thinkpad kernel:  ? rescuer_thread+0x350/0x350
> Nov 22 15:22:05 thinkpad kernel:  kthread+0x13c/0x160
> Nov 22 15:22:05 thinkpad kernel:  ? set_kthread_struct+0x40/0x40
> Nov 22 15:22:05 thinkpad kernel:  ret_from_fork+0x1f/0x30
> Nov 22 15:22:05 thinkpad kernel:  </TASK>
> Nov 22 15:22:05 thinkpad kernel: ---[ end trace efcf3c6627ff7164 ]---
>
> As this is new code in 5.16, I thought I should report it to you. I
> haven't started debugging it yet, and I'll load up rc2 this evening as
> well.
>
> Jason


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: RPM raw-wakeref not held in intel_pxp_fini_hw
  2021-11-22 16:53 ` Daniele Ceraolo Spurio
@ 2021-11-22 16:54   ` Jason A. Donenfeld
  2021-11-22 17:34   ` Lubart, Vitaly
  1 sibling, 0 replies; 4+ messages in thread
From: Jason A. Donenfeld @ 2021-11-22 16:54 UTC (permalink / raw)
  To: Daniele Ceraolo Spurio
  Cc: Vitaly Lubart, Anshuman Gupta, Tejas Upadhyay, LKML, intel-gfx,
	dri-devel

Hi Daniele,

I'll give it a whirl on my laptop. Thanks.

Jason

^ permalink raw reply	[flat|nested] 4+ messages in thread

* RE: RPM raw-wakeref not held in intel_pxp_fini_hw
  2021-11-22 16:53 ` Daniele Ceraolo Spurio
  2021-11-22 16:54   ` Jason A. Donenfeld
@ 2021-11-22 17:34   ` Lubart, Vitaly
  1 sibling, 0 replies; 4+ messages in thread
From: Lubart, Vitaly @ 2021-11-22 17:34 UTC (permalink / raw)
  To: Ceraolo Spurio, Daniele, Jason A. Donenfeld, Gupta, Anshuman,
	Surendrakumar Upadhyay, TejaskumarX
  Cc: LKML, intel-gfx, dri-devel, Usyskin, Alexander, Winkler, Tomas,
	Lubart, Vitaly

CC Tomas and Sasha

> -----Original Message-----
> From: Ceraolo Spurio, Daniele <daniele.ceraolospurio@intel.com>
> Sent: Monday, November 22, 2021 18:54
> To: Jason A. Donenfeld <Jason@zx2c4.com>; Lubart, Vitaly
> <vitaly.lubart@intel.com>; Gupta, Anshuman <anshuman.gupta@intel.com>;
> Surendrakumar Upadhyay, TejaskumarX
> <tejaskumarx.surendrakumar.upadhyay@intel.com>
> Cc: LKML <linux-kernel@vger.kernel.org>; intel-gfx@lists.freedesktop.org; dri-
> devel <dri-devel@lists.freedesktop.org>
> Subject: Re: RPM raw-wakeref not held in intel_pxp_fini_hw
> 
> Hi,
> 
> The fix for this is in flight:
> 
> https://patchwork.freedesktop.org/series/96658/
> 
> It just needs a last round of testing before we merge it.
> 
> Thanks,
> Daniele
> 
> On 11/22/2021 8:47 AM, Jason A. Donenfeld wrote:
> > Hey Intel PXPers,
> >
> > I hit this splat on 5.16-rc1 during system suspend:
> >
> > Nov 22 13:54:09 thinkpad systemd-logind[934]: Lid closed.
> > Nov 22 13:54:09 thinkpad systemd[1]: Reached target Sleep.
> > Nov 22 13:54:09 thinkpad systemd[1]: Starting System Suspend...
> > Nov 22 13:54:09 thinkpad systemd-sleep[519259]: Entering sleep state
> > 'suspend'...
> > Nov 22 13:54:09 thinkpad kernel: PM: suspend entry (s2idle) Nov 22
> > 15:22:05 thinkpad kernel: Filesystems sync: 0.124 seconds Nov 22
> > 15:22:05 thinkpad kernel: Freezing user space processes ...
> > (elapsed 0.001 seconds) done.
> > Nov 22 15:22:05 thinkpad kernel: OOM killer disabled.
> > Nov 22 15:22:05 thinkpad kernel: Freezing remaining freezable tasks
> > ... (elapsed 0.001 seconds) done.
> > Nov 22 15:22:05 thinkpad kernel: printk: Suspending console(s) (use
> > no_console_suspend to debug) Nov 22 15:22:05 thinkpad kernel:
> > ------------[ cut here ]------------ Nov 22 15:22:05 thinkpad kernel:
> > RPM wakelock ref not held during HW access Nov 22 15:22:05 thinkpad
> > kernel: WARNING: CPU: 10 PID: 519259 at
> > drivers/gpu/drm/i915/intel_runtime_pm.h:112
> > fwtable_write32+0x1cb/0x200 [i915]
> > Nov 22 15:22:05 thinkpad kernel: Modules linked in: cdc_mbim cdc_wdm
> > cdc_ncm cdc_ether usbnet mii snd_seq_dummy snd_hrtimer snd_seq
> > snd_seq_device rfcomm cmac algif_skcipher bnep uvcvideo
> > videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 btusb
> > videobuf2_common btintel blue> Nov 22 15:22:05 thinkpad kernel:
> > i2c_designware_platform i2c_designware_core mei_pxp mei_hdcp ac97_bus
> > kvm_intel snd_hda_intel snd_intel_dspcfg intel_rapl_msr think_lmi
> > snd_intel_sdw_acpi i915 firmware_attributes_class wmi_bmof
> > snd_hda_codec kvm i2c_algo_bit snd_hwdep int> Nov 22 15:22:05 thinkpad
> > kernel: CPU: 10 PID: 519259 Comm:
> > systemd-sleep Tainted: G S   U            5.16.0-rc1+ #192
> > Nov 22 15:22:05 thinkpad kernel: Hardware name: LENOVO
> > 20Y5CTO1WW/20Y5CTO1WW, BIOS N40ET28W (1.10 ) 09/09/2021 Nov 22
> > 15:22:05 thinkpad kernel: RIP: 0010:fwtable_write32+0x1cb/0x200 [i915]
> > Nov 22 15:22:05 thinkpad kernel: Code: 21 cb df 0f 0b e9 85 fe ff ff
> > 80 3d 36 68 1f 00 00 0f 85 82 fe ff ff 48 c7 c7 70 cf c4 a1 c6 05 22
> > 68 1f 00 01 e8 1c 21 cb df <0f> 0b e9 68 fe ff ff 48 8b bb 40 01 00 00
> > e8 a2 cf ce df b9 01 00
> > Nov 22 15:22:05 thinkpad kernel: RSP: 0018:ffff88821d283c80 EFLAGS:
> > 00010282 Nov 22 15:22:05 thinkpad kernel: RAX: 000000000000002a RBX:
> > ffff88813df707d0 RCX: 0000000000000027 Nov 22 15:22:05 thinkpad
> > kernel: RDX: ffff88901f69b448 RSI:
> > 0000000000000001 RDI: ffff88901f69b440 Nov 22 15:22:05 thinkpad
> > kernel: RBP: 00000000000320f0 R08:
> > 0000000000000d17 R09: ffff88821d283c20 Nov 22 15:22:05 thinkpad
> > kernel: R10: 3fffffffffffffff R11:
> > fffffffffff93a78 R12: 0000000040000000 Nov 22 15:22:05 thinkpad
> > kernel: R13: 0000000000000000 R14:
> > ffff888101311150 R15: ffffffff81491b20 Nov 22 15:22:05 thinkpad
> > kernel: FS:  00007efcfaa87800(0000)
> > GS:ffff88901f680000(0000) knlGS:0000000000000000 Nov 22 15:22:05
> > thinkpad kernel: CS:  0010 DS: 0000 ES: 0000 CR0:
> > 0000000080050033
> > Nov 22 15:22:05 thinkpad kernel: CR2: 00007efcfb41e6f0 CR3:
> > 00000005ed937004 CR4: 0000000000770ee0 Nov 22 15:22:05 thinkpad
> > kernel: PKRU: 55555554 Nov 22 15:22:05 thinkpad kernel: Call Trace:
> > Nov 22 15:22:05 thinkpad kernel:  <TASK> Nov 22 15:22:05 thinkpad
> > kernel:  intel_pxp_fini_hw+0x23/0x30 [i915] Nov 22 15:22:05 thinkpad
> > kernel:  intel_pxp_suspend+0x2f/0x40 [i915] Nov 22 15:22:05 thinkpad
> > kernel:  i915_gem_backup_suspend+0x6e/0x150 [i915] Nov 22 15:22:05
> > thinkpad kernel:  ? pci_target_state+0xc/0xc0 Nov 22 15:22:05 thinkpad
> > kernel:  pci_pm_prepare+0x28/0x60 Nov 22 15:22:05 thinkpad kernel:
> > dpm_prepare+0xbd/0x370 Nov 22 15:22:05 thinkpad kernel:
> > dpm_suspend_start+0x16/0x80 Nov 22 15:22:05 thinkpad kernel:
> > suspend_devices_and_enter+0x104/0x6d0
> > Nov 22 15:22:05 thinkpad kernel:  pm_suspend.cold+0x2f6/0x33d Nov 22
> > 15:22:05 thinkpad kernel:  state_store+0x6b/0xe0 Nov 22 15:22:05
> > thinkpad kernel:  kernfs_fop_write_iter+0x107/0x190 Nov 22 15:22:05
> > thinkpad kernel:  new_sync_write+0x100/0x170 Nov 22 15:22:05 thinkpad
> > kernel:  vfs_write+0x1c5/0x260 Nov 22 15:22:05 thinkpad kernel:
> > ksys_write+0x4a/0xc0 Nov 22 15:22:05 thinkpad kernel:
> > do_syscall_64+0x35/0x80 Nov 22 15:22:05 thinkpad kernel:
> > entry_SYSCALL_64_after_hwframe+0x44/0xae
> > Nov 22 15:22:05 thinkpad kernel: RIP: 0033:0x7efcfb27ccb3 Nov 22
> > 15:22:05 thinkpad kernel: Code: 8b 15 81 11 0f 00 f7 d8 64 89
> > 02 48 c7 c0 ff ff ff ff eb b7 0f 1f 00 64 8b 04 25 18 00 00 00 85 c0
> > 75 14 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 55 c3 0f 1f 40 00 48
> > 83 ec 28 48 89 54 24 18
> > Nov 22 15:22:05 thinkpad kernel: RSP: 002b:00007fff279a5308 EFLAGS:
> > 00000246 ORIG_RAX: 0000000000000001
> > Nov 22 15:22:05 thinkpad kernel: RAX: ffffffffffffffda RBX:
> > 0000000000000004 RCX: 00007efcfb27ccb3 Nov 22 15:22:05 thinkpad
> > kernel: RDX: 0000000000000004 RSI:
> > 00007fff279a5400 RDI: 0000000000000004 Nov 22 15:22:05 thinkpad
> > kernel: RBP: 00005571997e72d0 R08:
> > 0000000000000007 R09: 00005571997eb4a0 Nov 22 15:22:05 thinkpad
> > kernel: R10: 11500bc5676901a3 R11:
> > 0000000000000246 R12: 0000000000000004 Nov 22 15:22:05 thinkpad
> > kernel: R13: 00007fff279a5400 R14:
> > 0000000000000004 R15: 00007efcfb36aa00 Nov 22 15:22:05 thinkpad
> > kernel:  </TASK> Nov 22 15:22:05 thinkpad kernel: ---[ end trace
> > efcf3c6627ff7163 ]--- Nov 22 15:22:05 thinkpad kernel: ------------[
> > cut here ]------------ Nov 22 15:22:05 thinkpad kernel: RPM
> > raw-wakeref not held Nov 22 15:22:05 thinkpad kernel: WARNING: CPU: 0
> > PID: 518230 at
> > drivers/gpu/drm/i915/intel_runtime_pm.h:104
> > fwtable_write32+0x1a4/0x200 [i915]
> > Nov 22 15:22:05 thinkpad kernel: Modules linked in: cdc_mbim cdc_wdm
> > cdc_ncm cdc_ether usbnet mii snd_seq_dummy snd_hrtimer snd_seq
> > snd_seq_device rfcomm cmac algif_skcipher bnep uvcvideo
> > videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 btusb
> > videobuf2_common btintel blue> Nov 22 15:22:05 thinkpad kernel:
> > i2c_designware_platform i2c_designware_core mei_pxp mei_hdcp ac97_bus
> > kvm_intel snd_hda_intel snd_intel_dspcfg intel_rapl_msr think_lmi
> > snd_intel_sdw_acpi i915 firmware_attributes_class wmi_bmof
> > snd_hda_codec kvm i2c_algo_bit snd_hwdep int> Nov 22 15:22:05 thinkpad
> > kernel: CPU: 0 PID: 518230 Comm:
> > kworker/u32:4 Tainted: G S   U  W         5.16.0-rc1+ #192
> > Nov 22 15:22:05 thinkpad kernel: Hardware name: LENOVO
> > 20Y5CTO1WW/20Y5CTO1WW, BIOS N40ET28W (1.10 ) 09/09/2021 Nov 22
> > 15:22:05 thinkpad kernel: Workqueue: events_unbound async_run_entry_fn
> > Nov 22 15:22:05 thinkpad kernel: RIP: 0010:fwtable_write32+0x1a4/0x200
> > [i915] Nov 22 15:22:05 thinkpad kernel: Code: 00 00 c6 00 00 e9 02 ff
> > ff ff
> > 80 3d 5e 68 1f 00 00 0f 85 9f fe ff ff 48 c7 c7 a0 51 c7 a1 c6 05 4a
> > 68 1f 00 01 e8 43 21 cb df <0f> 0b e9 85 fe ff ff 80 3d 36 68 1f 00 00
> > 0f 85 82 fe ff ff 48 c7 Nov 22 15:22:05 thinkpad kernel: RSP:
> > 0018:ffff8882e341bc60 EFLAGS: 00010286 Nov 22 15:22:05 thinkpad
> > kernel: RAX: 0000000000000018 RBX:
> > ffff88813df707d0 RCX: 0000000000000027 Nov 22 15:22:05 thinkpad
> > kernel: RDX: ffff88901f41b448 RSI:
> > 0000000000000001 RDI: ffff88901f41b440 Nov 22 15:22:05 thinkpad
> > kernel: RBP: 00000000000320f0 R08:
> > 0000000000000da7 R09: ffff8882e341bc00 Nov 22 15:22:05 thinkpad
> > kernel: R10: 3fffffffffffffff R11:
> > fffffffffff94e08 R12: 0000000040000000 Nov 22 15:22:05 thinkpad
> > kernel: R13: 0000000000000000 R14:
> > ffff888102394150 R15: ffff888100068005 Nov 22 15:22:05 thinkpad
> > kernel: FS:  0000000000000000(0000)
> > GS:ffff88901f400000(0000) knlGS:0000000000000000 Nov 22 15:22:05
> > thinkpad kernel: CS:  0010 DS: 0000 ES: 0000 CR0:
> > 0000000080050033
> > Nov 22 15:22:05 thinkpad kernel: CR2: 00007f3018027098 CR3:
> > 000000000200a001 CR4: 0000000000770ef0 Nov 22 15:22:05 thinkpad
> > kernel: PKRU: 55555554 Nov 22 15:22:05 thinkpad kernel: Call Trace:
> > Nov 22 15:22:05 thinkpad kernel:  <TASK> Nov 22 15:22:05 thinkpad
> > kernel:  intel_pxp_fini_hw+0x23/0x30 [i915] Nov 22 15:22:05 thinkpad
> > kernel:  i915_pxp_tee_component_unbind+0x19/0x40 [i915] Nov 22
> > 15:22:05 thinkpad kernel:  component_unbind+0x26/0x40 Nov 22 15:22:05
> > thinkpad kernel:  component_unbind_all+0x85/0x90 Nov 22 15:22:05
> > thinkpad kernel:  component_master_del+0x73/0x90 Nov 22 15:22:05
> > thinkpad kernel:  mei_pxp_remove+0x23/0x50 [mei_pxp] Nov 22 15:22:05
> > thinkpad kernel:  mei_cl_device_remove+0x1a/0x80 [mei] Nov 22 15:22:05
> > thinkpad kernel:  __device_release_driver+0x172/0x230
> > Nov 22 15:22:05 thinkpad kernel:  device_release_driver+0x1f/0x30 Nov
> > 22 15:22:05 thinkpad kernel:  mei_cl_bus_remove_devices+0x56/0x70
> > [mei] Nov 22 15:22:05 thinkpad kernel:  mei_stop+0x32/0xc0 [mei] Nov
> > 22 15:22:05 thinkpad kernel:  mei_me_pci_suspend+0x1f/0x50 [mei_me]
> > Nov 22 15:22:05 thinkpad kernel:  ? pci_pm_suspend_noirq+0x270/0x270
> > Nov 22 15:22:05 thinkpad kernel:  pci_pm_suspend+0x6c/0x200 Nov 22
> > 15:22:05 thinkpad kernel:  ? pci_pm_suspend_noirq+0x270/0x270 Nov 22
> > 15:22:05 thinkpad kernel:  dpm_run_callback+0x36/0x100 Nov 22 15:22:05
> > thinkpad kernel:  __device_suspend+0x122/0x4c0 Nov 22 15:22:05
> > thinkpad kernel:  async_suspend+0x16/0x90 Nov 22 15:22:05 thinkpad
> > kernel:  async_run_entry_fn+0x15/0x90 Nov 22 15:22:05 thinkpad kernel:
> > process_one_work+0x1ce/0x370 Nov 22 15:22:05 thinkpad kernel:
> > worker_thread+0x48/0x3c0 Nov 22 15:22:05 thinkpad kernel:  ?
> > rescuer_thread+0x350/0x350 Nov 22 15:22:05 thinkpad kernel:
> > kthread+0x13c/0x160 Nov 22 15:22:05 thinkpad kernel:  ?
> > set_kthread_struct+0x40/0x40 Nov 22 15:22:05 thinkpad kernel:
> > ret_from_fork+0x1f/0x30 Nov 22 15:22:05 thinkpad kernel:  </TASK> Nov
> > 22 15:22:05 thinkpad kernel: ---[ end trace efcf3c6627ff7164 ]---
> >
> > As this is new code in 5.16, I thought I should report it to you. I
> > haven't started debugging it yet, and I'll load up rc2 this evening as
> > well.
> >
> > Jason

---------------------------------------------------------------------
Intel Israel (74) Limited

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2021-11-22 17:34 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-11-22 16:47 RPM raw-wakeref not held in intel_pxp_fini_hw Jason A. Donenfeld
2021-11-22 16:53 ` Daniele Ceraolo Spurio
2021-11-22 16:54   ` Jason A. Donenfeld
2021-11-22 17:34   ` Lubart, Vitaly

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).