linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Yu Zhao <yuzhao@google.com>
To: Liam Howlett <liam.howlett@oracle.com>
Cc: "maple-tree@lists.infradead.org" <maple-tree@lists.infradead.org>,
	 "linux-mm@kvack.org" <linux-mm@kvack.org>,
	 "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>
Subject: Re: [PATCH v14 00/70] Introducing the Maple Tree
Date: Sat, 17 Sep 2022 02:24:44 -0600	[thread overview]
Message-ID: <CAOUHufZabH85CeUN-MEMgL8gJGzJEWUrkiM58JkTbBhh-jew0Q@mail.gmail.com> (raw)
In-Reply-To: <CAOUHufbeh=v6gFuxyOA5xOtahL1AGUQYgQZzB7edDaS3hoc-LQ@mail.gmail.com>

On Thu, Sep 15, 2022 at 12:03 PM Yu Zhao <yuzhao@google.com> wrote:
>
> On Sun, Sep 11, 2022 at 6:20 PM Andrew Morton <akpm@linux-foundation.org> wrote:
> >
> > On Tue, 6 Sep 2022 19:48:38 +0000 Liam Howlett <liam.howlett@oracle.com> wrote:
> >
> > > Patch series "Introducing the Maple Tree".
> >
> > I haven't seen any issues attributed to maple tree in 2+ weeks.  Unless
> > there be weighty objections, I plan to move this series into mm-stable
> > soon after mglru is added.  Perhaps a week from now.
>
> Tested-by: Yu Zhao <yuzhao@google.com>
>
> stress/fuzzing: arm64, mips64, ppc64 and x86_64
> performance: arm64 (nodejs), mips64 (memcached), ppc64 (specjbb2015)
> and x86_64 (mmtests)
> boot: riscv64
> not covered: m68knommu and s390 (no hardware available)

This should be easy to fix:

  ======================================================
  WARNING: possible circular locking dependency detected
  6.0.0-dbg-DEV #1 Tainted: G S         O
  ------------------------------------------------------
  stress-ng/21813 is trying to acquire lock:
  ffffffff9b043388 (fs_reclaim){+.+.}-{0:0}, at:
kmem_cache_alloc_bulk+0x3f/0x460

  but task is already holding lock:
  ffffa2a509f8d080 (&anon_vma->rwsem){++++}-{3:3}, at: do_brk_flags+0x19d/0x410

  which lock already depends on the new lock.


  the existing dependency chain (in reverse order) is:

  -> #1 (&anon_vma->rwsem){++++}-{3:3}:
         down_read+0x3c/0x50
         folio_lock_anon_vma_read+0x147/0x180
         rmap_walk_anon+0x55/0x230
         try_to_unmap+0x65/0xa0
         shrink_folio_list+0x8c5/0x1c70
         evict_folios+0x6af/0xb50
         lru_gen_shrink_lruvec+0x1b6/0x430
         shrink_lruvec+0xa7/0x470
         shrink_node_memcgs+0x116/0x1f0
         shrink_node+0xb4/0x2e0
         balance_pgdat+0x3b9/0x710
         kswapd+0x2b1/0x320
         kthread+0xe5/0x100
         ret_from_fork+0x1f/0x30

  -> #0 (fs_reclaim){+.+.}-{0:0}:
         __lock_acquire+0x16f4/0x30c0
         lock_acquire+0xb2/0x190
         fs_reclaim_acquire+0x57/0xd0
         kmem_cache_alloc_bulk+0x3f/0x460
         mas_alloc_nodes+0x148/0x1e0
         mas_nomem+0x45/0x90
         mas_store_gfp+0xf3/0x160
         do_brk_flags+0x1f2/0x410
         __do_sys_brk+0x214/0x3b0
         __x64_sys_brk+0x12/0x20
         do_syscall_64+0x3d/0x80
         entry_SYSCALL_64_after_hwframe+0x63/0xcd

  other info that might help us debug this:

   Possible unsafe locking scenario:

         CPU0                    CPU1
         ----                    ----
    lock(&anon_vma->rwsem);
                                 lock(fs_reclaim);
                                 lock(&anon_vma->rwsem);
    lock(fs_reclaim);

   *** DEADLOCK ***

  2 locks held by stress-ng/21813:
   #0: ffffa285087f2a58 (&mm->mmap_lock#2){++++}-{3:3}, at:
__do_sys_brk+0x98/0x3b0
   #1: ffffa2a509f8d080 (&anon_vma->rwsem){++++}-{3:3}, at:
do_brk_flags+0x19d/0x410


      reply	other threads:[~2022-09-17  8:25 UTC|newest]

Thread overview: 89+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-09-06 19:48 [PATCH v14 00/70] Introducing the Maple Tree Liam Howlett
2022-09-06 19:48 ` [PATCH v14 02/70] radix tree test suite: add pr_err define Liam Howlett
2022-09-06 19:48 ` [PATCH v14 01/70] Maple Tree: add new data structure Liam Howlett
2022-09-12  8:42   ` Bagas Sanjaya
2022-09-14 10:16     ` Liam Howlett
2022-09-06 19:48 ` [PATCH v14 04/70] radix tree test suite: add allocation counts and size to kmem_cache Liam Howlett
2022-09-06 19:48 ` [PATCH v14 03/70] radix tree test suite: add kmem_cache_set_non_kernel() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 05/70] radix tree test suite: add support for slab bulk APIs Liam Howlett
2022-09-06 19:48 ` [PATCH v14 06/70] radix tree test suite: add lockdep_is_held to header Liam Howlett
2022-09-06 19:48 ` [PATCH v14 07/70] lib/test_maple_tree: add testing for maple tree Liam Howlett
2022-10-11 12:16   ` Geert Uytterhoeven
2022-10-11 12:56     ` Matthew Wilcox
2022-10-11 12:59       ` Geert Uytterhoeven
2022-10-11 16:13         ` Liam Howlett
2022-09-06 19:48 ` [PATCH v14 08/70] mm: start tracking VMAs with " Liam Howlett
2022-09-06 19:48 ` [PATCH v14 11/70] mm/mmap: use the maple tree in find_vma() instead of the rbtree Liam Howlett
2022-09-06 19:48 ` [PATCH v14 10/70] mmap: use the VMA iterator in count_vma_pages_range() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 09/70] mm: add VMA iterator Liam Howlett
2022-09-06 19:48 ` [PATCH v14 14/70] kernel/fork: use maple tree for dup_mmap() during forking Liam Howlett
2022-09-06 19:48 ` [PATCH v14 12/70] mm/mmap: use the maple tree for find_vma_prev() instead of the rbtree Liam Howlett
2022-09-06 19:48 ` [PATCH v14 13/70] mm/mmap: use maple tree for unmapped_area{_topdown} Liam Howlett
2022-09-06 19:48 ` [PATCH v14 17/70] mm: remove rb tree Liam Howlett
2022-09-06 19:48 ` [PATCH v14 16/70] proc: remove VMA rbtree use from nommu Liam Howlett
2022-09-06 19:48 ` [PATCH v14 15/70] damon: convert __damon_va_three_regions to use the VMA iterator Liam Howlett
2022-09-06 19:48 ` [PATCH v14 20/70] mm: optimize find_exact_vma() to use vma_lookup() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 18/70] mmap: change zeroing of maple tree in __vma_adjust() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 19/70] xen: use vma_lookup() in privcmd_ioctl_mmap() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 22/70] mm/mmap: change do_brk_flags() to expand existing VMA and add do_brk_munmap() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 21/70] mm/khugepaged: optimize collapse_pte_mapped_thp() by using vma_lookup() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 23/70] mm: use maple tree operations for find_vma_intersection() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 24/70] mm/mmap: use advanced maple tree API for mmap_region() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 25/70] mm: remove vmacache Liam Howlett
2022-09-06 19:48 ` [PATCH v14 26/70] mm: convert vma_lookup() to use mtree_load() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 28/70] mm/mmap: reorganize munmap to use maple states Liam Howlett
2022-09-06 19:48 ` [PATCH v14 27/70] mm/mmap: move mmap_region() below do_munmap() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 29/70] mm/mmap: change do_brk_munmap() to use do_mas_align_munmap() Liam Howlett
2022-09-06 19:48 ` [PATCH v14 30/70] arm64: remove mmap linked list from vdso Liam Howlett
2022-09-06 19:48 ` [PATCH v14 31/70] arm64: Change elfcore for_each_mte_vma() to use VMA iterator Liam Howlett
2022-09-06 19:48 ` [PATCH v14 32/70] parisc: remove mmap linked list from cache handling Liam Howlett
2022-09-06 19:48 ` [PATCH v14 33/70] powerpc: remove mmap linked list walks Liam Howlett
2022-09-06 19:48 ` [PATCH v14 34/70] s390: remove vma " Liam Howlett
2022-09-06 19:48 ` [PATCH v14 35/70] x86: " Liam Howlett
2022-09-06 19:48 ` [PATCH v14 38/70] optee: remove vma linked list walk Liam Howlett
2022-09-06 19:48 ` [PATCH v14 36/70] xtensa: remove vma linked list walks Liam Howlett
2022-09-06 19:48 ` [PATCH v14 37/70] cxl: remove vma linked list walk Liam Howlett
2022-09-06 19:48 ` [PATCH v14 39/70] um: " Liam Howlett
2022-09-06 19:48 ` [PATCH v14 41/70] exec: use VMA iterator instead of linked list Liam Howlett
2022-09-06 19:48 ` [PATCH v14 40/70] coredump: remove vma linked list walk Liam Howlett
2022-09-06 19:48 ` [PATCH v14 42/70] fs/proc/base: use the vma iterators in place of linked list Liam Howlett
2022-09-06 19:48 ` [PATCH v14 43/70] fs/proc/task_mmu: stop using linked list and highest_vm_end Liam Howlett
2022-09-06 19:48 ` [PATCH v14 44/70] userfaultfd: use maple tree iterator to iterate VMAs Liam Howlett
2022-09-06 19:48 ` [PATCH v14 45/70] ipc/shm: use VMA iterator instead of linked list Liam Howlett
2022-09-06 19:48 ` [PATCH v14 46/70] acct: " Liam Howlett
2022-09-06 19:48 ` [PATCH v14 47/70] perf: use VMA iterator Liam Howlett
2022-09-06 19:48 ` [PATCH v14 50/70] bpf: remove VMA linked list Liam Howlett
2022-09-06 19:48 ` [PATCH v14 49/70] fork: use VMA iterator Liam Howlett
2022-09-06 19:48 ` [PATCH v14 48/70] sched: use maple tree iterator to walk VMAs Liam Howlett
2022-09-06 19:49 ` [PATCH v14 52/70] mm/khugepaged: stop using vma linked list Liam Howlett
2022-09-06 19:49 ` [PATCH v14 51/70] mm/gup: use maple tree navigation instead of " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 55/70] mm/memcontrol: stop using mm->highest_vm_end Liam Howlett
2022-09-06 19:49 ` [PATCH v14 54/70] mm/madvise: use vma_find() instead of vma linked list Liam Howlett
2022-09-06 19:49 ` [PATCH v14 53/70] mm/ksm: use vma iterators " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 57/70] mm/mlock: use vma iterator and maple state " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 56/70] mm/mempolicy: use vma iterator & " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 58/70] mm/mprotect: use maple tree navigation instead of VMA " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 59/70] mm/mremap: use vma_find_intersection() instead of vma " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 60/70] mm/msync: use vma_find() " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 61/70] mm/oom_kill: use vma iterators " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 64/70] i915: use the VMA iterator Liam Howlett
2022-09-06 19:49 ` [PATCH v14 63/70] mm/swapfile: use vma iterator instead of vma linked list Liam Howlett
2022-09-06 19:49 ` [PATCH v14 62/70] mm/pagewalk: use vma_find() " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 65/70] nommu: remove uses of VMA " Liam Howlett
2022-09-06 19:49 ` [PATCH v14 67/70] mm/vmscan: Use vma iterator instead of vm_next Liam Howlett
2022-09-12  6:55   ` Yu Zhao
2022-09-12  7:13     ` Yu Zhao
2022-09-12  7:14     ` Liam Howlett
2022-09-12 19:45     ` Andrew Morton
2022-09-12 20:01       ` Yu Zhao
2022-09-12 21:03         ` Andrew Morton
2022-09-13  3:39           ` Yu Zhao
2022-09-06 19:49 ` [PATCH v14 66/70] riscv: use vma iterator for vdso Liam Howlett
2022-09-06 19:49 ` [PATCH v14 70/70] mm/mmap.c: pass in mapping to __vma_link_file() Liam Howlett
2022-09-06 19:49 ` [PATCH v14 68/70] mm: remove the vma linked list Liam Howlett
2022-09-06 19:49 ` [PATCH v14 69/70] mm/mmap: drop range_has_overlap() function Liam Howlett
2022-09-06 23:51 ` [PATCH v14 00/70] Introducing the Maple Tree Andrew Morton
2022-09-07  0:24   ` Liam Howlett
2022-09-12  0:20 ` Andrew Morton
2022-09-15 18:03   ` Yu Zhao
2022-09-17  8:24     ` Yu Zhao [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CAOUHufZabH85CeUN-MEMgL8gJGzJEWUrkiM58JkTbBhh-jew0Q@mail.gmail.com \
    --to=yuzhao@google.com \
    --cc=akpm@linux-foundation.org \
    --cc=liam.howlett@oracle.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=maple-tree@lists.infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).